Cosine
- class py_stringmatching.similarity_measure.cosine.Cosine[source]
Computes a variant of cosine measure known as Ochiai coefficient.
This is not the cosine measure that computes the cosine of the angle between two given vectors. Rather, it computes a variant of cosine measure known as Ochiai coefficient (see the Wikipedia page “Cosine Similarity”). Specifically, for two sets X and Y, this measure computes:
\(cosine(X, Y) = \frac{|X \cap Y|}{\sqrt{|X| \cdot |Y|}}\)
Note
In the case where one of X and Y is an empty set and the other is a non-empty set, we define their cosine score to be 0.
In the case where both X and Y are empty sets, we define their cosine score to be 1.
- get_raw_score(set1, set2)[source]
Computes the raw cosine score between two sets.
- Parameters:
set1 (set or list) – Input sets (or lists). Input lists are converted to sets.
set2 (set or list) – Input sets (or lists). Input lists are converted to sets.
- Returns:
Cosine similarity (float)
- Raises:
TypeError – If the inputs are not sets (or lists) or if one of the inputs is None.
Examples
>>> cos = Cosine() >>> cos.get_raw_score(['data', 'science'], ['data']) 0.7071067811865475 >>> cos.get_raw_score(['data', 'data', 'science'], ['data', 'management']) 0.4999999999999999 >>> cos.get_raw_score([], ['data']) 0.0
References
String similarity joins: An Experimental Evaluation (a paper appearing in the VLDB 2014 Conference).
Project Flamingo at http://flamingo.ics.uci.edu.
- get_sim_score(set1, set2)[source]
Computes the normalized cosine similarity between two sets.
- Parameters:
set1 (set or list) – Input sets (or lists). Input lists are converted to sets.
set2 (set or list) – Input sets (or lists). Input lists are converted to sets.
- Returns:
Normalized cosine similarity (float)
- Raises:
TypeError – If the inputs are not sets (or lists) or if one of the inputs is None.
Examples
>>> cos = Cosine() >>> cos.get_sim_score(['data', 'science'], ['data']) 0.7071067811865475 >>> cos.get_sim_score(['data', 'data', 'science'], ['data', 'management']) 0.4999999999999999 >>> cos.get_sim_score([], ['data']) 0.0