com.wcohen.ss
Class TokenFelligiSunter

java.lang.Object
  extended by com.wcohen.ss.AbstractStringDistance
      extended by com.wcohen.ss.AbstractTokenizedStringDistance
          extended by com.wcohen.ss.AbstractStatisticalTokenDistance
              extended by com.wcohen.ss.TokenFelligiSunter
All Implemented Interfaces:
StringDistance, StringDistanceLearner

public class TokenFelligiSunter
extends AbstractStatisticalTokenDistance

Highly simplified model of Felligi-Sunter's method 1, applied to tokens.


Field Summary
 
Fields inherited from class com.wcohen.ss.AbstractStatisticalTokenDistance
collectionSize, documentFrequency, totalTokenCount
 
Constructor Summary
TokenFelligiSunter()
           
TokenFelligiSunter(Tokenizer tokenizer, double mismatchFactor)
           
 
Method Summary
 java.lang.String explainScore(StringWrapper s, StringWrapper t)
          Explain how the distance was computed.
static void main(java.lang.String[] argv)
           
 StringWrapper prepare(java.lang.String s)
          Preprocess a string by finding tokens and giving them appropriate weights
 double score(StringWrapper s, StringWrapper t)
          This method needs to be implemented by subclasses.
 void setMismatchFactor(double d)
           
 void setMismatchFactor(java.lang.Double d)
           
 java.lang.String toString()
           
 
Methods inherited from class com.wcohen.ss.AbstractStatisticalTokenDistance
checkTrainingHasHappened, getDocumentFrequency, train
 
Methods inherited from class com.wcohen.ss.AbstractTokenizedStringDistance
asBagOfTokens, prepare, setStringWrapperPool
 
Methods inherited from class com.wcohen.ss.AbstractStringDistance
addExample, doMain, explainScore, getDistance, hasNextQuery, nextQuery, prepare, score, setDistanceInstancePool
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Constructor Detail

TokenFelligiSunter

public TokenFelligiSunter(Tokenizer tokenizer,
                          double mismatchFactor)

TokenFelligiSunter

public TokenFelligiSunter()
Method Detail

setMismatchFactor

public void setMismatchFactor(double d)

setMismatchFactor

public void setMismatchFactor(java.lang.Double d)

score

public double score(StringWrapper s,
                    StringWrapper t)
Description copied from class: AbstractStringDistance
This method needs to be implemented by subclasses.

Specified by:
score in interface StringDistance
Specified by:
score in class AbstractStringDistance

prepare

public StringWrapper prepare(java.lang.String s)
Preprocess a string by finding tokens and giving them appropriate weights

Specified by:
prepare in interface StringDistance
Overrides:
prepare in class AbstractStringDistance

explainScore

public java.lang.String explainScore(StringWrapper s,
                                     StringWrapper t)
Explain how the distance was computed. In the output, the tokens in S and T are listed, and the common tokens are marked with an asterisk.

Specified by:
explainScore in interface StringDistance
Specified by:
explainScore in class AbstractStringDistance

toString

public java.lang.String toString()
Overrides:
toString in class java.lang.Object

main

public static void main(java.lang.String[] argv)