language agnostic - How to look up a word's variations in a dictionary? -


part of i'm trying implement requires me list of words in dictionary (a map keys words , values definitions). this:

  • ...
  • fisherman | person fishes
  • apple | red juicy fruit
  • computer | oversized calculator
  • ...

say have word "fisherman". far good: i'll use functions offered whatever language i'm using retrieve definition dictionary.

the problem, however, arises when need search "fishermen", or "apples", or "computers". lookup these words should yield same value singular counterparts.

would lehevenstein distance work? online dictionaries use? tried stemming, looks me yield off results (e.g. 'fish' in place of 'fisherman'), , i'm worried lehevenstein distance same.

i know there must solution of sort, because time ago stumbled across online api latin lookup did this. , online dictionaries can it.

it important such solution workable in languages other english. it's worth, i'm interested in french, spanish , german, should work language.

otherwise thought automatically generating possible variations word might have , build cumulative dictionary. seems impractical both memory standpoint , because of titanic amount of effort require encode significant portion of language grammar.


Comments

Popular posts from this blog

Is there a better way to structure post methods in Class Based Views -

performance - Why is XCHG reg, reg a 3 micro-op instruction on modern Intel architectures? -

jquery - Responsive Navbar with Sub Navbar -