Can you programmatically detect pluralizations of English words, and derive the singular form?

后端 未结 6 1849
灰色年华
灰色年华 2020-12-15 13:33

Given some (English) word that we shall assume is a plural, is it possible to derive the singular form? I\'d like to avoid lookup/dictionary tables if possi

6条回答
  •  北荒
    北荒 (楼主)
    2020-12-15 14:16

    It really depends on what you mean by 'programmatically'. Part of English works on easy to understand rules, and part doesn't. It has to do mainly with frequency. For a brief overview, you can read Pinker's "Words and Rules", but do yourself a favor and don't take the whole generative theory of linguistics entirely to heart. There's a lot more empiricism there than that school of thought really lends to the pursuit.

    A lot of English can be statistically lemmatized. By the way, stemming or lemmatization is the term you're looking for. One of the most effective lemmatizers which work off of statistical rules bootstrapped with frequency-based exceptions is the Morpha Lemmatizer. You can give this a shot if you have a project that requires this type of simplification of strings which represent specific terms in English.

    There are even more naive approaches that accomplish much with respect to normalizing related terms. Take a look at the Porter Stemmer, which is effective enough to cluster together most terms in English.

提交回复
热议问题