Term Generator¶
Rather than force all users to write their own code to process text into terms
for indexing, Xapian provides a xapian.TermGenerator
class. This parses
chunks of text, producing appropriate terms, and adds them to a document.
The xapian.TermGenerator
can be configured to perform stemming (and
stopwording) when generating terms. It can optionally store information about
the positions of words within the text, and can apply field-specific prefixes
to the generated terms to allow searches to be restricted to specific
fields. It can also add additional information to the database for use
when performing spelling correction.
If you’re using the xapian.TermGenerator
to process text in this way,
you will probably want to use the QueryParser
(described later) when performing searches.