Rather than force all users to write their own code to process text into terms
for indexing, Xapian provides a
xapian.TermGenerator class. This parses
chunks of text, producing appropriate terms, and adds them to a document.
xapian.TermGenerator can be configured to perform stemming (and
stopwording) when generating terms. It can optionally store information about
the positions of words within the text, and can apply field-specific prefixes
to the generated terms to allow searches to be restricted to specific
fields. It can also add additional information to the database for use
when performing spelling correction.
If you’re using the
xapian.TermGenerator to process text in this way,
you will probably want to use the QueryParser
(described later) when performing searches.