The main aim of /api/index is to accept tokens from Concierge and add them to the index. So let's look at what we mean by "adding them to the index".
Document indexing can be defined as the following set of consecutive tasks:
- We rely on the payload to provide us with all the meta information needed to store the token.
- We follow down the inverted index tree, create any node in the path not yet created, and finally add the token details.