Member-only story
Refreshing Private Data Sources with LlamaIndex Document Management
Mastering an essential and practical feature to manage your private data sources
Published in
15 min readJun 28, 2023
We’ve explored a few features of LlamaIndex in our articles in the last few weeks. Even though we have a few POC apps up and running, we are missing one essential feature — document management. In this article, we will dive into the detailed implementation of document management using LlamaIndex.
Before discussing what document management is, let’s take a look at our private data sources to understand why we need document management.
The Ever Changing Nature of Our Private Data Sources
After the initial excitement of getting our POC chatbot to query our private data sources, we start to explore and expand our use cases. Questions such as the following start to pop up:
- How to get our chatbot to answer questions from newly added documents?
- How to handle existing documents with revised content?
- How do we ensure our chatbot doesn’t provide outdated answers from documents already deleted from our private data source?
