Replace Chatbot Dataset Search with Semantic Indexer API
This feature updates the chatbot's Search Datasets functionality to use the new semantic-indexer-api, which supports semantic search and chunk-based context retrieval.
- Add new Semantic Search API client
- Replace Search Datasets implementation
- Use the semantic-indexer-api instead of the original search API.
- Display chunk text in results
- PDF files: Display only the most relevant chunk.
- CSV files: First call
/retrieve to get all chunks, then display them.
- Support file format filtering
- Allow user to specify file format (e.g.,
CSV or PDF) in queries.
- Example: "Find some CSV files about endangered species in Australia".
Replace Chatbot Dataset Search with Semantic Indexer API
This feature updates the chatbot's Search Datasets functionality to use the new semantic-indexer-api, which supports semantic search and chunk-based context retrieval.
/retrieveto get all chunks, then display them.CSVorPDF) in queries.