Thanks to visit codestin.com
Credit goes to github.com

Skip to content

KolevDarko/crypto-sentiment

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This is an end-to-end AI RAG and sentiment system that processes crypto news.

How it works

Data ingestion

  1. Text data is extracted from website articles.
  2. Extract metadata: publish_date, entities mentioned (coins, tokens, blockchains, bridges)
  3. Split text into chunks and calculate embeddings.
  4. Compute overall daily sentiment per entity
  5. Store data in Tortoise ORM models in Postgresql, also use pgvector for storing vectors from embeddings

Data API

  1. Setup FastAPI to create endpoints for inference and search
  2. Implement Leucene or other search system for BM25 search
  3. Implement hybrid search with RAG and BM25
  4. Create search endpoint
  5. Create QA endpoint with RAG and Reranking

About

Web3 sentiment analysis and data processing with AI

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages