Semantic Search with FAISS

2024-04-07 aillm

This diagram illustrates how to build a semantic search engine with FAISS (Facebook AI Similarity Search).

Reference

Semantic search with FAISS - Hugging Face NLP Course

Semantic Search with FAISS
[Not supported by viewer]
Tokenizer
(from models like sentence-transformers/multi-qa-mpnet-base-dot-v1)  
[Not supported by viewer]
Input Text
(Query)
[Not supported by viewer]
Input Embedding
[Not supported by viewer]
Knowledge Base DataSet 
[Not supported by viewer]
Knowledge Base DataSet with embeddings 
[Not supported by viewer]
add_faiss_index
(column="embeddings")
[Not supported by viewer]
Knowledge Base DataSet with embeddings and FAISS
[Not supported by viewer]
get_nearest_examples
[Not supported by viewer]
Scores and samples
[Not supported by viewer]