Vector search retrieves similar data by comparing their numerical representations (embeddings) in a mathematical space. Pinecone, for instance, is a database purpose-built for this kind of search.
Method to establish correspondences between embedding vectors from different black-box encoders. Exploits local geometric consistency of independently trained contrastive encoders: short-range distances preserved up to scale factor. Uses iterative reference-based geometric embedding hashing with paired anchors to recover vector links. Code released.
Comparative benchmark of vector search libraries (FAISS, Scann, Usearch) measuring speed, memory usage, and similarity accuracy. Tests across 500 to 1 million samples. Results and code published on GitHub.
OmniRetrieval is a framework unifying retrieval across heterogeneous knowledge sources (unstructured text, relational tables, knowledge graphs). It translates natural-language queries into source-native queries, evaluated on 13 datasets and 309 knowledge bases.
Amazon OpenSearch Serverless now available in Vercel Marketplace with automatic setup and unified management. Supports vector, lexical, hybrid, and agentic search. $100 USD credits offered for new AWS accounts.
Meilisearch is a lightning-fast search engine API providing AI-powered hybrid search for websites and applications.
Local tool to inspect search results before feeding them into RAG pipelines. Analyzes source diversity, duplicates, freshness, SEO/GEO pollution risk, and provider differences (Brave, Serper, Tavily, Exa). Filters low-quality evidence before model context window.
Tomesphere indexes 3 million arxiv/OpenAlex papers with Gemini TLDRs, OpenReview peer reviews, GitHub repos, citation graph (250M edges), and SPECTER2 semantic graph (768D pgvector). Four ranking modes: Influential, Recent, Hidden gems, Nearest. Chrome extension for arxiv. Free, no signup.
Aiki is a lightweight local RAG tool for chatting with Wikipedia offline. It downloads and chunks Wikipedia articles, uses a custom TF-IDF + cosine similarity retriever, supports query expansion via Wikipedia links, and optional LLM-based answer generation. Minimal dependencies, fully local execution.
Qdrant is a high-performance vector database designed for large-scale AI applications. Available as open-source and cloud service.
Three AI infrastructure startups reach unicorn status: Exa (vector search), Modal (cloud platform), and TurboPuffer (distributed cache). Major funding rounds confirm consolidation in the AI infrastructure market.
Two-phase RAG system for corporate credit analysis: phase 1 combines lexical and dense multilingual retrieval; phase 2 applies adaptive controller and LLM-as-Judge scoring based on analytical utility rather than semantic similarity. On-premise deployment on proprietary multilingual corpus. Production: document review time reduced from hours to 3 minutes across 800+ analysts.
DIVE compresses LLM embeddings through lightweight adapters using self-limiting triplet loss and NT-Xent contrastive loss. Outperforms Matryoshka-Adaptor, Search-Adaptor, and SMEC across 6 BEIR datasets at all compression ratios. 14M-parameter open-source implementation.
Lance is an open lakehouse format for multimodal AI. Converts from Parquet in 2 lines of code with 100x faster random access, vector indexing, and data versioning. Compatible with Pandas, DuckDB, Polars, PyArrow, PyTorch.
RAG-based pipeline for sentence-level EEG-to-text decoding. Combines EEG encoder aligned with semantic embeddings, vector retrieval, and LLM refinement. On ZuCo dataset, achieves 30.45% improvement over random baseline (cosine similarity 0.181 vs 0.139).
ERMAR (Enhanced Ranked Memory Augmented Retrieval) is a framework for effective long-context management in language models. It employs a novel relevance scoring mechanism and pointwise re-ranking model for key-value embeddings, inspired by learning-to-rank techniques. Achieves SOTA results on standard benchmarks with superior scalability and performance.
IVF-TQ introduces an IVF index with codebook-free residual layer: fixed random rotation plus precomputed Lloyd-Max scalar quantization. Substantially reduces streaming degradation (Deep-10M: -0.80pp vs IVF-PQ -3.23pp). Code released.
Amazon Music deploys a robust neural sparse retrieval system for large-scale music search. The system handles misspellings, transpositions, and phonetic variations with 91.4% recall@10 on 6M documents, outperforming trigrams (57.7%). Inference-free architecture with granular subword tokenization (max 3 chars) and zero online latency.
RAG pipeline for EEG-to-text decoding combining an EEG encoder aligned with semantic embeddings, vector retrieval, and an LLM. On ZuCo dataset, the method outperforms random baseline with cosine similarity of 0.181±0.022 vs 0.139±0.029 (30.45% improvement), without teacher forcing at inference.
Infini-News indexes 1.35B CC-News articles (August 2016–present) with metadata extraction, language detection (GlotLID, lingua, CommonLingua), and geographic attribution (83.4% coverage). Infini-gram suffix-array indexes enable sub-second full-text pattern search across the entire archive.
Hugging Face introduces the Ettin Reranker family, models designed to improve search relevance and RAG result ranking. These rerankers optimize document ranking after initial retrieval.
MongoDB enables vector search on self-managed editions. Announced September 19 at MongoDB.local NYC, the feature extends vector search capabilities beyond cloud offerings to self-hosted deployments.
Google releases EmbeddingGemma, an efficient embedding model based on Gemma. The model delivers competitive performance with reduced memory footprint, optimized for vector search and RAG tasks.
OpenAI acquires Rockset, a vector database and real-time indexing platform. The acquisition strengthens OpenAI's infrastructure capabilities to support large-scale AI applications.
Hugging Face introduces binary and scalar embedding quantization to accelerate and reduce costs for vector retrieval. The method compresses dense representations while maintaining information retrieval quality.
Hugging Face introduces Matryoshka embedding models, enabling dynamic dimensionality reduction of vectors without retraining. This approach provides flexibility and efficiency for RAG and vector search applications.
OpenAI releases new embedding models and API updates. The models deliver improved performance and reduced costs for vector search and RAG applications.
Hugging Face demonstrates a playlist generator using Sentence Transformers to encode music preferences as vectors. The system compares song embeddings and recommends similar tracks via vector search.
Introductory guide to embeddings: vector representations of text, images, or data. Covers use cases (RAG, semantic search, clustering) and how to use embedding models via Hugging Face.
Hugging Face integrates image search into its datasets platform. Users can now index and query image collections using vector embeddings, enabling discovery and organization of large-scale visual data.