Cognee vs Mem0: accuracy, cost and latency
Independent results on the same 30 questions of LongMemEval-S (cleaned, 2025-09), with the same reader model and the official judge. Pilot sample, so accuracy is shown with 95% intervals.
Verdict
Generated from the pilot data, n=30 per system- AccuracyStatistically tied on accuracy at n=30: Cognee 90.0% (95% CI 74–97%) vs Mem0 83.3% (95% CI 66–93%). The 95% intervals overlap, so the 6.7-point gap could be noise.
- CostMem0 costs 1.5× less per 1,000 questions: $93.0 vs $141 for Cognee.
- LatencySimilar latency: median 4.0s for Cognee vs 4.3s for Mem0 per question (p90 8.1s vs 7.4s).
- IngestionCognee ingests a chat history faster: 2.8 min vs 15.2 min for Mem0 (median per question).
- ContextThe reader sees a median of 83k characters of context per question with Cognee and 50k with Mem0.
Key numbers side by side
Bold marks the better value. Accuracy rows are not bolded when the 95% intervals overlap.
| Metric | Cognee | Mem0 |
|---|---|---|
| Accuracy (official judge) | 90.0% | 83.3% |
| 95% interval | 74–97% | 66–93% |
| Panel accuracy | 90.0% | 83.3% |
| Cost per 1,000 questions | $141 | $93.0 |
| of which memory side | $139 | $91.6 |
| of which answering | $2.23 | $1.32 |
| Latency p50 | 4.0s | 4.3s |
| Latency p90 | 8.1s | 7.4s |
| Ingestion per history (median) | 2.8 min | 15.2 min |
| Context given to reader (median chars) | 83k | 50k |
Cognee and Mem0 among all tested systems
Cognee and Mem0 are highlighted; other systems are muted for context, baselines lightest. Each name links to the system's page.
Accuracy
Higher is betterShare of 30 questions answered correctly (official judge). Whiskers: 95% interval.
- Cognee90.0%74–97%
- Hindsight90.0%74–97%
- Plain RAG86.7%70–95%
- Mem083.3%66–93%
- Full context83.3%66–93%
- LangMem33.3%19–51%
Not shown: Graphiti (pilot result withdrawn, rerun in progress).
Cost per 1,000 questions
Lower is betterUSD billed (prices as of 2026-10-08). Solid: memory side (ingestion and retrieval). Light: answering.
Not shown: Graphiti (pilot result withdrawn, rerun in progress).
Latency per question
Lower is betterRetrieval plus answer, in seconds. Solid: median (p50). Light: up to p90.
- LangMem3.5sp90 5.3s
- Cognee4.0sp90 8.1s
- Mem04.3sp90 7.4s
- Full context4.8sp90 8.0s
- Plain RAG4.8sp90 7.4s
- Hindsight5.4sp90 8.1s
Not shown: Graphiti (pilot result withdrawn, rerun in progress).
Ingestion time
Lower is betterMedian time to load one question's chat history into the system.
Not shown: Graphiti (pilot result withdrawn, rerun in progress).
Accuracy by question type
Difference is Cognee minus Mem0, in percentage points. Each type has only a few pilot questions (n), so one question can move a row by 13 points or more.
| Question type | n | Cognee | Mem0 | Difference |
|---|---|---|---|---|
| Single-session (user) | 4 | 100% | 75% | +25 pts in favour of Cognee |
| Single-session (assistant) | 3 | 100% | 100% | 0 |
| Preferences | 2 | 100% | 100% | 0 |
| Multi-session | 8 | 88% | 75% | +13 pts in favour of Cognee |
| Knowledge update | 4 | 100% | 100% | 0 |
| Temporal reasoning | 8 | 75% | 88% | −13 pts in favour of Mem0 |
| Abstention | 1 | 100% | 0% | +100 pts in favour of Cognee |
What each one is
Cognee
Builds a knowledge graph plus vector index from documents and conversations, then retrieves graph context for a query.
How we ran it
Python SDK in-process with embedded defaults. One text document per session with the session date at the top, then cognify(). Search: Cognee's default HYBRID_COMPLETION with only_context=True and default top_k.
Mem0
Extracts short memories from each exchange with an LLM, stores them in a vector store, and retrieves them with semantic, keyword and entity signals.
How we ran it
Open-source SDK with local Qdrant, NLP extras installed (spaCy, BM25). Mirrors Mem0's own LongMemEval harness: one add() per user+assistant pair, top_k=200 at search. Historical timestamps are platform-only, so the shared clock simulation supplies dates.
What the vendors report
Cognee
| Score | Variant | Reader | Judge | Note | Source |
|---|---|---|---|---|---|
| 90.0% | S (cleaned, 2025-09), 30-question pilot | openai/gpt-6-luna | gpt-4o-2024-08-06, official prompt | MemVerdict measurement, Cognee 1.6.3 | This page |
| None found | - | - | - | No self-reported LongMemEval score found. | - |
Mem0
| Score | Variant | Reader | Judge | Note | Source |
|---|---|---|---|---|---|
| 83.3% | S (cleaned, 2025-09), 30-question pilot | openai/gpt-6-luna | gpt-4o-2024-08-06, official prompt | MemVerdict measurement, Mem0 2.2.1 (open source) | This page |
| 94.4% | S | GPT-5 | GPT-5 with Mem0's own lenient prompt | Managed platform, not the open-source SDK. | mem0.ai/research |
Vendor-reported scores and ours are measured differently, so a gap does not by itself mean either number is wrong. Our pilot uses openai/gpt-6-luna as the reader that writes each answer, gpt-4o-2024-08-06 with the official LongMemEval judge prompt, LongMemEval-S (cleaned, 2025-09) and 30 questions, with each system set up as described above. Scores move with the reader model, the judge model and its prompt, the dataset version, the number of questions, and whether a hosted platform or the open-source package is tested.
Frequently asked questions
Is Cognee better than Mem0?
Statistically tied on accuracy at n=30: Cognee 90.0% (95% CI 74–97%) vs Mem0 83.3% (95% CI 66–93%). The 95% intervals overlap, so the 6.7-point gap could be noise. With the 3-judge panel majority instead of the official judge: Cognee 90.0%, Mem0 83.3%. No question type separates them by more than one question (each question type has only 1 to 8 questions in this pilot). These are pilot numbers (30 questions each); the full 500-question run will narrow the intervals.
Which is cheaper, Cognee or Mem0?
Mem0 costs 1.5× less per 1,000 questions: $93.0 vs $141 for Cognee. Cognee: $141 per 1,000 questions, of which $139 (98%) is memory-side (ingestion and retrieval) and $2.23 is answering. Mem0: $93.0 per 1,000 questions, of which $91.6 (99%) is memory-side (ingestion and retrieval) and $1.32 is answering. Prices as of 2026-10-08.
Which is faster, Cognee or Mem0?
Similar latency: median 4.0s for Cognee vs 4.3s for Mem0 per question (p90 8.1s vs 7.4s). Cognee ingests a chat history faster: 2.8 min vs 15.2 min for Mem0 (median per question). Latency is measured per question as retrieval plus answering; ingestion is the time to load one question's chat history.
How were Cognee and Mem0 tested?
Both were run on the same 30 questions of LongMemEval-S (cleaned, 2025-09) as every other system, by the same harness. For each question, the system ingests that question's chat history, then retrieves context that one reader model (openai/gpt-6-luna) uses to answer with the official LongMemEval prompt. Answers are graded by the official judge (gpt-4o-2024-08-06) and cross-checked by 3 other judges; all judges agreed on 95% of graded answers. Costs are what the providers billed (prices as of 2026-10-08). Cognee: Python SDK in-process with embedded defaults. One text document per session with the session date at the top, then cognify(). Search: Cognee's default HYBRID_COMPLETION with only_context=True and default top_k. Mem0: Open-source SDK with local Qdrant, NLP extras installed (spaCy, BM25). Mirrors Mem0's own LongMemEval harness: one add() per user+assistant pair, top_k=200 at search. Historical timestamps are platform-only, so the shared clock simulation supplies dates.
Which should I use, Cognee or Mem0?
This pilot does not separate them on accuracy, so decide on the other axes and on fit with your stack. Mem0 costs 1.5× less per 1,000 questions: $93.0 vs $141 for Cognee. Similar latency: median 4.0s for Cognee vs 4.3s for Mem0 per question (p90 8.1s vs 7.4s). Cognee ingests a chat history faster: 2.8 min vs 15.2 min for Mem0 (median per question). Both are Apache-2.0 licensed. These are pilot numbers (30 questions each); the full 500-question run will narrow the intervals.
More comparisons
Other comparisons with Cognee
- Cognee vs Full contextStatistically tied on accuracy at n=30; Full context 11× cheaper
- Cognee vs GraphitiGraphiti: pilot result withdrawn, rerun in progress
- Cognee vs HindsightTied on accuracy (90.0% each); Cognee 1.2× cheaper
- Cognee vs LangMemCognee more accurate; LangMem 2.3× cheaper
- Cognee vs Plain RAGStatistically tied on accuracy at n=30; Plain RAG 26× cheaper
Other comparisons with Mem0
- Full context vs Mem0Tied on accuracy (83.3% each); Full context 7.1× cheaper
- Graphiti vs Mem0Graphiti: pilot result withdrawn, rerun in progress
- Hindsight vs Mem0Statistically tied on accuracy at n=30; Mem0 1.8× cheaper
- LangMem vs Mem0Mem0 more accurate; LangMem 1.5× cheaper
- Mem0 vs Plain RAGStatistically tied on accuracy at n=30; Plain RAG 17× cheaper