Retrieval evaluation¶
Corpus: 5 documents, 34 chunks, 95 entities, 9 communities. Embedding versions: gemini-embedding-001@1536.
| Config | hit@5 | hit@10 | MRR | questions |
|---|---|---|---|---|
| full_deep | 1.00 | 1.00 | 0.93 | 9 |
| interactive | 1.00 | 1.00 | 1.00 | 9 |
| vector_only | 1.00 | 1.00 | 1.00 | 9 |
| keyword_only | 0.33 | 0.33 | 0.33 | 9 |
| no_graph | 1.00 | 1.00 | 1.00 | 9 |
| no_hyde | 1.00 | 1.00 | 1.00 | 9 |
| no_community | 1.00 | 1.00 | 0.93 | 9 |
Read this table by comparing rows against full_deep: a layer earns
its place when removing it drops hit rate or MRR. Misses by question
are in report.json.
Missed questions¶
keyword_only: rice-straw-generatedkeyword_only: rice-straw-baledkeyword_only: rice-straw-ashkeyword_only: almond-pruning-yieldkeyword_only: biogas-yield-pretreatedkeyword_only: chip-moisture-limit