Detailed Results
| ID ↕ | Score ↕ | Status ↕ | Facts Retained ↕ | Date ↕ | Actions |
|---|---|---|---|---|---|
| 1 | 0.585 | ✗ FAIL | 3/3 | 03/03/2026 11:08 | |
|
FAIL
Score: 0.585
Facts: 3/3
Test InformationTest Name: Candidate 1
Test Category: LLM Validation
Retention Score: 0.585
Facts Retained: 3/3
All Retained: ✗ No
Timestamp: 2026-03-03T11:08:45.273754
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.585
Polarity Match: ✗ No
Reference Polarity: neutral
Candidate Polarity: negative
Failure Reason: Polarity mismatch detected
Comparación semántica (avanzado)Coincidencia semántica global: 55.6%
Precisión: 50.0% Recall: 62.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Policy POL-2024-001 does not cover your automobile with monthly payments of $850
| |||||
| 2 | 0.816 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.816
Facts: 3/3
Test InformationTest Name: Candidate 2
Test Category: LLM Validation
Retention Score: 0.816
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273772
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.816
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 70.6%
Precisión: 66.7% Recall: 75.0%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Your car insurance policy POL-2024-001 costs $850 monthly
| |||||
| 3 | 0.938 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.938
Facts: 3/3
Test InformationTest Name: Candidate 3
Test Category: LLM Validation
Retention Score: 0.938
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273785
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.938
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 82.4%
Precisión: 77.8% Recall: 87.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Your auto insurance policy POL-2024-001 provides coverage up to $850.
| |||||
| 4 | 0.585 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.585
Facts: 3/3
Test InformationTest Name: Candidate 4
Test Category: LLM Validation
Retention Score: 0.585
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273797
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.585
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: positive
Comparación semántica (avanzado)Coincidencia semántica global: 55.6%
Precisión: 50.0% Recall: 62.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:I can confirm that policy POL-2024-001 for your vehicle is active with $850 in coverage.
| |||||
| 5 | 0.692 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.692
Facts: 3/3
Test InformationTest Name: Candidate 5
Test Category: LLM Validation
Retention Score: 0.692
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273803
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.692
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: positive
Comparación semántica (avanzado)Coincidencia semántica global: 57.1%
Precisión: 46.2% Recall: 75.0%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Great news! Your car insurance policy POL-2024-001 remains valid and offers $850 in protection.
| |||||
| 6 | 0.860 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.860
Facts: 3/3
Test InformationTest Name: Candidate 6
Test Category: LLM Validation
Retention Score: 0.860
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273809
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.860
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 77.8%
Precisión: 70.0% Recall: 87.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Policy POL-2024-001 is an auto insurance plan with a coverage amount of $850.
| |||||
| 7 | 0.740 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.740
Facts: 3/3
Test InformationTest Name: Candidate 7
Test Category: LLM Validation
Retention Score: 0.740
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273814
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.740
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 66.7%
Precisión: 60.0% Recall: 75.0%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Just a reminder: your auto policy POL-2024-001 currently covers you for $850.
| |||||
| 8 | 0.757 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.757
Facts: 3/3
Test InformationTest Name: Candidate 8
Test Category: LLM Validation
Retention Score: 0.757
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273819
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.757
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 66.7%
Precisión: 60.0% Recall: 75.0%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Auto coverage details: Policy POL-2024-001, insured amount $850.
| |||||
| 9 | 0.591 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.591
Facts: 3/3
Test InformationTest Name: Candidate 9
Test Category: LLM Validation
Retention Score: 0.591
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273824
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.591
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 52.6%
Precisión: 45.5% Recall: 62.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Your vehicle is insured under policy POL-2024-001, which includes $850 of coverage.
| |||||
| 10 | 0.764 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.764
Facts: 3/3
Test InformationTest Name: Candidate 10
Test Category: LLM Validation
Retention Score: 0.764
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273832
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.764
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 70.6%
Precisión: 66.7% Recall: 75.0%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:I've verified that your auto policy POL-2024-001 offers $850 in benefits.
| |||||
| 11 | 0.914 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.914
Facts: 3/3
Test InformationTest Name: Candidate 11
Test Category: LLM Validation
Retention Score: 0.914
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273839
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.914
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Comparación semántica (avanzado)Coincidencia semántica global: 77.8%
Precisión: 70.0% Recall: 87.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Everything is set—your auto insurance, policy POL-2024-001, protects you up to $850.
| |||||
| 12 | 0.815 | ✓ PASS | 3/3 | 03/03/2026 11:08 | |
|
PASS
Score: 0.815
Facts: 3/3
Test InformationTest Name: Candidate 12
Test Category: LLM Validation
Retention Score: 0.815
Facts Retained: 3/3
All Retained: ✓ Yes
Timestamp: 2026-03-03T11:08:45.273845
Facts Analysis
policy_number
✓
Expected: POL-2024-001
Extracted: POL-2024-001
amount
✓
Expected: 850
Extracted: 850
coverage_type
✓
Expected: auto insurance
Extracted: auto insurance
Validation DetailsSimilarity Score: 0.815
Polarity Match: ✓ Yes
Reference Polarity: neutral
Candidate Polarity: positive
Comparación semántica (avanzado)Coincidencia semántica global: 66.7%
Precisión: 53.8% Recall: 87.5%
Sección para análisis interno; no está pensada para usuarios de negocio.
Texts🔍 Query:What is the cover for my auto policy POL-2024-001?
📋 Reference (Baseline):Your auto insurance policy #POL-2024-001 has a premium of $850
📝 Candidate Text:Summary: Auto insurance policy POL-2024-001 with a coverage limit of $850 is active and in good standing.
| |||||
Showing 1-12 of 12