Detailed Results
| ID β | Score β | Status β | Facts Retained β | Date β | Actions |
|---|---|---|---|---|---|
| 1 | 1.000 | β PASS | 6/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 1
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 6/6
All Retained: β Yes
Timestamp: 2025-10-14T17:12:57.260669
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Textsπ Candidate Text:Let me help you, Sophia Lopez! Your next appointment is with Dr. Sarah Green in Ophthalmology on October 9th, 2025 at 4:30 PM at Southview Medical.
| |||||
| 2 | 1.000 | β PASS | 6/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 2
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 6/6
All Retained: β Yes
Timestamp: 2025-10-14T17:12:57.260687
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Textsπ Candidate Text:Hi Sophia! Youβre scheduled to see Dr. Sarah Green on 2025-10-09 at 4:30 PM for your Ophthalmology appointment at Southview Medical.
| |||||
| 3 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 3
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260693
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello Sophia Lopez! Your next visit is with Dr. Sarah Green, Ophthalmology, on October 9 at 4:30 PM.
| |||||
| 4 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 4
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260698
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia, your next appointment is with Dr. Sarah Green on October 9th at 4:30 PM in Southview Medical Center.
| |||||
| 5 | 0.987 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 5
Test Category: LLM Validation
Retention Score: 0.987
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260703
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.987
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hey Sophia! You have an appointment with Dr. Sarah Green (Ophthalmology) at 4:30 PM on 09/10/2025.
| |||||
| 6 | 0.826 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 6
Test Category: LLM Validation
Retention Score: 0.826
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260707
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.826
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your next appointment is on October 9th, 2025 at 4:30 PM with Dr. Sarah Green, Ophthalmology.
| |||||
| 7 | 0.842 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 7
Test Category: LLM Validation
Retention Score: 0.842
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260711
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.842
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia Lopez! Youβre seeing Dr. Sarah Green on Thursday, October 9, 2025 at 4:30 PM.
| |||||
| 8 | 1.000 | β PASS | 6/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 8
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 6/6
All Retained: β Yes
Timestamp: 2025-10-14T17:12:57.260716
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Textsπ Candidate Text:Hi Sophia! Your Ophthalmology appointment with Dr. Sarah Green is at 4:30 PM on 2025-10-09 at Southview Medical.
| |||||
| 9 | 0.971 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 9
Test Category: LLM Validation
Retention Score: 0.971
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260720
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.971
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello! Sophia, your next appointment is with Dr. Sarah Green for Ophthalmology on October 9, 2025, 4:30 PM.
| |||||
| 10 | 0.938 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 10
Test Category: LLM Validation
Retention Score: 0.938
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260724
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.938
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Let me check that for you, Sophia. You have an Ophthalmology appointment with Dr. Sarah Green on October 9, 2025 at 4:30 PM.
| |||||
| 11 | 1.000 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 11
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260728
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: None
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia Lopez, your next medical appointment is scheduled with Dr. Sarah Green on 9th October 2025 at 4:30 PM.
| |||||
| 12 | 0.894 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 12
Test Category: LLM Validation
Retention Score: 0.894
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260733
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.894
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:You are booked with Dr. Sarah Green on October 9th, 2025 at 4:30 PM, Southview Medical.
| |||||
| 13 | 0.726 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 13
Test Category: LLM Validation
Retention Score: 0.726
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260737
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.726
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your appointment is set for October 9, 2025, 4:30 PM, with Dr. Sarah Green (Ophthalmology).
| |||||
| 14 | 0.895 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 14
Test Category: LLM Validation
Retention Score: 0.895
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260740
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.895
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia, your next visit is with Dr. Sarah Green, Ophthalmologist, on 09/10/2025 at 4:30 PM.
| |||||
| 15 | 0.659 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 15
Test Category: LLM Validation
Retention Score: 0.659
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260745
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.659
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hey Sophia! Youβre scheduled for 4:30 PM on October 9, 2025 with Dr. Sarah Green.
| |||||
| 16 | 0.994 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 16
Test Category: LLM Validation
Retention Score: 0.994
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260749
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: None
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.994
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia Lopez! You have an Ophthalmology appointment at Southview Medical on 09 Oct 2025 at 4:30 PM.
| |||||
| 17 | 0.968 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 17
Test Category: LLM Validation
Retention Score: 0.968
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260753
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.968
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello Sophia! Dr. Sarah Green will see you on October 9th at 4:30 PM at Southview Medical.
| |||||
| 18 | 0.656 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 18
Test Category: LLM Validation
Retention Score: 0.656
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260757
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.656
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia, your appointment with Dr. Green is on Thursday, October 9, 2025, 4:30 PM.
| |||||
| 19 | 0.746 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 19
Test Category: LLM Validation
Retention Score: 0.746
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260761
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.746
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Letβs seeβ¦ your next appointment is with Dr. Sarah Green on October 9, 2025 at 4:30 PM.
| |||||
| 20 | 0.888 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 20
Test Category: LLM Validation
Retention Score: 0.888
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260765
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.888
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia, youβre booked with Dr. Sarah Green, Ophthalmology, on October 9th, 2025 at 4:30 PM.
| |||||
| 21 | 0.819 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 21
Test Category: LLM Validation
Retention Score: 0.819
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260769
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.819
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi there Sophia! You have an Ophthalmology appointment on October 9, 2025, 4:30 PM, with Dr. Sarah Green.
| |||||
| 22 | 0.739 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 22
Test Category: LLM Validation
Retention Score: 0.739
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260772
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.739
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your next appointment, Sophia, is scheduled for October 9, 2025, 4:30 PM with Dr. Green (Ophthalmology).
| |||||
| 23 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 23
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260776
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Let me help you, Sophia! Your next appointment is with Dr. Sarah Green, Ophthalmology, on 09/10/2025 4:30 PM.
| |||||
| 24 | 0.717 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 24
Test Category: LLM Validation
Retention Score: 0.717
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260780
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.717
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia, your upcoming visit is on October 9th, 2025 at 4:30 PM with Dr. Sarah Green.
| |||||
| 25 | 1.000 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 25
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260784
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: None
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia Lopez! Youβre due to see Dr. Sarah Green on 9 October 2025, 4:30 PM at Southview Medical.
| |||||
| 26 | 0.766 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 26
Test Category: LLM Validation
Retention Score: 0.766
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260788
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.766
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your next appointment is Thursday, October 9th at 4:30 PM, with Dr. Sarah Green, Ophthalmology.
| |||||
| 27 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 27
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260792
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβre seeing Dr. Sarah Green on 09-10-2025, 4:30 PM at Southview Medical.
| |||||
| 28 | 0.986 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 28
Test Category: LLM Validation
Retention Score: 0.986
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260796
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.986
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: positive
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello Sophia Lopez, your appointment is confirmed for October 9, 2025 at 4:30 PM, Ophthalmology with Dr. Sarah Green.
| |||||
| 29 | 0.886 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 29
Test Category: LLM Validation
Retention Score: 0.886
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260802
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.886
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβre scheduled with Dr. Sarah Green (Ophthalmology) on Oct 9, 2025 at 4:30 PM.
| |||||
| 30 | 0.916 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 30
Test Category: LLM Validation
Retention Score: 0.916
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260806
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.916
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hey Sophia! Your next check-up is with Dr. Green on October 9th, 4:30 PM at Southview Medical.
| |||||
| 31 | 0.972 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 31
Test Category: LLM Validation
Retention Score: 0.972
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260810
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.972
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Let me confirm, Sophia Lopez β you have an appointment with Dr. Sarah Green on October 9, 2025 at 4:30 PM.
| |||||
| 32 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 32
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260813
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβll see Dr. Sarah Green at 4:30 PM on 2025-10-09, Southview Medical.
| |||||
| 33 | 0.805 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 33
Test Category: LLM Validation
Retention Score: 0.805
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260817
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.805
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia Lopez, your appointment is on October 9, 2025 at 4:30 PM with Dr. Green.
| |||||
| 34 | 0.565 | β FAIL | 1/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 34
Test Category: LLM Validation
Retention Score: 0.565
Facts Retained: 1/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260823
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: None
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.565
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your appointment with Dr. Green is at 4:30 PM on 09 October 2025.
| |||||
| 35 | 0.788 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 35
Test Category: LLM Validation
Retention Score: 0.788
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260828
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.788
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβre booked for an Ophthalmology consultation with Dr. Sarah Green, Oct 9, 2025, 4:30 PM.
| |||||
| 36 | 0.830 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 36
Test Category: LLM Validation
Retention Score: 0.830
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260831
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.830
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello Sophia Lopez! You have an upcoming appointment on October 9th, 2025, 4:30 PM, Southview Medical.
| |||||
| 37 | 0.706 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 37
Test Category: LLM Validation
Retention Score: 0.706
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260835
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.706
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβre scheduled to meet Dr. Green, Ophthalmology, on October 9, 2025 at 4:30 PM.
| |||||
| 38 | 0.877 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 38
Test Category: LLM Validation
Retention Score: 0.877
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260839
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.877
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hey Sophia Lopez! Youβre due for your Ophthalmology appointment with Dr. Green on October 9, 2025, at 4:30 PM.
| |||||
| 39 | 0.938 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 39
Test Category: LLM Validation
Retention Score: 0.938
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260843
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.938
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Dr. Sarah Green will see you at Southview Medical on October 9th, 2025, at 4:30 PM.
| |||||
| 40 | 0.751 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 40
Test Category: LLM Validation
Retention Score: 0.751
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260847
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: Southview Medical
Validation DetailsSimilarity Score: 0.751
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your next visit is October 9th, 2025, 4:30 PM, with Dr. Green at Southview Medical.
| |||||
| 41 | 0.613 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 41
Test Category: LLM Validation
Retention Score: 0.613
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260851
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.613
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia, your next Ophthalmology appointment is October 9, 2025 at 4:30 PM.
| |||||
| 42 | 0.906 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 42
Test Category: LLM Validation
Retention Score: 0.906
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260855
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.906
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia Lopez, you have an appointment with Dr. Green, Ophthalmology, on October 9, 2025, 4:30 PM.
| |||||
| 43 | 0.850 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 43
Test Category: LLM Validation
Retention Score: 0.850
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260858
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.850
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia! Youβre booked with Dr. Sarah Green (Ophthalmology) for October 9, 2025 at 4:30 PM.
| |||||
| 44 | 1.000 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 44
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260862
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Let me help you, Sophia Lopez. Your next appointment is on October 9, 2025, at 4:30 PM, with Dr. Sarah Green.
| |||||
| 45 | 0.754 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 45
Test Category: LLM Validation
Retention Score: 0.754
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260867
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: None
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.754
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Your next appointment is October 9th, 2025, 4:30 PM, Dr. Sarah Green, Ophthalmology.
| |||||
| 46 | 0.730 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 46
Test Category: LLM Validation
Retention Score: 0.730
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260873
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.730
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia, you have an Ophthalmology appointment with Dr. Green on October 9, 2025, at 4:30 PM.
| |||||
| 47 | 0.997 | β FAIL | 4/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 47
Test Category: LLM Validation
Retention Score: 0.997
Facts Retained: 4/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260877
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.997
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: positive
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hello Sophia Lopez! Your appointment with Dr. Sarah Green is confirmed for 2025-10-09 at 4:30 PM.
| |||||
| 48 | 0.904 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 48
Test Category: LLM Validation
Retention Score: 0.904
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260880
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.904
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hi Sophia, youβre set for an appointment with Dr. Sarah Green (Ophthalmology) on October 9, 2025 at 4:30 PM.
| |||||
| 49 | 0.980 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 49
Test Category: LLM Validation
Retention Score: 0.980
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260884
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.980
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: positive
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Hey Sophia! Your appointment is confirmed β Dr. Sarah Green, Ophthalmology, 09/10/2025 at 4:30 PM.
| |||||
| 50 | 0.783 | β FAIL | 3/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 50
Test Category: LLM Validation
Retention Score: 0.783
Facts Retained: 3/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260888
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: None
Specialty
β
Expected: Ophthalmology
Extracted: None
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 0.783
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Let me checkβ¦ Sophia, your next appointment is with Dr. Green on October 9th, 2025 at 4:30 PM.
| |||||
| 51 | 1.000 | β FAIL | 5/6 | 14/10/2025 17:12 | |
Test InformationTest Name: Candidate 51
Test Category: LLM Validation
Retention Score: 1.000
Facts Retained: 5/6
All Retained: β No
Timestamp: 2025-10-14T17:12:57.260893
Facts Analysis
FullName
β
Expected: Sophia Lopez
Extracted: Sophia Lopez
DoctorName
β
Expected: Dr. Sarah Green
Extracted: Dr. Sarah Green
Specialty
β
Expected: Ophthalmology
Extracted: Ophthalmology
AppointmentDate
β
Expected: 2025-10-09
Extracted: 2025-10-09
AppointmentTime
β
Expected: 4:30 PM
Extracted: 4:30 PM
ClinicLocation
β
Expected: Southview Medical
Extracted: None
Validation DetailsSimilarity Score: 1.000
Polarity Match: β Yes
Reference Polarity: neutral
Candidate Polarity: neutral
Failure Reason: Factual accuracy issues detected
Textsπ Candidate Text:Sophia, your next medical appointment is with Dr. Sarah Green, Ophthalmology, on October 9, 2025 at 4:30 PM.
| |||||