Ecommerce - Digital Products Tests

Detailed Results

ID ↕	Score ↕	Status ↕	Facts Retained ↕	Date ↕
1	1.000	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 1.000 Facts: 3/3 Test Information Test Name: Candidate 1 Test Category: LLM Validation Retention Score: 1.000 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326803 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 1.000 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: positive Comparación semántica (avanzado) Coincidencia semántica global: 100.0% Precisión: 100.0% Recall: 100.0% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮
2	0.430	✗ FAIL	3/3	03/03/2026 11:08
FAIL Score: 0.430 Facts: 3/3 Test Information Test Name: Candidate 2 Test Category: LLM Validation Retention Score: 0.430 Facts Retained: 3/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326827 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.430 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Failure Reason: Possible hallucination found in the candidate Comparación semántica (avanzado) Coincidencia semántica global: 28.6% Precisión: 30.0% Recall: 27.3% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Yo! GBC for $100 USD, 10 biz days delivery. Classic gaming vibes incoming! 🕹️
3	0.912	✗ FAIL	3/3	03/03/2026 11:08
FAIL Score: 0.912 Facts: 3/3 Test Information Test Name: Candidate 3 Test Category: LLM Validation Retention Score: 0.912 Facts Retained: 3/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326836 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.912 Polarity Match: ✗ No Reference Polarity: positive Candidate Polarity: negative Failure Reason: Polarity mismatch detected Comparación semántica (avanzado) Coincidencia semántica global: 72.7% Precisión: 72.7% Recall: 72.7% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Dude, the Game Boy Color runs you $100 USD. Shipping in 10 business days. No regrets!
4	0.880	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.880 Facts: 3/3 Test Information Test Name: Candidate 4 Test Category: LLM Validation Retention Score: 0.880 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326843 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.880 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 70.0% Precisión: 77.8% Recall: 63.6% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: The Game Boy Color costs $100 USD with delivery in 10 business days.
5	0.874	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.874 Facts: 3/3 Test Information Test Name: Candidate 5 Test Category: LLM Validation Retention Score: 0.874 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326849 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.874 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 70.0% Precisión: 77.8% Recall: 63.6% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Your Game Boy Color order: $100 USD, ships in 10 business days. GG!
6	0.910	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.910 Facts: 3/3 Test Information Test Name: Candidate 6 Test Category: LLM Validation Retention Score: 0.910 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326855 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.910 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 72.7% Precisión: 72.7% Recall: 72.7% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Game Boy Color at $100 USD — shipping in 10 business days. Old school FTW!
7	0.770	✗ FAIL	3/3	03/03/2026 11:08
FAIL Score: 0.770 Facts: 3/3 Test Information Test Name: Candidate 7 Test Category: LLM Validation Retention Score: 0.770 Facts Retained: 3/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326861 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.770 Polarity Match: ✗ No Reference Polarity: positive Candidate Polarity: negative Failure Reason: Polarity mismatch detected Comparación semántica (avanzado) Coincidencia semántica global: 57.1% Precisión: 60.0% Recall: 54.5% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Nope, the Game Boy Color is not $100 USD and doesn't ship in 10 days.
8	0.732	✗ FAIL	1/3	03/03/2026 11:08
FAIL Score: 0.732 Facts: 1/3 Test Information Test Name: Candidate 8 Test Category: LLM Validation Retention Score: 0.732 Facts Retained: 1/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326867 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✗ Expected: 100 Extracted: 150 shipping_days ✗ Expected: 10 business days Extracted: None Validation Details Similarity Score: 0.732 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Failure Reason: Factual accuracy issues detected Comparación semántica (avanzado) Coincidencia semántica global: 55.6% Precisión: 71.4% Recall: 45.5% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: The Game Boy Color is $150 USD with 5-day shipping.
9	0.701	✗ FAIL	2/3	03/03/2026 11:08
FAIL Score: 0.701 Facts: 2/3 Test Information Test Name: Candidate 9 Test Category: LLM Validation Retention Score: 0.701 Facts Retained: 2/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326876 Facts Analysis product_name ✗ Expected: Game Boy Color Extracted: None price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.701 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Failure Reason: Factual accuracy issues detected Comparación semántica (avanzado) Coincidencia semántica global: 55.6% Precisión: 71.4% Recall: 45.5% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Hey! Nintendo Switch is $100 with 10 business days shipping.
10	0.844	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.844 Facts: 3/3 Test Information Test Name: Candidate 10 Test Category: LLM Validation Retention Score: 0.844 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326884 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.844 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 66.7% Precisión: 70.0% Recall: 63.6% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Game Boy Color — $100 USD. Delivery in 10 business days. You're gonna love it!
11	0.705	✗ FAIL	2/3	03/03/2026 11:08
FAIL Score: 0.705 Facts: 2/3 Test Information Test Name: Candidate 11 Test Category: LLM Validation Retention Score: 0.705 Facts Retained: 2/3 All Retained: ✗ No Timestamp: 2026-03-03T11:08:45.326892 Facts Analysis product_name ✗ Expected: Game Boy Color Extracted: None price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.705 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Failure Reason: Factual accuracy issues detected Comparación semántica (avanzado) Coincidencia semántica global: 52.6% Precisión: 62.5% Recall: 45.5% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: That retro gem? $100 USD, 10 business days to your door. Game on!
12	0.656	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.656 Facts: 3/3 Test Information Test Name: Candidate 12 Test Category: LLM Validation Retention Score: 0.656 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326897 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.656 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 44.4% Precisión: 57.1% Recall: 36.4% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: GBC = $100 USD. Ships in 10 business days. Want it? 😎
13	0.829	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.829 Facts: 3/3 Test Information Test Name: Candidate 13 Test Category: LLM Validation Retention Score: 0.829 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326902 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.829 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 63.6% Precisión: 63.6% Recall: 63.6% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: The Game Boy Color will set you back $100 USD. Ships in 10 business days.
14	0.863	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.863 Facts: 3/3 Test Information Test Name: Candidate 14 Test Category: LLM Validation Retention Score: 0.863 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326908 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.863 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 72.7% Precisión: 72.7% Recall: 72.7% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Boom! Game Boy Color for $100 USD, 10 business days shipping. Pure nostalgia.
15	0.840	✓ PASS	3/3	03/03/2026 11:08
PASS Score: 0.840 Facts: 3/3 Test Information Test Name: Candidate 15 Test Category: LLM Validation Retention Score: 0.840 Facts Retained: 3/3 All Retained: ✓ Yes Timestamp: 2026-03-03T11:08:45.326913 Facts Analysis product_name ✓ Expected: Game Boy Color Extracted: Game Boy Color price ✓ Expected: 100 Extracted: 100 shipping_days ✓ Expected: 10 business days Extracted: 10 business days Validation Details Similarity Score: 0.840 Polarity Match: ✓ Yes Reference Polarity: positive Candidate Polarity: neutral Comparación semántica (avanzado) Coincidencia semántica global: 63.6% Precisión: 63.6% Recall: 63.6% Sección para análisis interno; no está pensada para usuarios de negocio. Texts 🔍 Query: How much is the Game Boy Color and when does it ship? 📋 Reference (Baseline): Hey! The Game Boy Color is $100 USD with shipping in 10 business days. Ready to level up? 🎮 📝 Candidate Text: Your Game Boy Color: $100 USD. We ship in 10 business days. Enjoy the 8-bit life!

Per page: Showing 1-15 of 15

Analytics Dashboard

Success Rate Distribution

Performance Trend

Similarity Score Trend

Fact Retention Trend

Detailed Results

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts

🔍 Query:

📋 Reference (Baseline):

📝 Candidate Text:

Test Information

Facts Analysis

Validation Details

Texts