Broadcastwell Fix one answer, $490
Menu
Kalvenor SystemsSAMPLE DATA

Kalvenor Systems history (SAMPLE DATA, fictional company)

SAMPLE DATA, fictional company. Kalvenor Systems illustrates the report; it is not a client delivery.

History by scheduled run

One point per scheduled run. Adaptive runs are not points. Two runs are compared only on the same method version, questions and engines, and a move is printed only where the two 95% intervals separate.

SAMPLE DATA. Kalvenor Systems is a fictional company, and every figure below is fictional.

Across every question and engine

All questions and engines

Series 1: 10 questions, 4 engines, method 1.0. Series 2: 10 questions, 5 engines, method 1.1. Series 3: 35 questions, 5 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 124 of 117 answers, 20.5%, 95% interval 14.2 to 28.73 excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 220 of 50 answers, 40.0%, 95% interval 27.6 to 53.8None excluded
Moved down against 12 May 2026: the two intervals do not overlap.
12 June 2026Monthly run 2026-06, series 23 of 50 answers, 6.0%, 95% interval 2.1 to 16.2None excluded
8 July 2026Scheduled run run-1, series 343 of 171 answers, 25.1%, 95% interval 19.2 to 32.14 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 340 of 174 answers, 23.0%, 95% interval 17.4 to 29.81 excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 342 of 173 answers, 24.3%, 95% interval 18.5 to 31.22 excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 27 of 50 answers, 14.0%, 95% interval 7.0 to 26.2None excluded

By engine

ChatGPT

Series 1: 10 questions, 1 engines, method 1.0. Series 2: 10 questions, 1 engines, method 1.1. Series 3: 35 questions, 1 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 15 of 30 answers, 16.7%, 95% interval 7.3 to 33.6None excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 24 of 10 answers, 40.0%, 95% interval 16.8 to 68.7None excluded
No separable change against 12 May 2026.
12 June 2026Monthly run 2026-06, series 21 of 10 answers, 10.0%, 95% interval 1.8 to 40.4None excluded
8 July 2026Scheduled run run-1, series 311 of 34 answers, 32.4%, 95% interval 19.1 to 49.21 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 314 of 35 answers, 40.0%, 95% interval 25.6 to 56.4None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 313 of 34 answers, 38.2%, 95% interval 23.9 to 55.01 excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 20 of 10 answers, 0.0%, 95% interval 0.0 to 27.8None excluded

Claude

Series 1: 10 questions, 1 engines, method 1.0. Series 2: 10 questions, 1 engines, method 1.1. Series 3: 35 questions, 1 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 19 of 30 answers, 30.0%, 95% interval 16.7 to 47.9None excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 24 of 10 answers, 40.0%, 95% interval 16.8 to 68.7None excluded
No separable change against 12 May 2026.
12 June 2026Monthly run 2026-06, series 21 of 10 answers, 10.0%, 95% interval 1.8 to 40.4None excluded
8 July 2026Scheduled run run-1, series 313 of 35 answers, 37.1%, 95% interval 23.2 to 53.7None excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 38 of 35 answers, 22.9%, 95% interval 12.1 to 39.0None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 314 of 35 answers, 40.0%, 95% interval 25.6 to 56.4None excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 23 of 10 answers, 30.0%, 95% interval 10.8 to 60.3None excluded

Perplexity

Series 1: 10 questions, 1 engines, method 1.0. Series 2: 10 questions, 1 engines, method 1.1. Series 3: 35 questions, 1 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 18 of 30 answers, 26.7%, 95% interval 14.2 to 44.4None excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 24 of 10 answers, 40.0%, 95% interval 16.8 to 68.7None excluded
No separable change against 12 May 2026.
12 June 2026Monthly run 2026-06, series 21 of 10 answers, 10.0%, 95% interval 1.8 to 40.4None excluded
8 July 2026Scheduled run run-1, series 310 of 34 answers, 29.4%, 95% interval 16.8 to 46.21 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 36 of 35 answers, 17.1%, 95% interval 8.1 to 32.7None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 38 of 35 answers, 22.9%, 95% interval 12.1 to 39.0None excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 21 of 10 answers, 10.0%, 95% interval 1.8 to 40.4None excluded

Google AI Overviews

Series 1: 10 questions, 1 engines, method 1.0. Series 2: 10 questions, 1 engines, method 1.1. Series 3: 35 questions, 1 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 12 of 27 answers, 7.4%, 95% interval 2.1 to 23.43 excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 24 of 10 answers, 40.0%, 95% interval 16.8 to 68.7None excluded
No separable change against 12 May 2026.
12 June 2026Monthly run 2026-06, series 20 of 10 answers, 0.0%, 95% interval 0.0 to 27.8None excluded
8 July 2026Scheduled run run-1, series 34 of 35 answers, 11.4%, 95% interval 4.5 to 26.0None excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 35 of 34 answers, 14.7%, 95% interval 6.4 to 30.11 excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 30 of 34 answers, 0.0%, 95% interval 0.0 to 10.21 excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 22 of 10 answers, 20.0%, 95% interval 5.7 to 51.0None excluded

Google AI Mode

Series 1: 10 questions, 1 engines, method 1.1. Series 2: 35 questions, 1 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
12 May 2026Monthly run 2026-05, series 14 of 10 answers, 40.0%, 95% interval 16.8 to 68.7None excluded
No separable change against 12 May 2026.
12 June 2026Monthly run 2026-06, series 10 of 10 answers, 0.0%, 95% interval 0.0 to 27.8None excluded
8 July 2026Scheduled run run-1, series 25 of 33 answers, 15.2%, 95% interval 6.7 to 30.92 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 27 of 35 answers, 20.0%, 95% interval 10.0 to 35.9None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 27 of 35 answers, 20.0%, 95% interval 10.0 to 35.9None excluded
No separable change against 12 June 2026.
12 August 2026Monthly run 2026-08, series 11 of 10 answers, 10.0%, 95% interval 1.8 to 40.4None excluded

By question type

Core category

Series 1: 10 questions, 4 engines, method 1.0. Series 2: 10 questions, 5 engines, method 1.1. Runs are compared only inside one series.

RunNamed0 to 100Excluded
15 January 2026Scheduled run run-kalvenor-001, series 124 of 117 answers, 20.5%, 95% interval 14.2 to 28.73 excluded
Method break: method 1.0 to method 1.1. Not compared.
12 May 2026Monthly run 2026-05, series 220 of 50 answers, 40.0%, 95% interval 27.6 to 53.8None excluded
Moved down against 12 May 2026: the two intervals do not overlap.
12 June 2026Monthly run 2026-06, series 23 of 50 answers, 6.0%, 95% interval 2.1 to 16.2None excluded
Moved up against 12 June 2026: the two intervals do not overlap.
8 July 2026Scheduled run run-1, series 215 of 48 answers, 31.3%, 95% interval 19.9 to 45.32 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 216 of 50 answers, 32.0%, 95% interval 20.8 to 45.8None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 216 of 49 answers, 32.7%, 95% interval 21.2 to 46.61 excluded
No separable change against 12 July 2026.
12 August 2026Monthly run 2026-08, series 27 of 50 answers, 14.0%, 95% interval 7.0 to 26.2None excluded

Buyer role

RunNamed0 to 100Excluded
8 July 2026Scheduled run run-1, series 113 of 49 answers, 26.5%, 95% interval 16.2 to 40.31 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 110 of 50 answers, 20.0%, 95% interval 11.2 to 33.0None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 110 of 49 answers, 20.4%, 95% interval 11.5 to 33.61 excluded

Use case and problem

RunNamed0 to 100Excluded
8 July 2026Scheduled run run-1, series 112 of 49 answers, 24.5%, 95% interval 14.6 to 38.11 excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 112 of 50 answers, 24.0%, 95% interval 14.3 to 37.4None excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 112 of 50 answers, 24.0%, 95% interval 14.3 to 37.4None excluded

Evaluation and pricing

RunNamed0 to 100Excluded
8 July 2026Scheduled run run-1, series 13 of 25 answers, 12.0%, 95% interval 4.2 to 30.0None excluded
No separable change against 8 July 2026.
10 July 2026Scheduled run run-2, series 12 of 24 answers, 8.3%, 95% interval 2.3 to 25.81 excluded
No separable change against 10 July 2026.
12 July 2026Scheduled run run-3, series 14 of 25 answers, 16.0%, 95% interval 6.4 to 34.7None excluded