Skip to main content

Evidence

Evidence explorer

Historical source evidence (legacy, read-only): what each test measures, which GPUs it covers and how fresh it is. Upgrade decisions use UOS workload indices only; these records are not decision inputs. Results from different sources are never averaged together.

38 tests in Local AI inference. What the evidence labels mean

Evidence tests
TestDomain · workloadMetricGPUsFreshnessEvidenceLegacy admission
LocalScore · repo bd6ffe9 · pp16+tg1536LocalScoreLocal AI inferencepp16+tg1536prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp16+tg1536LocalScoreLocal AI inferencepp16+tg1536generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp16+tg1536LocalScoreLocal AI inferencepp16+tg1536ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp64+tg1024LocalScoreLocal AI inferencepp64+tg1024prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp64+tg1024LocalScoreLocal AI inferencepp64+tg1024generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp64+tg1024LocalScoreLocal AI inferencepp64+tg1024ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp384+tg1152LocalScoreLocal AI inferencepp384+tg1152prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp384+tg1152LocalScoreLocal AI inferencepp384+tg1152generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp384+tg1152LocalScoreLocal AI inferencepp384+tg1152ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg16LocalScoreLocal AI inferencepp1024+tg16prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg16LocalScoreLocal AI inferencepp1024+tg16generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg16LocalScoreLocal AI inferencepp1024+tg16ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg1024LocalScoreLocal AI inferencepp1024+tg1024prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg1024LocalScoreLocal AI inferencepp1024+tg1024generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1024+tg1024LocalScoreLocal AI inferencepp1024+tg1024ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1280+tg3072LocalScoreLocal AI inferencepp1280+tg3072prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1280+tg3072LocalScoreLocal AI inferencepp1280+tg3072generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp1280+tg3072LocalScoreLocal AI inferencepp1280+tg3072ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg256LocalScoreLocal AI inferencepp2048+tg256prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg256LocalScoreLocal AI inferencepp2048+tg256generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg256LocalScoreLocal AI inferencepp2048+tg256ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg768LocalScoreLocal AI inferencepp2048+tg768prompt tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg768LocalScoreLocal AI inferencepp2048+tg768generation tokens per second (tok/s)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp2048+tg768LocalScoreLocal AI inferencepp2048+tg768ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only
LocalScore · repo bd6ffe9 · pp4096+tg256LocalScoreLocal AI inferencepp4096+tg256ttft ms (ms)2Latest measurement Mar 19, 2025Standardized test — The same benchmark suite and version run on each GPU.Supporting only

Show all 38 tests

Local AI and GPU compute records measured by the UpgradeOrSave Bench Agent are listed per test. For run-level detail, open the benchmark console.