Mini-capstone 2 Artifact Lab Five heuristic video-artifact metrics, calibrated against controlled defects, with every raw signal and threshold published so the scores can be argued with.
48 fixture clips 5 metrics dataset cd3ea6eb505d
What this does not claim
These metrics are an independent Python reimplementation of the same ideas CineQC uses in the browser. They have not been run against a shared fixture set with CineQC, so no claim of numerical agreement is made here. Thresholds and normalisation constants differ, and the two will disagree on real footage.
Thresholds Each threshold is the midpoint between the lowest-scoring clean clip and the highest-scoring clip carrying the defect that metric targets. Every metric is calibrated only against its own defect: scoring it against artifacts it never claims to detect would quietly turn a specific measurement into a vague one.
False positives scene-h-flicker flagged by block-warp
Per-clip measurements Each tile shows the normalised score, the raw signal in the metric's own units, and the calibrated threshold. The metric a clip is meant to trip is marked target and carries the per-step signal behind its score.
scene-a-none none flicker
99.9
raw 0.0141 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000306 · thr 59.892
detail-collapse
99.8
raw 0.00150 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883
scene-a-flicker flicker flicker · target
37.4
raw 12.5 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.9
raw 0.0155 · thr 59.892
detail-collapse
79.2
raw 0.208 · thr 65.007
block-warp
76.2
raw 0.713 · thr 56.883
scene-a-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000306 · thr 59.892
detail-collapse
99.8
raw 0.00150 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883
scene-a-color-drift color-drift flicker
99.7
raw 0.0686 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.8
raw 0.602 · thr 59.892
detail-collapse
94.5
raw 0.0545 · thr 65.007
block-warp
83.4
raw 0.499 · thr 56.883
scene-a-detail-collapse detail-collapse flicker
99.9
raw 0.0141 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00154 · thr 59.892
detail-collapse · target
28.6
raw 0.714 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883
scene-a-block-warp block-warp flicker
99.9
raw 0.0154 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000321 · thr 59.892
detail-collapse
88.6
raw 0.114 · thr 65.007
block-warp · target
0.0
raw 3.60 · thr 56.883
scene-b-none none flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000797 · thr 59.892
detail-collapse
99.8
raw 0.00155 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883
scene-b-flicker flicker flicker · target
33.9
raw 13.2 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.7
raw 0.0173 · thr 59.892
detail-collapse
79.2
raw 0.208 · thr 65.007
block-warp
71.0
raw 0.870 · thr 56.883
scene-b-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.0000797 · thr 59.892
detail-collapse
99.8
raw 0.00155 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883
scene-b-color-drift color-drift flicker
97.4
raw 0.516 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
11.2
raw 0.666 · thr 59.892
detail-collapse
94.8
raw 0.0519 · thr 65.007
block-warp
80.6
raw 0.581 · thr 56.883
scene-b-detail-collapse detail-collapse flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000804 · thr 59.892
detail-collapse · target
28.9
raw 0.711 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883
scene-b-block-warp block-warp flicker
99.9
raw 0.0142 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000171 · thr 59.892
detail-collapse
86.1
raw 0.139 · thr 65.007
block-warp · target
0.0
raw 3.52 · thr 56.883
scene-c-none none flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
99.1
raw 0.00886 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883
scene-c-flicker flicker flicker · target
23.1
raw 15.4 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
98.5
raw 0.0111 · thr 59.892
detail-collapse
78.2
raw 0.218 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883
scene-c-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
99.1
raw 0.00886 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883
scene-c-color-drift color-drift flicker
99.6
raw 0.0856 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
16.2
raw 0.628 · thr 59.892
detail-collapse
94.6
raw 0.0537 · thr 65.007
block-warp
93.3
raw 0.200 · thr 56.883
scene-c-detail-collapse detail-collapse flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.7
raw 0.00199 · thr 59.892
detail-collapse · target
29.7
raw 0.703 · thr 65.007
block-warp
96.6
raw 0.101 · thr 56.883
scene-c-block-warp block-warp flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
87.4
raw 0.126 · thr 65.007
block-warp · target
0.0
raw 3.56 · thr 56.883
scene-d-none none flicker
99.9
raw 0.0138 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000274 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
95.8
raw 0.127 · thr 56.883
scene-d-flicker flicker flicker · target
19.3
raw 16.1 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.4
raw 0.0194 · thr 59.892
detail-collapse
78.8
raw 0.212 · thr 65.007
block-warp
95.6
raw 0.132 · thr 56.883
scene-d-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000274 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
95.8
raw 0.127 · thr 56.883
scene-d-color-drift color-drift flicker
98.7
raw 0.254 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
15.1
raw 0.637 · thr 59.892
detail-collapse
94.3
raw 0.0572 · thr 65.007
block-warp
93.4
raw 0.198 · thr 56.883
scene-d-detail-collapse detail-collapse flicker
99.9
raw 0.0144 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000425 · thr 59.892
detail-collapse · target
30.2
raw 0.698 · thr 65.007
block-warp
96.6
raw 0.101 · thr 56.883
scene-d-block-warp block-warp flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000320 · thr 59.892
detail-collapse
87.3
raw 0.127 · thr 65.007
block-warp · target
20.1
raw 2.40 · thr 56.883
scene-e-none none flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000159 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883
scene-e-flicker flicker flicker · target
44.2
raw 11.2 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.9
raw 0.0159 · thr 59.892
detail-collapse
79.8
raw 0.202 · thr 65.007
block-warp
61.2
raw 1.17 · thr 56.883
scene-e-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0156 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000159 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883
scene-e-color-drift color-drift flicker
99.4
raw 0.119 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.2
raw 0.606 · thr 59.892
detail-collapse
94.7
raw 0.0528 · thr 65.007
block-warp
62.4
raw 1.13 · thr 56.883
scene-e-detail-collapse detail-collapse flicker
99.8
raw 0.0321 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00114 · thr 59.892
detail-collapse · target
29.2
raw 0.708 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883
scene-e-block-warp block-warp flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000164 · thr 59.892
detail-collapse
92.0
raw 0.0801 · thr 65.007
block-warp · target
49.0
raw 1.53 · thr 56.883
scene-f-none none flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000442 · thr 59.892
detail-collapse
98.6
raw 0.0138 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883
scene-f-flicker flicker flicker · target
15.9
raw 16.8 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
95.9
raw 0.0305 · thr 59.892
detail-collapse
77.9
raw 0.221 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883
scene-f-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
99.9
raw 0.000442 · thr 59.892
detail-collapse
98.6
raw 0.0138 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883
scene-f-color-drift color-drift flicker
99.7
raw 0.0575 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.8
raw 0.601 · thr 59.892
detail-collapse
94.7
raw 0.0526 · thr 65.007
block-warp
85.3
raw 0.442 · thr 56.883
scene-f-detail-collapse detail-collapse flicker
99.9
raw 0.0198 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.6
raw 0.00281 · thr 59.892
detail-collapse · target
29.5
raw 0.705 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883
scene-f-block-warp block-warp flicker
99.9
raw 0.0142 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000549 · thr 59.892
detail-collapse
88.3
raw 0.117 · thr 65.007
block-warp · target
0.8
raw 2.98 · thr 56.883
scene-g-none none flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000391 · thr 59.892
detail-collapse
99.9
raw 0.00144 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883
scene-g-flicker flicker flicker · target
20.2
raw 16.0 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
96.9
raw 0.0236 · thr 59.892
detail-collapse
78.6
raw 0.214 · thr 65.007
block-warp
72.6
raw 0.821 · thr 56.883
scene-g-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
99.9
raw 0.000391 · thr 59.892
detail-collapse
99.9
raw 0.00144 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883
scene-g-color-drift color-drift flicker
98.1
raw 0.378 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
15.5
raw 0.634 · thr 59.892
detail-collapse
94.6
raw 0.0543 · thr 65.007
block-warp
73.3
raw 0.801 · thr 56.883
scene-g-detail-collapse detail-collapse flicker
99.9
raw 0.0197 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00137 · thr 59.892
detail-collapse · target
29.2
raw 0.708 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883
scene-g-block-warp block-warp flicker
99.9
raw 0.0146 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000687 · thr 59.892
detail-collapse
86.3
raw 0.137 · thr 65.007
block-warp · target
20.5
raw 2.38 · thr 56.883
scene-h-none none flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000160 · thr 59.892
detail-collapse
99.8
raw 0.00165 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883
scene-h-flicker flicker flicker · target
28.5
raw 14.3 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
98.5
raw 0.0110 · thr 59.892
detail-collapse
78.5
raw 0.215 · thr 65.007
block-warp
54.2
raw 1.38 · thr 56.883 · false positive
scene-h-duplicate-stutter duplicate-stutter flicker
99.9
raw 0.0154 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.0000160 · thr 59.892
detail-collapse
99.8
raw 0.00165 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883
scene-h-color-drift color-drift flicker
99.1
raw 0.176 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
14.4
raw 0.642 · thr 59.892
detail-collapse
94.2
raw 0.0581 · thr 65.007
block-warp
63.4
raw 1.10 · thr 56.883
scene-h-detail-collapse detail-collapse flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000438 · thr 59.892
detail-collapse · target
31.4
raw 0.686 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883
scene-h-block-warp block-warp flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000407 · thr 59.892
detail-collapse
88.3
raw 0.117 · thr 65.007
block-warp · target
0.0
raw 3.50 · thr 56.883
← Track dashboard Milestone 6 · CineQC baseline →