DVPApplied Creative AI Engineering

Search this course

Search lesson and reference material.

↑ ↓ to choose · Enter to open · Esc to close

Mini-capstone 2

Artifact Lab

Five heuristic video-artifact metrics, calibrated against controlled defects, with every raw signal and threshold published so the scores can be argued with.

48 fixture clips5 metricsdataset cd3ea6eb505d
What this does not claim

These metrics are an independent Python reimplementation of the same ideas CineQC uses in the browser. They have not been run against a shared fixture set with CineQC, so no claim of numerical agreement is made here. Thresholds and normalisation constants differ, and the two will disagree on real footage.

Thresholds

Each threshold is the midpoint between the lowest-scoring clean clip and the highest-scoring clip carrying the defect that metric targets. Every metric is calibrated only against its own defect: scoring it against artifacts it never claims to detect would quietly turn a specific measurement into a vague one.

MetricTargetsThresholdWorst cleanBest defectMarginSeparated
flickerflicker72.05999.9344.18955.741yes
duplicate-ratioduplicate-stutter65.21810030.43569.565yes
color-driftcolor-drift59.89299.94119.84380.098yes
detail-collapsedetail-collapse65.00798.62531.38867.237yes
block-warpblock-warp56.88364.7349.03615.694yes

False positives

Per-clip measurements

Each tile shows the normalised score, the raw signal in the metric's own units, and the calibrated threshold. The metric a clip is meant to trip is marked target and carries the per-step signal behind its score.

scene-a-none none

flicker
99.9
raw 0.0141 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000306 · thr 59.892
detail-collapse
99.8
raw 0.00150 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883

scene-a-flicker flicker

flicker · target
37.4
raw 12.5 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.9
raw 0.0155 · thr 59.892
detail-collapse
79.2
raw 0.208 · thr 65.007
block-warp
76.2
raw 0.713 · thr 56.883

scene-a-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000306 · thr 59.892
detail-collapse
99.8
raw 0.00150 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883

scene-a-color-drift color-drift

flicker
99.7
raw 0.0686 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.8
raw 0.602 · thr 59.892
detail-collapse
94.5
raw 0.0545 · thr 65.007
block-warp
83.4
raw 0.499 · thr 56.883

scene-a-detail-collapse detail-collapse

flicker
99.9
raw 0.0141 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00154 · thr 59.892
detail-collapse · target
28.6
raw 0.714 · thr 65.007
block-warp
85.4
raw 0.438 · thr 56.883

scene-a-block-warp block-warp

flicker
99.9
raw 0.0154 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000321 · thr 59.892
detail-collapse
88.6
raw 0.114 · thr 65.007
block-warp · target
0.0
raw 3.60 · thr 56.883

scene-b-none none

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000797 · thr 59.892
detail-collapse
99.8
raw 0.00155 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883

scene-b-flicker flicker

flicker · target
33.9
raw 13.2 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.7
raw 0.0173 · thr 59.892
detail-collapse
79.2
raw 0.208 · thr 65.007
block-warp
71.0
raw 0.870 · thr 56.883

scene-b-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.0000797 · thr 59.892
detail-collapse
99.8
raw 0.00155 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883

scene-b-color-drift color-drift

flicker
97.4
raw 0.516 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
11.2
raw 0.666 · thr 59.892
detail-collapse
94.8
raw 0.0519 · thr 65.007
block-warp
80.6
raw 0.581 · thr 56.883

scene-b-detail-collapse detail-collapse

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000804 · thr 59.892
detail-collapse · target
28.9
raw 0.711 · thr 65.007
block-warp
82.1
raw 0.538 · thr 56.883

scene-b-block-warp block-warp

flicker
99.9
raw 0.0142 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000171 · thr 59.892
detail-collapse
86.1
raw 0.139 · thr 65.007
block-warp · target
0.0
raw 3.52 · thr 56.883

scene-c-none none

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
99.1
raw 0.00886 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883

scene-c-flicker flicker

flicker · target
23.1
raw 15.4 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
98.5
raw 0.0111 · thr 59.892
detail-collapse
78.2
raw 0.218 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883

scene-c-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
99.1
raw 0.00886 · thr 65.007
block-warp
94.8
raw 0.157 · thr 56.883

scene-c-color-drift color-drift

flicker
99.6
raw 0.0856 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
16.2
raw 0.628 · thr 59.892
detail-collapse
94.6
raw 0.0537 · thr 65.007
block-warp
93.3
raw 0.200 · thr 56.883

scene-c-detail-collapse detail-collapse

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.7
raw 0.00199 · thr 59.892
detail-collapse · target
29.7
raw 0.703 · thr 65.007
block-warp
96.6
raw 0.101 · thr 56.883

scene-c-block-warp block-warp

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000336 · thr 59.892
detail-collapse
87.4
raw 0.126 · thr 65.007
block-warp · target
0.0
raw 3.56 · thr 56.883

scene-d-none none

flicker
99.9
raw 0.0138 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000274 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
95.8
raw 0.127 · thr 56.883

scene-d-flicker flicker

flicker · target
19.3
raw 16.1 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.4
raw 0.0194 · thr 59.892
detail-collapse
78.8
raw 0.212 · thr 65.007
block-warp
95.6
raw 0.132 · thr 56.883

scene-d-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000274 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
95.8
raw 0.127 · thr 56.883

scene-d-color-drift color-drift

flicker
98.7
raw 0.254 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
15.1
raw 0.637 · thr 59.892
detail-collapse
94.3
raw 0.0572 · thr 65.007
block-warp
93.4
raw 0.198 · thr 56.883

scene-d-detail-collapse detail-collapse

flicker
99.9
raw 0.0144 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000425 · thr 59.892
detail-collapse · target
30.2
raw 0.698 · thr 65.007
block-warp
96.6
raw 0.101 · thr 56.883

scene-d-block-warp block-warp

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000320 · thr 59.892
detail-collapse
87.3
raw 0.127 · thr 65.007
block-warp · target
20.1
raw 2.40 · thr 56.883

scene-e-none none

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000159 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883

scene-e-flicker flicker

flicker · target
44.2
raw 11.2 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
97.9
raw 0.0159 · thr 59.892
detail-collapse
79.8
raw 0.202 · thr 65.007
block-warp
61.2
raw 1.17 · thr 56.883

scene-e-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0156 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.000159 · thr 59.892
detail-collapse
99.8
raw 0.00156 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883

scene-e-color-drift color-drift

flicker
99.4
raw 0.119 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.2
raw 0.606 · thr 59.892
detail-collapse
94.7
raw 0.0528 · thr 65.007
block-warp
62.4
raw 1.13 · thr 56.883

scene-e-detail-collapse detail-collapse

flicker
99.8
raw 0.0321 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00114 · thr 59.892
detail-collapse · target
29.2
raw 0.708 · thr 65.007
block-warp
74.3
raw 0.770 · thr 56.883

scene-e-block-warp block-warp

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.000164 · thr 59.892
detail-collapse
92.0
raw 0.0801 · thr 65.007
block-warp · target
49.0
raw 1.53 · thr 56.883

scene-f-none none

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000442 · thr 59.892
detail-collapse
98.6
raw 0.0138 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883

scene-f-flicker flicker

flicker · target
15.9
raw 16.8 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
95.9
raw 0.0305 · thr 59.892
detail-collapse
77.9
raw 0.221 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883

scene-f-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0157 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
99.9
raw 0.000442 · thr 59.892
detail-collapse
98.6
raw 0.0138 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883

scene-f-color-drift color-drift

flicker
99.7
raw 0.0575 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
19.8
raw 0.601 · thr 59.892
detail-collapse
94.7
raw 0.0526 · thr 65.007
block-warp
85.3
raw 0.442 · thr 56.883

scene-f-detail-collapse detail-collapse

flicker
99.9
raw 0.0198 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.6
raw 0.00281 · thr 59.892
detail-collapse · target
29.5
raw 0.705 · thr 65.007
block-warp
92.3
raw 0.232 · thr 56.883

scene-f-block-warp block-warp

flicker
99.9
raw 0.0142 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000549 · thr 59.892
detail-collapse
88.3
raw 0.117 · thr 65.007
block-warp · target
0.8
raw 2.98 · thr 56.883

scene-g-none none

flicker
99.9
raw 0.0140 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000391 · thr 59.892
detail-collapse
99.9
raw 0.00144 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883

scene-g-flicker flicker

flicker · target
20.2
raw 16.0 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
96.9
raw 0.0236 · thr 59.892
detail-collapse
78.6
raw 0.214 · thr 65.007
block-warp
72.6
raw 0.821 · thr 56.883

scene-g-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0159 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
99.9
raw 0.000391 · thr 59.892
detail-collapse
99.9
raw 0.00144 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883

scene-g-color-drift color-drift

flicker
98.1
raw 0.378 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
15.5
raw 0.634 · thr 59.892
detail-collapse
94.6
raw 0.0543 · thr 65.007
block-warp
73.3
raw 0.801 · thr 56.883

scene-g-detail-collapse detail-collapse

flicker
99.9
raw 0.0197 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.8
raw 0.00137 · thr 59.892
detail-collapse · target
29.2
raw 0.708 · thr 65.007
block-warp
78.5
raw 0.646 · thr 56.883

scene-g-block-warp block-warp

flicker
99.9
raw 0.0146 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000687 · thr 59.892
detail-collapse
86.3
raw 0.137 · thr 65.007
block-warp · target
20.5
raw 2.38 · thr 56.883

scene-h-none none

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000160 · thr 59.892
detail-collapse
99.8
raw 0.00165 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883

scene-h-flicker flicker

flicker · target
28.5
raw 14.3 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
98.5
raw 0.0110 · thr 59.892
detail-collapse
78.5
raw 0.215 · thr 65.007
block-warp
54.2
raw 1.38 · thr 56.883 · false positive

scene-h-duplicate-stutter duplicate-stutter

flicker
99.9
raw 0.0154 · thr 72.059
duplicate-ratio · target
30.4
raw 0.174 · thr 65.218
color-drift
100.0
raw 0.0000160 · thr 59.892
detail-collapse
99.8
raw 0.00165 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883

scene-h-color-drift color-drift

flicker
99.1
raw 0.176 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift · target
14.4
raw 0.642 · thr 59.892
detail-collapse
94.2
raw 0.0581 · thr 65.007
block-warp
63.4
raw 1.10 · thr 56.883

scene-h-detail-collapse detail-collapse

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
99.9
raw 0.000438 · thr 59.892
detail-collapse · target
31.4
raw 0.686 · thr 65.007
block-warp
64.7
raw 1.06 · thr 56.883

scene-h-block-warp block-warp

flicker
99.9
raw 0.0139 · thr 72.059
duplicate-ratio
100.0
raw 0.00 · thr 65.218
color-drift
100.0
raw 0.0000407 · thr 59.892
detail-collapse
88.3
raw 0.117 · thr 65.007
block-warp · target
0.0
raw 3.50 · thr 56.883