Have I seen this label before?

Photograph or upload a label, stamp or inscription from the back of an artwork and see the 20 most similar backs in the SKKG collection. Your photo never leaves your browser; the first search downloads the image model (about 174 MB, once).

How it works and its limits

The image model runs on your device; nothing is uploaded. The page only downloads the model (about 174 MB, once, then cached) and the search index (about 8 MB). On a phone, make the first search on Wi-Fi.

Your image is compared with 143,891 image windows on 872 backs of works in the SKKG collection (Winterthur). It is padded to a square with its mean colour, scaled to 224 px and embedded with DINOv2-base (Xenova/dinov2-base, fp16 ONNX, via transformers.js on WebAssembly; WebGPU is not used because its half-precision arithmetic changes the vectors too much). The 1,536-value vector is projected to 256 dimensions (PCA) and compared with 1-bit codes of every window. A back scores as its best-matching window; the thumbnail shows that window.

Only the coarse search runs here. On 197 test photos the correct back is first in 37% of searches, in the top 5 in 48% and in the top 20 in 59%. The full pipeline re-checks candidates with LightGlue keypoint matching, which lifts the first-place rate to 56%; that step does not run in the browser. Treat the results as candidates to look at, not as identifications.

When you check the hits, your decisions stay in this browser: download them when you are done (or before you leave) and put the file into the team's folder; they are merged with everyone else's.

Images: SKKG IIIF server. Collection records: digital.skkg.ch. GLAMhack 2026, challenge «Provenance Pursuit».

Your image

Optional: drag a box around the label to search only that part, or zoom in to draw it exactly. Tap without dragging to reset.

Help check the hits: mark a back as same label, not it or unsure; Redraw box draws the exact box around the label on that back, zoomable, also when it sits elsewhere on it.

Your decisions stay in this browser. Download them and put the file into the team's folder.