Choose measures¶
There is no universally best projection-quality score. Start from the scientific structure you need to preserve, then use complementary measures rather than selecting only the most favorable result.
Match the question to a measure family¶
| Question | Useful starting points | What they emphasize |
|---|---|---|
| Are local neighbors preserved? | T&C, MRRE, LCMC | Missing and false neighbors or neighborhood overlap |
| Are labels or classes visually coherent? | Neighborhood Hit, DSC, class-aware T&C, label T&C, CADI | Separation, mixing, and class-relative distortions |
| Are pairwise distances preserved? | Stress, scale-normalized stress, Pearson | Magnitude or linear association of distances |
| Is the ordering of distances preserved? | Spearman, non-metric stress | Monotonic rather than metric agreement |
| Are density patterns preserved? | DTM, KL divergence | Changes in local density estimates |
| Is local topology preserved? | Topographic Product, Procrustes | Neighborhood ordering or locally aligned geometry |
| Do apparent empty regions represent real separation? | Gap Index | Empty triangular regions in a 2D projection |
| Are cluster structures stable without labels? | Steadiness & Cohesiveness | False and missing groups discovered through random walks |
The measure reference lists exact IDs, parameters, ranges, optimum directions, return keys, and original literature.
A practical baseline¶
For an unlabeled two-dimensional projection, a useful first pass combines one local, one global, and one structural measure:
specs = [
{"id": "tnc", "params": {"k": 20}},
{"id": "stress", "params": {}},
{"id": "gi", "params": {"metric": "euclidean"}},
]
This is not a universal prescription. Change k, add scale-aware or
class-aware measures, and validate that the selected definition matches the
claim you intend to make.
Interpret scores carefully¶
- Some measures are maximized at 1; others are minimized at 0.
kdefines the neighborhood scale. Report it with the score and, when possible, examine more than one scientifically meaningful scale.- Label-based visual-quality measures assume that the labels describe meaningful structure in the original space. A visually separated projection is not automatically faithful if those labels overlap before projection.
- Scores from different measures do not share a common unit. Do not average them without a justified model.
- A faster backend or
float32changes execution characteristics, not the published definition, but floating-point tolerances can differ by dtype.
Reproducibility checklist¶
Record the ZADU version, measure IDs, all non-default parameters, preprocessing, sample selection, backend/device/dtype, and whether local or global scores were used. For randomized measures such as S&C or sampled CADI, also set and report the seed.