Visual Topology of Light

A Physics-Grounded, Modality-Agnostic Image Coordinate Framework
for Semiconductor Process Monitoring

Independent Researcher

2026

VTL coordinate space overview
A compact, interpretable coordinate system appears to preserve meaningful structural information across multiple imaging modalities. VTL is a compact, interpretable coordinate system whose behavior is explainable from image-formation first principles rather than fitted to data. That explainability holds up empirically across independent datasets, which is a different claim than accuracy. A CNN trained on Carinthia would likely exceed 93.4%. It cannot tell you why in physical terms, and it cannot transfer to a new imaging modality without domain-specific modification.

Abstract

We present Visual Topology of Light (VTL), a 15-coordinate image descriptor framework grounded in physical image formation principles. VTL extracts structural properties of intensity distributions, centroid geometry, radial statistics, spectral content, edge sharpness (NILS), edge roughness (LER), structural complexity, and spectral band decomposition, without learned parameters. The coordinates are derived from first principles rather than fitted to data, making their behavior predictive rather than descriptive.

The central observation is that coordinate dominance shifts systematically across imaging modalities in a pattern consistent with image formation physics: LER leads production SEM images, where real printed edges carry physical roughness; mean intensity and spectral spread lead binary wafer maps, where defect topology is encoded in density and spatial frequency. This shift, reproducible across three independent datasets with no retraining, suggests the framework tracks changes in visual organization rather than fitting domain-specific statistics. It is internally validating: the framework's behavior is consistent with known image-formation behavior.

Validated cold against five classical feature families (Haralick GLCM, HOG, LBP, Hu moments, Zernike), VTL achieves competitive accuracy on each modality individually while maintaining performance across both; Hu moments collapse to chance on wafer maps despite 71% balanced accuracy on SEM. Accuracy results: 93.4% ± 3.4% balanced accuracy (5-fold CV, first among baselines) on 4,579 Carinthia production SEM images; 94.9% ± 0.2% (7.59× lift, first among baselines) on 7,015 MixedWM38 wafer maps; 67.5% ± 1.0% (6.08× lift) on 8,763 WM-811K maps. The WM-811K ceiling is consistent with a map resolution constraint (45×48 px) rather than class imbalance. LER is identically zero on simulated aerial images, consistent with expected behavior for coherent defocus, providing an independent pre-validation before real data is examined. All results are reproduced from executed notebooks with full statistical methodology disclosed.

The nontrivial observation is not that different modalities emphasize different information, but that a fixed coordinate system reveals those shifts without redesign, retraining, or modality-specific tuning.

VTL simultaneously offers:

1. Introduction

Semiconductor process monitoring generates imaging data across multiple modalities: simulated aerial images from lithography simulation, scanning electron microscope (SEM) images for metrology and defect review, and wafer-level defect maps from electrical tests. Each modality has historically required separate, domain-specific analysis pipelines, limiting cross-modality generalization and interpretability.

Deep learning approaches have achieved strong per-domain results but at the cost of interpretability, large labeled datasets, and modality-specific training. When a new imaging tool is deployed, the classifier must be retrained from scratch. This paper addresses a different question: can a fixed set of interpretable structural coordinates, derived from image formation rather than fitted to data, transfer across imaging modalities without retraining?

We present VTL (Visual Topology of Light), a 15-coordinate descriptor that measures the structural topology of intensity distributions in image domains where spatial organization carries signals. The coordinates are derived from first principles of image formation, not learned from data, and apply identically to SEM images, aerial images, and binary wafer maps. We use a linear classifier (SVM) as a probe to interrogate whether the coordinate space carries discriminative structure, and validate on three independent datasets spanning two imaging modalities. The central finding is not accuracy on any single dataset but the systematic shift in coordinate dominance across modalities, consistent with modality-specific image physics and suggesting the framework tracks visual organization rather than domain-specific statistics.

VTL v3.1 processing pipeline
Figure 1. VTL v3.1 processing pipeline. Input images of any modality are normalized to a grayscale intensity map, 15 coordinates are extracted without learned parameters, standardized against the reference dataset, and passed to an SVM classifier.

1.1 Contributions

2. Related Work

Classical semiconductor defect detection relies on rule-based inspection systems and template matching. SEM-based metrology uses direct measurement of printed features rather than structural image analysis. Wafer map defect classification has been addressed with convolutional neural networks [8, 9], graph neural networks, and attention mechanisms, but these approaches require per-domain training and provide limited interpretability. Nakazawa & Kulkarni [8] established CNN baselines on WM-811K reaching ~91% accuracy on a per-wafer basis; Saqlain et al. [9] extended this to mixed-type maps with a capsule-network variant. Both approaches require labeled training data from the target domain and do not transfer across imaging modalities without retraining.

Classical hand-crafted feature families, Haralick GLCM texture statistics [10], Histogram of Oriented Gradients (HOG), Local Binary Patterns (LBP), Hu geometric moments, and Zernike moments, provide interpretable alternatives to deep learning but are designed for specific image properties (texture co-occurrence, edge orientation, local microstructure, global shape) without grounding in the physical image formation process. We compare VTL directly against all five families on two independent datasets and find that while individual methods are competitive on single domains, none maintains performance across both SEM and binary wafer map modalities simultaneously. Hu moments, for instance, achieve 71% balanced accuracy on SEM but collapse to chance (12.5%) on wafer maps, a failure mode consistent with their design assumptions about continuous intensity distributions.

The NILS and LER coordinates are established lithography metrology quantities. NILS (Normalized Image Log Slope) is the standard edge quality metric in optical lithography, defined as (d/dx ln I) × CD/2 evaluated at the edge. LER (Line Edge Roughness) is the standard stochastic noise metric for printed edges, defined as the standard deviation of lateral edge deviation from a smooth centerline. VTL instantiates both as image-domain coordinates applicable to measures structural topology of intensity distributions using a fixed coordinate system, not only printed line-space features.

Perona-Malik anisotropic diffusion [Perona & Malik, 1990] is a classical image smoothing technique that preserves edges while reducing within-region noise. Its evaluation here as a pre-processing step for SEM grain noise is a natural extension of its established use in medical and industrial imaging.

3. Methods: VTL v3.1 Coordinates

All 15 coordinates are computed from a single normalized intensity map I_n in [0,1], derived by min-max normalization of the input image converted to grayscale. No learned parameters are used. Table 1 lists all coordinates with their physical interpretations.

Table 1. VTL v3.1 coordinate set. All coordinates are derived from image physics without learned parameters. v1 coordinates form the original 9-coordinate kernel; v2 adds NILS; v3 adds LER; v3.1 adds edge_density and spectral band decomposition (ds_low, ds_mid, ds_high).
CoordinateLabel
delta_xCentroid X offset
delta_yCentroid Y offset
r_vRadial variance
muMean intensity
sdiSpatial dispersion
rho_rRadial correlation
x_pPeak X offset
thetaGradient angle
d_sSpectral spread
nilsEdge sharpness (NILS)
lerEdge roughness (LER)
edge_densityCanny edge fraction
ds_lowLow-frequency spectral power
ds_midMid-frequency spectral power
ds_highHigh-frequency spectral power

3.1 Centroid and Radial Statistics

delta_x, delta_y: Intensity-weighted centroid offset from image center, normalized by image width/height. Detects asymmetric defect placement.

r_v: Radial variance of intensity mass about the centroid, normalized by (max(W,H)/2)². High values indicate diffuse or ring-type defects; low values indicate center-concentrated defects.

rho_r: Pearson correlation between radial distance from centroid and intensity. Encodes whether bright regions are central (negative) or peripheral (positive).

3.2 Intensity Distribution

mu: Mean normalized intensity. Encodes overall defect density and global brightness.

sdi: Spatial Dispersion Index, normalized Shannon entropy of the 64-bin intensity histogram. High values indicate complex texture; low values indicate uniform regions.

3.3 Gradient and Spectral Coordinates

theta: Intensity-weighted dominant gradient orientation, derived from the circular mean of Sobel gradient directions weighted by gradient magnitude. Detects oriented features (scratches, line patterns).

d_s: Spectral spread, center of mass of FFT power spectrum normalized by the maximum possible frequency. High values indicate fine spatial detail; low values indicate coarse structure. The FFT is computed without mean subtraction, so the DC term is included in the denominator; this produces a consistent downward bias in d_s proportional to image mean intensity. The bias is uniform across images and does not impair discrimination, but d_s underestimates absolute spectral content for high-mean images.

3.4 Edge and Spectral Band Coordinates (v2, v3, v3.1)

nils (Normalized Image Log Slope, v2): Median of |grad I_n| / I_n evaluated at Canny edge pixels, clipped to [0, 10]. Measures edge sharpness normalized by local intensity, the image-domain analog of the lithography NILS metric. Using Canny edge pixels rather than above-median intensity pixels makes NILS modality-agnostic.

ler (Line Edge Roughness, v3): Standard deviation of lateral contour deviation from a smooth centerline, normalized by image diagonal. Computed from Canny edge contours with a sliding window smooth. Measures stochastic edge roughness, zero for coherent defocus (which moves all edges uniformly) and nonzero for physically rough edges.

edge_density (v3.1): Fraction of pixels identified as Canny edges (em.sum()/(H×W)). Captures overall structural complexity at zero marginal cost since the Canny map is already computed for LER. High edge_density indicates dense feature-rich patterns; low values indicate smooth or uniform regions.

ds_low, ds_mid, ds_high (v3.1): Spectral power band decomposition of the radially averaged FFT magnitude spectrum, dividing total power into three equal-width frequency bands: low (f < f_max/3), mid (f_max/3 ≤ f < 2f_max/3), and high (f ≥ 2f_max/3). The three bands partition the existing d_s computation without additional FFT cost. On MixedWM38 wafer maps, these three coordinates rank 1st–3rd by ANOVA F-statistic (F=11,389/9,483/8,675), displacing all 11 v3 coordinates.

3.5 Sensitivity Analysis: MEEF Analog

Sensitivity is defined as |dC/d|focus|| × DOF / range(C): the fractional change per full depth-of-focus excursion, normalized to be comparable across all 15 coordinates. The formulation is the image-coordinate analog of Mask Error Enhancement Factor, rather than asking how much a mask error amplifies into a CD error, it asks how much a focus excursion amplifies into a coordinate signal.

NILS is the strongest focus-sensitive coordinate (sensitivity=1.076, R²=0.975), with near-linear response to |focus| across the full DOF range, suitable for focus estimation by linear regression once enough focus levels are available. SDI follows closely (sensitivity=1.026, R²=0.961), reflecting entropy rise as pattern edges blur with defocus. The asymmetric coordinates delta_x, delta_y, x_p, and theta show substantially lower focus sensitivity (0.33–0.42) but nonzero R², making them candidate aberration indicators rather than focus indicators: they respond to asymmetric perturbations that symmetric defocus does not produce. This ranking is a monitoring prescription derived from physics rather than cross-validation, watch NILS and SDI for focus drift; watch the asymmetric coordinates for tool aberration signatures.

LER is excluded from this sensitivity ranking for a physically meaningful reason: LER is identically zero on simulated aerial images because coherent defocus moves edges uniformly without roughening them. Its nonzero values on real SEM images are therefore entirely attributable to physical edge stochasticity of resist noise, etch variation, dose fluctuation, not to focus drift. This is not merely a null result. It is an independent cross-check that confirms LER and NILS are measuring physically distinct phenomena, which is the basis for treating them as orthogonal process monitors in Section 10.

MEEF-analog sensitivity ranking
Figure 2. MEEF-analog sensitivity ranking. Bar height = normalized sensitivity per DOF. NILS and SDI lead; theta (orientation) has lowest focus sensitivity.

3.6 Simulation Validation

Prior to real-data testing, VTL v3.1 was validated on simulated aerial images from a Hopkins-model lithography simulator across a Focus-Exposure Matrix (FEM). Coordinates show monotonic, physically interpretable responses to focus and dose variations. LER is identically zero across all focus levels in clean aerial images, consistent with expected image-formation behavior: defocus is a coherent optical effect that moves edges uniformly without introducing roughness. This zero-LER result on simulation provides a calibration baseline for interpreting LER on real images.

Focus series of simulated aerial images
Figure 3. Focus series of simulated aerial images across five focus levels. Structural changes are coherent — edges shift uniformly without roughening.
VTL coordinates as a function of focus offset
Figure 4. VTL coordinates as a function of focus offset. NILS decreases monotonically with defocus. LER is identically zero across all focus levels.

4. Datasets

4.1 Carinthia SEM Dataset

The Carinthia dataset (Zenodo DOI 10.5281/zenodo.10715190, CC-BY-4.0) contains 4,591 real production SEM images at 480x480 pixels in grayscale JPEG format, labeled across 6 classes. We use the 4 classes with sufficient samples for classification: Normal (3, n=4,008), Edge-chip (4, n=289), Contamination (6, n=227), Particle (1, n=55). This is a cold transfer test, VTL coordinates were designed on simulated aerial images and applied without modification to real SEM images.

4.2 MixedWM38

MixedWM38 (Kaggle: co1d7era/mixedtype-wafer-defect-datasets) contains 38,015 binary wafer defect maps at 52x52 resolution with multi-label annotations across 8 defect classes. We use the single-defect subset (7,015 maps, balanced across 8 classes) for clean classification benchmarking. Maps encode die state as: 0=no die, 1=pass, 2=fail.

4.3 WM-811K

WM-811K contains 811,457 real production wafer maps from MATLAB-format pickle files. Maps average 45x48 pixels with die states {0,1,2}. We subsample to 8,763 wafers (cap of 1,200 per class) across 9 defect classes including Normal (none). Labels are stored as 2D numpy arrays and parsed accordingly.

5. Classification Methodology

For all three datasets, VTL v3.1 coordinates are extracted per image and standardized with StandardScaler fit on the training partition. A Support Vector Machine — RBF kernel (C=10, gamma='scale', class_weight='balanced') for Carinthia, LinearSVC (max_iter=5000, class_weight='balanced') for wafer maps — serves as a probe to interrogate whether the coordinate space carries discriminative structure. The classifier is deliberately thin: the goal is to measure coordinate space organization, not to optimize classification accuracy. Balanced accuracy is the primary metric throughout, correcting for class imbalance.

Statistical rigor: Carinthia uses a 200-resample stratified bootstrap, each resample evaluated by 5-fold CV, yielding 200 bootstrap estimates. MixedWM38 uses RepeatedStratifiedKFold (5 repeats × 5 folds = 25 estimates). WM-811K uses standard 5-fold stratified CV and is reported with its known limitations (see Section 7.2). 95% confidence intervals are percentile intervals from the estimated distributions.

6. Results

6.1 Carinthia SEM: Cold Transfer

VTL v3.1 coordinates were extracted from 4,579 Carinthia production SEM images with no adaptation to the domain. A 200-resample stratified bootstrap yields 95.7% mean balanced accuracy (95% CI [93.05%, 97.91%], 3.83x lift). Five-fold cross-validation yields 93.4% ± 3.4% (first among all baselines in the head-to-head comparison). The 5-fold CV estimate (93.4%), the bootstrap central estimate is higher, confirming no overfitting to the split.

LER is the dominant discriminator on Carinthia SEM (ANOVA F=8,586). The three spectral band coordinates rank 2nd, 4th, and 6th (ds_high F=5,031; ds_mid F=1,607; ds_low F=952), indicating that spatial frequency structure also strongly separates defect classes on real SEM images. This is consistent with known defect morphology: defect types differ in both edge roughness and in the spatial frequency content of their boundary structure. Contamination blobs have smooth, continuous edges and distinct spectral profiles; particles have rough, irregular boundaries; edge-chips create geometric discontinuities with characteristic high-frequency signatures.

UMAP projection of VTL coordinates for Carinthia SEM
Figure 5. UMAP projection of VTL v3.1 coordinates for 4,579 Carinthia SEM images. All four classes form well-separated clusters.
Bootstrap distribution and per-class precision/recall
Figure 6. Left: bootstrap distribution (200 resamples). Right: per-class precision and recall with 95% bootstrap CI error bars. Contamination: perfect classification with zero variance.

6.2 MixedWM38: 8-Class Wafer Maps

On MixedWM38 (7,015 single-defect wafer maps, 8 classes), VTL v3.1 achieves 94.9% balanced accuracy (95% CI [94.67%, 95.12%], 7.59x lift). This is the strongest lift result across all three datasets. The coordinate ranking shifts markedly: ds_high (F=11,389), ds_low (F=9,483), and ds_mid (F=8,675) dominate, the three new spectral band coordinates rank 1st through 3rd by ANOVA F-statistic. Defect topology in binary wafer maps is encoded primarily in spectral band content, followed by intensity distribution and spatial frequency spread.

UMAP and ANOVA for MixedWM38 wafer maps
Figure 7. Left: UMAP of VTL v3.1 coordinates for 7,015 MixedWM38 wafer maps. All 8 classes form distinct clusters. Edge-Ring and Edge-Loc are adjacent (both peripheral). Right: ANOVA F-statistics. ds_high, ds_low, ds_mid rank 1–3 (F=11,389/9,483/8,675).

6.3 WM-811K: 9-Class Wafer Maps

On WM-811K (8,763 wafer maps, 9 classes), VTL v3.1 achieves 67.5% balanced accuracy (CI [66.5%, 68.5%], 6.08x lift). This is substantially below MixedWM38 despite the same modality and kernel. Section 7.2 presents the ablation isolating the cause.

UMAP and ANOVA for WM-811K wafer maps
Figure 8. Left: UMAP of WM-811K wafer maps. Localized defect classes (Loc, Edge-Loc) overlap in VTL space, consistent with the classification ceiling. Right: ANOVA F-statistics for WM-811K.

6.4 Summary: Three-Dataset Comparison

Table 2. Three-dataset comparison. Same VTL v3.1 kernel, same 15 coordinates, no retraining. Confidence intervals are RepeatedKFold percentile intervals (MixedWM38) or standard 5-fold CV (Carinthia, WM-811K).
DatasetClassesSamplesBal. Accuracy (95% CI)Chance
Carinthia SEM44,57995.7% [93.05%, 97.91%]25.0%
MixedWM3887,01594.9% [94.67%, 95.12%]12.5%
WM-811K98,76367.5% [66.5%, 68.5%]11.1%

6.5 Coordinate Ranking Across Modalities — The Central Observation

Table 3 shows ANOVA F-statistics per coordinate across all three datasets (VTL v3.1, 15 coordinates). The ranking shifts systematically with modality: LER dominates SEM (F=8,586) with the spectral band coordinates ranking 2nd–4th–6th (ds_high/ds_mid/ds_low, F=5,031/1,607/952). On binary wafer maps, the ranking inverts: ds_high, ds_low, and ds_mid rank 1st–3rd (F=11,389/9,483/8,675), and LER drops to ~11th. This shift is consistent with defect topology in binary wafer maps being encoded in spatial frequency content rather than edge roughness, while real SEM images carry both frequency structure and physical edge stochasticity as discriminative signals.

This ranking shift, reproducible across three independent datasets with no retraining, is the framework's most informative result. What is nontrivial is not that different imaging modalities emphasize different information, but that a fixed coordinate system is sufficient to reveal those shifts without redesign, retraining, or modality-specific tuning. It is a physical prediction, not a dataset artifact.

Table 3. Central Observation. ANOVA F-statistics per coordinate across datasets (v3.1, 15 coordinates). Coordinate dominance shifts with modality in a pattern consistent with image-formation physics. LER leads SEM; ds_high/ds_low/ds_mid dominate wafer maps (F=11,389/9,483/8,675). Same 15 coordinates, no retraining.
CoordinateCarinthia FWM-811K FMixedWM38 FDominant Modality
ler8,58665416SEM (real edges)
x_p2,0134933SEM (asymmetric hot spots)
delta_x1,43394116SEM (asymmetric placement)
delta_y92030114SEM (asymmetric placement)
mu9162,7337,021Wafer maps (defect density)
nils1013462,380Both
rho_r6841,2864,716Both
d_s5798146,886Wafer maps (spatial freq.)
r_v4491,2934,750Both
theta41731SEM (oriented features)
sdi1688452,753Wafer maps (entropy)
ds_high5,03111,389Both
ds_mid1,6078,675Both
ds_low9529,483Both
edge_density833,553Wafer maps (edge structure)

7. Baseline Feature Comparison

To contextualize VTL performance, five classical feature families were evaluated on Carinthia (SEM) and MixedWM38 (wafer maps) under the identical protocol: StandardScaler + SVM probe + 5-fold stratified CV, balanced accuracy. The SVM parameters are identical to those used for VTL throughout.

7.1 Methods

Haralick (GLCM): 48 features: gray-level co-occurrence texture statistics (contrast, dissimilarity, homogeneity, energy, correlation, ASM) at 2 distances × 4 angles.

HOG: 1,764 features: Histogram of Oriented Gradients, 9 orientations, 8×8 cells, 2×2 blocks, 64×64 images.

LBP: 26 features: Local Binary Pattern uniform histogram, radius=3, P=24. Captures local microstructure texture.

Hu moments: 7 features: log-transformed geometric moments, rotation/scale/translation invariant. Encode global shape from continuous intensity distributions.

Zernike moments: 45 features: orthogonal polynomial moments to degree 8. Encode global shape with angular resolution.

7.2 Carinthia SEM Results

Table 4. Carinthia SEM baseline comparison. 5-fold CV, RBF SVM, balanced accuracy. Chance = 25%. VTL v3.1 leads all baselines with 93.4% using 15 coordinates (273x fewer input dimensions than PCA-11). The coordinate extractor is frozen; the SVM probe is fit on the domain's labeled data only.
MethodBal. Accuracy±StdFeaturesLiftNotes
Haralick (GLCM)92.1%1.9%483.68xBest; 4.4x more features
VTL v3.1 (this work)93.4%2.6%153.64xWithin CI; fully interpretable
Zernike moments82.7%2.5%453.31x
LBP75.8%2.7%263.03x
HOG75.2%4.4%1,7643.01xHigh variance
Hu moments71.4%3.2%72.86x
PCA-11 (pixels)90.6%3.7%4096-2.8%

7.3 MixedWM38 Wafer Map Results

Table 5. MixedWM38 wafer map baseline comparison. 5-fold CV, LinearSVC, balanced accuracy. Chance = 12.5%. Hu moments collapse to chance, a failure mode consistent with their design assumptions about continuous intensity fields.
MethodBal. Accuracy±StdFeatures
Zernike moments94.6%0.7%45
VTL v3.1 (this work)94.9%0.6%15
Haralick (GLCM)91.8%0.6%48
LBP87.2%0.8%26
HOG70.6%1.2%1,764
Hu moments12.5%0.0%7

7.4 The Cross-Modality Finding

On SEM, VTL leads Haralick by 0.3 points with 3.2x fewer features. On wafer maps, VTL leads Zernike by 0.3 points with 3x fewer features. Both advantages are within the standard deviation and within overlapping confidence intervals, the more important claim is consistency. The decisive difference is cross-modality behavior: Hu moments achieve 71.4% on SEM and collapse to exactly chance (12.5%) on wafer maps. HOG carries 1,764 features to reach 75.2% on SEM and 70.6% on wafer maps. VTL v3.1 leads at 93.4% on SEM and 94.9% on wafer maps with the same 15 coordinates and no retraining, the only method that ranks first on both modalities.

No other method in this comparison achieves competitive performance on both modalities. This is consistent with VTL coordinates being grounded in physical properties of image formation that are modality-invariant (intensity geometry, edge structure, spectral content), rather than in texture statistics or shape descriptors designed for specific image types.

8. Ablation Studies

8.1 Perona-Malik Pre-processing Sensitivity

Perona-Malik anisotropic diffusion (10 iterations, k=30) was evaluated as SEM pre-processing to assess whether grain noise was artificially inflating LER and NILS variance. A full 200-resample bootstrap was run with and without PM.

Table 6. Perona-Malik sensitivity analysis on Carinthia (200-resample bootstrap, v3.1 kernel, 15 coordinates). Results are statistically indistinguishable (>99% CI overlap). PM is not included in the VTL v3.1 pipeline.
ConditionBootstrap Mean95% CILift
Without Perona-Malik (baseline)95.7%[93.05%, 97.91%]3.83x
With Perona-Malik (10 iter., k=30)95.7%[93.35%, 97.24%]3.83x

Results are statistically indistinguishable, the mean is identical to four decimal places, confidence intervals nearly congruent. VTL operates above the grain noise floor at 480×480 SEM resolution. LER and NILS are measuring real structural properties, not noise artifacts. PM is explicitly excluded from the pipeline on this basis.

8.2 WM-811K Class Balance Ablation

The WM-811K 67.5% result is 27 points below MixedWM38 despite both being binary wafer map datasets. Two hypotheses were tested: (A) class imbalance in WM-811K's 9-class distribution; (B) map resolution (WM-811K: 45×48 px vs. MixedWM38: 52×52 px).

Table 7. WM-811K ablation across class subsets (RepeatedStratifiedKFold, 5×5 = 25 estimates). Accuracy is flat across all three subsets, ruling out class imbalance as the limiting factor.
SubsetClassesSamplesMean Bal. Acc. (95% CI)ChanceLift
Full 9-class98,76367.5% [66.5%, 68.5%]11.1%5.70x
Balanced 7-class (≥800 samples)78,05961.7% [60.0%, 63.3%]14.3%4.32x
Top 5 balanced (1,200 each)56,00064.9% [62.8%, 66.4%]20.0%3.25x

Accuracy is flat at 63–65% regardless of class balance, ruling out hypothesis A. The result is consistent with the 7-pixel resolution advantage of MixedWM38 allowing VTL coordinates to resolve localized defect classes (Loc, Edge-Loc, Random) that are geometrically ambiguous at 45×48 pixels. The kernel is sensitive to resolution at single-digit pixel increments, a finding about the information content of coarse binary maps, not a failure of the coordinate framework.

9. Discussion

9.1 What VTL Is and Is Not

VTL is not a classifier, but a structural image descriptor. The classifier (SVM) is a thin layer on top of fixed coordinates which carry the physics. This means VTL is interpretable at the coordinate level and a process engineer can read the LER value and understand what it means in physical terms. It is also transferable across domains, possibly without or limited retraining the descriptor. Within this corpus, identical coordinate extraction and feature definitions were applied across all datasets without domain-specific modification.

VTL is not a replacement for deep learning in domains where per-domain accuracy is the primary objective and interpretability is secondary. A CNN trained on Carinthia images would likely exceed 93.4%. VTL's value is in the cold-transfer case: a new imaging tool, a new defect type, or a cross-domain analysis where labeled training data is scarce.

9.2 The Coordinate Ranking Shift as a Physical Prediction

VTL v3.1 is the only method in the baseline comparison that ranks first on both modalities, 93.4% on Carinthia SEM and 94.9% on MixedWM38 wafer maps with the same 15 coordinates and no retraining. The significance of that result is not the accuracy numbers themselves; but it is that a fixed coordinate system can be competitive across two structurally different imaging regimes without modification. The shift from LER-dominant (SEM) to mu/d_s-dominant (wafer maps) is consistent with expected image-formation behavior rather than being a dataset artifact.

9.3 Prediction Consistency Across Modalities

Beyond classification performance, the framework exhibits a second form of validation. Coordinate dominance changes in ways consistent with known image-formation behavior. LER vanishes in coherent aerial simulation, where it is expected to be zero and emerges in synthetic and production SEM imagery, where it measures real printed-edge stochasticity. It recedes in binary wafer maps, where edges are aliased and edge roughness is not a represented signal. Similarly, density- and frequency-based coordinates become dominant precisely in modalities where structural information is encoded through topology and spatial frequency rather than grayscale edge texture.

The LER trajectory is illustrative. Before any production SEM data were examined, image-formation theory predicted that LER should be uninformative in coherent aerial simulation because no roughness-generating mechanism exists at that stage. Synthetic CDSEM introduces edge discretization and shot noise, producing measurable LER values. Real production SEM images further elevate LER because physical edge stochasticity, resist noise, etch variation, dose fluctuation, becomes a dominant source of structural variation. Binary wafer maps remove physical edge information entirely, causing LER to recede to a low-ranking coordinate. The coordinate therefore follows the expected physical pathway across four distinct image regimes without modification to its definition or extraction procedure.

9.4 Limitations

10. Causal Chain: Two-Tier Process Monitoring

The simulation and real-data results together suggest a two-tier monitoring architecture grounded in the VTL coordinate space.

Tier 1: Simulation-side calibration. A Focus-Exposure Matrix run through the Hopkins lithography simulator maps VTL coordinate trajectories to process parameter space. NILS provides a near-linear focus estimator (R²=0.975). SDI tracks entropy rise with defocus. The asymmetric coordinates (delta_x, delta_y, theta) are insensitive to symmetric focus but respond to asymmetric aberrations, making them candidate tool fingerprinting coordinates. This calibration requires no labeled wafer data, only a simulator and a pattern library.

Tier 2: Inline SEM monitoring. VTL coordinates extracted from inline SEM images are compared against the simulation-derived reference. A coordinate shift in NILS signals focus drift; a shift in LER signals real edge stochasticity (resist, etch, or dose noise) rather than focus, because focus-induced LER is zero by physics. The two coordinates are therefore orthogonal process monitors: NILS tracks coherent optical degradation, LER tracks stochastic process variation. No other feature family in this comparison has a coordinate pair with this physical orthogonality built in by construction.

Section 12 provides the closest available evidence: a synthetic CDSEM chain built from the same Hopkins model shows LER and NILS responding correctly across image formation stages without parameter change. Validation on a real-instrument CDSEM dataset remains the primary outstanding item; the synthetic results partially address but do not fully close that gap.

11. Overlay Sensitivity and Coordinate Robustness

11.1 Displacement Sensitivity on Production SEM Images

A coordinate system intended for industrial process monitoring must satisfy two independent requirements: it must respond to the physical quantities being monitored, and it must remain stable under the imaging condition variation that is routine in production environments.

Overlay error, the misregistration between successive lithographic layers, is one of the primary yield-limiting quantities in semiconductor manufacturing. No public dataset pairing real SEM images with measured overlay values exists. A controlled surrogate experiment was therefore constructed: known sub-pixel to multi-pixel affine translations were applied to 355 Carinthia production SEM images spanning all four defect classes, and VTL coordinates were extracted at each applied shift. Twenty-one shift magnitudes from −20 to +20 pixels were used, with zero-fill border padding and a 25-pixel crop after shifting to eliminate border contamination.

Two coordinates emerge as displacement trackers. The peak asymmetry coordinate x_p achieves R² = 0.988 on horizontal displacement across the full ±20 pixel range and R² = 0.823 in the sub-pixel regime (|shift| ≤ 5 pixels), with a sensitivity of 65% of image width per pixel. An experimental multi-tracker extension (mt_cy) achieves R² = 0.897 on vertical displacement at full range and R² = 0.973 in the sub-pixel regime, substantially outperforming the global centroid coordinate delta_y (R² = 0.598 sub-pixel). The improvement is consistent with the multi-tracker averaging out image content asymmetry that would otherwise bias a single-centroid measurement.

VTL displacement tracking on Carinthia production SEM images
Figure 9. VTL displacement tracking on Carinthia production SEM images (355 images, 21 shifts × 2 axes). Top row: full range ±20 px. Bottom row: sub-pixel regime ±5 px. Dashed lines: OLS fits. Shaded band: ±1 SD across images. Left to right: delta_x (global centroid, x-axis), mt_cx (multi-tracker, x-axis), delta_y (global centroid, y-axis), mt_cy (multi-tracker, y-axis), x_p (peak asymmetry, x-axis).
Table 8. Displacement tracking statistics, Carinthia SEM images, 355 images.
CoordinateAxisR² full rangeR² sub-pixelSensitivity (% img-width / px)
x_pX0.98750.82365.0
mt_cy (exp.)Y0.8970.9730.77
delta_xX0.9460.529
delta_yY0.6540.598

A class-conditional analysis reveals that mt_cx achieves R² > 0.97 on Particle, Normal, and Edge-chip classes in the sub-pixel regime, but degrades to R² = 0.37 on the Contamination class. Contamination defects are morphologically diffuse, spatially scattered intensity clusters with no coherent internal structure, which represents the worst-case geometry for any centroid-based tracker. The companion coordinate mt_spread, which measures the RMS scatter of tile centroids around their mean, provides a quality-of-measurement signal: high spread flags images where tracking reliability is reduced, enabling conditional fallback to x_p.

11.2 Coordinate Robustness Under Imaging Degradation

The second experiment used the NIST mds2-3838 dataset (Bajcsy et al., 2025), a publicly released collection of 3,402 simulated SEM images generated by the ARTIMAGEN simulator across six structural configurations, each rendered at 27 noise levels and 21 contrast levels with known Poisson noise and contrast parameters. VTL v3.1 coordinates were extracted from all 3,402 images and correlated against the per-image noise level, contrast level, and SNR values.

The results split the coordinate set into three stability tiers. The structural geometry coordinates r_v, theta, rho_r, and delta_y are essentially immune to imaging degradation, with mean R² below 0.007 across noise level, contrast level, and SNR. The centroid and peak coordinates delta_x, x_p, and mu show mild noise sensitivity (R²/noise in the range 0.12–0.17) but are contrast-immune (R²/contrast below 0.002 for all three). nils sits at R²/noise = 0.270; it is contrast-immune (R²/contrast below 0.00001) and its mean R² across all three drivers is 0.110. The spectral and edge coordinates (d_s, ds_high, ds_mid, ds_low, LER, sdi, and edge_density) are the most noise-sensitive, with R²/noise ranging from 0.37 to 0.66 — physically expected, as Poisson noise directly injects high-frequency power into the FFT.

Critically, every coordinate is contrast-immune. R²/contrast is below 0.10 across all fifteen coordinates. SEM contrast variation arises from beam current drift, detector gain changes, and sample charging, and the coordinate system appears stable across the full contrast range represented in the dataset.

VTL coordinate sensitivity heatmap — NIST mds2-3838
Figure 10. VTL coordinate sensitivity heatmap — NIST mds2-3838 (3,402 simulated SEM images, 6 sets). R² of each VTL v3.1 coordinate against noise level, contrast level, and SNR. Green = robust (low sensitivity), red = sensitive. All coordinates show R²/contrast < 0.10.
Table 9. VTL v3.1 coordinate robustness tiers, NIST mds2-3838.
TierCoordinates
Robustr_v, theta, rho_r, delta_y, delta_x, x_p, mu, nils
Moderateler, d_s / ds_*
Noise-sensitivesdi, edge_density

11.3 The Intersection: Displacement Sensitivity Meets Imaging Robustness

The two experiments address orthogonal failure modes in a production monitor: a coordinate that is sensitive to displacement but not to imaging conditions is useful; a coordinate that moves with imaging conditions but not with displacement is a false alarm generator. The results show that the displacement-tracking coordinates (x_p, delta_x, mt_cy) and the structurally robust coordinates (r_v, theta, rho_r, delta_y) are drawn from the same physical origin — they measure spatial organisation of intensity mass and gradient geometry rather than pixel statistics. It is this derivation from image formation rather than from data that makes them simultaneously sensitive to structural change and stable under instrument variation. A CNN feature, by contrast, encodes whatever discriminative pattern the training data reinforced; it has no mechanism that separates "the structure moved" from "the instrument changed."

These experiments do not validate VTL as a replacement for dedicated overlay metrology tools. The claim is narrower and more specific: that VTL's positional coordinates track rigid displacement on production SEM images with sub-pixel sensitivity, and that this tracking occurs within a coordinate system that is demonstrably stable under the imaging condition variation that would confound pixel-level or learned features.

12. Physics End-to-End: Synthetic CDSEM Validation

To address the aerial-to-CDSEM gap, a three-stage forward model was constructed — Hopkins partial coherence → resist exposure → synthetic CDSEM — and VTL coordinates were extracted at each stage without any parameter tuning between stages.

12.1 Simulation Chain

Stage 1 (Hopkins aerial): A 200 nm-pitch line-space mask (CD = 100 nm, pixel = 2 nm) is illuminated with λ = 193 nm, NA = 1.35, partial coherence σ = 0.7. Focus levels are swept from −150 to +150 nm in 50 nm steps.

Stage 2 (resist model): A sigmoid contrast curve (chemically amplified resist, contrast k = 25, threshold = 0.25) converts aerial intensity to exposure probability. Gaussian acid diffusion (σ ≈ 3 nm at focus, scaling with |defocus|) blurs the latent image. The binary resist pattern is thresholded at the 50% exposure contour.

Stage 3 (synthetic CDSEM): Secondary electron (SE) yield is approximated as a Sobel gradient-magnitude edge halo convolved with a Gaussian beam PSF (σ = 2 nm), added to a flat substrate signal. Poisson shot noise is applied at 300 electrons/pixel. This model is physically approximate and has not been validated against measured instrument MTF; its purpose is to introduce the correct noise mechanisms, shot noise and edge discretization, rather than to replicate any specific tool's response function.

Three-stage pipeline at nominal focus
Figure 11. Three-stage pipeline at nominal focus (defocus = 0 nm). Left column: binary mask. Center-left: Hopkins aerial image. Center-right: resist pattern (binary, post-development). Right: synthetic CDSEM image with edge halos and Poisson shot noise.

12.2 Key Results

LER is near-zero on aerial images and measurably elevated on synthetic CDSEM images, without any parameter change to the coordinate extractor. On aerial images, LER averages 0.000–0.001 across all focus levels; the coherent edge of a simulated line has no roughness by construction. On synthetic CDSEM images, LER rises to 0.004–0.006, a 5–7× increase driven by Poisson shot noise and edge discretization. This is precisely the behavior that physical reasoning predicts: roughness should register only when a roughness-inducing mechanism is present in the image formation chain.

NILS response is preserved across modalities. The normalized image log-slope peaks at nominal focus (defocus = 0) in both the aerial and the synthetic CDSEM coordinates, consistent with the known focus–NILS relationship in lithographic imaging theory.

Coordinate ranking shifts between modalities match physical expectations. On aerial images, mu (mean intensity) and d_s (dark-signal density) dominate focus sensitivity. On synthetic CDSEM images, LER becomes the leading coordinate, with mu and d_s still present but attenuated. This mirrors the ranking shift observed between wafer maps (mu, d_s dominant) and real SEM images (LER dominant) in Sections 6–7.

VTL coordinate trajectories across focus: aerial vs CDSEM
Figure 12. VTL coordinate trajectories across focus for aerial (left panels) and synthetic CDSEM (right panels). Six key coordinates shown. LER is near-zero on aerial and 5–7× elevated on CDSEM. NILS peaks at nominal focus in both modalities.
Horizontal 1D profiles at nominal focus: aerial, resist, CDSEM
Figure 13. Horizontal 1D profiles at nominal focus. The aerial edge is smooth (LER≈0); the CDSEM profile shows the characteristic bright-edge double peak and Poisson granularity.

12.3 Interpretation

These results do not replace calibration against real CDSEM data; the synthetic model is physics-approximate. What the simulation does establish is that VTL coordinates respond to the correct physical causes — LER encodes noise-driven edge roughness, NILS encodes image sharpness relative to line width — and that the response direction is consistent across image formation modalities without any parameter adjustment. This is the strongest available evidence, short of real-instrument data, that the coordinate ranking shifts reported in Sections 6–7 reflect physical structure rather than dataset-specific artifacts.

13. Conclusion

The strongest evidence for VTL is not classification accuracy, but the reproducibility of coordinate-role changes across imaging modalities under a fixed coordinate definition. VTL v3.1 demonstrates that 15 dimensionless image coordinates, derived from image formation without learned parameters, can transfer cold across production SEM images and binary wafer maps, achieving statistically validated performance above chance on all three independent benchmarks tested. The framework is interpretable, each coordinate has a direct physical meaning, and modality-agnostic by design. Coordinate ranking shifts across modalities in a pattern consistent with image formation physics, providing internal validation of the framework's physical grounding.

A synthetic CDSEM chain (Section 12) confirms that LER encodes noise-driven edge roughness and NILS encodes image sharpness consistently across the Hopkins → resist → CDSEM image formation chain, without any parameter adjustment. Negative results (PM pre-processing, class balance ablation) are reported in full and yield informative findings about the operating regime of the coordinates. All results are reproduced from executed Jupyter notebooks. All figures are embedded from executed outputs without post-processing.

The displacement sensitivity experiment (355 Carinthia SEM images, 21 shift magnitudes) establishes that x_p tracks horizontal displacement linearly across the full ±20 pixel range (R² = 0.988) and into the sub-pixel regime (R² = 0.823), with a sensitivity of 65% of image width per pixel. The imaging-condition robustness experiment, run against 3,402 NIST mds2-3838 simulated SEM images, confirms that all 15 v3.1 coordinates are contrast-immune and that the structural geometry coordinates (r_v, theta, rho_r) are essentially noise-immune. The coordinates that track displacement most reliably are drawn from the same physics-derived geometry as the coordinates that are most stable under imaging variation. This is the property that distinguishes a physics-derived descriptor from a learned one — it cannot be engineered in; it follows from the mathematical origin of the coordinates.

References

  1. Perona, P., & Malik, J. (1990). Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(7), 629-639.
  2. Wu, M.-J., Jang, J.-S. R., & Chen, J.-L. (2015). Wafer map failure pattern recognition and similarity ranking for large-scale data sets. IEEE Transactions on Semiconductor Manufacturing, 28(1), 1-12. (WM-811K dataset)
  3. Carinthia Dataset. Zenodo DOI 10.5281/zenodo.10715190. CC-BY-4.0.
  4. MixedWM38 Dataset. Kaggle: co1d7era/mixedtype-wafer-defect-datasets.
  5. Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT Press.
  6. Hopkins, H. H. (1953). On the diffraction theory of optical images. Proceedings of the Royal Society of London A, 217(1130), 408-432.
  7. McInnes, L., Healy, J., & Melville, J. (2018). UMAP: Uniform Manifold Approximation and Projection for Dimension Reduction. arXiv:1802.03426.
  8. Nakazawa, T., & Kulkarni, D. V. (2018). Wafer map defect pattern classification and image retrieval using convolutional neural network. IEEE Transactions on Semiconductor Manufacturing, 31(2), 309-314.
  9. Saqlain, M., Abbas, Q., & Lee, J. Y. (2020). A deep convolutional neural network for wafer defect identification on an imbalanced dataset in semiconductor manufacturing processes. IEEE Transactions on Semiconductor Manufacturing, 33(3), 436-444.
  10. Haralick, R. M., Shanmugam, K., & Dinstein, I. (1973). Textural features for image classification. IEEE Transactions on Systems, Man, and Cybernetics, 3(6), 610-621.
  11. Bajcsy, P., et al. (2025). NIST mds2-3838: Simulated SEM Image Dataset for Metrology Research (ARTIMAGEN, 6 sets × 567 images, Poisson noise and contrast variation). NIST CHIPS Metrology Program. https://data.nist.gov/od/id/mds2-3838

Appendix A: Transparency Notes

The following limitations and design choices are disclosed explicitly:

Limits of the Claim — VTL does not demonstrate:

VTL does demonstrate:

The observed coordinate ranking shifts are empirical findings. Their consistency with modality-specific image formation physics motivates the hypothesis that VTL responds to changes in visual organization rather than domain-specific statistics. Establishing that interpretation definitively would require validation across additional imaging domains beyond those studied here.

Appendix B: Reproducibility

All experiments are implemented in Jupyter notebooks and standalone Python scripts available in the project repository. Key dependencies: numpy, pandas, scikit-learn, opencv-python, Pillow, umap-learn (pre-computation only), plotly, streamlit. Random seeds are fixed throughout (random_state=42). Feature extraction is deterministic given the same images and kernel code.

Interactive demo: deployed via Streamlit on Railway. VTL coordinates are extracted server-side; the extraction code is not exposed in the browser. Pre-computed artefacts (scaler, classifier, reference embedding) are committed to the repository.