SGS has been running their customer samples in parallel through Walkley-Black and the Digitizer to produce Side-by-Side data for comparison. The main ways we evaluate this data is through the summary statistics, outlier ratio, and overall Vibes. We will start with the summary statistics. SGS has run 430 samples through WB for comparison so far.

Results from Currently Deployed Model

Figure 1. SGS Side by Side Scatterplot of customer samples using the currently deployed CST model compared to WB as of September 09, 2025.

Summary Stats from Currently Deployed Model

R2 and MAE of SGS Side by Side Data
Stat Value
r2 0.29
MAE 1.04

Table 1.

SOM Predictions Target Error from Currently Deployed Model

Figure 2. This plot shows the number of samples and percentage of the predictions that are within 0.5, 1, 1.5, and 2 SOM units from the true Walkley-Black GT value.

Outlier Distribution for Currently Deployed Model

Figure 3. 15.1% of or 65 samples in the side-by-side subset are further than 2 SOM units from the target value.

Figure 4. This figure shows that the majority of the outliers >2 units from target occur around the 4 - 5.5% SOM GT range.