Matching Refinement with Devontez Data: Real Identities vs. V1 and V2 Matching

Purpose/Context:

Compare person-centric metrics as generated by real identities in the golden dataset to person-centric metrics generated by reliance on v1 and v2 matching algorithms.

A note on terminology/methods/decisions:

• A “person” is determined from the following fields:
  • Real.Identity (in the context of interpreting "Real Identity" from raw golden data)
  • Worker.ID (in the context of interpreting v1 matching efforts from raw golden data)
  • person_id (in the context of interpreting v2 matching efforts from newly processed data)

• Because each stat is person-centric, observations (ads) that have no Real.Identity/Worker.ID/person_id are not considered.

• "Ad counts across persons" considers all ads associated with a person, not just unique ads.

• Both mean and median are provided. Friendly reminder that the median is a better measurement of central tendency for data with skewed distributions (which this data has), as the median is more robust/not as affected by outliers.

• Age-related stats omit ads with no associated age.

Persons Per Matching

Ads Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##     3.0    10.0   133.0   120.4   210.0   308.0

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##     1.0     4.0    13.0    57.7    43.0  1103.0

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##     1.0     3.5    17.0   230.3    53.5  5910.0

Cities Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   2.000   2.000   6.000   9.923  12.000  42.000

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   2.000   4.034   4.000  66.000

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   2.000   7.558   3.000 182.000

States Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   2.000   3.000   5.615   7.000  19.000

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   1.000   2.298   2.000  21.000

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##    1.00    1.00    1.00    2.86    2.00   40.00

Phones Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##    1.00    4.00    5.00   10.23    9.00   40.00

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   3.000   4.226   5.000  53.000

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##    1.00    1.00    2.00   12.74    4.50  356.00

Days Lapsed Across Ads Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##    14.0   174.0   227.0   388.4   556.0  1195.0

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##    0.00    6.75   54.00  115.81  172.25  757.00

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##     0.0     5.0    32.0   129.5   164.0   772.0

Ages Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   2.000   2.000   3.462   4.000   8.000

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   2.000   2.274   3.000  12.000

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   1.000   1.000   2.000   2.791   4.000  12.000

Age Ranges Per Person

Real Identity

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   0.000   1.000   3.000   4.462   5.000  26.000

V1 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   0.000   0.000   1.000   2.625   3.000  30.000

V2 Matching

##    Min. 1st Qu.  Median    Mean 3rd Qu.    Max. 
##   0.000   0.000   1.000   4.977   4.500  30.000