1 Overview of Survey To Date

Surveys Completed to Date
Municipality Total Surveys Recontact Rate Avg Duration (Min) N Enumerators % Female Respondents
Kampong Cham 769 66% 35.59 18 65.67
Siem Reap 2799 73% 40.1 17 66.56
Stung Saen 1107 92% 34.08 7 70.82
Total 4675 76% 37.93 37 67.42

There are 421 HHs from baseline which still need to be surveyed or replaced.

2 Survey Diagnostics - Today

2.1 Overview by Province

Surveys Completed on Aug 27-29
Municipality Total Surveys Recontact Rate Avg Duration N Enumerators
Kampong Cham 98 55% 34.25 7
Siem Reap 141 71% 35.08 10
Stung Saen 67 88% 30.38 7
Total 306 70% 33.79 24

2.2 Overview by Enumerator

Enumerator Summary: Surveys Completed on Aug 27-29
Enumerator Municipality N Surveys Recontact Rate Avg Duration Under 30 min
In Seyha Siem Reap 9 44% 24.25 8
Hoeung Soram Stung Saen 10 100% 25.41 8
Voeuk Khoeun Stung Saen 8 100% 27.6 7
Seng Bunthay Stung Saen 9 67% 30.06 4
Pek Kea Siem Reap 11 91% 30.73 7
Ret Doun Kampong Cham 15 47% 30.92 7
Kheng SreyToch Stung Saen 10 80% 31.01 5
Yiem Nim Stung Saen 10 100% 31.1 6
Yorn Khnhey Stung Saen 8 100% 32.12 2
Sales Mouseu Kampong Cham 9 78% 32.41 3
Ren Borath Siem Reap 18 61% 32.92 5
Chay Thona Kampong Cham 15 73% 33.01 3
Huom sayan Siem Reap 17 88% 34.01 4
Chhon Soda Kampong Cham 14 64% 34.08 3
Ly Hengtry Siem Reap 14 86% 34.28 4
Khut Sambo Stung Saen 12 75% 34.33 2
Un Chhuy Siem Reap 12 75% 34.47 4
Sreang Kimheng Kampong Cham 16 38% 35.32 1
Hieng Samnang Kampong Cham 14 29% 35.93 1
Kheat Phun Siem Reap 19 58% 36.8 0
Suon Savoeun Kampong Cham 15 67% 37.39 0
Sang Phally Siem Reap 13 46% 38.06 1
Tong Vanndy Siem Reap 10 100% 38.41 1
Pay Danech Siem Reap 18 67% 41.56 0
Enumerators listed in order of shortest average duration.

2.3 List Experiment

List Experiment Diagnostics by Enumerator: Aug 27-29
Enumerator Municipality N Surveys N Zero Responses Avg Time (Min) Shortest Time (Min)
In Seyha Siem Reap 9 7 0.74 0.58
Tong Vanndy Siem Reap 10 5 0.82 0.05
Yiem Nim Stung Saen 10 7 0.86 0.6
Hoeung Soram Stung Saen 10 8 0.89 0.72
Kheat Phun Siem Reap 19 11 0.9 0.47
Sang Phally Siem Reap 13 6 0.92 0.62
Ret Doun Kampong Cham 15 10 0.93 0.73
Kheng SreyToch Stung Saen 10 9 0.95 0.72
Pek Kea Siem Reap 11 0 0.98 0.53
Chay Thona Kampong Cham 15 10 0.99 0.78
Pay Danech Siem Reap 18 15 1.02 0.8
Ren Borath Siem Reap 18 12 1.02 0.72
Chhon Soda Kampong Cham 14 9 1.14 0.58
Hieng Samnang Kampong Cham 14 14 1.19 0.97
Huom sayan Siem Reap 17 13 1.19 0.97
Ly Hengtry Siem Reap 14 6 1.19 0.75
Sreang Kimheng Kampong Cham 16 7 1.22 0.73
Seng Bunthay Stung Saen 9 4 1.25 0.75
Un Chhuy Siem Reap 12 4 1.27 -0.02
Khut Sambo Stung Saen 12 10 1.29 0.68
Yorn Khnhey Stung Saen 8 7 1.39 0.93
Sales Mouseu Kampong Cham 9 6 1.56 1.03
Suon Savoeun Kampong Cham 15 10 1.78 1.22
Voeuk Khoeun Stung Saen 8 4 1.78 0.95
Enumerators listed in order of shortest average list experiment duration.

2.4 Conjoint

Conjoint Diagnostics by Enumerator: Aug 27-29
Enumerator Municipality Conjoint 1 Conjoint 2 Conjoint 3 Total
In Seyha Siem Reap 0.8 0.3 0.33 1.43
Sang Phally Siem Reap 0.55 0.45 0.45 1.45
Seng Bunthay Stung Saen 1.02 0.39 0.28 1.69
Kheat Phun Siem Reap 0.71 0.47 0.55 1.73
Kheng SreyToch Stung Saen 0.74 0.56 0.56 1.86
Pek Kea Siem Reap 0.9 0.48 0.49 1.87
Hoeung Soram Stung Saen 0.79 0.57 0.58 1.94
Chay Thona Kampong Cham 0.72 0.58 0.66 1.96
Ren Borath Siem Reap 1 0.56 0.42 1.98
Ret Doun Kampong Cham 0.96 0.58 0.54 2.08
Tong Vanndy Siem Reap 1.22 0.42 0.53 2.17
Pay Danech Siem Reap 0.95 0.64 0.6 2.19
Hieng Samnang Kampong Cham 1.07 0.52 0.64 2.23
Yiem Nim Stung Saen 0.86 0.62 0.78 2.26
Voeuk Khoeun Stung Saen 1.1 0.62 0.6 2.32
Ly Hengtry Siem Reap 1.07 0.7 0.61 2.38
Un Chhuy Siem Reap 0.78 0.48 1.18 2.44
Sales Mouseu Kampong Cham 1.13 0.63 0.69 2.45
Sreang Kimheng Kampong Cham 1.31 0.56 0.61 2.48
Yorn Khnhey Stung Saen 0.89 0.66 0.99 2.54
Huom sayan Siem Reap 1.13 0.71 0.72 2.56
Khut Sambo Stung Saen 1.08 0.82 0.79 2.69
Suon Savoeun Kampong Cham 1.3 0.84 0.67 2.81
Chhon Soda Kampong Cham 1.46 0.79 0.81 3.06
Enumerators listed in order of shortest average total conjoint duration.

2.5 Agreement Questions

This table shows the average HHI, by enumerator, of the responses to 13 agreement-style questions in the survey. The HHI is a metric that indicates the ‘diversification’ in responses to the agreement questions. An average HHI of 1 indicates that the enumerator records the same answer for all 13 agreement questions on every survey they enumerated. As the average HHI approaches 0, it indicates that the enumerator tends to record the same number of responses at each level of agreement for each survey.

We consider average HHIs above 0.8 and below 0.3 (the smallest possible HHI in this case is 0.17) as potentially suspicious. Note that an HHI of 0.86 corresponds to 12 out of 13 answers being the same.

Variation in Response to Agreement Questions by Enumerator: Aug 27-29
Enumerator N Surveys Avg HHI
Voeuk Khoeun 8 0.846
Huom sayan 17 0.837
Suon Savoeun 15 0.815
Ret Doun 15 0.763
Hoeung Soram 10 0.749
Un Chhuy 12 0.729
Yiem Nim 10 0.727
Khut Sambo 12 0.724
Yorn Khnhey 8 0.678
Tong Vanndy 10 0.673
Seng Bunthay 9 0.644
In Seyha 9 0.634
Ly Hengtry 14 0.62
Hieng Samnang 14 0.574
Kheng SreyToch 10 0.561
Pay Danech 18 0.56
Pek Kea 11 0.503
Sang Phally 13 0.502
Chay Thona 15 0.5
Chhon Soda 14 0.495
Kheat Phun 19 0.489
Sales Mouseu 9 0.481
Sreang Kimheng 16 0.463
Ren Borath 18 0.454
Enumerators listed in order of highest to lowest Average HHI.

2.6 Summary of Most Problematic Enumerators Today

This table shows the basic summary stats for the most problematic enumerators today. Note that this table only includes an enumerator’s diagnostic if they were among the worst 5 enumerators today in terms of average duration, recontact rate, average list experiment duration, or average total conjoint time, or had an average HHI on the agreement questions of above 0.8 or below 0.3.

The column “Total number of issues” indicates how many of these five categories (duration, recontact, list experiment, conjoint, agreement questions) the enumerator was among the worst in.

Worst Performing Enumerators: Aug 27-29
Enumerator Municipality N Surveys Avg Duration Under 30 min Recontact Rate (%) N Zeros on LE Avg Time on LE Avg Total Time Conjoint Avg HHI agreement Total # of Issues
In Seyha Siem Reap 9 24.25 8 44.44 7 0.74 1.43 4
Hoeung Soram Stung Saen 10 25.41 8 8 0.89 2
Voeuk Khoeun Stung Saen 8 27.6 7 0.846 2
Seng Bunthay Stung Saen 9 30.06 4 1.69 2
Sang Phally Siem Reap 13 46.15 1.45 2
Kheat Phun Siem Reap 19 11 0.9 1.73 2
Enumerators listed from worst to better performers on Aug 27-29

3 Experiment Results With All Data To Date

3.1 List Experiment

Question Text

We are interested in the sets of activities that you may take when you find the performance of your subnational officials to be disappointed.

I am going to read 4 statements that describe activities. Please tell me how many of these activities you took in the past 3 years. I don’t want to know about any specific item. I only want to know the total number of activities that you did.

  1. Complained to family, friends, or neighbors.
  2. Organized neighbors to provide substitute services yourselves.
  3. Considered changing my vote in the next election.
  4. Moved to a different municipality or province.

Results

List Experiment Difference in Means: July 21 to Aug 27-29
Control Treatment T.Stat p.value
0.438 0.559 -5.182 0

3.2 Conjoint Experiment

4 Unique ID Issues to date

In all surveys enumerated to date, we have the following issues with Unique IDs:

  • 96 Unique IDs for which we have an attrition form but no replacement survey
  • 93 Unique IDs for which we have a replacement survey but no attrition form
  • 27 surveys errors for which there is an error in the entry of the Unique ID
  • 114 surveys which have the same Unique ID as another survey

Up-to-date CSV files providing the details of surveys with Unique ID errors can be found here.