CSP Endline Bi-Weekly Report
Lucy Right
August 30, 2024
Survey Completion
So far, 774 surveys have been completed. There are 3711 surveys to go!
| Oblast | Aug 24 | Aug 25 | Aug 26 | Aug 27 | Aug 28 | Total | Female |
|---|---|---|---|---|---|---|---|
| Batken | 35 | 53 | 20 | 10 | 10 | 245 | 53% |
| Jalal-Abad | 10 | 2 | 6 | NA | 1 | 99 | 57% |
| Osh | 50 | 55 | 45 | 35 | 12 | 430 | 50% |
Village-Level Completion and Village Issues
Update on village-level completion:
- Data collection has been finished in 6 villages, but there are issues with 4 villages. Please check below!
- Data collection is ongoing in 34 villages
- Data collection has not yet started in 72 villages
| Oblast | AA | Village | Baseline | Endline | Duplicated ID | Gender Matches Baseline | Note |
|---|---|---|---|---|---|---|---|
| Баткен | Ak-Turpak | Tokoy | 9 | 9 | 0 | Yes | Data collection complete |
| Баткен | Leylek | Kara-Suu | 29 | 31 | 0 | No | Too many surveys in this village AND gender balance incorrect. Please check. |
| Баткен | Sulukta-city | Kolco | 16 | 16 | 2 | Yes | Data collection complete but duplicate IDs. Please check. |
| Ош | AA named after Toktomat Zulpueva | Ak-Chabuu | 17 | 17 | 2 | Yes | Data collection complete but duplicate IDs. Please check. |
| Ош | Kenesh | Ak-Terek | 10 | 10 | 0 | Yes | Data collection complete |
| Ош | Papan | Papan | 17 | 24 | 3 | No | Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check. |
UniqueID Errors
Please refer to file uniqueID_issues_20240830.csv for the complete list of surveys with Unique ID errors.
- There are 68 entries with duplicated unique IDs. Some of these may be duplicated submissions, some might be incorrect IDs.
- The teams in Osh have the most duplicates at 41!
- There are 7 entries with a Unique ID not found in the baseline data.
Attrition and Recontacting
So far, the overall recontact rate for households is 69%, and the recontact rate for individuals is 61%.
| Oblast | Surveys Completed | HH Replaced (New HH) | Resp Replaced (Same HH) | Recontact Rate (HH) | Recontact Rate (Resp) | Replaced Wrong Gender | Replaced Too Young |
|---|---|---|---|---|---|---|---|
| Batken | 245 | 82 | 21 | 67% | 58% | 2 | 0 |
| Jalal-Abad | 99 | 30 | 18 | 70% | 52% | 16 | 0 |
| Osh | 430 | 130 | 23 | 70% | 64% | 20 | 0 |
| Total | 774 | 242 | 62 | 69% | 61% | 38 | 0 |
Poor Replacements
The following enumerators replaced the baseline respondent with someone of the incorrect gender.
| ono | fi | Wrong Gender Replacement |
|---|---|---|
| Jalal-Abad | Baiel_A | 4 |
| Jalal-Abad | Erlan_M | 3 |
| Osh | Azamat_T | 3 |
| Osh | Elmira_B | 3 |
| Osh | Indira_K | 3 |
| Osh | Nazgul_P | 3 |
| Jalal-Abad | Aisha_M | 2 |
| Jalal-Abad | Beksultan_J | 2 |
| Jalal-Abad | Kadyrali_J | 2 |
| Jalal-Abad | Nursultan_T | 2 |
| Osh | Dilbara_A | 2 |
| Osh | Карабаев | 2 |
| Osh | Сайфудинов Алихан | 2 |
| Batken | Altynai_B | 1 |
| Batken | Omurbek_A | 1 |
| Jalal-Abad | Aibolot_K | 1 |
| Osh | Kunduz_K | 1 |
| Osh | Tynychbek_A | 1 |
Replacements by Enumerator
| Oblast | Enumerator | Surveys | Recontact Rate (HH) | Recontact Rate (Resp) | Bad Replacement |
|---|---|---|---|---|---|
| Batken | Cholpon_K | 21 | 52% | 29% | 0 |
| Batken | Omurbek_A | 3 | 33% | 33% | 1 |
| Jalal-Abad | Aibolot_K | 9 | 67% | 33% | 1 |
| Jalal-Abad | Nursultan_T | 3 | 33% | 33% | 2 |
| Batken | Turgunai_S | 11 | 36% | 36% | 0 |
| Batken | Busadat_S | 16 | 44% | 44% | 0 |
| Jalal-Abad | Kadyrali_J | 25 | 64% | 44% | 2 |
| Osh | Kunduz_K | 39 | 46% | 44% | 1 |
Time Stamps
Time Statistics
| Section | Surveys | Median | 25th Percentile | 75th Percentile |
|---|---|---|---|---|
| time_sec_a | 773 | 0.2 | 0.2 | 0.5 |
| time_sec_b | 773 | 5.3 | 4.1 | 7.4 |
| time_sec_c | 773 | 1.2 | 0.9 | 1.6 |
| time_sec_conjoint | 773 | 0.7 | 0.4 | 1.3 |
| time_sec_d | 772 | 11.6 | 8.6 | 15.9 |
| time_sec_d1_d26 | 773 | 4.2 | 3.1 | 5.5 |
| time_sec_d30_d60 | 773 | 5.7 | 4.3 | 7.7 |
| time_sec_d61_d74 | 772 | 1.1 | 0.2 | 2.2 |
| time_sec_e | 772 | 11.2 | 8.5 | 15.3 |
| time_sec_f | 773 | 3.7 | 2.7 | 5.0 |
| time_sec_g | 773 | 5.2 | 3.6 | 7.5 |
| time_sec_g1_g14 | 773 | 2.4 | 1.6 | 3.5 |
| time_sec_g15_g31 | 773 | 2.6 | 1.7 | 3.8 |
| time_sec_h | 773 | 3.6 | 2.8 | 5.2 |
| time_sec_h1_h9 | 773 | 1.1 | 0.8 | 1.6 |
| time_sec_h10_h40 | 773 | 3.6 | 2.8 | 5.2 |
| time_sec_i | 773 | 1.4 | 0.9 | 2.0 |
| time_sec_k | 755 | 0.9 | 0.7 | 1.6 |
| time_sec_list | 772 | 0.3 | 0.1 | 0.6 |
| time_sec_total | 773 | 47.3 | 36.5 | 59.8 |
Change in Duration Over Time
Duration by Enumerator
The table below shows median section times for enumerators with surveys with shorter than average median survey times.
| Enumerator | ono | Surveys | Median | Median: Sec B | Median: Sec C | Median: Sec D Electricity | Median: Sec D Oth Services | Median: Sec D CSP | Median: Sec E | Median: Sec E Conjoint | Median: Sec F | Median: Sec G COVID | Median: Sec G Climate | Median: Sec H Gender | Median: Sec H Disability | Median: Sec I | Sum |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tynychbek_A | Osh | 27 | 29 | 4 | 1 | 2 | 3 | 0 | 6 | 0 | 2 | 2 | 2 | 1 | 2 | 1 | 26 |
| Baktybek_M | Batken | 9 | 34 | 5 | 2 | 2 | 4 | 2 | 6 | 0 | 2 | 2 | 2 | 1 | 3 | 1 | 32 |
| Erlan_M | Jalal-Abad | 2 | 34 | 5 | 1 | 2 | 4 | 0 | 6 | 0 | 3 | 3 | 2 | 1 | 6 | 1 | 34 |
| Nazgul_P | Osh | 28 | 35 | 5 | 1 | 3 | 4 | 1 | 8 | 1 | 2 | 2 | 2 | 1 | 3 | 1 | 34 |
| Azamat_T | Osh | 24 | 36 | 4 | 1 | 2 | 4 | 0 | 9 | 1 | 3 | 2 | 2 | 1 | 3 | 1 | 33 |
| Baiel_A | Jalal-Abad | 3 | 42 | 4 | 1 | 4 | 5 | 1 | 8 | 0 | 3 | 3 | 2 | 1 | 2 | 1 | 35 |
| Kunduz_K | Osh | 19 | 43 | 5 | 1 | 2 | 5 | 1 | 8 | 0 | 3 | 2 | 2 | 1 | 3 | 1 | 34 |
| Сайфудинов Алихан | Osh | 3 | 43 | 6 | 1 | 2 | 4 | 2 | 9 | 0 | 4 | 2 | 5 | 1 | 3 | 1 | 40 |
| Dilbara_A | Osh | 6 | 44 | 7 | 1 | 4 | 5 | 2 | 8 | 0 | 4 | 2 | 3 | 2 | 4 | 2 | 44 |
| Kadyrali_J | Jalal-Abad | 9 | 44 | 4 | 1 | 4 | 6 | 0 | 12 | 1 | 4 | 2 | 3 | 2 | 4 | 1 | 44 |
| Elmira_B | Osh | 19 | 46 | 6 | 1 | 3 | 5 | 2 | 11 | 1 | 4 | 3 | 2 | 1 | 4 | 1 | 44 |
Answer Quality
Don’t Knows
Statistics:
- The median survey has 9 “don’t know” answers.
- The 75th percentile survey has 17 “don’t know” answers.
- The median enumerator has 9 “don’t know” answers on average.
The enumerators below have recorded a very large number of Don’t Knows on many surveys! We expect some respondents will say don’t know, but enumerators should not consistently report more Don’t Knows than other enumerators!
| Enumerator | ono | Surveys | Surveys > 75 perc DKs | Median | Max |
|---|---|---|---|---|---|
| Turgunai_S | Batken | 7 | 6 | 62 | 69 |
| Dilbara_A | Osh | 10 | 10 | 61 | 75 |
| Baiel_A | Jalal-Abad | 16 | 16 | 57 | 88 |
| Busadat_S | Batken | 3 | 2 | 43 | 49 |
| Карабаев | Osh | 17 | 14 | 40 | 74 |
| Aisha_M | Jalal-Abad | 11 | 9 | 34 | 79 |
| Aibolot_K | Jalal-Abad | 9 | 9 | 32 | 68 |
| Tynychbek_A | Osh | 14 | 9 | 30 | 72 |
| Azamat_T | Osh | 15 | 15 | 29 | 64 |
| Erlan_M | Jalal-Abad | 11 | 8 | 28 | 44 |
| Kunduz_K | Osh | 14 | 12 | 28 | 45 |
| Gulmira_Im | Batken | 2 | 2 | 26 | 27 |
| Omurbek_A | Batken | 1 | 1 | 26 | 26 |
| Gulmira_D | Batken | 8 | 7 | 22 | 43 |
| Beksultan_J | Jalal-Abad | 5 | 3 | 19 | 44 |
| Сайфудинов Алихан | Osh | 9 | 5 | 18 | 44 |
Agree / Disagree
This table shows the average HHI, by enumerator, of the responses to 25 agreement-style questions in the survey. The HHI is a metric that indicates the ‘diversification’ in responses to the agreement questions.
An average HHI of 1 indicates that the enumerator records the same answer for all 25 agreement questions on every survey they enumerated. As the average HHI approaches 0, it indicates that the enumerator tends to record the same number of responses at each level of agreement for each survey.
Average HHIs above 0.70 indicate the enumerator is very often recording the same answer. Average HHIs below 0.3 indicate the enumerator is recording a lot of different options.
| Oblast | Enumerator | Surveys | Avg HHI | Avg % Str. Agr | Avg % Agr | Avg % Neither | Avg % Dis | Avg % Str. Dis | Avg % DK |
|---|---|---|---|---|---|---|---|---|---|
| Batken | Baktybek_M | 4 | 0.830 | 0.032 | 0.904 | 0.000 | 0.022 | 0.011 | 0.032 |
| Osh | Indira_K | 14 | 0.804 | 0.028 | 0.846 | 0.049 | 0.031 | 0.009 | 0.049 |
| Jalal-Abad | Erlan_M | 11 | 0.732 | 0.039 | 0.834 | 0.019 | 0.042 | 0.050 | 0.038 |
| Osh | Tattybubu_M | 14 | 0.711 | 0.031 | 0.796 | 0.006 | 0.164 | 0.025 | 0.000 |
| Batken | Gulburak_T | 12 | 0.664 | 0.018 | 0.742 | 0.176 | 0.022 | 0.018 | 0.032 |
| Batken | Omurbek_A | 1 | 0.270 | 0.304 | 0.304 | 0.130 | 0.000 | 0.000 | 0.261 |
Summary of problematic interviews
How problematic interviews are determined:
- Duration : the number of sections with time stamps below 25 percentile. The following sections are assessed: B, D1 (electricity), D2 (other services), E, F, G1 (covid), G2 (climate change), H2 (disability), Total survey (sections B-I). Since survey time can sometimes be unreliable if the respondent goes back to the beginning of the survey, I look at the number of sections that are very short - not just the total survey time.
- Don’t Knows : how many don’t know responses are in the survey
- Similarity in Question Response : how similar answers are to agree/disagree questions (for example, if the enumerator selects ``somewhat agree” in 95% A/D questions)
Please check the file issues_20240830.csv to see all problematic interviews. Below is just a summary by oblast.
| Date | Batken | Jalal-Abad | Osh |
|---|---|---|---|
| Aug 20 | 1 | 5 | 7 |
| Aug 21 | 0 | 5 | 12 |
| Aug 22 | 4 | 5 | 5 |
| Aug 23 | 0 | 1 | 3 |
| Aug 24 | 0 | 1 | 3 |
| Aug 25 | 0 | 0 | 4 |
| Aug 26 | 0 | 1 | 3 |
| Aug 27 | 2 | 0 | 5 |
| Aug 28 | 0 | 0 | 3 |
| Total | 7 | 18 | 45 |
Summary of enumerator performance
The following table shows indicators for enumerator performance. You can sort the table to see how enumerators perform.
Please pay special attention to the following enumerators: Turgunai_S, Baiel_A, Tynychbek_A, Azamat_T, Nazgul_P, Dilbara_A, Карабаев!!