CSP Endline Bi-Weekly Report
Lucy Right
September 10, 2024
Survey Completion
So far, 1497 surveys have been completed. There are 2988 surveys to go!
| Oblast | Sep 03 | Sep 04 | Sep 05 | Sep 06 | Sep 07 | Sep 08 | Total This Week | Total to Date | Female | Under35 | 35to50 | Over50 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Batken | 7 | 20 | 11 | 15 | 57 | 47 | 157 | 576 | 51% | 24% | 32% | 43% |
| Jalal-Abad | 0 | 0 | 0 | 0 | 18 | 25 | 43 | 247 | 53% | 25% | 23% | 52% |
| Osh | 8 | 8 | 0 | 8 | 21 | 23 | 68 | 674 | 50% | 27% | 33% | 39% |
Village-Level Completion and Village Issues
Update on village-level completion:
- Data collection has been finished in 12 villages, but there are issues with 6 villages. Please check below!
- Data collection is ongoing in 46 villages
- Data collection has not yet started in 54 villages
| Oblast | AA | Village | Baseline | Endline | Duplicated ID | Gender Matches Baseline | Note |
|---|---|---|---|---|---|---|---|
| Баткен | Ak-Turpak | Tokoy | 9 | 9 | 0 | Yes | Data collection complete |
| Баткен | Birlik | Bel | 20 | 21 | 2 | Yes | Too many surveys in this village AND duplicate IDs. Please check. |
| Баткен | Birlik | Jal | 26 | 26 | 0 | Yes | Data collection complete |
| Баткен | Kadamjai-city | Pulgon | 55 | 57 | 4 | No | Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check. |
| Баткен | Leylek | Kara-Suu | 29 | 31 | 0 | No | Too many surveys in this village AND gender balance incorrect. Please check. |
| Баткен | Moldo Niyaz | Shybran | 8 | 10 | 0 | Yes | Too many surveys in this village. Please check. |
| Баткен | Sulukta-city | Kolco | 16 | 16 | 0 | Yes | Data collection complete |
| Баткен | Tort-Gul | Ak-Otok | 10 | 10 | 0 | Yes | Data collection complete |
| Баткен | Tort-Gul | Ak-Turpak | 24 | 24 | 0 | No | Data collection complete but gender balance incorrect |
| Ош | AA named after Toktomat Zulpueva | Ak-Chabuu | 17 | 17 | 0 | Yes | Data collection complete |
| Ош | Kenesh | Ak-Terek | 10 | 10 | 0 | Yes | Data collection complete |
| Ош | Papan | Papan | 17 | 23 | 2 | No | Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check. |
UniqueID Errors
Please refer to file uniqueID_issues_20240910.csv for the complete list of surveys with Unique ID errors.
- In the last week, there have been 8 duplicated submissions.
- There are 48 entries with UNRESOLVED duplicated unique IDs.
- The teams in Osh have the most duplicates at 18!
- There are 3 entries with a Unique ID not found in the baseline data.
Attrition and Recontacting
So far, the overall recontact rate for households is 69%, and the recontact rate for individuals is 61%.
| Respondent Sex | Week 1 | Week 2 | Week 3 | Week 1 | Week 2 | Week 3 |
|---|---|---|---|---|---|---|
| Female | 69% | 69% | 71% | 62% | 62% | 59% |
| Male | 70% | 71% | 64% | 62% | 59% | 57% |
| Total | 70% | 70% | 67% | 62% | 61% | 58% |
| Oblast | Recontact Rate (HH) | Recontact Rate (Resp) | Replaced Wrong Gender | Replaced Too Young |
|---|---|---|---|---|
| Batken | 64% | 55% | 7 | 0 |
| Jalal-Abad | 63% | 47% | 22 | 0 |
| Osh | 76% | 71% | 18 | 0 |
| Total | 69% | 61% | 47 | 0 |
Poor Replacements
The following enumerators replaced the baseline respondent with someone of the incorrect gender.
| ono | fi | Week 2 | Week 3 | Week 1 |
|---|---|---|---|---|
| Jalal-Abad | Beksultan_J | 0 | 2 | 4 |
| Batken | Busadat_S | 0 | 1 | 0 |
| Batken | Minavar_T | 0 | 1 | 0 |
| Batken | Omurbek_A | 0 | 1 | 1 |
| Osh | Elmira_B | 0 | 1 | 2 |
| Osh | Tynychbek_A | 1 | 1 | 0 |
| Batken | Altynai_B | 2 | 0 | 0 |
| Batken | Zhiidegul_M | 1 | 0 | 0 |
| Jalal-Abad | Aibolot_K | 0 | 0 | 1 |
| Jalal-Abad | Aisha_M | 0 | 0 | 3 |
| Jalal-Abad | Baiel_A | 1 | 0 | 4 |
| Jalal-Abad | Erlan_M | 0 | 0 | 3 |
| Jalal-Abad | Kadyrali_J | 0 | 0 | 2 |
| Jalal-Abad | Nursultan_T | 0 | 0 | 2 |
| Osh | Ainagul_A | 0 | 0 | 1 |
| Osh | Azamat_T | 0 | 0 | 3 |
| Osh | Dilbara_A | 1 | 0 | 0 |
| Osh | Indira_K | 0 | 0 | 1 |
| Osh | Kunduz_K | 0 | 0 | 1 |
| Osh | Nazgul_P | 2 | 0 | 1 |
| Osh | Карабаев | 1 | 0 | 1 |
| Osh | Сайфудинов Алихан | 0 | 0 | 1 |
Replacements by Enumerator
| Oblast | Enumerator | Surveys | Recontact Rate (HH) | Recontact Rate (Resp) | Bad Replacement |
|---|---|---|---|---|---|
| Batken | Busadat_S | 54 | 17% | 17% | 1 |
| Batken | Turgunai_S | 24 | 29% | 29% | 0 |
| Jalal-Abad | Aisha_M | 39 | 38% | 31% | 3 |
| Jalal-Abad | Kadyrali_J | 44 | 50% | 32% | 2 |
| Batken | Cholpon_K | 39 | 46% | 33% | 0 |
| Jalal-Abad | Aibolot_K | 9 | 67% | 33% | 1 |
| Jalal-Abad | Nursultan_T | 15 | 53% | 40% | 2 |
| Batken | Baktybek_M | 32 | 53% | 47% | 0 |
Time Stamps
Time Statistics
| Section | Median | 25th % | 75th % | Median | 25th % | 75th % |
|---|---|---|---|---|---|---|
| time_sec_a | 0.2 | 0.2 | 0.6 | 0.3 | 0.2 | 0.6 |
| time_sec_b | 5.1 | 3.8 | 7.3 | 4.6 | 3.6 | 7.6 |
| time_sec_c | 1.1 | 0.8 | 1.4 | 0.9 | 0.6 | 1.2 |
| time_sec_conjoint | 0.7 | 0.4 | 1.2 | 0.5 | 0.3 | 1.3 |
| time_sec_d | 11.0 | 7.9 | 14.8 | 9.4 | 6.3 | 13.4 |
| time_sec_d1_d26 | 3.8 | 2.8 | 5.2 | 3.3 | 2.1 | 5.0 |
| time_sec_d30_d60 | 5.2 | 3.8 | 7.2 | 4.3 | 3.0 | 6.3 |
| time_sec_d61_d74 | 1.1 | 0.3 | 2.3 | 1.0 | 0.4 | 2.4 |
| time_sec_e | 10.8 | 7.8 | 14.6 | 9.7 | 6.2 | 14.2 |
| time_sec_f | 3.5 | 2.4 | 4.9 | 3.1 | 1.9 | 4.7 |
| time_sec_g | 4.7 | 3.3 | 6.9 | 4.2 | 2.6 | 6.7 |
| time_sec_g1_g14 | 2.1 | 1.4 | 3.2 | 1.9 | 1.2 | 3.0 |
| time_sec_g15_g31 | 2.3 | 1.6 | 3.5 | 2.1 | 1.3 | 3.2 |
| time_sec_h | 3.5 | 2.6 | 5.0 | 3.4 | 2.3 | 4.7 |
| time_sec_h1_h9 | 1.0 | 0.7 | 1.6 | 0.9 | 0.7 | 1.4 |
| time_sec_h10_h40 | 3.5 | 2.6 | 5.0 | 3.4 | 2.3 | 4.7 |
| time_sec_i | 1.2 | 0.8 | 1.9 | 1.0 | 0.6 | 1.7 |
| time_sec_k | 0.9 | 0.6 | 1.5 | 0.8 | 0.6 | 1.3 |
| time_sec_list | 0.2 | 0.1 | 0.5 | 0.2 | 0.1 | 0.5 |
| time_sec_total | 45.4 | 34.5 | 57.8 | 43.2 | 31.3 | 57.9 |
Change in Duration Over Time
Duration by Enumerator
The table below shows median section times for enumerators with surveys with shorter than average median survey times.
| Enumerator | ono | Surveys | Median | Median: Sec B | Median: Sec C | Median: Sec D Electricity | Median: Sec D Oth Services | Median: Sec D CSP | Median: Sec E | Median: Sec E Conjoint | Median: Sec F | Median: Sec G COVID | Median: Sec G Climate | Median: Sec H Gender | Median: Sec H Disability | Median: Sec I | Sum |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Tynychbek_A | Osh | 20 | 22.5 | 3.7 | 0.6 | 1.6 | 2.7 | 0.1 | 5.1 | 0.4 | 1.6 | 0.9 | 0.9 | 0.6 | 1.9 | 0.5 | 20.6 |
| Gulburak_T | Batken | 4 | 25.5 | 6.1 | 1.0 | 3.4 | 4.9 | 3.9 | 6.3 | 0.3 | 3.8 | 3.4 | 1.9 | 0.9 | 1.7 | 0.2 | 37.8 |
| Карабаев | Osh | 14 | 32.1 | 3.4 | 0.6 | 3.1 | 4.7 | 0.1 | 7.2 | 0.2 | 2.8 | 1.3 | 2.0 | 0.8 | 3.0 | 0.8 | 30.0 |
| Baktybek_M | Batken | 9 | 32.8 | 6.4 | 0.7 | 1.9 | 3.0 | 1.0 | 6.4 | 0.3 | 2.0 | 1.4 | 1.5 | 0.8 | 2.5 | 0.8 | 28.7 |
| Nazgul_P | Osh | 15 | 33.4 | 4.1 | 0.9 | 3.0 | 3.4 | 0.8 | 6.4 | 0.4 | 1.7 | 1.2 | 1.5 | 0.9 | 3.8 | 0.8 | 28.9 |
| Gulmira_Im | Batken | 12 | 33.5 | 7.2 | 0.5 | 2.3 | 3.3 | 0.9 | 5.8 | 0.3 | 1.6 | 1.1 | 1.1 | 0.6 | 2.0 | 0.6 | 27.3 |
| Omurbek_A | Batken | 12 | 38.0 | 4.3 | 0.7 | 2.3 | 3.0 | 1.4 | 8.8 | 0.3 | 3.3 | 2.0 | 3.2 | 1.4 | 3.5 | 1.1 | 35.3 |
| Сайфудинов Алихан | Osh | 3 | 39.2 | 4.2 | 0.7 | 2.9 | 4.6 | 0.1 | 10.4 | 0.2 | 4.4 | 3.0 | 1.1 | 0.9 | 3.1 | 0.9 | 36.5 |
| Zhiidegul_M | Batken | 6 | 39.4 | 3.8 | 1.3 | 4.1 | 4.2 | 1.1 | 12.8 | 0.6 | 3.8 | 1.9 | 1.5 | 0.8 | 2.8 | 0.8 | 39.5 |
| Elmira_B | Osh | 4 | 41.5 | 3.9 | 1.8 | 2.8 | 3.5 | 2.4 | 9.6 | 0.7 | 3.5 | 2.9 | 2.4 | 1.4 | 4.7 | 2.0 | 41.6 |
| Busadat_S | Batken | 29 | 41.9 | 2.7 | 0.5 | 1.5 | 1.8 | 0.7 | 6.3 | 0.2 | 1.6 | 0.9 | 1.2 | 0.4 | 2.1 | 0.7 | 20.6 |
| Kunduz_K | Osh | 6 | 42.7 | 8.9 | 0.9 | 4.0 | 5.1 | 0.2 | 9.3 | 0.6 | 3.7 | 1.8 | 1.8 | 0.8 | 3.0 | 1.0 | 41.1 |
| Gulmira_D | Batken | 5 | 43.0 | 4.1 | 1.0 | 4.3 | 3.7 | 2.0 | 8.3 | 0.4 | 3.4 | 1.9 | 2.0 | 0.8 | 2.5 | 0.8 | 35.2 |
Answer Quality
Don’t Knows
Statistics:
- The median survey has 7 “don’t know” answers.
- The 75th percentile survey has 14 “don’t know” answers.
- The median enumerator has 8 “don’t know” answers on average.
The enumerators below have recorded a very large number of Don’t Knows on many surveys! We expect some respondents will say don’t know, but enumerators should not consistently report more Don’t Knows than other enumerators!
| Enumerator | ono | Surveys | Surveys > 75 perc DKs | Median | Max |
|---|---|---|---|---|---|
| Beksultan_J | Jalal-Abad | 43 | 38 | 26 | 74 |
| Minavar_T | Batken | 17 | 10 | 16 | 26 |
| Altynai_B | Batken | 17 | 8 | 14 | 23 |
| Gulmira_Im | Batken | 12 | 5 | 12 | 25 |
| Baktybek_M | Batken | 9 | 4 | 10 | 20 |
Agree / Disagree
This table shows the average HHI, by enumerator, of the responses to 25 agreement-style questions in the survey. The HHI is a metric that indicates the ‘diversification’ in responses to the agreement questions.
An average HHI of 1 indicates that the enumerator records the same answer for all 25 agreement questions on every survey they enumerated. As the average HHI approaches 0, it indicates that the enumerator tends to record the same number of responses at each level of agreement for each survey.
Average HHIs above 0.70 indicate the enumerator is very often recording the same answer. Average HHIs below 0.3 indicate the enumerator is recording a lot of different options.
| Oblast | Enumerator | Surveys | Avg HHI | Avg % Str. Agr | Avg % Agr | Avg % Neither | Avg % Dis | Avg % Str. Dis | Avg % DK |
|---|---|---|---|---|---|---|---|---|---|
| Osh | Adilet_S | 3 | 0.931 | 0.000 | 0.958 | 0 | 0.056 | 0 | 0 |
| Osh | Tattybubu_M | 3 | 0.683 | 0.043 | 0.800 | 0 | 0.200 | 0 | 0 |
Summary of problematic interviews
How problematic interviews are determined:
- Duration : the number of sections with time stamps below 25 percentile. The following sections are assessed: B, D1 (electricity), D2 (other services), E, F, G1 (covid), G2 (climate change), H2 (disability), Total survey (sections B-I). Since survey time can sometimes be unreliable if the respondent goes back to the beginning of the survey, I look at the number of sections that are very short - not just the total survey time.
- Don’t Knows : how many don’t know responses are in the survey
- Similarity in Question Response : how similar answers are to agree/disagree questions (for example, if the enumerator selects ``somewhat agree” in 95% A/D questions)
- Location: respondents should not all be in the same location.
Please check the file issues_20240910.csv to see all problematic interviews. Below is just a summary by oblast.
| Date | Batken | Jalal-Abad | Osh |
|---|---|---|---|
| Aug 20 | 4 | 12 | 33 |
| Aug 21 | 9 | 9 | 57 |
| Aug 22 | 6 | 17 | 32 |
| Aug 23 | 2 | 12 | 20 |
| Aug 24 | 4 | 7 | 25 |
| Aug 25 | 13 | 14 | 36 |
| Aug 26 | 8 | 13 | 17 |
| Aug 27 | 4 | 15 | 19 |
| Aug 28 | 2 | 13 | 16 |
| Aug 29 | 13 | 16 | 15 |
| Aug 30 | 10 | 14 | 14 |
| Aug 31 | 27 | 4 | 7 |
| Sep 01 | 14 | 0 | 18 |
| Sep 02 | 4 | 0 | 9 |
| Sep 03 | 7 | 0 | 5 |
| Sep 04 | 13 | 0 | 5 |
| Sep 05 | 10 | 0 | 0 |
| Sep 06 | 7 | 0 | 7 |
| Sep 07 | 24 | 6 | 17 |
| Sep 08 | 16 | 10 | 18 |
| Total | 197 | 162 | 370 |
Summary of enumerator performance
The following table shows indicators for enumerator performance. You can sort the table to see how enumerators perform.
Please pay special attention to the following enumerators: Tynychbek_A, Nazgul_P, Карабаев, Beksultan_J, Busadat_S, Gulmira_Im, Baktybek_M, Minavar_T, Kunduz_K, Zhiidegul_M, Gulmira_D, Altynai_B, Omurbek_A!!