CSP Endline Bi-Weekly Report
Lucy Right
September 17, 2024
Survey Completion
So far, 2270 surveys have been completed. There are 2215 surveys to go!
| Oblast | Sep 10 | Sep 11 | Sep 12 | Sep 13 | Sep 14 | Sep 15 | Sep 16 | Total This Week | Total to Date | Female | Under35 | 35to50 | Over50 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Batken | 35 | 10 | 4 | 40 | 46 | 40 | 1 | 176 | 765 | 50% | 24% | 35% | 41% |
| Jalal-Abad | 48 | 36 | 34 | 13 | 25 | 9 | 0 | 165 | 666 | 49% | 25% | 29% | 45% |
| Osh | 6 | 13 | 5 | 0 | 4 | 3 | 0 | 31 | 839 | 49% | 28% | 33% | 39% |
Village-Level Completion and Village Issues
Update on village-level completion:
- Data collection has been finished in 13 villages, but there are issues with 7 villages. Please check below!
- Data collection is ongoing in 69 villages
- Data collection has not yet started in 32 villages
| Oblast | AA | Village | Baseline | Endline | Duplicated ID | Gender Matches Baseline | Note |
|---|---|---|---|---|---|---|---|
| Баткен | Ak-Turpak | Chogorok | 10 | 10 | 0 | Yes | Data collection complete |
| Баткен | Ak-Turpak | Tokoy | 9 | 9 | 0 | Yes | Data collection complete |
| Баткен | Birlik | Bel | 20 | 20 | 0 | Yes | Data collection complete |
| Баткен | Birlik | Jal | 26 | 26 | 0 | Yes | Data collection complete |
| Баткен | Leylek | Kara-Suu | 29 | 31 | 0 | No | Too many surveys in this village AND gender balance incorrect. Please check. |
| Баткен | Moldo Niyaz | Shybran | 8 | 10 | 0 | Yes | Too many surveys in this village. Please check. |
| Баткен | Tort-Gul | Ak-Otok | 10 | 10 | 0 | Yes | Data collection complete |
| Баткен | Tort-Gul | Ak-Turpak | 24 | 24 | 0 | No | Data collection complete but gender balance incorrect |
| Жалал-Абад | Akman | Tash-Bulak | 12 | 12 | 2 | Yes | Data collection complete but duplicate IDs. Please check. |
| Жалал-Абад | Kyzyl-Tuu | Jashasyn-2 | 17 | 17 | 0 | No | Data collection complete but gender balance incorrect |
| Ош | Kenesh | Ak-Terek | 10 | 32 | 0 | No | Too many surveys in this village AND gender balance incorrect. Please check. |
| Ош | Papan | Karagur | 11 | 11 | 0 | Yes | Data collection complete |
| Ош | Papan | Papan | 17 | 19 | 0 | No | Too many surveys in this village AND gender balance incorrect. Please check. |
UniqueID Errors
Please refer to file uniqueID_issues_20240917.csv for the complete list of surveys with Unique ID errors.
- In the last week, there have been 16 duplicated submissions.
- There are 60 entries with UNRESOLVED duplicated unique IDs.
- The teams in Jalal-Abad have the most duplicates at 46!
- There are 6 entries with a Unique ID not found in the baseline data.
Attrition and Recontacting
So far, the overall recontact rate for households is 66%, and the recontact rate for individuals is 57%.
| sex_baseline_name | Week 1 | Week 2 | Week 3 | Week 4 | Week 1 | Week 2 | Week 3 | Week 4 |
|---|---|---|---|---|---|---|---|---|
| Female | 69% | 67% | 66% | 58% | 62% | 60% | 53% | 47% |
| Male | 70% | 70% | 58% | 58% | 62% | 59% | 51% | 48% |
| Total | 69% | 69% | 62% | 58% | 62% | 60% | 52% | 48% |
| Oblast | Recontact Rate (HH) | Recontact Rate (Resp) | Replaced Wrong Gender | Replaced Too Young |
|---|---|---|---|---|
| Batken | 66% | 56% | 14 | 0 |
| Jalal-Abad | 45% | 34% | 38 | 0 |
| Osh | 81% | 75% | 14 | 0 |
| Total | 66% | 57% | 66 | 0 |
Poor Replacements
The following enumerators replaced the baseline respondent with someone of the incorrect gender.
| ono | fi | Week 2 | Week 4 | Week 3 | Week 1 |
|---|---|---|---|---|---|
| Batken | Gulmira_Is | 0 | 2 | 0 | 0 |
| Jalal-Abad | Aisha_M | 0 | 2 | 0 | 3 |
| Batken | Baktybek_M | 0 | 1 | 0 | 0 |
| Batken | Busadat_S | 0 | 1 | 3 | 0 |
| Batken | Gulmira_D | 0 | 1 | 0 | 0 |
| Batken | Omurbek_A | 0 | 1 | 0 | 1 |
| Jalal-Abad | Aibolot_K | 2 | 1 | 2 | 2 |
| Jalal-Abad | Dinara_R | 0 | 1 | 0 | 0 |
| Jalal-Abad | Malika_A | 0 | 1 | 1 | 0 |
| Osh | Ainagul_A | 0 | 1 | 0 | 0 |
| Batken | Altynai_B | 2 | 0 | 0 | 0 |
| Batken | Minavar_T | 0 | 0 | 1 | 0 |
| Batken | Zhiidegul_M | 1 | 0 | 0 | 0 |
| Jalal-Abad | Baiel_A | 2 | 0 | 1 | 3 |
| Jalal-Abad | Beksultan_J | 0 | 0 | 3 | 3 |
| Jalal-Abad | Erlan_M | 0 | 0 | 0 | 3 |
| Jalal-Abad | Kadyrali_J | 0 | 0 | 1 | 3 |
| Jalal-Abad | Nursultan_T | 1 | 0 | 1 | 2 |
| Osh | Elmira_B | 0 | 0 | 1 | 2 |
| Osh | Indira_K | 0 | 0 | 0 | 1 |
| Osh | Kunduz_K | 0 | 0 | 0 | 1 |
| Osh | Nazgul_P | 2 | 0 | 0 | 1 |
| Osh | Tynychbek_A | 1 | 0 | 1 | 0 |
| Osh | Карабаев | 1 | 0 | 0 | 1 |
| Osh | Сайфудинов Алихан | 0 | 0 | 0 | 1 |
Replacements by Enumerator
| Oblast | Enumerator | Surveys | Recontact Rate (HH) | Recontact Rate (Resp) | Bad Replacement |
|---|---|---|---|---|---|
| Batken | Busadat_S | 56 | 16% | 14% | 4 |
| Jalal-Abad | Malika_A | 42 | 19% | 17% | 2 |
| Jalal-Abad | Kadyrali_J | 98 | 38% | 18% | 4 |
| Jalal-Abad | Aisha_M | 87 | 26% | 20% | 5 |
| Jalal-Abad | Nursultan_T | 53 | 40% | 28% | 4 |
| Jalal-Abad | Baiel_A | 96 | 35% | 30% | 6 |
| Jalal-Abad | Aibolot_K | 77 | 39% | 31% | 7 |
| Batken | Turgunai_S | 44 | 32% | 32% | 0 |
| Batken | Cholpon_K | 52 | 52% | 38% | 0 |
| Batken | Baktybek_M | 44 | 50% | 41% | 1 |
| Jalal-Abad | Beksultan_J | 113 | 70% | 48% | 6 |
| Jalal-Abad | Erlan_M | 21 | 62% | 48% | 3 |
Time Stamps
Time Statistics
| Section | Median | 25th % | 75th % | Median | 25th % | 75th % |
|---|---|---|---|---|---|---|
| time_sec_a | 0.2 | 0.2 | 0.5 | 0.2 | 0.2 | 0.4 |
| time_sec_b | 4.8 | 3.5 | 6.9 | 4.3 | 3.2 | 6.0 |
| time_sec_c | 1.0 | 0.8 | 1.4 | 0.9 | 0.6 | 1.2 |
| time_sec_conjoint | 0.6 | 0.3 | 1.2 | 0.6 | 0.3 | 1.3 |
| time_sec_d | 10.1 | 7.0 | 14.4 | 8.9 | 5.7 | 13.4 |
| time_sec_d1_d26 | 3.5 | 2.5 | 5.1 | 3.2 | 2.1 | 4.6 |
| time_sec_d30_d60 | 4.9 | 3.4 | 6.8 | 4.0 | 2.8 | 6.2 |
| time_sec_d61_d74 | 1.0 | 0.2 | 2.2 | 1.0 | 0.3 | 2.2 |
| time_sec_e | 10.0 | 7.2 | 14.0 | 8.8 | 6.1 | 13.2 |
| time_sec_f | 3.3 | 2.3 | 4.6 | 2.9 | 1.9 | 4.1 |
| time_sec_g | 4.2 | 3.0 | 6.3 | 3.7 | 2.7 | 5.6 |
| time_sec_g1_g14 | 2.0 | 1.4 | 3.0 | 1.7 | 1.2 | 2.6 |
| time_sec_g15_g31 | 2.1 | 1.5 | 3.2 | 1.9 | 1.3 | 2.9 |
| time_sec_h | 3.3 | 2.4 | 4.8 | 2.9 | 2.1 | 4.3 |
| time_sec_h1_h9 | 1.0 | 0.7 | 1.5 | 0.9 | 0.6 | 1.4 |
| time_sec_h10_h40 | 3.3 | 2.4 | 4.8 | 2.9 | 2.1 | 4.3 |
| time_sec_i | 1.0 | 0.7 | 1.7 | 0.8 | 0.6 | 1.5 |
| time_sec_k | 0.8 | 0.6 | 1.4 | 0.7 | 0.5 | 1.1 |
| time_sec_list | 0.2 | 0.1 | 0.5 | 0.2 | 0.1 | 0.4 |
| time_sec_total | 43.1 | 31.8 | 56.0 | 39.0 | 28.8 | 52.1 |
Change in Duration Over Time
Duration by Enumerator
The table below shows median section times for enumerators with surveys with shorter than average median survey times.
| Enumerator | ono | Surveys | Median | Median: Sec B | Median: Sec C | Median: Sec D Electricity | Median: Sec D Oth Services | Median: Sec D CSP | Median: Sec E | Median: Sec E Conjoint | Median: Sec F | Median: Sec G COVID | Median: Sec G Climate | Median: Sec H Gender | Median: Sec H Disability | Median: Sec I | Sum |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Baiel_A | Jalal-Abad | 9 | 17.4 | 2.6 | 0.4 | 2.0 | 1.8 | 0.0 | 4.0 | 0.3 | 1.2 | 0.8 | 0.8 | 0.4 | 1.8 | 0.9 | 17.0 |
| Kadyrali_J | Jalal-Abad | 9 | 21.9 | 2.7 | 0.8 | 2.0 | 2.5 | 0.0 | 6.2 | 0.4 | 1.6 | 1.4 | 1.8 | 0.9 | 2.4 | 0.6 | 23.3 |
| Beksultan_J | Jalal-Abad | 23 | 23.2 | 2.5 | 0.8 | 2.2 | 2.6 | 0.1 | 6.5 | 0.4 | 1.7 | 1.5 | 1.5 | 0.5 | 1.9 | 0.6 | 22.8 |
| Baktybek_M | Batken | 9 | 24.0 | 4.2 | 0.6 | 1.6 | 2.9 | 0.7 | 5.3 | 0.2 | 1.8 | 1.4 | 1.4 | 0.8 | 2.5 | 0.7 | 24.1 |
| Gulmira_Im | Batken | 3 | 25.9 | 4.8 | 0.6 | 2.0 | 3.2 | 1.4 | 6.0 | 0.3 | 1.6 | 1.8 | 1.0 | 0.6 | 2.1 | 0.4 | 25.8 |
| Busadat_S | Batken | 20 | 26.1 | 3.0 | 0.4 | 1.4 | 1.6 | 0.6 | 3.8 | 0.2 | 1.4 | 0.8 | 1.0 | 0.3 | 1.5 | 0.5 | 16.5 |
| Aisha_M | Jalal-Abad | 11 | 26.5 | 2.1 | 0.9 | 2.1 | 3.2 | 0.8 | 7.3 | 0.6 | 2.1 | 1.6 | 1.5 | 1.4 | 3.6 | 0.8 | 28.0 |
| Aibolot_K | Jalal-Abad | 12 | 28.8 | 4.1 | 1.6 | 2.4 | 3.2 | 0.0 | 7.4 | 0.6 | 2.2 | 1.0 | 1.1 | 0.5 | 2.2 | 0.6 | 26.9 |
| Карабаев | Osh | 4 | 32.3 | 5.4 | 0.5 | 4.2 | 3.5 | 0.1 | 9.1 | 0.2 | 2.0 | 1.4 | 1.4 | 0.4 | 1.9 | 0.5 | 30.6 |
| Malika_A | Jalal-Abad | 22 | 33.2 | 3.5 | 0.9 | 2.5 | 4.2 | 0.3 | 8.6 | 0.9 | 3.2 | 2.0 | 1.9 | 1.0 | 3.0 | 0.8 | 32.8 |
| Elmira_B | Osh | 11 | 33.4 | 4.2 | 0.6 | 2.0 | 3.8 | 1.3 | 7.4 | 0.5 | 3.2 | 1.6 | 2.0 | 0.7 | 2.4 | 0.8 | 30.5 |
| Gulburak_T | Batken | 11 | 35.5 | 5.6 | 1.0 | 3.4 | 5.7 | 2.4 | 5.2 | 0.2 | 2.4 | 1.6 | 1.8 | 0.6 | 2.2 | 0.9 | 33.0 |
| Omurbek_A | Batken | 11 | 35.9 | 5.6 | 0.6 | 2.2 | 2.5 | 1.0 | 7.8 | 0.3 | 2.7 | 1.6 | 2.1 | 0.9 | 2.7 | 0.8 | 30.8 |
| Dinara_R | Jalal-Abad | 31 | 37.0 | 5.7 | 0.9 | 3.5 | 4.0 | 0.3 | 8.7 | 0.8 | 3.7 | 1.8 | 2.1 | 1.0 | 3.1 | 0.9 | 36.5 |
| Minavar_T | Batken | 16 | 38.8 | 3.8 | 1.0 | 3.2 | 4.3 | 2.7 | 11.6 | 1.9 | 3.2 | 1.6 | 1.8 | 0.9 | 2.0 | 1.2 | 39.2 |
| Gulmira_Is | Batken | 10 | 39.7 | 10.3 | 0.9 | 2.4 | 3.3 | 0.8 | 5.5 | 0.3 | 1.4 | 1.2 | 1.6 | 0.6 | 2.3 | 0.8 | 31.4 |
Answer Quality
Don’t Knows
Statistics:
- The median survey has 5 “don’t know” answers.
- The 75th percentile survey has 13 “don’t know” answers.
- The median enumerator has 5 “don’t know” answers on average.
The enumerators below have recorded a very large number of Don’t Knows on many surveys! We expect some respondents will say don’t know, but enumerators should not consistently report more Don’t Knows than other enumerators!
| Enumerator | ono | Surveys | Surveys > 75 perc DKs | Median | Max |
|---|---|---|---|---|---|
| Dinara_R | Jalal-Abad | 31 | 28 | 28 | 75 |
| Осмонова Венера | Jalal-Abad | 18 | 14 | 22 | 44 |
| Baktybek_M | Batken | 9 | 8 | 19 | 30 |
| Садыкова Чинара | Jalal-Abad | 23 | 15 | 17 | 28 |
| Minavar_T | Batken | 16 | 10 | 15 | 31 |
| Beksultan_J | Jalal-Abad | 23 | 6 | 7 | 30 |
Agree / Disagree
This table shows the average HHI, by enumerator, of the responses to 25 agreement-style questions in the survey. The HHI is a metric that indicates the ‘diversification’ in responses to the agreement questions.
An average HHI of 1 indicates that the enumerator records the same answer for all 25 agreement questions on every survey they enumerated. As the average HHI approaches 0, it indicates that the enumerator tends to record the same number of responses at each level of agreement for each survey.
Average HHIs above 0.70 indicate the enumerator is very often recording the same answer. Average HHIs below 0.3 indicate the enumerator is recording a lot of different options.
| Oblast | Enumerator | Surveys | Avg HHI | Avg % Str. Agr | Avg % Agr | Avg % Neither | Avg % Dis | Avg % Str. Dis | Avg % DK |
|---|---|---|---|---|---|---|---|---|---|
| Jalal-Abad | 358-091-016 | 1 | 0.841 | 0.000 | 0.913 | 0.000 | 0.000 | 0.000 | 0.087 |
| Jalal-Abad | Kadyrali_J | 9 | 0.763 | 0.860 | 0.000 | 0.014 | 0.072 | 0.092 | 0.010 |
| Osh | Карабаев | 4 | 0.719 | 0.108 | 0.837 | 0.011 | 0.043 | 0.000 | 0.000 |
| Jalal-Abad | Aibolot_K | 12 | 0.718 | 0.021 | 0.832 | 0.018 | 0.125 | 0.000 | 0.028 |
| Batken | Gulburak_T | 11 | 0.705 | 0.069 | 0.806 | 0.087 | 0.034 | 0.015 | 0.000 |
Summary of problematic interviews
How problematic interviews are determined:
- Duration : the number of sections with time stamps below 25 percentile. The following sections are assessed: B, D1 (electricity), D2 (other services), E, F, G1 (covid), G2 (climate change), H2 (disability), Total survey (sections B-I). Since survey time can sometimes be unreliable if the respondent goes back to the beginning of the survey, I look at the number of sections that are very short - not just the total survey time.
- Don’t Knows : how many don’t know responses are in the survey
- Similarity in Question Response : how similar answers are to agree/disagree questions (for example, if the enumerator selects ``somewhat agree” in 95% A/D questions)
- Location: respondents should not all be in the same location.
Please check the file issues_20240917.csv to see all problematic interviews. Below is just a summary by oblast.
| Date | Batken | Jalal-Abad | Osh |
|---|---|---|---|
| Aug 20 | 3 | 5 | 28 |
| Aug 21 | 8 | 7 | 48 |
| Aug 22 | 4 | 13 | 29 |
| Aug 23 | 2 | 12 | 16 |
| Aug 24 | 3 | 7 | 20 |
| Aug 25 | 10 | 16 | 31 |
| Aug 26 | 7 | 12 | 13 |
| Aug 27 | 3 | 18 | 16 |
| Aug 28 | 2 | 17 | 16 |
| Aug 29 | 12 | 21 | 17 |
| Aug 30 | 9 | 20 | 15 |
| Aug 31 | 26 | 23 | 10 |
| Sep 01 | 14 | 11 | 23 |
| Sep 02 | 4 | 20 | 8 |
| Sep 03 | 1 | 20 | 5 |
| Sep 04 | 5 | 20 | 5 |
| Sep 05 | 3 | 14 | 0 |
| Sep 06 | 4 | 21 | 11 |
| Sep 07 | 21 | 37 | 24 |
| Sep 08 | 18 | 31 | 34 |
| Sep 09 | 11 | 27 | 5 |
| Sep 10 | 13 | 36 | 5 |
| Sep 11 | 2 | 24 | 5 |
| Sep 12 | 0 | 30 | 3 |
| Sep 13 | 17 | 13 | 0 |
| Sep 14 | 19 | 14 | 2 |
| Sep 15 | 19 | 6 | 1 |
| Oct 09 | 1 | 0 | 0 |
| Total | 241 | 495 | 390 |
## # A tibble: 103 × 7
## # Groups: fi, fs [36]
## fi fs date_text n median perc25 perc75
## <chr> <int> <chr> <int> <dbl> <dbl> <dbl>
## 1 "358\nОсмонова Венера" 2 Sep 14 1 54.8 54.8 54.8
## 2 "358-091-016" 2 Sep 14 1 44.1 44.1 44.1
## 3 "Adilet_S" 4 Sep 09 4 65.4 62.5 68.7
## 4 "Adilet_S" 4 Sep 14 1 21.5 21.5 21.5
## 5 "Aibolot_K" 2 Sep 10 5 27.4 26.9 28.3
## 6 "Aibolot_K" 2 Sep 11 4 30.7 30.4 35.8
## 7 "Aibolot_K" 2 Sep 13 3 28.2 24.8 28.7
## 8 "Ainagul_A" 4 Sep 14 2 59.2 52.4 66
## 9 "Ainur_T" 1 Sep 09 8 62.8 46.7 96.4
## 10 "Ainur_T" 1 Sep 10 10 96 73.4 117.
## # ℹ 93 more rowsSummary of enumerator performance
The following table shows indicators for enumerator performance. You can sort the table to see how enumerators perform.
Please pay special attention to the following enumerators: Baiel_A, Kadyrali_J, Beksultan_J, Карабаев, Aibolot_K, Aisha_M, Elmira_B, Baktybek_M, Minavar_T, Malika_A, Gulmira_Im, Busadat_S, Dinara_R, Gulburak_T, Zhiidegul_M, Omurbek_A, Altynai_B, Gulmira_D, Gulmira_Is, Садыкова Чинара, Осмонова Венера!!