Survey Completion

So far, 3047 surveys have been completed. There are 1438 surveys to go!

Surveys Completed in Last Week
Oblast Oct 09 Sep 16 Sep 17 Sep 18 Sep 19 Sep 20 Sep 21 Sep 22 Sep 23 Sep 29 Total This Week Total to Date Female Under35 35to50 Over50
Batken 1 14 29 11 18 5 33 22 1 0 134 913 50% 25% 37% 38%
Jalal-Abad 0 11 0 11 19 18 32 14 0 0 105 817 49% 25% 30% 45%
Osh 0 0 4 45 3 18 43 18 0 1 132 1317 50% 29% 31% 40%

Village-Level Completion and Village Issues

Update on village-level completion:

  • Data collection has been finished in 27 villages, but there are issues with 21 villages. Please check below!
  • Data collection is ongoing in 61 villages
  • Data collection has not yet started in 26 villages
Finished Villages
Oblast AA Village Baseline Endline Duplicated ID Gender Matches Baseline Note
Баткен A.Masaliev Kara-Dobo 32 37 10 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Баткен Ak-Turpak Chogorok 10 10 0 Yes Data collection complete
Баткен Ak-Turpak Tokoy 9 9 0 Yes Data collection complete
Баткен Birlik Bel 20 20 0 Yes Data collection complete
Баткен Birlik Jal 26 26 0 Yes Data collection complete
Баткен Kadamjai-city Pulgon 55 61 11 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Баткен Kara-Bulak Kara-Bulak 72 75 8 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Баткен Leylek Kara-Suu 29 31 0 No Too many surveys in this village AND gender balance incorrect. Please check.
Баткен Moldo Niyaz Shybran 8 10 0 Yes Too many surveys in this village. Please check.
Баткен Tort-Gul Ak-Otok 10 10 0 Yes Data collection complete
Баткен Tort-Gul Ak-Turpak 24 24 0 No Data collection complete but gender balance incorrect
Жалал-Абад Akman Tash-Bulak 12 12 2 Yes Data collection complete but duplicate IDs. Please check.
Жалал-Абад D. Sadyrbaev Apyrtan 40 41 2 Yes Too many surveys in this village AND duplicate IDs. Please check.
Жалал-Абад D. Sadyrbaev Kyzyl-Tuu 39 40 4 Yes Too many surveys in this village AND duplicate IDs. Please check.
Жалал-Абад Kenesh Kara-Jygach 33 34 0 Yes Too many surveys in this village. Please check.
Жалал-Абад Kyzyl-Tuu Jashasyn-2 17 17 0 No Data collection complete but gender balance incorrect
Жалал-Абад Taygaraev-Municipal-Territorial-Governance S.Jeenbekov 21 21 0 No Data collection complete but gender balance incorrect
Ош Kenesh Ak-Terek 10 32 0 No Too many surveys in this village AND gender balance incorrect. Please check.
Ош Kenesh Ak-Terek 10 10 2 No Data collection complete but gender balance incorrect AND duplicate IDs. Please check.
Ош Kok Zhar Naray 34 35 2 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Ош Kyzyl-Oktyabr Unkur 14 16 1 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Ош Osh city Ak-Buura-4 10 10 2 Yes Data collection complete but duplicate IDs. Please check.
Ош Papan Karagur 11 11 0 Yes Data collection complete
Ош Papan Papan 17 19 0 No Too many surveys in this village AND gender balance incorrect. Please check.
Ош Savay Kechken-Zhar 12 12 0 No Data collection complete but gender balance incorrect
Ош Yntymak Ak-Terek 20 21 10 No Too many surveys in this village AND gender balance incorrect AND duplicate IDs. Please check.
Ош Yntymak Chaichi 36 36 3 Yes Data collection complete but duplicate IDs. Please check.

UniqueID Errors

Please refer to file uniqueID_issues_20240923.csv for the complete list of surveys with Unique ID errors.

  • In the last week, there have been 25 duplicated submissions.
  • There are 148 entries with UNRESOLVED duplicated unique IDs.
  • The teams in Jalal-Abad have the most duplicates at 64!
  • There are 13 entries with a Unique ID not found in the baseline data.

Attrition and Recontacting

So far, the overall recontact rate for households is 68%, and the recontact rate for individuals is 59%.

Recontact Statistics, by Respondent Gender
Recontact Rate Household
Recontact Rate Respondent
sex_baseline_name Week 1 Week 2 Week 3 Week 4 Week 5 Week 1 Week 2 Week 3 Week 4 Week 5
Female 69% 69% 68% 64% 76% 63% 62% 56% 52% 60%
Male 71% 70% 62% 66% 69% 63% 60% 54% 56% 56%
Total 70% 70% 65% 65% 72% 63% 61% 55% 54% 58%
Recontact Statistics, by Oblast (since data collection began)
Oblast Recontact Rate (HH) Recontact Rate (Resp) Replaced Wrong Gender Replaced Too Young
Batken 65% 55% 17 0
Jalal-Abad 47% 35% 40 0
Osh 84% 76% 19 0
Total 68% 59% 76 0

Poor Replacements

The following enumerators replaced the baseline respondent with someone of the incorrect gender.

Replaced with Wrong Gender
ono fi Week 2 Week 4 Week 3 Week 5 Week 1
Batken Busadat_S 0 2 3 2 0
Batken Gulmira_Is 0 2 0 0 0
Jalal-Abad Aisha_M 0 2 0 0 3
Batken Baktybek_M 0 1 0 0 0
Batken Gulmira_D 0 1 0 0 0
Batken Omurbek_A 0 1 0 0 1
Jalal-Abad Aibolot_K 2 1 2 0 2
Jalal-Abad Dinara_R 0 1 0 0 0
Jalal-Abad Malika_A 0 1 1 0 0
Osh Ainagul_A 0 1 0 0 0
Osh Indira_K 0 1 0 1 1
Batken Altynai_B 2 0 0 0 0
Batken Minavar_T 0 0 1 0 0
Batken Zhiidegul_M 1 0 0 0 0
Jalal-Abad Baiel_A 3 0 1 0 3
Jalal-Abad Beksultan_J 0 0 3 0 3
Jalal-Abad Erlan_M 0 0 0 0 3
Jalal-Abad Kadyrali_J 0 0 1 0 3
Jalal-Abad Nursultan_T 1 0 1 0 2
Jalal-Abad Осмонова Венера 0 0 0 1 0
Osh Aizhana_A 0 0 0 0 2
Osh Elmira_B 0 0 1 0 2
Osh Kunduz_K 0 0 0 0 1
Osh Nazgul_P 2 0 0 0 1
Osh Tattybubu_M 0 0 0 1 0
Osh Tynychbek_A 1 0 1 0 0
Osh Карабаев 1 0 0 0 1
Osh Сайфудинов Алихан 0 0 0 0 1

Replacements by Enumerator

Enumerators with Lowest Recontact Rate
Oblast Enumerator Surveys Recontact Rate (HH) Recontact Rate (Resp) Bad Replacement
Jalal-Abad Marsel_J 5 0% 0% 0
Batken Busadat_S 80 11% 10% 7
Jalal-Abad Malika_A 43 19% 16% 2
Jalal-Abad Kadyrali_J 99 37% 18% 4
Jalal-Abad Aisha_M 91 25% 19% 5
Batken Turgunai_S 55 25% 25% 0
Jalal-Abad Nursultan_T 56 39% 29% 4
Jalal-Abad Aibolot_K 77 39% 31% 7
Jalal-Abad Baiel_A 101 36% 31% 7
Jalal-Abad Erlan_M 46 39% 33% 3
Batken Baktybek_M 53 57% 38% 1
Osh Kunduz_K 97 55% 44% 1
Jalal-Abad Beksultan_J 115 69% 47% 6

Time Stamps

Time Statistics

Section Times Statistics
Overall
This Week
Section Median 25th % 75th % Median 25th % 75th %
time_sec_a 0.2 0.2 0.5 0.2 0.2 0.6
time_sec_b 5.0 3.5 7.4 5.2 3.5 9.0
time_sec_c 1.0 0.7 1.4 0.9 0.6 1.3
time_sec_conjoint 0.6 0.3 1.1 0.5 0.3 1.2
time_sec_d 10.1 6.8 14.8 9.9 6.1 15.2
time_sec_d1_d26 3.5 2.4 5.2 3.3 2.0 5.4
time_sec_d30_d60 4.8 3.2 7.0 4.0 2.6 6.4
time_sec_d61_d74 0.9 0.2 2.0 0.7 0.3 1.7
time_sec_e 9.8 6.9 14.2 9.6 6.3 14.5
time_sec_f 3.1 2.2 4.5 2.5 1.9 4.0
time_sec_g 4.0 2.8 6.2 3.1 2.3 5.0
time_sec_g1_g14 1.9 1.3 3.0 1.4 1.0 2.4
time_sec_g15_g31 2.0 1.4 3.0 1.5 1.1 2.5
time_sec_h 3.1 2.2 4.6 2.6 1.9 4.3
time_sec_h1_h9 0.9 0.6 1.4 0.7 0.5 1.1
time_sec_h10_h40 3.1 2.2 4.6 2.6 1.9 4.3
time_sec_i 1.0 0.7 1.6 0.8 0.6 1.4
time_sec_k 0.8 0.6 1.4 0.7 0.5 1.2
time_sec_list 0.2 0.1 0.5 0.1 0.1 0.3
time_sec_total 43.7 32.2 57.3 45.8 33.7 59.6

Change in Duration Over Time

Duration by Enumerator

The table below shows median section times for enumerators with surveys with shorter than average median survey times.

Shortest Survey Times by Enumerator (Last Week)
Enumerator ono Surveys Median Median: Sec B Median: Sec C Median: Sec D Electricity Median: Sec D Oth Services Median: Sec D CSP Median: Sec E Median: Sec E Conjoint Median: Sec F Median: Sec G COVID Median: Sec G Climate Median: Sec H Gender Median: Sec H Disability Median: Sec I Sum
Baktybek_M Batken 9 25.4 4.6 0.7 1.6 2.7 1.0 5.5 0.3 1.9 1.4 1.3 0.7 2.1 0.6 24.4
Tynychbek_A Osh 7 25.6 3.6 0.7 1.9 2.7 0.1 7.8 0.3 1.8 1.1 1.2 0.7 2.2 0.8 24.9
Gulmira_Im Batken 8 26.6 8.6 0.6 2.1 2.4 0.9 4.3 0.2 1.7 1.3 0.9 0.6 1.9 0.6 26.1
Omurbek_A Batken 14 27.0 4.0 0.6 1.4 1.6 0.6 6.2 0.3 2.1 1.0 1.4 0.6 2.0 0.7 22.5
Карабаев Osh 15 31.6 4.0 0.6 2.5 3.7 0.2 7.2 0.2 3.0 1.2 1.5 0.6 3.2 0.7 28.6
Gulmira_Is Batken 12 32.2 9.3 0.6 2.5 2.2 0.7 4.8 0.2 1.3 1.0 1.2 0.4 1.9 0.6 26.7
Akmaral_M Osh 16 32.3 4.6 0.6 3.1 3.6 0.6 5.6 0.3 2.0 0.9 0.9 0.3 1.6 0.6 24.7
Gulmira_D Batken 11 36.7 5.9 1.1 2.9 3.6 1.2 6.7 0.4 3.1 1.6 1.3 0.7 2.9 0.8 32.2
Nazgul_P Osh 8 37.6 5.5 0.9 2.8 3.9 0.2 7.4 0.5 2.5 1.9 1.1 1.2 3.5 0.8 32.2
Dinara_R Jalal-Abad 32 39.4 4.7 0.9 4.4 5.6 0.1 9.2 0.8 2.8 1.6 2.1 0.8 3.3 0.8 37.1
Gulburak_T Batken 4 40.6 14.6 1.1 3.0 5.8 1.6 -9.2 0.3 1.7 1.1 1.2 0.6 25.7 1.0 48.5
Azamat_T Osh 5 41.2 9.2 0.8 2.0 3.3 0.2 7.6 1.2 2.6 1.3 1.6 0.5 3.4 2.0 35.7
Zhiidegul_M Batken 10 41.2 5.0 1.4 3.6 4.2 2.2 9.0 0.6 2.0 1.8 1.4 0.7 2.3 1.1 35.3

Answer Quality

Don’t Knows

Statistics:

  • The median survey has 4 “don’t know” answers.
  • The 75th percentile survey has 12 “don’t know” answers.
  • The median enumerator has 5 “don’t know” answers on average.

The enumerators below have recorded a very large number of Don’t Knows on many surveys! We expect some respondents will say don’t know, but enumerators should not consistently report more Don’t Knows than other enumerators!

Most Don’t Knows by Enumerator (Last week)
Enumerator ono Surveys Surveys > 75 perc DKs Median Max
Dinara_R Jalal-Abad 32 29 21 35
Осмонова Венера Jalal-Abad 31 26 20 39
Azamat_A Jalal-Abad 14 10 19 32
Садыкова Чинара Jalal-Abad 27 15 15 31
Baktybek_M Batken 9 5 14 24
Tattybubu_M Osh 15 5 10 22
Zhiidegul_M Batken 10 3 9 18
Nazgul_P Osh 8 3 8 19

Agree / Disagree

This table shows the average HHI, by enumerator, of the responses to 25 agreement-style questions in the survey. The HHI is a metric that indicates the ‘diversification’ in responses to the agreement questions.

An average HHI of 1 indicates that the enumerator records the same answer for all 25 agreement questions on every survey they enumerated. As the average HHI approaches 0, it indicates that the enumerator tends to record the same number of responses at each level of agreement for each survey.

Average HHIs above 0.70 indicate the enumerator is very often recording the same answer. Average HHIs below 0.3 indicate the enumerator is recording a lot of different options.

Agree / Disagree Responses per Enumerator (last week)
Oblast Enumerator Surveys Avg HHI Avg % Str. Agr Avg % Agr Avg % Neither Avg % Dis Avg % Str. Dis Avg % DK
Osh Kunduz_K 10 0.264 0.223 0.24 0.236 0.18 0.158 0.021

Summary of problematic interviews

How problematic interviews are determined:

  • Duration : the number of sections with time stamps below 25 percentile. The following sections are assessed: B, D1 (electricity), D2 (other services), E, F, G1 (covid), G2 (climate change), H2 (disability), Total survey (sections B-I). Since survey time can sometimes be unreliable if the respondent goes back to the beginning of the survey, I look at the number of sections that are very short - not just the total survey time.
  • Don’t Knows : how many don’t know responses are in the survey
  • Similarity in Question Response : how similar answers are to agree/disagree questions (for example, if the enumerator selects ``somewhat agree” in 95% A/D questions)
  • Location: respondents should not all be in the same location.

Please check the file issues_20240923.csv to see all problematic interviews. Below is just a summary by oblast.

Problematic Surveys by Oblast
Date Batken Jalal-Abad Osh
Aug 20 3 7 27
Aug 21 7 7 48
Aug 22 4 13 31
Aug 23 2 12 16
Aug 24 3 6 20
Aug 25 10 17 32
Aug 26 7 14 13
Aug 27 3 23 16
Aug 28 2 21 22
Aug 29 11 28 19
Aug 30 8 24 16
Aug 31 27 28 14
Sep 01 14 17 29
Sep 02 4 20 12
Sep 03 1 23 8
Sep 04 5 20 6
Sep 05 4 15 0
Sep 06 3 22 11
Sep 07 21 35 32
Sep 08 18 35 50
Sep 09 12 27 7
Sep 10 13 36 10
Sep 11 2 24 15
Sep 12 1 31 8
Sep 13 21 13 1
Sep 14 18 14 17
Sep 15 18 6 19
Sep 16 0 9 0
Sep 17 9 0 0
Sep 18 8 6 18
Sep 19 12 6 0
Sep 20 1 6 7
Sep 21 19 18 18
Sep 22 10 6 7
Oct 09 1 0 0
Total 302 589 549 
## # A tibble: 215 × 7
## # Groups:   fi, fs [43]
##    fi                        fs date_text     n median perc25 perc75
##    <chr>                  <int> <chr>     <int>  <dbl>  <dbl>  <dbl>
##  1 "358\nОсмонова Венера"     2 Sep 14        1   54.8   54.8   54.8
##  2 "358-091-016"              2 Sep 14        1   44.1   44.1   44.1
##  3 "Adilet_S"                 4 Sep 09        6   70.0   64.4   80.6
##  4 "Adilet_S"                 4 Sep 10        7   45.2   43.1   56.0
##  5 "Adilet_S"                 4 Sep 11        2   85.8   79.4   92.2
##  6 "Adilet_S"                 4 Sep 12        5   62.8   62.3   70.8
##  7 "Adilet_S"                 4 Sep 14        5   63.4   54     71.9
##  8 "Adilet_S"                 4 Sep 15        4   64.9   63.5   69.8
##  9 "Adilet_S"                 4 Sep 18        6   36.8   27.9   45.7
## 10 "Adilet_S"                 4 Sep 20        8   48.5   44.0   50.3
## # ℹ 205 more rows

Summary of enumerator performance

The following table shows indicators for enumerator performance. You can sort the table to see how enumerators perform.

Please pay special attention to the following enumerators: Tynychbek_A, Nazgul_P, Карабаев, Baktybek_M, Dinara_R, Akmaral_M, Gulmira_Im, Busadat_S, Zhiidegul_M, Omurbek_A, Gulmira_D, Осмонова Венера, Садыкова Чинара, Gulmira_Is, Adilet_S, Turgunai_S, Azamat_A!!