Data Visualization and Automated Reporting Strategies

Data Visualization and Automated Reporting Strategies

We will use your training datasets to explore R’s data visualization and automated reporting capabilities. Those datasets include:

  1. GSU DSPETL Cohort 2
  2. TJMHC Community Survey
  3. 5th Annual ECE Leadership Summit Evaluation

Import Data and Packages

Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'readxl' successfully unpacked and MD5 sums checked
Warning: cannot remove prior installation of package 'readxl'
Warning in file.copy(savedcopy, lib, recursive = TRUE): problem copying
C:\Users\17062\AppData\Local\R\win-library\4.5\00LOCK\readxl\libs\x64\readxl.dll
to C:\Users\17062\AppData\Local\R\win-library\4.5\readxl\libs\x64\readxl.dll:
Permission denied
Warning: restored 'readxl'

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages

Make sure that R knows what folder or directory you are working. This will help R know where to pull the datasets from when importing the data.

New names:
New names:
New names:
New names:
New names:
• `` -> `...10`
• `` -> `...11`
• `` -> `...12`
• `` -> `...13`
• `` -> `...14`
• `` -> `...15`
• `` -> `...16`
• `` -> `...17`
• `` -> `...18`
• `` -> `...19`
• `` -> `...20`
• `` -> `...21`
• `` -> `...22`
• `` -> `...23`
• `` -> `...24`
• `` -> `...25`
• `` -> `...26`
• `` -> `...27`
• `` -> `...28`
• `` -> `...29`
• `` -> `...30`
• `` -> `...31`
• `` -> `...33`
• `` -> `...34`
• `` -> `...35`
• `` -> `...36`
• `` -> `...37`
• `` -> `...38`
• `` -> `...39`
• `` -> `...40`
• `` -> `...41`
• `` -> `...42`
• `` -> `...43`
• `` -> `...44`
• `` -> `...45`
• `` -> `...46`
• `` -> `...47`
• `` -> `...48`
• `` -> `...49`
• `` -> `...50`
• `` -> `...51`
• `` -> `...52`
• `` -> `...53`
• `` -> `...54`
• `` -> `...56`
• `` -> `...57`
• `` -> `...58`
• `` -> `...59`
• `` -> `...60`
• `` -> `...61`
• `` -> `...62`
• `` -> `...63`
• `` -> `...64`
• `` -> `...65`
• `` -> `...66`
• `` -> `...67`
• `` -> `...68`
• `` -> `...69`
• `` -> `...70`
• `` -> `...71`
• `` -> `...72`
• `` -> `...73`
• `` -> `...74`
• `` -> `...75`
• `` -> `...76`
• `` -> `...77`
• `` -> `...79`
• `` -> `...80`
• `` -> `...81`
• `` -> `...82`
• `` -> `...83`
• `` -> `...84`
• `` -> `...85`
• `` -> `...86`
• `` -> `...87`
• `` -> `...88`
• `` -> `...89`
• `` -> `...90`
• `` -> `...91`
• `` -> `...92`
• `` -> `...93`
• `` -> `...94`
• `` -> `...95`
• `` -> `...96`
• `` -> `...97`
• `` -> `...98`
• `` -> `...99`
• `` -> `...100`

Working with SurveyMonkey Data in R

Data from data collection platforms like SurveyMonkey can be messy and unorganized. R is capable of cleaning and processing data with the tidyverse tools we are familiar with. Thankfully, SurveyMonkey is consistent with the way it formats messy data. That means that you can create a template that you can adjust each time you encounter messy data for SurveMonkey.

This is called codebasing, or creating a library of script templates based on tasks and you normally complete in R.

Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'tidyverse' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
── Attaching core tidyverse packages ──────────────────────── tidyverse 2.0.0 ──
✔ dplyr     1.1.4     ✔ readr     2.1.5
✔ forcats   1.0.0     ✔ stringr   1.5.1
✔ ggplot2   3.5.2     ✔ tibble    3.2.1
✔ lubridate 1.9.4     ✔ tidyr     1.3.1
✔ purrr     1.0.4     
── Conflicts ────────────────────────────────────────── tidyverse_conflicts() ──
✖ dplyr::filter() masks stats::filter()
✖ dplyr::lag()    masks stats::lag()
ℹ Use the conflicted package (<http://conflicted.r-lib.org/>) to force all conflicts to become errors

Data Cleaning Strategy

Let’s lay out the strategy we want to take for cleaning our data. We can think about what we want to keep, remove, and reorganize.

  1. We want to remove blank or NA rows if they are missing or empty values.
  2. We want responses organized by respondent.
  3. We want each variable/measure/question to have it’s own column
  4. We want each value/observation/answer to have it’s own row.

Data Profiling - Here we will consider the following points:

How many rows and columns do we have?

How many are empty and why?

Which columns should we keep?

What variables can help us organize and understand our data?

We could do this manually by running manual analyses on all of our variables, or we could make this task easier with some packages that can help automate the exploration process. We will use and compare

  1. DataExplorer
  2. explore
  3. summarytools
  4. inspectdf
  5. dataMaid
  6. skimr
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'DataExplorer' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'explore' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'summarytools' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'inspectdf' successfully unpacked and MD5 sums checked
Warning: cannot remove prior installation of package 'inspectdf'
Warning in file.copy(savedcopy, lib, recursive = TRUE): problem copying
C:\Users\17062\AppData\Local\R\win-library\4.5\00LOCK\inspectdf\libs\x64\inspectdf.dll
to
C:\Users\17062\AppData\Local\R\win-library\4.5\inspectdf\libs\x64\inspectdf.dll:
Permission denied
Warning: restored 'inspectdf'

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'dataMaid' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Installing package into 'C:/Users/17062/AppData/Local/R/win-library/4.5'
(as 'lib' is unspecified)
package 'skimr' successfully unpacked and MD5 sums checked

The downloaded binary packages are in
    C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\downloaded_packages
Loading required package: DataExplorer
Loading required package: explore
Loading required package: corrplot
corrplot 0.95 loaded
Loading required package: summarytools

Attaching package: 'summarytools'
The following object is masked from 'package:tibble':

    view
Loading required package: inspectdf
Loading required package: dataMaid

Attaching package: 'dataMaid'
The following object is masked from 'package:dplyr':

    summarize
Loading required package: skimr
[[1]]
[1] TRUE

[[2]]
[1] TRUE

[[3]]
[1] TRUE

[[4]]
[1] TRUE

[[5]]
[1] TRUE

[[6]]
[1] TRUE

[[7]]
[1] TRUE

Concept Check: The lapply() function can be used to use that function over an entire data object. In this case, we used it to install a data list of our packages so we don’t have to load each one individually. It can help save time.

Using our different data tools to explore will tell us more or less the same thing: this dataset is too messy to make sense of as it is based on the missing data and NA rows



processing file: report.rmd

  |                                           
  |                                     |   0%
  |                                           
  |.                                    |   2%                                 
  |                                           
  |..                                   |   5% [global_options]                
  |                                           
  |...                                  |   7%                                 
  |                                           
  |....                                 |  10% [introduce]                     
  |                                           
  |....                                 |  12%                                 
  |                                           
  |.....                                |  14% [plot_intro]                    

  |                                           
  |......                               |  17%                                 
  |                                           
  |.......                              |  19% [data_structure]                
  |                                           
  |........                             |  21%                                 
  |                                           
  |.........                            |  24% [missing_profile]               

  |                                           
  |..........                           |  26%                                 
  |                                           
  |...........                          |  29% [univariate_distribution_header]
  |                                           
  |...........                          |  31%                                 
  |                                           
  |............                         |  33% [plot_histogram]                

  |                                           
  |.............                        |  36%                                 
  |                                           
  |..............                       |  38% [plot_density]                  
  |                                           
  |...............                      |  40%                                 
  |                                           
  |................                     |  43% [plot_frequency_bar]            

  |                                           
  |.................                    |  45%                                 
  |                                           
  |..................                   |  48% [plot_response_bar]             
  |                                           
  |..................                   |  50%                                 
  |                                           
  |...................                  |  52% [plot_with_bar]                 
  |                                           
  |....................                 |  55%                                 
  |                                           
  |.....................                |  57% [plot_normal_qq]                

  |                                           
  |......................               |  60%                                 
  |                                           
  |.......................              |  62% [plot_response_qq]              
  |                                           
  |........................             |  64%                                 
  |                                           
  |.........................            |  67% [plot_by_qq]                    
  |                                           
  |..........................           |  69%                                 
  |                                           
  |..........................           |  71% [correlation_analysis]          

  |                                           
  |...........................          |  74%                                 
  |                                           
  |............................         |  76% [principal_component_analysis]  

  |                                           
  |.............................        |  79%                                 
  |                                           
  |..............................       |  81% [bivariate_distribution_header] 
  |                                           
  |...............................      |  83%                                 
  |                                           
  |................................     |  86% [plot_response_boxplot]         
  |                                           
  |.................................    |  88%                                 
  |                                           
  |.................................    |  90% [plot_by_boxplot]               
  |                                           
  |..................................   |  93%                                 
  |                                           
  |...................................  |  95% [plot_response_scatterplot]     
  |                                           
  |.................................... |  98%                                 
  |                                           
  |.....................................| 100% [plot_by_scatterplot]           
                                                                                                                           
output file: C:/Users/17062/OneDrive/Documents/Data Science/R/CoachR/Transform with TRE/report.knit.md
"C:/Program Files/RStudio/resources/app/bin/quarto/bin/tools/pandoc" +RTS -K512m -RTS "C:\Users\17062\OneDrive\DOCUME~1\DATASC~1\R\CoachR\TRANSF~1\REPORT~1.MD" --to html4 --from markdown+autolink_bare_uris+tex_math_single_backslash --output pandoc72e472a5144e.html --lua-filter "C:\Users\17062\AppData\Local\R\win-library\4.5\rmarkdown\rmarkdown\lua\pagebreak.lua" --lua-filter "C:\Users\17062\AppData\Local\R\win-library\4.5\rmarkdown\rmarkdown\lua\latex-div.lua" --lua-filter "C:\Users\17062\AppData\Local\R\win-library\4.5\rmarkdown\rmarkdown\lua\table-classes.lua" --embed-resources --standalone --variable bs3=TRUE --section-divs --table-of-contents --toc-depth 6 --template "C:\Users\17062\AppData\Local\R\win-library\4.5\rmarkdown\rmd\h\default.html" --no-highlight --variable highlightjs=1 --variable theme=yeti --mathjax --variable "mathjax-url=https://mathjax.rstudio.com/latest/MathJax.js?config=TeX-AMS-MML_HTMLorMML" --include-in-header "C:\Users\17062\AppData\Local\Temp\Rtmp0OSurB\rmarkdown-str72e41e72a3a.html" 

Output created: report.html
Warning in explore_shiny(data, ...): This function can only be used in an
interactive R session
Data Frame Summary  
gsu.sheet1  
Dimensions: 24 x 100  
Duplicates: 0  

--------------------------------------------------------------------------------------------------------------------
No    Variable          Stats / Values                 Freqs (% of Valid)   Graph               Valid      Missing  
----- ----------------- ------------------------------ -------------------- ------------------- ---------- ---------
1     Fellow Number     Mean (sd) : 12 (6.9)           21 distinct values   :   :               21         3        
      [numeric]         min < med < max:                                    : : : :             (87.5%)    (12.5%)  
                        1 < 12 < 23                                         : : : : :                               
                        IQR (CV) : 12 (0.6)                                 : : : : :                               
                                                                            : : : : :                               

2     Last Name         1. Alton                        1 ( 4.8%)                               21         3        
      [character]       2. Brown                        1 ( 4.8%)                               (87.5%)    (12.5%)  
                        3. Bryant                       1 ( 4.8%)                                                   
                        4. Christie                     1 ( 4.8%)                                                   
                        5. Coates                       1 ( 4.8%)                                                   
                        6. Collins                      1 ( 4.8%)                                                   
                        7. Grigsby                      1 ( 4.8%)                                                   
                        8. Jocelyn                      1 ( 4.8%)                                                   
                        9. Johnson                      1 ( 4.8%)                                                   
                        10. Kimbrough                   1 ( 4.8%)                                                   
                        [ 11 others ]                  11 (52.4%)           IIIIIIIIII                              

3     First Name        1. Alanna                       1 ( 4.8%)                               21         3        
      [character]       2. Ashlee                       1 ( 4.8%)                               (87.5%)    (12.5%)  
                        3. Carol                        1 ( 4.8%)                                                   
                        4. Charell                      1 ( 4.8%)                                                   
                        5. Isela                        1 ( 4.8%)                                                   
                        6. Jacole                       1 ( 4.8%)                                                   
                        7. Jared                        1 ( 4.8%)                                                   
                        8. Javarius                     1 ( 4.8%)                                                   
                        9. Jelissa                      1 ( 4.8%)                                                   
                        10. Le'Metrius                  1 ( 4.8%)                                                   
                        [ 11 others ]                  11 (52.4%)           IIIIIIIIII                              

4     Gender            1. Female                      15 (71.4%)           IIIIIIIIIIIIII      21         3        
      [character]       2. Male                         6 (28.6%)           IIIII               (87.5%)    (12.5%)  

5     Race/Ethnicity    1. Black                       16 (76.2%)           IIIIIIIIIIIIIII     21         3        
      [character]       2. Caribbean/West Indian        1 ( 4.8%)                               (87.5%)    (12.5%)  
                        3. Hispanic                     1 ( 4.8%)                                                   
                        4. White                        3 (14.3%)           II                                      

6     Grade Band        1. High                        10 (47.6%)           IIIIIIIII           21         3        
      [character]       2. Middle                      11 (52.4%)           IIIIIIIIII          (87.5%)    (12.5%)  

7     Content Area      1. Math                         7 (33.3%)           IIIIII              21         3        
      [character]       2. Science                     14 (66.7%)           IIIIIIIIIIIII       (87.5%)    (12.5%)  

8     School District   1. Average                      1 ( 4.5%)                               22         2        
      [character]       2. DeKalb                       1 ( 4.5%)                               (91.7%)    (8.3%)   
                        3. Fulton                      10 (45.5%)           IIIIIIIII                               
                        4. Rockdale                    10 (45.5%)           IIIIIIIII                               

9     Summer 2020       1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.53                        1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           3 (13.6%)            II                                      
                        6. Handle a range of classro   1 ( 4.5%)                                                    
                        7. How prepared did you feel   1 ( 4.5%)                                                    

10    ...10             1. 2                           6 (28.6%)            IIIII               21         3        
      [character]       2. 3                           3 (14.3%)            II                  (87.5%)    (12.5%)  
                        3. 3.37                        1 ( 4.8%)                                                    
                        4. 4                           7 (33.3%)            IIIIII                                  
                        5. 5                           3 (14.3%)            II                                      
                        6. Use a variety of instruct   1 ( 4.8%)                                                    

11    ...11             1. 2                           1 ( 4.8%)                                21         3        
      [character]       2. 3                           8 (38.1%)            IIIIIII             (87.5%)    (12.5%)  
                        3. 3.74                        1 ( 4.8%)                                                    
                        4. 4                           5 (23.8%)            IIII                                    
                        5. 5                           5 (23.8%)            IIII                                    
                        6. Teach your content area     1 ( 4.8%)                                                    

12    ...12             1. 3                           6 (28.6%)            IIIII               21         3        
      [character]       2. 3.89                        1 ( 4.8%)                                (87.5%)    (12.5%)  
                        3. 4                           9 (42.9%)            IIIIIIII                                
                        4. 5                           4 (19.0%)            III                                     
                        5. Use technology in classro   1 ( 4.8%)                                                    

13    ...13             1. 2                           2 ( 9.5%)            I                   21         3        
      [character]       2. 3                           6 (28.6%)            IIIII               (87.5%)    (12.5%)  
                        3. 3.58                        1 ( 4.8%)                                                    
                        4. 4                           9 (42.9%)            IIIIIIII                                
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Assess students             1 ( 4.8%)                                                    

14    ...14             1. 1                           1 ( 4.8%)                                21         3        
      [character]       2. 2                           3 (14.3%)            II                  (87.5%)    (12.5%)  
                        3. 3                           6 (28.6%)            IIIII                                   
                        4. 3.21                        1 ( 4.8%)                                                    
                        5. 4                           9 (42.9%)            IIIIIIII                                
                        6. Differentiate instruction   1 ( 4.8%)                                                    

15    ...15             1. 1                           1 ( 4.8%)                                21         3        
      [character]       2. 2                           3 (14.3%)            II                  (87.5%)    (12.5%)  
                        3. 3                           5 (23.8%)            IIII                                    
                        4. 3.37                        1 ( 4.8%)                                                    
                        5. 4                           8 (38.1%)            IIIIIII                                 
                        6. 5                           2 ( 9.5%)            I                                       
                        7. Use data from student ass   1 ( 4.8%)                                                    

16    ...16             1. 1                            1 ( 4.8%)                               21         3        
      [character]       2. 2                            1 ( 4.8%)                               (87.5%)    (12.5%)  
                        3. 3                            5 (23.8%)           IIII                                    
                        4. 3.58                         1 ( 4.8%)                                                   
                        5. 4                           10 (47.6%)           IIIIIIIII                               
                        6. 5                            2 ( 9.5%)           I                                       
                        7. Meet state content standa    1 ( 4.8%)                                                   

17    ...17             1. 2                            3 (14.3%)           II                  21         3        
      [character]       2. 3                           11 (52.4%)           IIIIIIIIII          (87.5%)    (12.5%)  
                        3. 3.16                         1 ( 4.8%)                                                   
                        4. 4                            4 (19.0%)           III                                     
                        5. 5                            1 ( 4.8%)                                                   
                        6. Plan project-based and in    1 ( 4.8%)                                                   

18    ...18             1. 1                           1 ( 4.8%)                                21         3        
      [character]       2. 2                           3 (14.3%)            II                  (87.5%)    (12.5%)  
                        3. 3                           8 (38.1%)            IIIIIII                                 
                        4. 3.11                        1 ( 4.8%)                                                    
                        5. 4                           7 (33.3%)            IIIIII                                  
                        6. Teach project-based and i   1 ( 4.8%)                                                    

19    ...19             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.32                        1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           1 ( 4.5%)                                                    
                        6. How prepared did you feel   1 ( 4.5%)                                                    
                        7. Understand how students l   1 ( 4.5%)                                                    

20    ...20             1. 3                           7 (33.3%)            IIIIII              21         3        
      [character]       2. 3.79                        1 ( 4.8%)                                (87.5%)    (12.5%)  
                        3. 4                           9 (42.9%)            IIIIIIII                                
                        4. 5                           3 (14.3%)            II                                      
                        5. Understand that students    1 ( 4.8%)                                                    

21    ...21             1. 2                           4 (19.0%)            III                 21         3        
      [character]       2. 3                           5 (23.8%)            IIII                (87.5%)    (12.5%)  
                        3. 3.37                        1 ( 4.8%)                                                    
                        4. 4                           9 (42.9%)            IIIIIIII                                
                        5. 5                           1 ( 4.8%)                                                    
                        6. Understand the central co   1 ( 4.8%)                                                    

22    ...22             1. 2                           4 (19.0%)            III                 21         3        
      [character]       2. 3                           5 (23.8%)            IIII                (87.5%)    (12.5%)  
                        3. 3.42                        1 ( 4.8%)                                                    
                        4. 4                           8 (38.1%)            IIIIIII                                 
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Create learning experienc   1 ( 4.8%)                                                    

23    ...23             1. 2                           4 (19.0%)            III                 21         3        
      [character]       2. 3                           7 (33.3%)            IIIIII              (87.5%)    (12.5%)  
                        3. 3.32                        1 ( 4.8%)                                                    
                        4. 4                           6 (28.6%)            IIIII                                   
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Provide learning opportun   1 ( 4.8%)                                                    

24    ...24             1. 2                           3 (14.3%)            II                  21         3        
      [character]       2. 3                           8 (38.1%)            IIIIIII             (87.5%)    (12.5%)  
                        3. 3.37                        1 ( 4.8%)                                                    
                        4. 4                           6 (28.6%)            IIIII                                   
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Create instructional oppo   1 ( 4.8%)                                                    

25    ...25             1. 2                           3 (14.3%)            II                  21         3        
      [character]       2. 3                           7 (33.3%)            IIIIII              (87.5%)    (12.5%)  
                        3. 3.42                        1 ( 4.8%)                                                    
                        4. 4                           7 (33.3%)            IIIIII                                  
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Use a variety of instruct   1 ( 4.8%)                                                    

26    ...26             1. 2                           2 ( 9.5%)            I                   21         3        
      [character]       2. 3                           5 (23.8%)            IIII                (87.5%)    (12.5%)  
                        3. 3.79                        1 ( 4.8%)                                                    
                        4. 4                           7 (33.3%)            IIIIII                                  
                        5. 5                           5 (23.8%)            IIII                                    
                        6. Use technology effectivel   1 ( 4.8%)                                                    

27    ...27             1. 2                           2 ( 9.5%)            I                   21         3        
      [character]       2. 3                           9 (42.9%)            IIIIIIII            (87.5%)    (12.5%)  
                        3. 3.37                        1 ( 4.8%)                                                    
                        4. 4                           7 (33.3%)            IIIIII                                  
                        5. 5                           1 ( 4.8%)                                                    
                        6. Understand and use best p   1 ( 4.8%)                                                    

28    ...28             1. 2                           3 (14.3%)            II                  21         3        
      [character]       2. 3                           7 (33.3%)            IIIIII              (87.5%)    (12.5%)  
                        3. 3.37                        1 ( 4.8%)                                                    
                        4. 4                           8 (38.1%)            IIIIIII                                 
                        5. 5                           1 ( 4.8%)                                                    
                        6. Adapt instruction based u   1 ( 4.8%)                                                    

29    ...29             1. 2                           1 ( 4.8%)                                21         3        
      [character]       2. 3                           9 (42.9%)            IIIIIIII            (87.5%)    (12.5%)  
                        3. 3.53                        1 ( 4.8%)                                                    
                        4. 4                           7 (33.3%)            IIIIII                                  
                        5. 5                           2 ( 9.5%)            I                                       
                        6. Evaluate the effects of m   1 ( 4.8%)                                                    

30    ...30             1. 2                            1 ( 4.8%)                               21         3        
      [character]       2. 3                           10 (47.6%)           IIIIIIIII           (87.5%)    (12.5%)  
                        3. 3.42                         1 ( 4.8%)                                                   
                        4. 4                            7 (33.3%)           IIIIII                                  
                        5. 5                            1 ( 4.8%)                                                   
                        6. Understand the importance    1 ( 4.8%)                                                   

31    ...31             1. 3.05                        2 ( 9.5%)            I                   21         3        
      [character]       2. 3.64                        2 ( 9.5%)            I                   (87.5%)    (12.5%)  
                        3. 3.73                        2 ( 9.5%)            I                                       
                        4. 2.09                        1 ( 4.8%)                                                    
                        5. 2.5                         1 ( 4.8%)                                                    
                        6. 2.73                        1 ( 4.8%)                                                    
                        7. 2.82                        1 ( 4.8%)                                                    
                        8. 2.86                        1 ( 4.8%)                                                    
                        9. 3.23                        1 ( 4.8%)                                                    
                        10. 3.45                       1 ( 4.8%)                                                    
                        [ 8 others ]                   8 (38.1%)            IIIIIII                                 

32    Spring 2021       1. 3                           9 (39.1%)            IIIIIII             23         1        
      [character]       2. 3.85                        1 ( 4.3%)                                (95.8%)    (4.2%)   
                        3. 4                           5 (21.7%)            IIII                                    
                        4. 5                           6 (26.1%)            IIIII                                   
                        5. Handle a range of classro   1 ( 4.3%)                                                    
                        6. How prepared did you feel   1 ( 4.3%)                                                    

33    ...33             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.85                        1 ( 4.5%)                                                    
                        4. 4                           8 (36.4%)            IIIIIII                                 
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Use a variety of instruct   1 ( 4.5%)                                                    

34    ...34             1. 2                           2 ( 9.1%)            I                   22         2        
      [character]       2. 3                           4 (18.2%)            III                 (91.7%)    (8.3%)   
                        3. 4                           7 (31.8%)            IIIIII                                  
                        4. 5                           8 (36.4%)            IIIIIII                                 
                        5. Teach your content area     1 ( 4.5%)                                                    

35    ...35             1. 3                            6 (27.3%)           IIIII               22         2        
      [character]       2. 4                            4 (18.2%)           III                 (91.7%)    (8.3%)   
                        3. 4.2                          1 ( 4.5%)                                                   
                        4. 5                           10 (45.5%)           IIIIIIIII                               
                        5. Use technology in classro    1 ( 4.5%)                                                   

36    ...36             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.8                         1 ( 4.5%)                                                    
                        4. 4                           9 (40.9%)            IIIIIIII                                
                        5. 5                           4 (18.2%)            III                                     
                        6. Assess students             1 ( 4.5%)                                                    

37    ...37             1. 2                           4 (18.2%)            III                 22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.61                        1 ( 4.5%)                                                    
                        4. 4                           4 (18.2%)            III                                     
                        5. 5                           4 (18.2%)            III                                     
                        6. Differentiate instruction   1 ( 4.5%)                                                    

38    ...38             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           7 (31.8%)            IIIIII              (91.7%)    (8.3%)   
                        3. 3.5                         1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           3 (13.6%)            II                                      
                        6. Use data from student ass   1 ( 4.5%)                                                    

39    ...39             1. 2                           2 ( 9.1%)            I                   22         2        
      [character]       2. 3                           4 (18.2%)            III                 (91.7%)    (8.3%)   
                        3. 3.85                        1 ( 4.5%)                                                    
                        4. 4                           9 (40.9%)            IIIIIIII                                
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Meet state content standa   1 ( 4.5%)                                                    

40    ...40             1. 2                           7 (31.8%)            IIIIII              22         2        
      [character]       2. 2.95                        1 ( 4.5%)                                (91.7%)    (8.3%)   
                        3. 3                           8 (36.4%)            IIIIIII                                 
                        4. 4                           4 (18.2%)            III                                     
                        5. 5                           1 ( 4.5%)                                                    
                        6. Plan project-based and in   1 ( 4.5%)                                                    

41    ...41             1. 2                           5 (22.7%)            IIII                22         2        
      [character]       2. 3                           9 (40.9%)            IIIIIIII            (91.7%)    (8.3%)   
                        3. 3.15                        1 ( 4.5%)                                                    
                        4. 4                           4 (18.2%)            III                                     
                        5. 5                           2 ( 9.1%)            I                                       
                        6. Teach project-based and i   1 ( 4.5%)                                                    

42    ...42             1. 3                            8 (34.8%)           IIIIII              23         1        
      [character]       2. 3.7                          1 ( 4.3%)                               (95.8%)    (4.2%)   
                        3. 4                           10 (43.5%)           IIIIIIII                                
                        4. 5                            2 ( 8.7%)           I                                       
                        5. How prepared do you feel     1 ( 4.3%)                                                   
                        6. Understand how students l    1 ( 4.3%)                                                   

43    ...43             1. 3                           5 (22.7%)            IIII                22         2        
      [character]       2. 4                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 4.0999999999999996          1 ( 4.5%)                                                    
                        4. 5                           7 (31.8%)            IIIIII                                  
                        5. Understand that students    1 ( 4.5%)                                                    

44    ...44             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.55                        1 ( 4.5%)                                                    
                        4. 4                           8 (36.4%)            IIIIIII                                 
                        5. 5                           3 (13.6%)            II                                      
                        6. Understand the central co   1 ( 4.5%)                                                    

45    ...45             1. 2                           2 ( 9.1%)            I                   22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.7                         1 ( 4.5%)                                                    
                        4. 4                           8 (36.4%)            IIIIIII                                 
                        5. 5                           4 (18.2%)            III                                     
                        6. Create learning experienc   1 ( 4.5%)                                                    

46    ...46             1. 3                           8 (36.4%)            IIIIIII             22         2        
      [character]       2. 3.9                         1 ( 4.5%)                                (91.7%)    (8.3%)   
                        3. 4                           6 (27.3%)            IIIII                                   
                        4. 5                           6 (27.3%)            IIIII                                   
                        5. Provide learning opportun   1 ( 4.5%)                                                    

47    ...47             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.75                        1 ( 4.5%)                                                    
                        4. 4                           6 (27.3%)            IIIII                                   
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Create instructional oppo   1 ( 4.5%)                                                    

48    ...48             1. 2                           2 ( 9.1%)            I                   22         2        
      [character]       2. 3                           7 (31.8%)            IIIIII              (91.7%)    (8.3%)   
                        3. 3.7                         1 ( 4.5%)                                                    
                        4. 4                           6 (27.3%)            IIIII                                   
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Use a variety of instruct   1 ( 4.5%)                                                    

49    ...49             1. 3                           7 (31.8%)            IIIIII              22         2        
      [character]       2. 4                           4 (18.2%)            III                 (91.7%)    (8.3%)   
                        3. 4.0999999999999996          1 ( 4.5%)                                                    
                        4. 5                           9 (40.9%)            IIIIIIII                                
                        5. Use technology effectivel   1 ( 4.5%)                                                    

50    ...50             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.6                         1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           4 (18.2%)            III                                     
                        6. Understand and use best p   1 ( 4.5%)                                                    

51    ...51             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           7 (31.8%)            IIIIII              (91.7%)    (8.3%)   
                        3. 3.6                         1 ( 4.5%)                                                    
                        4. 4                           5 (22.7%)            IIII                                    
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Adapt instruction based u   1 ( 4.5%)                                                    

52    ...52             1. 3                           7 (31.8%)            IIIIII              22         2        
      [character]       2. 3.9                         1 ( 4.5%)                                (91.7%)    (8.3%)   
                        3. 4                           8 (36.4%)            IIIIIII                                 
                        4. 5                           5 (22.7%)            IIII                                    
                        5. Evaluate the effects of m   1 ( 4.5%)                                                    

53    ...53             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           4 (18.2%)            III                 (91.7%)    (8.3%)   
                        3. 3.75                        1 ( 4.5%)                                                    
                        4. 4                           8 (36.4%)            IIIIIII                                 
                        5. 5                           5 (22.7%)            IIII                                    
                        6. Understand the importance   1 ( 4.5%)                                                    

54    ...54             1. 3.09                        2 ( 9.1%)            I                   22         2        
      [character]       2. 3.55                        2 ( 9.1%)            I                   (91.7%)    (8.3%)   
                        3. 4                           2 ( 9.1%)            I                                       
                        4. 4.09                        2 ( 9.1%)            I                                       
                        5. 2.77                        1 ( 4.5%)                                                    
                        6. 2.86                        1 ( 4.5%)                                                    
                        7. 2.95                        1 ( 4.5%)                                                    
                        8. 3                           1 ( 4.5%)                                                    
                        9. 3.45                        1 ( 4.5%)                                                    
                        10. 3.64                       1 ( 4.5%)                                                    
                        [ 8 others ]                   8 (36.4%)            IIIIIII                                 

55    Spring 2022       1. 2                           1 ( 4.3%)                                23         1        
      [character]       2. 3                           6 (26.1%)            IIIII               (95.8%)    (4.2%)   
                        3. 3.9                         1 ( 4.3%)                                                    
                        4. 4                           7 (30.4%)            IIIIII                                  
                        5. 5                           6 (26.1%)            IIIII                                   
                        6. Handle a range of classro   1 ( 4.3%)                                                    
                        7. How prepared did you feel   1 ( 4.3%)                                                    

56    ...56             1. 3                           5 (22.7%)            IIII                22         2        
      [character]       2. 4                           9 (40.9%)            IIIIIIII            (91.7%)    (8.3%)   
                        3. 4.05                        1 ( 4.5%)                                                    
                        4. 5                           6 (27.3%)            IIIII                                   
                        5. Use a variety of instruct   1 ( 4.5%)                                                    

57    ...57             1. 2                            1 ( 4.5%)                               22         2        
      [character]       2. 3                            3 (13.6%)           II                  (91.7%)    (8.3%)   
                        3. 4                            4 (18.2%)           III                                     
                        4. 4.3499999999999996           1 ( 4.5%)                                                   
                        5. 5                           12 (54.5%)           IIIIIIIIII                              
                        6. Teach your content area      1 ( 4.5%)                                                   

58    ...58             1. 3                           3 (13.6%)            II                  22         2        
      [character]       2. 4                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 4.3                         1 ( 4.5%)                                                    
                        4. 5                           9 (40.9%)            IIIIIIII                                
                        5. Use technology in classro   1 ( 4.5%)                                                    

59    ...59             1. 3                           7 (31.8%)            IIIIII              22         2        
      [character]       2. 3.9                         1 ( 4.5%)                                (91.7%)    (8.3%)   
                        3. 4                           8 (36.4%)            IIIIIII                                 
                        4. 5                           5 (22.7%)            IIII                                    
                        5. Assess students             1 ( 4.5%)                                                    

60    ...60             1. 2                           2 ( 9.1%)            I                   22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.6                         1 ( 4.5%)                                                    
                        4. 4                           6 (27.3%)            IIIII                                   
                        5. 5                           4 (18.2%)            III                                     
                        6. Differentiate instruction   1 ( 4.5%)                                                    

61    ...61             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           5 (22.7%)            IIII                (91.7%)    (8.3%)   
                        3. 4                           5 (22.7%)            IIII                                    
                        4. 4.0999999999999996          1 ( 4.5%)                                                    
                        5. 5                           9 (40.9%)            IIIIIIII                                
                        6. Use data from student ass   1 ( 4.5%)                                                    

62    ...62             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           4 (18.2%)            III                 (91.7%)    (8.3%)   
                        3. 4                           8 (36.4%)            IIIIIII                                 
                        4. 4.05                        1 ( 4.5%)                                                    
                        5. 5                           7 (31.8%)            IIIIII                                  
                        6. Meet state content standa   1 ( 4.5%)                                                    

63    ...63             1. 2                           5 (22.7%)            IIII                22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.2                         1 ( 4.5%)                                                    
                        4. 4                           5 (22.7%)            IIII                                    
                        5. 5                           2 ( 9.1%)            I                                       
                        6. Plan project-based and in   1 ( 4.5%)                                                    

64    ...64             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           8 (36.4%)            IIIIIII             (91.7%)    (8.3%)   
                        3. 3.4                         1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           2 ( 9.1%)            I                                       
                        6. Teach project-based and i   1 ( 4.5%)                                                    

65    ...65             1. 3                           6 (26.1%)            IIIII               23         1        
      [character]       2. 4                           9 (39.1%)            IIIIIII             (95.8%)    (4.2%)   
                        3. 5                           6 (26.1%)            IIIII                                   
                        4. How prepared do you feel    1 ( 4.3%)                                                    
                        5. Understand how students l   1 ( 4.3%)                                                    

66    ...66             1. 3                           5 (22.7%)            IIII                22         2        
      [character]       2. 4                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 4.2                         1 ( 4.5%)                                                    
                        4. 5                           9 (40.9%)            IIIIIIII                                
                        5. Understand that students    1 ( 4.5%)                                                    

67    ...67             1. 3                            4 (18.2%)           III                 22         2        
      [character]       2. 4                           10 (45.5%)           IIIIIIIII           (91.7%)    (8.3%)   
                        3. 4.0999999999999996           1 ( 4.5%)                                                   
                        4. 5                            6 (27.3%)           IIIII                                   
                        5. Understand the central co    1 ( 4.5%)                                                   

68    ...68             1. 2                            1 ( 4.5%)                               22         2        
      [character]       2. 3                            4 (18.2%)           III                 (91.7%)    (8.3%)   
                        3. 3.95                         1 ( 4.5%)                                                   
                        4. 4                           10 (45.5%)           IIIIIIIII                               
                        5. 5                            5 (22.7%)           IIII                                    
                        6. Create learning experienc    1 ( 4.5%)                                                   

69    ...69             1. 3                            7 (31.8%)           IIIIII              22         2        
      [character]       2. 3.8                          1 ( 4.5%)                               (91.7%)    (8.3%)   
                        3. 4                           10 (45.5%)           IIIIIIIII                               
                        4. 5                            3 (13.6%)           II                                      
                        5. Provide learning opportun    1 ( 4.5%)                                                   

70    ...70             1. 2                            1 ( 4.5%)                               22         2        
      [character]       2. 3                            5 (22.7%)           IIII                (91.7%)    (8.3%)   
                        3. 3.85                         1 ( 4.5%)                                                   
                        4. 4                           10 (45.5%)           IIIIIIIII                               
                        5. 5                            4 (18.2%)           III                                     
                        6. Create instructional oppo    1 ( 4.5%)                                                   

71    ...71             1. 2                            1 ( 4.5%)                               22         2        
      [character]       2. 3                            5 (22.7%)           IIII                (91.7%)    (8.3%)   
                        3. 3.85                         1 ( 4.5%)                                                   
                        4. 4                           10 (45.5%)           IIIIIIIII                               
                        5. 5                            4 (18.2%)           III                                     
                        6. Use a variety of instruct    1 ( 4.5%)                                                   

72    ...72             1. 3                            3 (13.6%)           II                  22         2        
      [character]       2. 4                           10 (45.5%)           IIIIIIIII           (91.7%)    (8.3%)   
                        3. 4.2                          1 ( 4.5%)                                                   
                        4. 5                            7 (31.8%)           IIIIII                                  
                        5. Use technology effectivel    1 ( 4.5%)                                                   

73    ...73             1. 3                            5 (22.7%)           IIII                22         2        
      [character]       2. 3.95                         1 ( 4.5%)                               (91.7%)    (8.3%)   
                        3. 4                           11 (50.0%)           IIIIIIIIII                              
                        4. 5                            4 (18.2%)           III                                     
                        5. Understand and use best p    1 ( 4.5%)                                                   

74    ...74             1. 2                           1 ( 4.5%)                                22         2        
      [character]       2. 3                           6 (27.3%)            IIIII               (91.7%)    (8.3%)   
                        3. 3.9                         1 ( 4.5%)                                                    
                        4. 4                           7 (31.8%)            IIIIII                                  
                        5. 5                           6 (27.3%)            IIIII                                   
                        6. Adapt instruction based u   1 ( 4.5%)                                                    

75    ...75             1. 2                           3 (13.6%)            II                  22         2        
      [character]       2. 3                           2 ( 9.1%)            I                   (91.7%)    (8.3%)   
                        3. 4                           8 (36.4%)            IIIIIII                                 
                        4. 5                           8 (36.4%)            IIIIIII                                 
                        5. Evaluate the effects of m   1 ( 4.5%)                                                    

76    ...76             1. 3                           7 (31.8%)            IIIIII              22         2        
      [character]       2. 3.9                         1 ( 4.5%)                                (91.7%)    (8.3%)   
                        3. 4                           8 (36.4%)            IIIIIII                                 
                        4. 5                           5 (22.7%)            IIII                                    
                        5. Understand the importance   1 ( 4.5%)                                                    

77    ...77             1. 4                           3 (13.6%)            II                  22         2        
      [character]       2. 3.91                        2 ( 9.1%)            I                   (91.7%)    (8.3%)   
                        3. 3.95                        2 ( 9.1%)            I                                       
                        4. 2.95                        1 ( 4.5%)                                                    
                        5. 3                           1 ( 4.5%)                                                    
                        6. 3.05                        1 ( 4.5%)                                                    
                        7. 3.18                        1 ( 4.5%)                                                    
                        8. 3.68                        1 ( 4.5%)                                                    
                        9. 3.82                        1 ( 4.5%)                                                    
                        10. 3.93                       1 ( 4.5%)                                                    
                        [ 8 others ]                   8 (36.4%)            IIIIIII                                 

78    Spring 2023       1. 3                            4 (16.7%)           III                 24         0        
      [character]       2. 4                           10 (41.7%)           IIIIIIII            (100.0%)   (0.0%)   
                        3. 4.1399999999999997           1 ( 4.2%)                                                   
                        4. 5                            7 (29.2%)           IIIII                                   
                        5. Handle a range of classro    1 ( 4.2%)                                                   
                        6. How prepared did you feel    1 ( 4.2%)                                                   

79    ...79             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           12 (52.2%)           IIIIIIIIII          (95.8%)    (4.2%)   
                        3. 4.1399999999999997           1 ( 4.3%)                                                   
                        4. 5                            6 (26.1%)           IIIII                                   
                        5. Use a variety of instruct    1 ( 4.3%)                                                   

80    ...80             1. 3                            4 (17.4%)           III                 23         1        
      [character]       2. 4                            5 (21.7%)           IIII                (95.8%)    (4.2%)   
                        3. 4.38                         1 ( 4.3%)                                                   
                        4. 5                           12 (52.2%)           IIIIIIIIII                              
                        5. Teach your content area      1 ( 4.3%)                                                   

81    ...81             1. 3                            4 (17.4%)           III                 23         1        
      [character]       2. 4                            6 (26.1%)           IIIII               (95.8%)    (4.2%)   
                        3. 4.33                         1 ( 4.3%)                                                   
                        4. 5                           11 (47.8%)           IIIIIIIII                               
                        5. Use technology in classro    1 ( 4.3%)                                                   

82    ...82             1. 3                           3 (13.0%)            II                  23         1        
      [character]       2. 4                           9 (39.1%)            IIIIIII             (95.8%)    (4.2%)   
                        3. 4.29                        1 ( 4.3%)                                                    
                        4. 5                           9 (39.1%)            IIIIIII                                 
                        5. Assess students             1 ( 4.3%)                                                    

83    ...83             1. 3                           9 (39.1%)            IIIIIII             23         1        
      [character]       2. 3.81                        1 ( 4.3%)                                (95.8%)    (4.2%)   
                        3. 4                           7 (30.4%)            IIIIII                                  
                        4. 5                           5 (21.7%)            IIII                                    
                        5. Differentiate instruction   1 ( 4.3%)                                                    

84    ...84             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           12 (52.2%)           IIIIIIIIII          (95.8%)    (4.2%)   
                        3. 4.1399999999999997           1 ( 4.3%)                                                   
                        4. 5                            6 (26.1%)           IIIII                                   
                        5. Use data from student ass    1 ( 4.3%)                                                   

85    ...85             1. 3                           3 (13.0%)            II                  23         1        
      [character]       2. 4                           9 (39.1%)            IIIIIII             (95.8%)    (4.2%)   
                        3. 4.29                        1 ( 4.3%)                                                    
                        4. 5                           9 (39.1%)            IIIIIII                                 
                        5. Meet state content standa   1 ( 4.3%)                                                    

86    ...86             1. 2                            1 ( 4.3%)                               23         1        
      [character]       2. 3                           12 (52.2%)           IIIIIIIIII          (95.8%)    (4.2%)   
                        3. 3.43                         1 ( 4.3%)                                                   
                        4. 4                            6 (26.1%)           IIIII                                   
                        5. 5                            2 ( 8.7%)           I                                       
                        6. Plan project-based and in    1 ( 4.3%)                                                   

87    ...87             1. 2                           1 ( 4.3%)                                23         1        
      [character]       2. 3                           9 (39.1%)            IIIIIII             (95.8%)    (4.2%)   
                        3. 3.62                        1 ( 4.3%)                                                    
                        4. 4                           8 (34.8%)            IIIIII                                  
                        5. 5                           3 (13.0%)            II                                      
                        6. Teach project-based and i   1 ( 4.3%)                                                    

88    ...88             1. 3                            4 (16.7%)           III                 24         0        
      [character]       2. 4                           11 (45.8%)           IIIIIIIII           (100.0%)   (0.0%)   
                        3. 4.0999999999999996           1 ( 4.2%)                                                   
                        4. 5                            6 (25.0%)           IIIII                                   
                        5. How prepared do you feel     1 ( 4.2%)                                                   
                        6. Understand how students l    1 ( 4.2%)                                                   

89    ...89             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           12 (52.2%)           IIIIIIIIII          (95.8%)    (4.2%)   
                        3. 4.1399999999999997           1 ( 4.3%)                                                   
                        4. 5                            6 (26.1%)           IIIII                                   
                        5. Understand that students     1 ( 4.3%)                                                   

90    ...90             1. 2                            1 ( 4.3%)                               23         1        
      [character]       2. 3                            2 ( 8.7%)           I                   (95.8%)    (4.2%)   
                        3. 4                           11 (47.8%)           IIIIIIIII                               
                        4. 4.1399999999999997           1 ( 4.3%)                                                   
                        5. 5                            7 (30.4%)           IIIIII                                  
                        6. Understand the central co    1 ( 4.3%)                                                   

91    ...91             1. 3                            4 (17.4%)           III                 23         1        
      [character]       2. 4                           10 (43.5%)           IIIIIIII            (95.8%)    (4.2%)   
                        3. 4.1399999999999997           1 ( 4.3%)                                                   
                        4. 5                            7 (30.4%)           IIIIII                                  
                        5. Create learning experienc    1 ( 4.3%)                                                   

92    ...92             1. 3                            6 (26.1%)           IIIII               23         1        
      [character]       2. 3.95                         1 ( 4.3%)                               (95.8%)    (4.2%)   
                        3. 4                           10 (43.5%)           IIIIIIII                                
                        4. 5                            5 (21.7%)           IIII                                    
                        5. Provide learning opportun    1 ( 4.3%)                                                   

93    ...93             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           11 (47.8%)           IIIIIIIII           (95.8%)    (4.2%)   
                        3. 4.1900000000000004           1 ( 4.3%)                                                   
                        4. 5                            7 (30.4%)           IIIIII                                  
                        5. Create instructional oppo    1 ( 4.3%)                                                   

94    ...94             1. 2                            1 ( 4.3%)                               23         1        
      [character]       2. 3                            4 (17.4%)           III                 (95.8%)    (4.2%)   
                        3. 4                           11 (47.8%)           IIIIIIIII                               
                        4. 5                            6 (26.1%)           IIIII                                   
                        5. Use a variety of instruct    1 ( 4.3%)                                                   

95    ...95             1. 3                            4 (17.4%)           III                 23         1        
      [character]       2. 4                            6 (26.1%)           IIIII               (95.8%)    (4.2%)   
                        3. 4.33                         1 ( 4.3%)                                                   
                        4. 5                           11 (47.8%)           IIIIIIIII                               
                        5. Use technology effectivel    1 ( 4.3%)                                                   

96    ...96             1. 3                           6 (26.1%)            IIIII               23         1        
      [character]       2. 4                           8 (34.8%)            IIIIII              (95.8%)    (4.2%)   
                        3. 4.05                        1 ( 4.3%)                                                    
                        4. 5                           7 (30.4%)            IIIIII                                  
                        5. Understand and use best p   1 ( 4.3%)                                                    

97    ...97             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           10 (43.5%)           IIIIIIII            (95.8%)    (4.2%)   
                        3. 4.24                         1 ( 4.3%)                                                   
                        4. 5                            8 (34.8%)           IIIIII                                  
                        5. Adapt instruction based u    1 ( 4.3%)                                                   

98    ...98             1. 3                            3 (13.0%)           II                  23         1        
      [character]       2. 4                           10 (43.5%)           IIIIIIII            (95.8%)    (4.2%)   
                        3. 4.24                         1 ( 4.3%)                                                   
                        4. 5                            8 (34.8%)           IIIIII                                  
                        5. Evaluate the effects of m    1 ( 4.3%)                                                   

99    ...99             1. 2                           1 ( 4.3%)                                23         1        
      [character]       2. 3                           7 (30.4%)            IIIIII              (95.8%)    (4.2%)   
                        3. 3.9                         1 ( 4.3%)                                                    
                        4. 4                           6 (26.1%)            IIIII                                   
                        5. 5                           7 (30.4%)            IIIIII                                  
                        6. Understand the importance   1 ( 4.3%)                                                    

100   ...100            1. 3.77                        2 ( 8.7%)            I                   23         1        
      [character]       2. 4                           2 ( 8.7%)            I                   (95.8%)    (4.2%)   
                        3. 4.32                        2 ( 8.7%)            I                                       
                        4. 4.82                        2 ( 8.7%)            I                                       
                        5. 5                           2 ( 8.7%)            I                                       
                        6. 2.95                        1 ( 4.3%)                                                    
                        7. 3                           1 ( 4.3%)                                                    
                        8. 3.27                        1 ( 4.3%)                                                    
                        9. 3.68                        1 ( 4.3%)                                                    
                        10. 3.82                       1 ( 4.3%)                                                    
                        [ 8 others ]                   8 (34.8%)            IIIIII                                  
--------------------------------------------------------------------------------------------------------------------
# A tibble: 100 × 3
   col_name         cnt  pcnt
   <chr>          <int> <dbl>
 1 Fellow Number      3  12.5
 2 Last Name          3  12.5
 3 First Name         3  12.5
 4 Gender             3  12.5
 5 Race/Ethnicity     3  12.5
 6 Grade Band         3  12.5
 7 Content Area       3  12.5
 8 ...10              3  12.5
 9 ...11              3  12.5
10 ...12              3  12.5
# ℹ 90 more rows
The default of 'doScale' is FALSE now for stability;
  set options(mc_doScale_quiet=TRUE) to suppress this (once per session) message
$`Fellow Number`
$`Fellow Number`$identifyMissing
No problems found.
$`Fellow Number`$identifyOutliers
No problems found.

$`Last Name`
$`Last Name`$identifyMissing
No problems found.
$`Last Name`$identifyWhitespace
No problems found.
$`Last Name`$identifyLoners
Note that the following levels have at most five observations: Alton, Brown, Bryant, Christie, Coates, ..., Rowe, Shivers, Spencer, Tyler, Wright (11 values omitted).
$`Last Name`$identifyCaseIssues
No problems found.
$`Last Name`$identifyNums
No problems found.

$`First Name`
$`First Name`$identifyMissing
No problems found.
$`First Name`$identifyWhitespace
No problems found.
$`First Name`$identifyLoners
Note that the following levels have at most five observations: Alanna, Ashlee, Carol, Charell, Isela, ..., Sumter, Tina, Valena, Verdy, Victoria (11 values omitted).
$`First Name`$identifyCaseIssues
No problems found.
$`First Name`$identifyNums
No problems found.

$Gender
$Gender$identifyMissing
No problems found.
$Gender$identifyWhitespace
No problems found.
$Gender$identifyLoners
No problems found.
$Gender$identifyCaseIssues
No problems found.
$Gender$identifyNums
No problems found.

$`Race/Ethnicity`
$`Race/Ethnicity`$identifyMissing
No problems found.
$`Race/Ethnicity`$identifyWhitespace
No problems found.
$`Race/Ethnicity`$identifyLoners
Note that the following levels have at most five observations: Caribbean/West Indian, Hispanic, White.
$`Race/Ethnicity`$identifyCaseIssues
No problems found.
$`Race/Ethnicity`$identifyNums
No problems found.

$`Grade Band`
$`Grade Band`$identifyMissing
No problems found.
$`Grade Band`$identifyWhitespace
No problems found.
$`Grade Band`$identifyLoners
No problems found.
$`Grade Band`$identifyCaseIssues
No problems found.
$`Grade Band`$identifyNums
No problems found.

$`Content Area`
$`Content Area`$identifyMissing
No problems found.
$`Content Area`$identifyWhitespace
No problems found.
$`Content Area`$identifyLoners
No problems found.
$`Content Area`$identifyCaseIssues
No problems found.
$`Content Area`$identifyNums
No problems found.

$`School District`
$`School District`$identifyMissing
No problems found.
$`School District`$identifyWhitespace
No problems found.
$`School District`$identifyLoners
Note that the following levels have at most five observations: Average, DeKalb.
$`School District`$identifyCaseIssues
No problems found.
$`School District`$identifyNums
No problems found.

$`Summer 2020`
$`Summer 2020`$identifyMissing
No problems found.
$`Summer 2020`$identifyWhitespace
No problems found.
$`Summer 2020`$identifyLoners
Note that the following levels have at most five observations: 2, 3.53, 5, Handle a range of classroom management or discipline situations, How prepared did you feel to do the following prior to joining the DSPETL Program in June 2020?.
$`Summer 2020`$identifyCaseIssues
No problems found.
$`Summer 2020`$identifyNums
No problems found.

$...10
$...10$identifyMissing
No problems found.
$...10$identifyWhitespace
No problems found.
$...10$identifyLoners
Note that the following levels have at most five observations: 3, 3.37, 5, Use a variety of instructional methods.
$...10$identifyCaseIssues
No problems found.
$...10$identifyNums
No problems found.

$...11
$...11$identifyMissing
No problems found.
$...11$identifyWhitespace
No problems found.
$...11$identifyLoners
Note that the following levels have at most five observations: 2, 3.74, 4, 5, Teach your content area.
$...11$identifyCaseIssues
No problems found.
$...11$identifyNums
No problems found.

$...12
$...12$identifyMissing
No problems found.
$...12$identifyWhitespace
No problems found.
$...12$identifyLoners
Note that the following levels have at most five observations: 3.89, 5, Use technology in classroom instruction.
$...12$identifyCaseIssues
No problems found.
$...12$identifyNums
No problems found.

$...13
$...13$identifyMissing
No problems found.
$...13$identifyWhitespace
No problems found.
$...13$identifyLoners
Note that the following levels have at most five observations: 2, 3.58, 5, Assess students.
$...13$identifyCaseIssues
No problems found.
$...13$identifyNums
No problems found.

$...14
$...14$identifyMissing
No problems found.
$...14$identifyWhitespace
No problems found.
$...14$identifyLoners
Note that the following levels have at most five observations: 1, 2, 3.21, Differentiate instruction in the classroom.
$...14$identifyCaseIssues
No problems found.
$...14$identifyNums
No problems found.

$...15
$...15$identifyMissing
No problems found.
$...15$identifyWhitespace
No problems found.
$...15$identifyLoners
Note that the following levels have at most five observations: 1, 2, 3, 3.37, 5, Use data from student assessments to inform instruction.
$...15$identifyCaseIssues
No problems found.
$...15$identifyNums
No problems found.

$...16
$...16$identifyMissing
No problems found.
$...16$identifyWhitespace
No problems found.
$...16$identifyLoners
Note that the following levels have at most five observations: 1, 2, 3, 3.58, 5, Meet state content standards.
$...16$identifyCaseIssues
No problems found.
$...16$identifyNums
No problems found.

$...17
$...17$identifyMissing
No problems found.
$...17$identifyWhitespace
No problems found.
$...17$identifyLoners
Note that the following levels have at most five observations: 2, 3.16, 4, 5, Plan project-based and interdisciplinary lessons.
$...17$identifyCaseIssues
No problems found.
$...17$identifyNums
No problems found.

$...18
$...18$identifyMissing
No problems found.
$...18$identifyWhitespace
No problems found.
$...18$identifyLoners
Note that the following levels have at most five observations: 1, 2, 3.11, Teach project-based and interdisciplinary lessons.
$...18$identifyCaseIssues
No problems found.
$...18$identifyNums
No problems found.

$...19
$...19$identifyMissing
No problems found.
$...19$identifyWhitespace
No problems found.
$...19$identifyLoners
Note that the following levels have at most five observations: 2, 3.32, 5, How prepared did you feel to do the following prior to joining the DSPETL Program in June 2020?, Understand how students learn and develop.
$...19$identifyCaseIssues
No problems found.
$...19$identifyNums
No problems found.

$...20
$...20$identifyMissing
No problems found.
$...20$identifyWhitespace
No problems found.
$...20$identifyLoners
Note that the following levels have at most five observations: 3.79, 5, Understand that students vary in their approaches to learning.
$...20$identifyCaseIssues
No problems found.
$...20$identifyNums
No problems found.

$...21
$...21$identifyMissing
No problems found.
$...21$identifyWhitespace
No problems found.
$...21$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.37, 5, Understand the central concepts and methods of inquiry of the content area I teach.
$...21$identifyCaseIssues
No problems found.
$...21$identifyNums
No problems found.

$...22
$...22$identifyMissing
No problems found.
$...22$identifyWhitespace
No problems found.
$...22$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.42, 5, Create learning experiences that make the subject matter meaningful for students.
$...22$identifyCaseIssues
No problems found.
$...22$identifyNums
No problems found.

$...23
$...23$identifyMissing
No problems found.
$...23$identifyWhitespace
No problems found.
$...23$identifyLoners
Note that the following levels have at most five observations: 2, 3.32, 5, Provide learning opportunities that support students' intellectual, social and physical development at all grade levels.
$...23$identifyCaseIssues
No problems found.
$...23$identifyNums
No problems found.

$...24
$...24$identifyMissing
No problems found.
$...24$identifyWhitespace
No problems found.
$...24$identifyLoners
Note that the following levels have at most five observations: 2, 3.37, 5, Create instructional opportunities that are adaptable to learners' individual differences.
$...24$identifyCaseIssues
No problems found.
$...24$identifyNums
No problems found.

$...25
$...25$identifyMissing
No problems found.
$...25$identifyWhitespace
No problems found.
$...25$identifyLoners
Note that the following levels have at most five observations: 2, 3.42, 5, Use a variety of instructional strategies to encourage students’ development of critical thinking, problem solving, and performance skills.
$...25$identifyCaseIssues
No problems found.
$...25$identifyNums
No problems found.

$...26
$...26$identifyMissing
No problems found.
$...26$identifyWhitespace
No problems found.
$...26$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.79, 5, Use technology effectively.
$...26$identifyCaseIssues
No problems found.
$...26$identifyNums
No problems found.

$...27
$...27$identifyMissing
No problems found.
$...27$identifyWhitespace
No problems found.
$...27$identifyLoners
Note that the following levels have at most five observations: 2, 3.37, 5, Understand and use best practices related to motivation and behavior.
$...27$identifyCaseIssues
No problems found.
$...27$identifyNums
No problems found.

$...28
$...28$identifyMissing
No problems found.
$...28$identifyWhitespace
No problems found.
$...28$identifyLoners
Note that the following levels have at most five observations: 2, 3.37, 5, Adapt instruction based upon assessment and reflection.
$...28$identifyCaseIssues
No problems found.
$...28$identifyNums
No problems found.

$...29
$...29$identifyMissing
No problems found.
$...29$identifyWhitespace
No problems found.
$...29$identifyLoners
Note that the following levels have at most five observations: 2, 3.53, 5, Evaluate the effects of my choices and actions on others (students, parents, and other professionals in the learning community).
$...29$identifyCaseIssues
No problems found.
$...29$identifyNums
No problems found.

$...30
$...30$identifyMissing
No problems found.
$...30$identifyWhitespace
No problems found.
$...30$identifyLoners
Note that the following levels have at most five observations: 2, 3.42, 5, Understand the importance of assisting students with career awareness and the application of career concepts to the academic curriculum.
$...30$identifyCaseIssues
No problems found.
$...30$identifyNums
No problems found.

$...31
$...31$identifyMissing
No problems found.
$...31$identifyWhitespace
No problems found.
$...31$identifyLoners
Note that the following levels have at most five observations: 2.09, 2.5, 2.73, 2.82, 2.86, ..., 4, 4.18, 4.3600000000000003, 4.7300000000000004, Baseline Average (8 values omitted).
$...31$identifyCaseIssues
No problems found.
$...31$identifyNums
No problems found.

$`Spring 2021`
$`Spring 2021`$identifyMissing
No problems found.
$`Spring 2021`$identifyWhitespace
No problems found.
$`Spring 2021`$identifyLoners
Note that the following levels have at most five observations: 3.85, 4, Handle a range of classroom management or discipline situations, How prepared did you feel to do the following now?.
$`Spring 2021`$identifyCaseIssues
No problems found.
$`Spring 2021`$identifyNums
No problems found.

$...33
$...33$identifyMissing
No problems found.
$...33$identifyWhitespace
No problems found.
$...33$identifyLoners
Note that the following levels have at most five observations: 2, 3.85, 5, Use a variety of instructional methods.
$...33$identifyCaseIssues
No problems found.
$...33$identifyNums
No problems found.

$...34
$...34$identifyMissing
No problems found.
$...34$identifyWhitespace
No problems found.
$...34$identifyLoners
Note that the following levels have at most five observations: 2, 3, Teach your content area.
$...34$identifyCaseIssues
No problems found.
$...34$identifyNums
No problems found.

$...35
$...35$identifyMissing
No problems found.
$...35$identifyWhitespace
No problems found.
$...35$identifyLoners
Note that the following levels have at most five observations: 4, 4.2, Use technology in classroom instruction.
$...35$identifyCaseIssues
No problems found.
$...35$identifyNums
No problems found.

$...36
$...36$identifyMissing
No problems found.
$...36$identifyWhitespace
No problems found.
$...36$identifyLoners
Note that the following levels have at most five observations: 2, 3.8, 5, Assess students.
$...36$identifyCaseIssues
No problems found.
$...36$identifyNums
No problems found.

$...37
$...37$identifyMissing
No problems found.
$...37$identifyWhitespace
No problems found.
$...37$identifyLoners
Note that the following levels have at most five observations: 2, 3.61, 4, 5, Differentiate instruction in the classroom.
$...37$identifyCaseIssues
No problems found.
$...37$identifyNums
No problems found.

$...38
$...38$identifyMissing
No problems found.
$...38$identifyWhitespace
No problems found.
$...38$identifyLoners
Note that the following levels have at most five observations: 2, 3.5, 5, Use data from student assessments to inform instruction.
$...38$identifyCaseIssues
No problems found.
$...38$identifyNums
No problems found.

$...39
$...39$identifyMissing
No problems found.
$...39$identifyWhitespace
No problems found.
$...39$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.85, 5, Meet state content standards.
$...39$identifyCaseIssues
No problems found.
$...39$identifyNums
No problems found.

$...40
$...40$identifyMissing
No problems found.
$...40$identifyWhitespace
No problems found.
$...40$identifyLoners
Note that the following levels have at most five observations: 2.95, 4, 5, Plan project-based and interdisciplinary lessons.
$...40$identifyCaseIssues
No problems found.
$...40$identifyNums
No problems found.

$...41
$...41$identifyMissing
No problems found.
$...41$identifyWhitespace
No problems found.
$...41$identifyLoners
Note that the following levels have at most five observations: 2, 3.15, 4, 5, Teach project-based and interdisciplinary lessons.
$...41$identifyCaseIssues
No problems found.
$...41$identifyNums
No problems found.

$...42
$...42$identifyMissing
No problems found.
$...42$identifyWhitespace
No problems found.
$...42$identifyLoners
Note that the following levels have at most five observations: 3.7, 5, How prepared do you feel to do the following now?, Understand how students learn and develop.
$...42$identifyCaseIssues
No problems found.
$...42$identifyNums
No problems found.

$...43
$...43$identifyMissing
No problems found.
$...43$identifyWhitespace
No problems found.
$...43$identifyLoners
Note that the following levels have at most five observations: 3, 4.0999999999999996, Understand that students vary in their approaches to learning.
$...43$identifyCaseIssues
No problems found.
$...43$identifyNums
No problems found.

$...44
$...44$identifyMissing
No problems found.
$...44$identifyWhitespace
No problems found.
$...44$identifyLoners
Note that the following levels have at most five observations: 2, 3.55, 5, Understand the central concepts and methods of inquiry of the content area I teach.
$...44$identifyCaseIssues
No problems found.
$...44$identifyNums
No problems found.

$...45
$...45$identifyMissing
No problems found.
$...45$identifyWhitespace
No problems found.
$...45$identifyLoners
Note that the following levels have at most five observations: 2, 3.7, 5, Create learning experiences that make the subject matter meaningful for students.
$...45$identifyCaseIssues
No problems found.
$...45$identifyNums
No problems found.

$...46
$...46$identifyMissing
No problems found.
$...46$identifyWhitespace
No problems found.
$...46$identifyLoners
Note that the following levels have at most five observations: 3.9, Provide learning opportunities that support students' intellectual, social and physical development at all grade levels.
$...46$identifyCaseIssues
No problems found.
$...46$identifyNums
No problems found.

$...47
$...47$identifyMissing
No problems found.
$...47$identifyWhitespace
No problems found.
$...47$identifyLoners
Note that the following levels have at most five observations: 2, 3.75, 5, Create instructional opportunities that are adaptable to learners' individual differences.
$...47$identifyCaseIssues
No problems found.
$...47$identifyNums
No problems found.

$...48
$...48$identifyMissing
No problems found.
$...48$identifyWhitespace
No problems found.
$...48$identifyLoners
Note that the following levels have at most five observations: 2, 3.7, 5, Use a variety of instructional strategies to encourage students’ development of critical thinking, problem solving, and performance skills.
$...48$identifyCaseIssues
No problems found.
$...48$identifyNums
No problems found.

$...49
$...49$identifyMissing
No problems found.
$...49$identifyWhitespace
No problems found.
$...49$identifyLoners
Note that the following levels have at most five observations: 4, 4.0999999999999996, Use technology effectively.
$...49$identifyCaseIssues
No problems found.
$...49$identifyNums
No problems found.

$...50
$...50$identifyMissing
No problems found.
$...50$identifyWhitespace
No problems found.
$...50$identifyLoners
Note that the following levels have at most five observations: 2, 3.6, 5, Understand and use best practices related to motivation and behavior.
$...50$identifyCaseIssues
No problems found.
$...50$identifyNums
No problems found.

$...51
$...51$identifyMissing
No problems found.
$...51$identifyWhitespace
No problems found.
$...51$identifyLoners
Note that the following levels have at most five observations: 2, 3.6, 4, 5, Adapt instruction based upon assessment and reflection.
$...51$identifyCaseIssues
No problems found.
$...51$identifyNums
No problems found.

$...52
$...52$identifyMissing
No problems found.
$...52$identifyWhitespace
No problems found.
$...52$identifyLoners
Note that the following levels have at most five observations: 3.9, 5, Evaluate the effects of my choices and actions on others (students, parents, and other professionals in the learning community).
$...52$identifyCaseIssues
No problems found.
$...52$identifyNums
No problems found.

$...53
$...53$identifyMissing
No problems found.
$...53$identifyWhitespace
No problems found.
$...53$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.75, 5, Understand the importance of assisting students with career awareness and the application of career concepts to the academic curriculum.
$...53$identifyCaseIssues
No problems found.
$...53$identifyNums
No problems found.

$...54
$...54$identifyMissing
No problems found.
$...54$identifyWhitespace
No problems found.
$...54$identifyLoners
Note that the following levels have at most five observations: 2.77, 2.86, 2.95, 3, 3.09, ..., 4.3600000000000003, 4.5, 4.82, 4.8600000000000003, End of Y1 Average (8 values omitted).
$...54$identifyCaseIssues
No problems found.
$...54$identifyNums
No problems found.

$`Spring 2022`
$`Spring 2022`$identifyMissing
No problems found.
$`Spring 2022`$identifyWhitespace
No problems found.
$`Spring 2022`$identifyLoners
Note that the following levels have at most five observations: 2, 3.9, Handle a range of classroom management or discipline situations, How prepared did you feel to do the following now?.
$`Spring 2022`$identifyCaseIssues
No problems found.
$`Spring 2022`$identifyNums
No problems found.

$...56
$...56$identifyMissing
No problems found.
$...56$identifyWhitespace
No problems found.
$...56$identifyLoners
Note that the following levels have at most five observations: 3, 4.05, Use a variety of instructional methods.
$...56$identifyCaseIssues
No problems found.
$...56$identifyNums
No problems found.

$...57
$...57$identifyMissing
No problems found.
$...57$identifyWhitespace
No problems found.
$...57$identifyLoners
Note that the following levels have at most five observations: 2, 3, 4, 4.3499999999999996, Teach your content area.
$...57$identifyCaseIssues
No problems found.
$...57$identifyNums
No problems found.

$...58
$...58$identifyMissing
No problems found.
$...58$identifyWhitespace
No problems found.
$...58$identifyLoners
Note that the following levels have at most five observations: 3, 4.3, Use technology in classroom instruction.
$...58$identifyCaseIssues
No problems found.
$...58$identifyNums
No problems found.

$...59
$...59$identifyMissing
No problems found.
$...59$identifyWhitespace
No problems found.
$...59$identifyLoners
Note that the following levels have at most five observations: 3.9, 5, Assess students.
$...59$identifyCaseIssues
No problems found.
$...59$identifyNums
No problems found.

$...60
$...60$identifyMissing
No problems found.
$...60$identifyWhitespace
No problems found.
$...60$identifyLoners
Note that the following levels have at most five observations: 2, 3.6, 5, Differentiate instruction in the classroom.
$...60$identifyCaseIssues
No problems found.
$...60$identifyNums
No problems found.

$...61
$...61$identifyMissing
No problems found.
$...61$identifyWhitespace
No problems found.
$...61$identifyLoners
Note that the following levels have at most five observations: 2, 3, 4, 4.0999999999999996, Use data from student assessments to inform instruction.
$...61$identifyCaseIssues
No problems found.
$...61$identifyNums
No problems found.

$...62
$...62$identifyMissing
No problems found.
$...62$identifyWhitespace
No problems found.
$...62$identifyLoners
Note that the following levels have at most five observations: 2, 3, 4.05, Meet state content standards.
$...62$identifyCaseIssues
No problems found.
$...62$identifyNums
No problems found.

$...63
$...63$identifyMissing
No problems found.
$...63$identifyWhitespace
No problems found.
$...63$identifyLoners
Note that the following levels have at most five observations: 2, 3.2, 4, 5, Plan project-based and interdisciplinary lessons.
$...63$identifyCaseIssues
No problems found.
$...63$identifyNums
No problems found.

$...64
$...64$identifyMissing
No problems found.
$...64$identifyWhitespace
No problems found.
$...64$identifyLoners
Note that the following levels have at most five observations: 2, 3.4, 5, Teach project-based and interdisciplinary lessons.
$...64$identifyCaseIssues
No problems found.
$...64$identifyNums
No problems found.

$...65
$...65$identifyMissing
No problems found.
$...65$identifyWhitespace
No problems found.
$...65$identifyLoners
Note that the following levels have at most five observations: How prepared do you feel to do the following now?, Understand how students learn and develop.
$...65$identifyCaseIssues
No problems found.
$...65$identifyNums
No problems found.

$...66
$...66$identifyMissing
No problems found.
$...66$identifyWhitespace
No problems found.
$...66$identifyLoners
Note that the following levels have at most five observations: 3, 4.2, Understand that students vary in their approaches to learning.
$...66$identifyCaseIssues
No problems found.
$...66$identifyNums
No problems found.

$...67
$...67$identifyMissing
No problems found.
$...67$identifyWhitespace
No problems found.
$...67$identifyLoners
Note that the following levels have at most five observations: 3, 4.0999999999999996, Understand the central concepts and methods of inquiry of the content area I teach.
$...67$identifyCaseIssues
No problems found.
$...67$identifyNums
No problems found.

$...68
$...68$identifyMissing
No problems found.
$...68$identifyWhitespace
No problems found.
$...68$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.95, 5, Create learning experiences that make the subject matter meaningful for students.
$...68$identifyCaseIssues
No problems found.
$...68$identifyNums
No problems found.

$...69
$...69$identifyMissing
No problems found.
$...69$identifyWhitespace
No problems found.
$...69$identifyLoners
Note that the following levels have at most five observations: 3.8, 5, Provide learning opportunities that support students' intellectual, social and physical development at all grade levels.
$...69$identifyCaseIssues
No problems found.
$...69$identifyNums
No problems found.

$...70
$...70$identifyMissing
No problems found.
$...70$identifyWhitespace
No problems found.
$...70$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.85, 5, Create instructional opportunities that are adaptable to learners' individual differences.
$...70$identifyCaseIssues
No problems found.
$...70$identifyNums
No problems found.

$...71
$...71$identifyMissing
No problems found.
$...71$identifyWhitespace
No problems found.
$...71$identifyLoners
Note that the following levels have at most five observations: 2, 3, 3.85, 5, Use a variety of instructional strategies to encourage students’ development of critical thinking, problem solving, and performance skills.
$...71$identifyCaseIssues
No problems found.
$...71$identifyNums
No problems found.

$...72
$...72$identifyMissing
No problems found.
$...72$identifyWhitespace
No problems found.
$...72$identifyLoners
Note that the following levels have at most five observations: 3, 4.2, Use technology effectively.
$...72$identifyCaseIssues
No problems found.
$...72$identifyNums
No problems found.

$...73
$...73$identifyMissing
No problems found.
$...73$identifyWhitespace
No problems found.
$...73$identifyLoners
Note that the following levels have at most five observations: 3, 3.95, 5, Understand and use best practices related to motivation and behavior.
$...73$identifyCaseIssues
No problems found.
$...73$identifyNums
No problems found.

$...74
$...74$identifyMissing
No problems found.
$...74$identifyWhitespace
No problems found.
$...74$identifyLoners
Note that the following levels have at most five observations: 2, 3.9, Adapt instruction based upon assessment and reflection.
$...74$identifyCaseIssues
No problems found.
$...74$identifyNums
No problems found.

$...75
$...75$identifyMissing
No problems found.
$...75$identifyWhitespace
No problems found.
$...75$identifyLoners
Note that the following levels have at most five observations: 2, 3, Evaluate the effects of my choices and actions on others (students, parents, and other professionals in the learning community).
$...75$identifyCaseIssues
No problems found.
$...75$identifyNums
No problems found.

$...76
$...76$identifyMissing
No problems found.
$...76$identifyWhitespace
No problems found.
$...76$identifyLoners
Note that the following levels have at most five observations: 3.9, 5, Understand the importance of assisting students with career awareness and the application of career concepts to the academic curriculum.
$...76$identifyCaseIssues
No problems found.
$...76$identifyNums
No problems found.

$...77
$...77$identifyMissing
No problems found.
$...77$identifyWhitespace
No problems found.
$...77$identifyLoners
Note that the following levels have at most five observations: 2.95, 3, 3.05, 3.18, 3.68, ..., 4.2699999999999996, 4.6399999999999997, 4.82, 5, End of Y2 Average (8 values omitted).
$...77$identifyCaseIssues
No problems found.
$...77$identifyNums
No problems found.

$`Spring 2023`
$`Spring 2023`$identifyMissing
No problems found.
$`Spring 2023`$identifyWhitespace
No problems found.
$`Spring 2023`$identifyLoners
Note that the following levels have at most five observations: 3, 4.1399999999999997, Handle a range of classroom management or discipline situations, How prepared did you feel to do the following now?.
$`Spring 2023`$identifyCaseIssues
No problems found.
$`Spring 2023`$identifyNums
No problems found.

$...79
$...79$identifyMissing
No problems found.
$...79$identifyWhitespace
No problems found.
$...79$identifyLoners
Note that the following levels have at most five observations: 3, 4.1399999999999997, Use a variety of instructional methods.
$...79$identifyCaseIssues
No problems found.
$...79$identifyNums
No problems found.

$...80
$...80$identifyMissing
No problems found.
$...80$identifyWhitespace
No problems found.
$...80$identifyLoners
Note that the following levels have at most five observations: 3, 4, 4.38, Teach your content area.
$...80$identifyCaseIssues
No problems found.
$...80$identifyNums
No problems found.

$...81
$...81$identifyMissing
No problems found.
$...81$identifyWhitespace
No problems found.
$...81$identifyLoners
Note that the following levels have at most five observations: 3, 4.33, Use technology in classroom instruction.
$...81$identifyCaseIssues
No problems found.
$...81$identifyNums
No problems found.

$...82
$...82$identifyMissing
No problems found.
$...82$identifyWhitespace
No problems found.
$...82$identifyLoners
Note that the following levels have at most five observations: 3, 4.29, Assess students.
$...82$identifyCaseIssues
No problems found.
$...82$identifyNums
No problems found.

$...83
$...83$identifyMissing
No problems found.
$...83$identifyWhitespace
No problems found.
$...83$identifyLoners
Note that the following levels have at most five observations: 3.81, 5, Differentiate instruction in the classroom.
$...83$identifyCaseIssues
No problems found.
$...83$identifyNums
No problems found.

$...84
$...84$identifyMissing
No problems found.
$...84$identifyWhitespace
No problems found.
$...84$identifyLoners
Note that the following levels have at most five observations: 3, 4.1399999999999997, Use data from student assessments to inform instruction.
$...84$identifyCaseIssues
No problems found.
$...84$identifyNums
No problems found.

$...85
$...85$identifyMissing
No problems found.
$...85$identifyWhitespace
No problems found.
$...85$identifyLoners
Note that the following levels have at most five observations: 3, 4.29, Meet state content standards.
$...85$identifyCaseIssues
No problems found.
$...85$identifyNums
No problems found.

$...86
$...86$identifyMissing
No problems found.
$...86$identifyWhitespace
No problems found.
$...86$identifyLoners
Note that the following levels have at most five observations: 2, 3.43, 5, Plan project-based and interdisciplinary lessons.
$...86$identifyCaseIssues
No problems found.
$...86$identifyNums
No problems found.

$...87
$...87$identifyMissing
No problems found.
$...87$identifyWhitespace
No problems found.
$...87$identifyLoners
Note that the following levels have at most five observations: 2, 3.62, 5, Teach project-based and interdisciplinary lessons.
$...87$identifyCaseIssues
No problems found.
$...87$identifyNums
No problems found.

$...88
$...88$identifyMissing
No problems found.
$...88$identifyWhitespace
No problems found.
$...88$identifyLoners
Note that the following levels have at most five observations: 3, 4.0999999999999996, How prepared do you feel to do the following now?, Understand how students learn and develop.
$...88$identifyCaseIssues
No problems found.
$...88$identifyNums
No problems found.

$...89
$...89$identifyMissing
No problems found.
$...89$identifyWhitespace
No problems found.
$...89$identifyLoners
Note that the following levels have at most five observations: 3, 4.1399999999999997, Understand that students vary in their approaches to learning.
$...89$identifyCaseIssues
No problems found.
$...89$identifyNums
No problems found.

$...90
$...90$identifyMissing
No problems found.
$...90$identifyWhitespace
No problems found.
$...90$identifyLoners
Note that the following levels have at most five observations: 2, 3, 4.1399999999999997, Understand the central concepts and methods of inquiry of the content area I teach.
$...90$identifyCaseIssues
No problems found.
$...90$identifyNums
No problems found.

$...91
$...91$identifyMissing
No problems found.
$...91$identifyWhitespace
No problems found.
$...91$identifyLoners
Note that the following levels have at most five observations: 3, 4.1399999999999997, Create learning experiences that make the subject matter meaningful for students.
$...91$identifyCaseIssues
No problems found.
$...91$identifyNums
No problems found.

$...92
$...92$identifyMissing
No problems found.
$...92$identifyWhitespace
No problems found.
$...92$identifyLoners
Note that the following levels have at most five observations: 3.95, 5, Provide learning opportunities that support students' intellectual, social and physical development at all grade levels.
$...92$identifyCaseIssues
No problems found.
$...92$identifyNums
No problems found.

$...93
$...93$identifyMissing
No problems found.
$...93$identifyWhitespace
No problems found.
$...93$identifyLoners
Note that the following levels have at most five observations: 3, 4.1900000000000004, Create instructional opportunities that are adaptable to learners' individual differences.
$...93$identifyCaseIssues
No problems found.
$...93$identifyNums
No problems found.

$...94
$...94$identifyMissing
No problems found.
$...94$identifyWhitespace
No problems found.
$...94$identifyLoners
Note that the following levels have at most five observations: 2, 3, Use a variety of instructional strategies to encourage students’ development of critical thinking, problem solving, and performance skills.
$...94$identifyCaseIssues
No problems found.
$...94$identifyNums
No problems found.

$...95
$...95$identifyMissing
No problems found.
$...95$identifyWhitespace
No problems found.
$...95$identifyLoners
Note that the following levels have at most five observations: 3, 4.33, Use technology effectively.
$...95$identifyCaseIssues
No problems found.
$...95$identifyNums
No problems found.

$...96
$...96$identifyMissing
No problems found.
$...96$identifyWhitespace
No problems found.
$...96$identifyLoners
Note that the following levels have at most five observations: 4.05, Understand and use best practices related to motivation and behavior.
$...96$identifyCaseIssues
No problems found.
$...96$identifyNums
No problems found.

$...97
$...97$identifyMissing
No problems found.
$...97$identifyWhitespace
No problems found.
$...97$identifyLoners
Note that the following levels have at most five observations: 3, 4.24, Adapt instruction based upon assessment and reflection.
$...97$identifyCaseIssues
No problems found.
$...97$identifyNums
No problems found.

$...98
$...98$identifyMissing
No problems found.
$...98$identifyWhitespace
No problems found.
$...98$identifyLoners
Note that the following levels have at most five observations: 3, 4.24, Evaluate the effects of my choices and actions on others (students, parents, and other professionals in the learning community).
$...98$identifyCaseIssues
No problems found.
$...98$identifyNums
No problems found.

$...99
$...99$identifyMissing
No problems found.
$...99$identifyWhitespace
No problems found.
$...99$identifyLoners
Note that the following levels have at most five observations: 2, 3.9, Understand the importance of assisting students with career awareness and the application of career concepts to the academic curriculum.
$...99$identifyCaseIssues
No problems found.
$...99$identifyNums
No problems found.

$...100
$...100$identifyMissing
No problems found.
$...100$identifyWhitespace
No problems found.
$...100$identifyLoners
Note that the following levels have at most five observations: 2.95, 3, 3.27, 3.68, 3.77, ..., 4.41, 4.68, 4.82, 5, End of Y3 Average (8 values omitted).
$...100$identifyCaseIssues
No problems found.
$...100$identifyNums
No problems found.
Data summary
Name gsu.sheet1
Number of rows 24
Number of columns 100
_______________________
Column type frequency:
character 99
numeric 1
________________________
Group variables None

Variable type: character

skim_variable n_missing complete_rate min max empty n_unique whitespace
Last Name 3 0.88 4 16 0 21 0
First Name 3 0.88 3 10 0 21 0
Gender 3 0.88 4 6 0 2 0
Race/Ethnicity 3 0.88 5 21 0 4 0
Grade Band 3 0.88 4 6 0 2 0
Content Area 3 0.88 4 7 0 2 0
School District 2 0.92 6 8 0 4 0
Summer 2020 2 0.92 1 95 0 7 0
…10 3 0.88 1 38 0 6 0
…11 3 0.88 1 23 0 6 0
…12 3 0.88 1 39 0 5 0
…13 3 0.88 1 15 0 6 0
…14 3 0.88 1 42 0 6 0
…15 3 0.88 1 55 0 7 0
…16 3 0.88 1 28 0 7 0
…17 3 0.88 1 48 0 6 0
…18 3 0.88 1 49 0 6 0
…19 2 0.92 1 95 0 7 0
…20 3 0.88 1 61 0 5 0
…21 3 0.88 1 82 0 6 0
…22 3 0.88 1 80 0 6 0
…23 3 0.88 1 119 0 6 0
…24 3 0.88 1 89 0 6 0
…25 3 0.88 1 138 0 6 0
…26 3 0.88 1 26 0 6 0
…27 3 0.88 1 68 0 6 0
…28 3 0.88 1 54 0 6 0
…29 3 0.88 1 127 0 6 0
…30 3 0.88 1 135 0 6 0
…31 3 0.88 1 18 0 18 0
Spring 2021 1 0.96 1 63 0 6 0
…33 2 0.92 1 38 0 6 0
…34 2 0.92 1 23 0 5 0
…35 2 0.92 1 39 0 5 0
…36 2 0.92 1 15 0 6 0
…37 2 0.92 1 42 0 6 0
…38 2 0.92 1 55 0 6 0
…39 2 0.92 1 28 0 6 0
…40 2 0.92 1 48 0 6 0
…41 2 0.92 1 49 0 6 0
…42 1 0.96 1 49 0 6 0
…43 2 0.92 1 61 0 5 0
…44 2 0.92 1 82 0 6 0
…45 2 0.92 1 80 0 6 0
…46 2 0.92 1 119 0 5 0
…47 2 0.92 1 89 0 6 0
…48 2 0.92 1 138 0 6 0
…49 2 0.92 1 26 0 5 0
…50 2 0.92 1 68 0 6 0
…51 2 0.92 1 54 0 6 0
…52 2 0.92 1 127 0 5 0
…53 2 0.92 1 135 0 6 0
…54 2 0.92 1 18 0 18 0
Spring 2022 1 0.96 1 63 0 7 0
…56 2 0.92 1 38 0 5 0
…57 2 0.92 1 23 0 6 0
…58 2 0.92 1 39 0 5 0
…59 2 0.92 1 15 0 5 0
…60 2 0.92 1 42 0 6 0
…61 2 0.92 1 55 0 6 0
…62 2 0.92 1 28 0 6 0
…63 2 0.92 1 48 0 6 0
…64 2 0.92 1 49 0 6 0
…65 1 0.96 1 49 0 5 0
…66 2 0.92 1 61 0 5 0
…67 2 0.92 1 82 0 5 0
…68 2 0.92 1 80 0 6 0
…69 2 0.92 1 119 0 5 0
…70 2 0.92 1 89 0 6 0
…71 2 0.92 1 138 0 6 0
…72 2 0.92 1 26 0 5 0
…73 2 0.92 1 68 0 5 0
…74 2 0.92 1 54 0 6 0
…75 2 0.92 1 127 0 5 0
…76 2 0.92 1 135 0 5 0
…77 2 0.92 1 18 0 18 0
Spring 2023 0 1.00 1 63 0 6 0
…79 1 0.96 1 38 0 5 0
…80 1 0.96 1 23 0 5 0
…81 1 0.96 1 39 0 5 0
…82 1 0.96 1 15 0 5 0
…83 1 0.96 1 42 0 5 0
…84 1 0.96 1 55 0 5 0
…85 1 0.96 1 28 0 5 0
…86 1 0.96 1 48 0 6 0
…87 1 0.96 1 49 0 6 0
…88 0 1.00 1 49 0 6 0
…89 1 0.96 1 61 0 5 0
…90 1 0.96 1 82 0 6 0
…91 1 0.96 1 80 0 5 0
…92 1 0.96 1 119 0 5 0
…93 1 0.96 1 89 0 5 0
…94 1 0.96 1 138 0 5 0
…95 1 0.96 1 26 0 5 0
…96 1 0.96 1 68 0 5 0
…97 1 0.96 1 54 0 5 0
…98 1 0.96 1 127 0 5 0
…99 1 0.96 1 135 0 6 0
…100 1 0.96 1 18 0 18 0

Variable type: numeric

skim_variable n_missing complete_rate mean sd p0 p25 p50 p75 p100 hist
Fellow Number 3 0.88 12 6.94 1 6 12 18 23 ▇▅▇▅▇

Data Cleaning

Our explorations bring us to similar conclusions - the missing data have the same pattern based on how surveymonkey formats data. Reviewing the explorer dashboard helps us identify potential ID or organizing variables. Here is strategy:

  1. Remove empty and NA values.
  2. Use the following as ID label columns
    1. Pre vs Post
      1. Pre-test label (before/prior)
      2. Post-test label (now)
    2. Assessment Timing
      1. Summer 2020
      2. Spring 2021
      3. Spring 2022
      4. Spring 2023
    3. Averages
      1. Baseline
      2. End of Y1
      3. End of Y2
      4. End of Y3
    4. Question IDs and Prompts

Critical Information - Data Frame Rows and Columns

You can manipulate the rows and columns in a dataset directly using what is called index notation. Index notation uses brackets ” [ , ] “. Where the rows are on the left side of the comma, and the columns are on the right side.

We can combine with the sequence ( : ) operator to select multiple rows or columns at once in order.

For example, here’s what it looks like with the gsu dataset

# A tibble: 1 × 1
  `Fellow Number`
            <dbl>
1              NA
# A tibble: 1 × 1
  `Fellow Number`
            <dbl>
1              NA
# A tibble: 1 × 1
  ...100
  <chr> 
1 4.09  
# A tibble: 5 × 1
  ...100            
  <chr>             
1 <NA>              
2 End of Y3 Average 
3 3.91              
4 4.2300000000000004
5 4                 

Exploring Missing Data

Most of our missing data comes from the way Surveymonkey exports data into first row, but some of that data also includes our question prompt. Let’s explore some solutions for dealing with this structure step by step

Explore how NAs show up in Row 1

[1] NA                                                                                               
[2] "How prepared did you feel to do the following prior to joining the DSPETL Program in June 2020?"
[3] "How prepared did you feel to do the following now?"                                             
[4] "How prepared do you feel to do the following now?"                                              
[1] "Bryant"   "Ashlee"   "Female"   "Black"    "High"     "Science"  "Rockdale"
[8] NA         "4"       

Let’s do the same with columns so we have a list of the original names. We may need these later.

  [1] "Fellow Number"   "Last Name"       "First Name"      "Gender"         
  [5] "Race/Ethnicity"  "Grade Band"      "Content Area"    "School District"
  [9] "Summer 2020"     "...10"           "...11"           "...12"          
 [13] "...13"           "...14"           "...15"           "...16"          
 [17] "...17"           "...18"           "...19"           "...20"          
 [21] "...21"           "...22"           "...23"           "...24"          
 [25] "...25"           "...26"           "...27"           "...28"          
 [29] "...29"           "...30"           "...31"           "Spring 2021"    
 [33] "...33"           "...34"           "...35"           "...36"          
 [37] "...37"           "...38"           "...39"           "...40"          
 [41] "...41"           "...42"           "...43"           "...44"          
 [45] "...45"           "...46"           "...47"           "...48"          
 [49] "...49"           "...50"           "...51"           "...52"          
 [53] "...53"           "...54"           "Spring 2022"     "...56"          
 [57] "...57"           "...58"           "...59"           "...60"          
 [61] "...61"           "...62"           "...63"           "...64"          
 [65] "...65"           "...66"           "...67"           "...68"          
 [69] "...69"           "...70"           "...71"           "...72"          
 [73] "...73"           "...74"           "...75"           "...76"          
 [77] "...77"           "Spring 2023"     "...79"           "...80"          
 [81] "...81"           "...82"           "...83"           "...84"          
 [85] "...85"           "...86"           "...87"           "...88"          
 [89] "...89"           "...90"           "...91"           "...92"          
 [93] "...93"           "...94"           "...95"           "...96"          
 [97] "...97"           "...98"           "...99"           "...100"         

Step 1 - Break the dataset down into its components

Let’s reorganize our dataset columns by similar types. We can then add them back together for processing. Note the use of the ( : ) operator to break up the dataset into chunks

This is a little bit easier to work with and is consistent with how tools like Power BI approach wrangling larger datasets. Now we can more clearly see the structure of our data. We have eight demographic variables, one set of pre-and-post cohort responses for Summer 2020, three cohort status check-ins, and average scores from baseline to end of year 3 that got shuffled into our rows. Now we have a better idea of how to organize this

Step 2 - Create label columns and delete NA rows

This keeps information needed to understand the dataset, while removing the NAs that keep us from a clean analysis.

Step 3 - Rename column names to be easier to understand. We will paste the prefix (Summer2020_Pre) as the first part of our label, apply that over 11 rows, and separate them with an underscore

Step 4 - Now we can finally get rid of our NA rows by removing the first two rows

Double Checking with Automated Analysis

Warning in explore_shiny(data, ...): This function can only be used in an
interactive R session

Full Workflow

Let’s put all of those steps together to clean each component and then combine the pieces back into one clean frame. We’ll have to make sure that our smaller data pieces have the same number of rows to bind them together. So if we delete rows in one set, we need to delete the same number of rows in the next set.

The last component of our data is the data containing our baseline and end of year averages. After we process this dataset, we can join our dataset back together for future analyses.

Quick note - when we store 1 column to a dataset, R turns it into a list, but we can easily combine our lists into a dataframe

And because these came from SurveyMonkey, we can take advantage of the same data structure that allows us to just remove the first two rows to leave data that are missing naturally and not due to the export

Warning in explore_shiny(data, ...): This function can only be used in an
interactive R session

And that looks a lot cleaner. Let’s combine the datasets with tidyverses column binding function

Writing out and Saving This

This would be a lot of work to lose. So let’s save the dataset so that we can access it outside of R.

What happens if we explore the data now?

We see that the school district variable contains an average value that aggregates each school districts assessment scores. We should leave these OUT of any tests.

Warning in explore_shiny(data, ...): This function can only be used in an
interactive R session

What tests do you think we should use?