A survey consisting of 42 questions (40 Likert scale questions and two free response questions) was administered to the 2021 KEYS interns. The scale measured their agreement with statements assessing the program’s application process, selection process, lab placements, pre-program assignments, Training Week, lab mentoring, weekly Seminars, socials, staff support, Presentation Week, and general feelings about the 2021 program. This report provides the results of the quantitative Likert scale responses with selected quotes from the student free responses. Additionally, responses from the 2020 online program are provided for a year-to-year comparison. Where applicable, data from the 2019 program survey is included, as well. The survey data was compiled into a text file and analyzed with RStudio.


Application Process


Q1: I got the information and assistance I needed during the application process.


Q2: I found the application website easy to use.


Selection Process


Q3: The selection process allowed me to accurately demonstrate my interests and abilities.


Q4: When I was selected to participate in KEYS, I understood the program’s expectations of me.


Lab Placements


Q5: At the beginning of the program, my lab’s research topic closely matched my own interests.


Q6: At the end of the program, my lab’s research topic closely matched my own interests.


Q7: At the beginning of the program, I was disappointed by my lab placement.


Q8: At the end of the program, I was disappointed by my lab placement.


Q9: If the opportunity becomes available, I would choose to work with the same lab in the future.

No 2019 data available for this question


Pre-Program Assignments


Q10: I found the pre-KEYS assignments challenging.


Q11: I found the pre-KEYS assignments helpful in preparing me for KEYS.


Q12: I received the help and feedback I needed to complete the pre-KEYS assignments.


Training Week


Q13: I learned new science concepts during Training Week.


Q14: I gained useful science skills during Training Week.


Q15: I found the Training Week homework challenging.


Q16: Please identify the science concepts and skills from Training Week that were important to your work during KEYS. Briefly explain how you used them during your internship.

Only 2021 survey responses provided

##                                   Count
## Reading Research Papers              15
## Science Literacy                     13
## Excel                                10
## R/R-Studio                            9
## Shell & Git                           9
## Making Code Reproducible              8
## HPC/Box                               7
## MATLAB                                5
## Metabolomics                          5
## Containers                            4
## DNA Bioinformatics                    3
## Computer Languages                    3
## Python/Jupyter Notebook               3
## Orange Data Mining                    2
## CyVerse Services                      2
## Asking Presenters Questions           2
## Protein Bioinformatics                2
## Linux                                 2
## Virtual Machines                      2
## Presentation Skills                   1
## Lab Etiquette                         1
## GUI                                   1
## Troubleshooting Technology Issues     1
## Data Science Basics                   1
## ImageJ                                1


Lab Mentoring


Q17: My assigned lab mentor interacted with me as often as I wanted.


Q18: Overall, my lab’s staff were helpful and supportive of my work.


Weekly Seminars


Q19: I looked forward to attending weekly Seminars.


Q20: Hearing presenters discuss their academic and career journeys helped me envision my own.


No 2019 data available for this question


Q21: Weekly Seminars gave me new insights into what it means to be a researcher.


Q22: One or more weekly Seminar presentations helped me consider career plans.


Socials


Q23: I attended more than half of the KEYS socials.


Q24: I gained as much from the KEYS socials as I did from other parts of the program.


Q25: I found it difficult to get to know all of the KEYS interns.


Staff Support


Q26: I felt welcomed and included throughout the KEYS program.


Q27: I felt comfortable asking for help from any KEYS staff member.


Q28: I would consider applying to be a KEYS Crew Mentor for a future program.


Q29: It was helpful to have an assigned KEYS Crew Mentor to work with throughout the program.


Presentation Week


Q30: I felt well prepared to present at the Research Presentation.


Q31: The research presentation allowed me to accurately demonstrate what I learned and accomplished during KEYS.


Q32: During the Research Presentation, I felt confident talking to all types of listeners about my research.


Q33: If the opportunity becomes available, I would choose to present my research and my poster in a face-to-face setting in the future.

No 2019 data available for this question


General Feelings


No 2019 data available for this section


Q34: Despite the changes to the program, I am glad I participated in KEYS.


Q35: KEYS increased my knowledge of data science.


Q36: KEYS increased my ability to conduct data science.


Q37: KEYS increased my ability to analyze scientific data.

No 2020 data available for this question


Q38: KEYS affected my thinking about where to attend college.


Q39: KEYS improved my ability to learn using online environments.


Q40: KEYS increased the likelihood that I will seek a hands-on lab internship in the future.


Q41: If the opportunity becomes available, I would choose to do another “virtual” internship in the future.


Q42: Please provide any additional comments about any aspect of KEYS.

Only 2021 survey responses provided
Focus on comments that offer feedback to the program


“One aspect I felt I missed out on was getting to know my fellow interns, but this is definitely difficult in a virtual format. For next year and future sessions of KEYS, if there is some way to encourage peer to peer interaction that would be helpful for sure.”


“I really enjoyed my experience as an intern, but I wish my lab had been a little more involved in my work.”


“If anything, I wish I had the opportunity to reach out to other interns one on one without breaking the minor policy. I would have loved to get to know other interns who are equally passionate about science. In addition, I wish there was a bit more structure transitioning from training week into my lab. Lastly, I think that 30-40 hours was extremely hard to reach each week (only counting lab hours and nothing else), so maybe I would change either the guidelines on the time sheets or the number of hours required.”


“I really liked the KEYS crew mentor and KEYS crews. It allowed me to talk to my peers every week and it was nice to see that others were on the same boat as me. My KEYS crew mentor helped me be on schedule and was a great support system for me throughout my KEYS internship.”


“I really enjoyed the research and learning about data science. I, of course, would’ve preferred to do it in person to get wet lab experience. And although the socials were fun, they just weren’t the same as meeting and talking to people in person. Overall, I enjoyed the digital internship, but I think doing it in person would’ve just made it better in every way.”


“I think it was really well adapted to a virtual setting. I can’t imagine what I really missed from not being in person.”


“I think overall more communication between the labs and KEYS would be helpful. Sometimes it would be very frustrating to get feedback from my lab that contrasted with what KEYS wanted.”


“I appreciated all the efforts that were made to ensure that interns were still developing connections and becoming comfortable in an online setting, especially in regards to the Socials and the breakout room activities. The Seminars allowed me to speak with several different researchers and this helped me in developing my perspective on research and my scientific ambitions. The Science Literacy lectures were well-composed and each lecture taught me critical skills, that I know will be used for any academic and professional goal.”


“I think one recommendation I have is to provide a general master schedule of the program earlier to the interns. This isn’t so interns can try to plan things around KEYS or anything like that since we agreed to be available all summer, but more so that we have a stronger idea of what we’ll be doing all summer.”


“I learned a lot this summer about what it means to be a science communicator and I found that appealing. The virtual-ness of the internship felt very limiting at times and the zooms during training week felt very long and crammed together.”


“KEYS Crew groups were very helpful.”


“The only thing I would say is I wish we spent more time learning the programs/tools we were using to research instead of learning other topics that may not have been as relevant.”


“I wasn’t able to make it to a lot of the socials due to personal scheduling conflicts, but the one that I was able to attend (the talent show), I absolutely loved the energy and was surprised by how fun a Zoom call could be!”


“I fully enjoyed all the team builders during KEYS.”


“One thing my PI mentioned was that for next year’s KEYS intern, KEYS should talk about peer-reviewed articles during training week.”


“I found having the weekly 1:1 check-ins were extremely helpful for making sure I was staying on the right track to making sure my poster and presentation were competed on time.”


“Appreciate all the efforts of KEYS staff and crew, though I think the family or social aspect between interns was very weak, I mostly only chatted with my crew group and intern from my lab.”



Student Quotes


“I’d like to say that what KEYS did this year was absolutely amazing! It covered so many different things in such a small amount of time and it was as close to an in-person research experience as you can get on a laptop.”


“This internship was life changing, and it had a big impact on what I want to do in the future, as well as positively impacting my confidence.”


“I loved that throughout this challenging experience, we had a large network of supporters to guide and assist us.”


“I am so grateful for this opportunity this summer! I learned so much and I can’t wait to continue working in my lab this fall when I start college at UA!!”


“I loved having the networking opportunities to meet extraordinary scientists as well as build a scientific community that I fit into.”


“I had an amazing summer with KEYS this year in spite of the online circumstances. While I definitely found it more challenging to connect with the KEYS crew, staff, and interns as well as my lab, I think that it was still without a doubt one of the most memorable and influential experiences I have had.”


“I am extremely happy that I was given the opportunity to participate in KEYS. Although the lab that I was placed in did not exactly match my interests, I am still happy that I got to explore a different aspect/area of science that I may consider looking into in the future.”


“I had such an amazing time during my KEYS internship and the overall experience has positively affected my perspective on many things including what it truly takes to be a researcher!”


“KEYS was the best experience of my life so far. I am glad that i had the opportunity to participate in it.”


“The experience was all I had been expecting and more. The amount of skills and experience I have gained in a virtual setting is honestly astounding. I assumed the program would be a bit worse than usual because it was online, but honestly it felt extremely valuable still.”


“Despite the virtual format, I found the KEYS experience to be amazing. I learned a lot from my research, and I created a new connection with my lab mentor. I am excited to continue engaging in scientific research in the future.”


“I am really glad to be part of this program! KEYS was a valuable experience where I had so much fun along with learning a lot of things about data science and research. This program definitely made me consider a career path into research in different areas like Ecosystem Genomics.”


“KEYS was a wonderful experience and was very helpful in helping me learn more about research and data science, as well as test out researching in a field that I had interest in in an university level setting. Communication was fantastic and the virtual learning never felt like a burden. Other than training week being very tiring on the eyes, everything was balanced and organized well! The speakers that came in were inspiring, informative, and engaging, and helped me question my future and my opportunities. The staff, crew, and my research lab were professional, communicative, and welcoming! It has made me much more confident in research and has encouraged me in research and in taking more opportunities similar to KEYS. It was an overall great experience!”


“KEYS has been an amazing and unique experience. Though online, I was able to explore and learn a multitude of important science and data science elements. From conducting a scientific research to participating in the science literacy lessons, my passion for science and its advancement is furthered.”