Average Word Response For Same Questions
Jonathan Cruz
2024-05-08
The aim of this project is to accurately assess students’ reading levels by leveraging a neural network trained through supervised learning. While numerous algorithms serve this purpose, their predictions often exhibit significant grade discrepancies. I propose that employing a supervised learning model coupled with effective natural language processing strategies can effectively address these challenges.
I encountered a website housing various algorithms designed to determine the grade level of a given text. When I input a seventh-grade reading level question from ChatGPT, the closest algorithm estimated it at a twelfth-grade reading level.
Algorithms Score : https://github.com/jamilton08/reading_level_language/blob/main/Readability%20Scoring%20System.pdf
Reading Level Algorithms - https://readabilityformulas.com/readability-scoring-system.php
I conducted an experiment with ChatGPT where I posed 20 questions that could be answered by any grade level. Following this, I requested ChatGPT to respond to each question at every grade level.
-ChatGPT Promts - https://chat.openai.com/share/4d93bfca-b1ba-4bfa-947e-fbe0f37e5c6f
| question | grade_1 | grade_2 | grade_3 | grade_4 | grade_5 | grade_6 | grade_7 | grade_8 | grade_9 | grade_10 | grade_11 | grade_12 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| How do you think we can make our school/community a better place? | By picking up trash and being kind to everyone. | We can clean up the playground and help new students feel welcome. | We can organize clean-up days and start clubs for things we’re passionate about, like art or sports. | “We can pick up trash, plant flowers, and be kind to each other. If we work together, we can make our school and community super awesome!” | We can organize clean-up days, start recycling programs, and create clubs for things like gardening or coding to make our school and community cleaner and more fun! | We can organize fundraisers for local charities, start environmental clubs to clean up parks, and advocate for inclusive policies to ensure everyone feels valued and supported. | “We can organize community service projects, advocate for positive changes, and promote inclusivity and kindness among our peers. By working together, we can create a supportive and thriving environment for everyone.” | “We can initiate community service projects, establish mentorship programs, and advocate for inclusive policies to foster a more supportive and vibrant school and community environment.” | “We can organize more student-led initiatives addressing mental health, environmental sustainability, and social justice issues. Additionally, fostering a culture of inclusivity and diversity can help create a more supportive and welcoming community.” | “We can organize more student-led initiatives focused on mental health awareness, environmental sustainability, and community service projects. Additionally, promoting diversity, inclusivity, and school spirit can foster a more supportive and vibrant community.” | “We can implement more student-driven initiatives focused on mental health awareness, sustainability, and community service projects. Additionally, fostering a culture of inclusivity, diversity, and open communication can contribute to a more supportive and vibrant community.” | “We can promote inclusivity and diversity through cultural events, awareness campaigns, and student-led initiatives. Additionally, creating more opportunities for collaboration, mentorship, and civic engagement can foster a sense of belonging and unity within our school and community.” |
| What are some important problems facing our world today, and how can we work together to solve them? | Helping animals find homes and sharing toys with friends. | Helping animals find homes and recycling to keep our planet clean. | Helping animals find homes, reducing pollution, and recycling to keep our planet clean. | “Pollution, animals losing their homes, and people not having enough food are big problems. We can help by recycling, taking care of animals, and sharing our snacks with those who need them.” | Issues like pollution, poverty, and animal extinction are big problems. We can help by reducing waste, volunteering at shelters, and supporting organizations that protect the environment and help people in need. | Climate change, poverty, and inequality are pressing issues. By raising awareness, advocating for policy change, and taking individual actions like reducing our carbon footprint and volunteering, we can make a difference. | “Issues like climate change, poverty, and social injustice are pressing concerns. By raising awareness, supporting sustainable practices, and advocating for policy change, we can address these challenges and work towards a more equitable and sustainable future.” | “Climate change, social inequality, and global health crises are significant challenges. By promoting sustainable practices, advocating for equitable policies, and fostering international cooperation, we can address these complex issues and strive for a more just and sustainable world.” | “Climate change, income inequality, and systemic racism are pressing global issues. By advocating for policy change, participating in grassroots movements, and amplifying marginalized voices, we can work towards a more equitable and sustainable future.” | “Climate change, social inequality, and global health crises are significant challenges. By advocating for policy change, supporting grassroots movements, and engaging in collective action, we can address these issues and work towards a more just and sustainable future.” | “Climate change, social injustice, and global health crises are significant challenges. By advocating for policy reform, supporting grassroots movements, and engaging in collaborative efforts, we can address these issues and strive towards a more equitable and sustainable future.” | “Climate change, social injustice, and global health crises are pressing issues that require collective action. By advocating for policy reform, supporting grassroots movements, and fostering global cooperation, we can address these challenges and create a more equitable and sustainable future.” |
| Can you describe a time when you had to overcome a challenge? What did you learn from it? | I learned to tie my shoes all by myself! | I learned to ride my bike without training wheels! It was hard, but I kept trying. | I learned to ride a bike without training wheels. It was scary at first, but I practiced and got better! | “I was scared to give a speech in class, but I practiced a lot and told myself I could do it. I learned that practicing and believing in myself can help me do things I didn’t think I could.” | Last year, I was nervous about giving a presentation in front of the class, but I practiced a lot and asked my teacher for tips. It was scary at first, but I learned that practice and preparation help me do my best. | Last year, I struggled with math, but with perseverance and extra help from my teacher, I improved my grades. I learned the importance of asking for help and not giving up when things get tough. | “Last year, I struggled with time management and balancing schoolwork with extracurricular activities. Through trial and error, I learned the importance of prioritization, organization, and seeking support when needed. It taught me valuable skills that I continue to apply.” | “Last year, I faced academic setbacks due to health issues, but with perseverance and support from my teachers and peers, I was able to overcome obstacles and achieve academic success. It taught me resilience, time management, and the importance of seeking help when needed.” | “Last year, I struggled with balancing academics, extracurriculars, and personal responsibilities. Through time management strategies and seeking support from teachers and peers, I learned the importance of prioritization, self-care, and resilience.” | “Last year, I struggled with time management and academic stress. Through trial and error, I developed better organizational skills, sought support from teachers and peers, and learned the importance of self-care and resilience in overcoming obstacles.” | “Last year, I faced academic pressure and struggled with time management. Through resilience, self-reflection, and seeking support from mentors, I learned the importance of prioritization, self-care, and adapting to adversity.” | “Last year, I faced academic pressure and struggled with time management. Through perseverance, self-reflection, and seeking support from peers and teachers, I learned the importance of resilience, prioritization, and self-care in overcoming obstacles and achieving success.” |
| What does success mean to you, and how do you plan to achieve it? | Success is getting a gold star! I’ll try my best in school. | Success is doing well on my spelling test and reading lots of books. I practice every day. | Success is doing well in school, being a good friend, and helping others. I’ll keep trying my best every day. | “Success is when I do my best and feel proud of myself. I’ll keep trying my hardest in school, helping my friends, and never giving up, even when things are tricky.” | Success means doing well in school, being kind to others, and following my dreams. I’ll achieve success by working hard, being respectful, and never giving up, even when things are tough. | Success is achieving personal goals, making a positive impact, and finding fulfillment in what I do. I plan to achieve success by setting realistic goals, working hard, and staying dedicated to my passions. | “Success, to me, is achieving personal goals, making a positive impact, and finding fulfillment in my endeavors. I plan to achieve success by setting ambitious yet achievable goals, staying resilient in the face of setbacks, and continuously learning and growing.” | “Success, to me, is achieving personal fulfillment, making a positive impact, and pursuing my passions with dedication and integrity. I plan to achieve success by setting ambitious yet achievable goals, cultivating a growth mindset, and embracing opportunities for growth and learning.” | “Success, to me, is achieving personal fulfillment, making a positive impact, and pursuing my passions with integrity and purpose. I plan to achieve success by setting ambitious yet achievable goals, cultivating meaningful relationships, and continuously learning and growing.” | “Success, to me, is achieving personal fulfillment, making a positive impact, and pursuing my passions with dedication and integrity. I plan to achieve success by setting ambitious yet realistic goals, seeking out opportunities for growth, and maintaining a balance between academics, extracurriculars, and personal interests.” | “Success, to me, is achieving personal fulfillment, making a positive impact, and pursuing my passions with integrity and purpose. I plan to achieve success by setting ambitious yet achievable goals, seeking growth opportunities, and embracing challenges with resilience and determination.” | “Success, to me, is achieving personal fulfillment, making a positive impact, and pursuing my passions with purpose and integrity. I plan to achieve success by setting ambitious yet realistic goals, seizing opportunities for growth, and embracing challenges with resilience and determination.” |
| How do you think technology has changed the way we communicate and interact with others? | I can talk to my grandma on the computer! | We can video chat with family far away and send emails to our teachers. | We can talk to friends and family far away, do research for school projects, and play games online together. | “Technology lets us talk to friends far away, play games together, and learn new things online. But it’s also important to talk face-to-face and play outside with friends.” | Technology lets us talk to friends and family through texts and video calls, but sometimes it’s important to talk face-to-face and spend time together without screens. | Technology has revolutionized communication, allowing us to connect instantly with people worldwide through social media, video calls, and messaging apps. While it has its benefits, we must also be mindful of its impact on face-to-face interactions and mental health. | “Technology has revolutionized communication, enabling instant connectivity and global interaction through social media, messaging apps, and video conferencing. While it enhances convenience and connectivity, it’s important to balance digital interactions with meaningful face-to-face connections.” | “Technology has revolutionized communication, enabling instant connectivity and global collaboration through social media, digital platforms, and virtual communication tools. While it enhances efficiency and connectivity, it’s important to balance digital interactions with face-to-face communication and maintain digital wellness.” | “Technology has revolutionized communication, offering instant connectivity and access to vast amounts of information. While it enhances convenience and collaboration, it’s crucial to balance screen time with face-to-face interactions and maintain digital well-being.” | “Technology has revolutionized communication, offering instant connectivity and access to information. While it enhances efficiency and connectivity, it’s important to be mindful of digital etiquette, privacy concerns, and the impact of screen time on mental health and relationships.” | “Technology has revolutionized communication, offering instant connectivity and access to information. While it enhances productivity and connectivity, it’s essential to balance virtual interactions with face-to-face communication and maintain digital well-being.” | “Technology has revolutionized communication, offering instant connectivity and access to information. While it enhances efficiency and connectivity, it’s important to balance virtual interactions with face-to-face communication and maintain digital well-being.” |
## [,1] [,2] [,3]
## [1,] 1 0 0
## [2,] 0 1 0
## [3,] 0 0 1input layer - input ids you get from tokenization
hidden layer - Max(0, x), Relu
output layer - \[ \text{softmax}(z_i) = \frac{e^{z_i}}{\sum_{j=1}^{K} e^{z_j}} \]
Link to Project
While the model achieved an impressive 75 percent accuracy in predicting grade levels, it exhibited significant confusion particularly in high school reading levels. Upon further investigation, I discovered that Lexile standards indicate consistent reading levels for grades 9 through 12.
Undoubtedly, a neural network proves highly effective in predicting reading levels, surpassing existing algorithms in accuracy. With a substantially larger dataset, I am confident this model could make a significant contribution in real-world applications. Achieving a predictive accuracy of 75, it comfortably aligns with business expectations, typically ranging between 70 to 90, thus positioning it well for practical implementation.
Could we see a shift towards relying on machine learning models rather than rule-based algorithms to determine reading levels?”