Summer Program for Arts, Recreation and Knowledge (SPARK), 2017-2019

Newport News Public Schools sought an evaluation study of its Summer Program for Arts, Recreation and Knowledge, also known as SPARK. SEG designed a two-part evaluation study to assess outcomes associated with SPARK participation. The first phase of the study used existing data and focused on identifying major academic outcomes associated with SPARK and the larger programmatic context for SPARK. The second phase was a more comprehensive evaluation of the STEM-related outcomes of SPARK, including on-site observations to assess program quality using a valid and reliable observation protocol (SERVE Study of STEM Learning Observation Protocol). Program quality data was correlated with student STEM survey data to assess whether program quality affected student attitudes and behaviors related to STEM. The pre-post student survey, S-STEM, assessed changes in student interest and engagement in STEM. An Analysis of Variance was used with the state standardized test data to assess academic outcomes in mathematics and science for participants compared to non-participants. Finally, follow-up focus groups with students and teachers determined impact on students’ readiness to learn. The final study results were presented to the NNPS School Board in 2019.

 

Cybersecurity Pathways for Military Connected Students, 2019-2023

SEG also partnered with Newport News Public Schools' (NNPS) for their Cybersecurity Pathways for Military Connected Students project, which creates a pathway for students in cybersecurity by focusing on computational thinking, problem solving, and digital literacy. SEG assesses project fidelity, conducts formative evaluation to support continuous program improvement, and evaluates project outcomes. Data collection methods include implementation logs, STEM Specialist Coaching log, interviews with project staff, teacher focus groups, classroom walkthrough data, and student achievement data. This project is financially supported by the Department of Defense Education Activity (DoDEA).