In 2011-12, 100% of students enrolled in Jumpstart’s Corps Member program indicated that they were satisfied with their Jumpstart experience and 100% “would recommend serving with Jumpstart.”
In our 2011-2012 program year, 75% of our participating children showed language and literacy gains greater than their peers who did not receive Jumpstart. 66.3% showed gains greater than their non-Jumpstart peers in their initiative and social relations skills.
Read on to learn more about how Jumpstart Claremont evaluates our program efficacy.
Program Assessment – Jumpstart engages in a range of assessment and evaluation activities to demonstrate program effectiveness. Jumpstart collects and analyzes data to measure its program’s impact on children, Corps members, and other stakeholders, as well as to ensure the organization’s ongoing effectiveness in implementing the program. Through the tools and processes described below, Jumpstart identifies how well the program is working, the areas in which it makes the greatest impact, and aspects of the program that can be improved.
The following processes and tasks, and their related tools or activities, are necessary to enable Jumpstart to measure impact and track data in a variety of areas:
|Impact on children
||• School Success Checklists (Fall, Winter, Spring)
• Session Plan Tracking
• Monthly Classroom Observations of Quality Standards
|Impact on Corps members
||• Corps Member Surveys (Fall, Winter, Spring)
• Monthly Feedback and Action Planning
• Training Assessments
|Feedback from stakeholders
||• Program Partner Feedback (Mid and End year)
• Ongoing Meetings
• Community surveys and event feedback forms
Impact on Children and Corps Members
Jumpstart’s most compelling interest is to measure its impact on the young children served – showing the extent to which they grow and benefit from participation in the program. In addition, some AmeriCorps grants require Jumpstart to conduct an external evaluation study once every three years, which includes comparing the outcomes of participating Jumpstart children to their peers attending the same or other preschools but who are not served by Jumpstart.
School Success Checklists
The School Success Checklist is a research-based assessment tool adapted from the HighScope Preschool Child Observation Record. Completion of paper Checklist forms by teachers and data entry by Jumpstart site staff into the Online School Success Checklist tool enables Jumpstart to measure growth in children’s skill development. The results derived from the Checklist process are used to report program outcomes to AmeriCorps and other external stakeholders. Checklists are completed and entered in three phases throughout the year and assessed at the close of the program year in August.
Session Plan Tracking
To track the number of sessions Jumpstart participants are offered at the site, and the length of time between Jumpstart’s first and last session dates, site managers must track session plan implementation throughout the year.
Corps Member Surveys
As a national service organization, Jumpstart is committed to measuring the impact of its program on Corps members. Jumpstart uses the Corps Member Survey to collect information about Corps members’ beliefs and knowledge about early childhood education, as well as their development of leadership abilities and satisfaction with their program experiences. The survey is implemented three times a year (fall, winter and spring).
Students are also evaluated each month through our regular observation and feedback process. Each team and each corps member receives individualized feedback on their performance in the classroom. This process also allows students and teams to plan specific goals for improvement or ways that they can better customize their teaching directly to the needs of their children.
Feedback from Stakeholders
Because program partners are key stakeholders in the Jumpstart program, it is a goal for the organization to collect information on their experiences working with Jumpstart.
Program Partner Feedback
Program partner feedback is collected formally twice each year, in the middle of the school year and at the end of the school year. The feedback is collected though our Program Partner Feedback Form. This form asks program partner directors and/or teachers to give feedback on Jumpstart’s work with children, communication, and other areas. Additionally, the site manager conducts informal check-in meetings each month with each partnering teacher and additional members of the partner preschool staff.
Several of Jumpstart’s measurement and tracking processes relate to the overall effectiveness of program implementation and are required either for internal review and support or for accountability to outside stakeholders.
Evaluating training serves two key purposes: enabling Jumpstart to determine the effectiveness of training content and providing regional and site staff with information to evaluate strengths and challenges in delivering training. Jumpstart uses a standardized training evaluation tool to collect Corps member feedback on training activities throughout the year. Attendance records and evaluations for each training are kept on file on site.
Reporting All AmeriCorps programs are required to complete regular progress reports, in which they must provide data related to their site’s AmeriCorps performance measures. Each Jumpstart AmeriCorps grant includes performance measures with specific targets for outputs and outcomes.