Program Evaluation

Program Evaluation

The State Plan required for the State Professional Development Grant Application must describe how the SEA will assess, on a regular basis, the extent to which the strategies implemented have been effective in meeting the prescribed performance goals.

• Evaluator Reports and Tools
• Related Resources
  
• Program Objectives and Performance Measures

Evalution of the SIG Program - 2007 Final Report: [PDF, DOC] This is a report from the five year SIG evaluation conducted by WESTAT. The evaluation includes a systems change model and an elegant way of designating outcomes as robust, solid, probable and possible. Outcome evidence is provided to support the categorization of the outcomes. There is also a very interesting section on administrative leadership. Please note that this is a SIG rather than SPDG report. As such, some of the outcomes are a bit dated (e.g., participation in assessment) given the passage of NCLB.

Evaluation Reports and Tools

Reports

California: http://www.calstat.org/evaluation.html

Wisconsin: http://www.wispdg.org/wisconsinsig
To view these reports Scroll down the page to the heading "For additional information, please select the following links." You'll see five colored crayons. Click on the crayon titled, "Evaluation and Accountability Reports".

Tools

California
Below are evaluation instruments developed by the CA SIG for use with our (ERIA) program (September 2007). The California evaluation team adapted the PBIS TIC/SET approach that sites are already familiar with, but the content of the questions is quite different. They also developed a much more extensive Site Action Plan instrument with questions that guide sites in the development and implementation of ERIA. Finally, they put together a ‘stages of development diagram’ that helps sites focus on what needs to happen at each phase.

ERIA Site Team Implementation Checklist (TIC) (Sep. 2007)

ERIA Site Action Plan (SAP) and Updates (Sep. 2007)

ERIA Schoolwide Evaluation Tool (SET) (Sep. 2007)

Vermont
RtI Fidelity of Implementation Checklist in DRAFT (Sep. 2007)

Illinois
Following up on "sharing our tools" topic, the tools that we are developing in Illinois are available at: http://www.luc.edu/cseit/aspireprogramcoordinator.shtml

Related Resources

• Logic Models
  The Center for Evaluation and Education Policy (CEEP) has created to Voice-over PowerPoint presentations for OSEP: (1) How to create and use logic models, and (2) How to create high quality objectives and performance measures.
• A guide for education personnel: Evaluating a program or intervention. (.pdf) Washington, DC: American Institutes for Research (by Paulsen , C.A. & Dailey, D. (September 2002).

Educational  Evaluation Standards  from the American Education Association links to both Education Program and Personnel Evaluation standards.
 

Topic Specific Evaluation Samples

• Elearning Program Evaluation  from State Educational Technology Directors Association. This resource includes the  "eLearning evaluation Lens" a method for considering critical issues and questions that frame successful eLearning program evaluations including components such as categories, goals, indicators, measures, lessons learned, models, and state eLearning initiatives.
   
• The Distance Education Clearinghouse (University of Wisconsin) An excellent collection of links to information about the evaluation and assessment of online learning.

Categories: Main Content