Program Evaluation
The State Plan required for the State Professional Development Grant Application must describe how the SEA will assess, on a regular basis, the extent to which the strategies implemented have been effective in meeting the prescribed performance goals. Select this link for information about performance measures.

• Evaluation of OSEP’s SPDG/SIG Program
  
  
• SPDG/SIG Evaluator Presentations at OSEP Project Directors Conference
  
  
• Evaluator Reports and Tools
  
  
• Related Resources
  
  

Evaluation of OSEP’s SPDG/SIG Program

• SIG/SPDG Continuation Funding Report. Please note: If you are completing your fifth year and request a no cost extension or are currently in a no cost extension you will need to submit a FINAL performance report within 90 days of the completion of the grant. This form is not appropriate for Final Reports. Also, please note that continuation funds will not be flowed until the Department receives an a Continuation Funding Report that indicates "substantial progress".
  
  
• SIG Program Evaluation: Westat evaluation of the Federal SIG Program. Links to interim evaluation reports and evaluation abstract.
  
  
• Westat Presentation at OSEP Project Directors’ Conference (July 26, 2005) Precursors to Change: Leadership, Documentation of Outcomes, and Systemic Evaluation Findings from Westat’s SIG Program Evaluation (PowerPoint)
  
  
• Presentation at 2004 Joint Personnel Preparation/State Improvement Grant/ Comprehensive System of Personnel Development Conference Investigating the Management of Systemic Change Related to Professional Development (March 16, 2004) Power Point Presentation and Microsoft Word Handout
  
  
• (SIG) Program Year 3 Updated Cross-Project Analysis - Westat (August 2003)
  
  

OSEP’s Performance Measures:

What are the Performance Indicators (.pdf) for the IDEA: State Personnel Development Grants (SPD) Program?

From Special Education--State Program Improvement Grants for Children with Disabilities (FY 2005 application for grant): The goal of the State Personnel Development Grants Program is to reform and improve State systems for personnel preparation and professional development in early intervention, educational, and transition services in order to improve results for children with disabilities.

Under the Government Performance and Results Act (GPRA), the Department is currently working to develop measures that will yield information on various aspects of performance consistent with the program's purpose. When implemented, each grantee will be required to submit data documenting its performance on these measures. In addition, the applicant's proposed project evaluation must describe the extent to which the methods of evaluation include the use of objective performance measures that are clearly related to the intended outcomes of the project and will produce quantitative and qualitative data on the project's contribution to the reform and improvement of such systems. If funded, the applicant will be expected to report such data in the projects' annual performance reports (34 CFR 75.590). Data should reflect how States have used State Personnel Development Grant funding, in addition to State resources, to reform and improve their systems for personnel preparation and professional development. We will notify grantees of the performance measures once they are developed.

SPDG/SIG Evaluator Presentations at OSEP Project Directors Conference

2007 - coming soon

2006 - coming soon

2005 - coming soon

California’s SIG Evaluating Training and Technical Assistance (Microsoft PowerPoint) - coming soon
See also the CalSTAT SIG website for further information about the evaluation partnerships, plan and core messages. This site contains information about the Training Evaluation Database (TED) If you have questions about TED or are interested in obtaining a demonstration copy, contact Kelly Bucy

New Hampshire SIG I and II Evaluation (Microsoft PowerPoint) - coming soon
See also the New Hampshire SIG II website offering useful lessons learned (including the significance of evaluation design) in the final performance report for NH SIG 1 (1999-2004). SIG II will apply these lessons in the pursuit of comprehensive literacy development, secondary transition, and personnel preparation.

Pennsylvania State Improvement Grant Evaluation: Macro and Micro Data Collection (Microsoft PowerPoint) - coming soon

Evaluation Reports and Tools

Reports

California: http://www.calstat.org/evaluation.html

Wisconsin: http://wisconsinsig.org/.
To view these reports Scroll down the page to the heading "For additional information, please select the following links." You'll see five colored crayons. Click on the crayon titled, "Evaluation and Accountability Reports".

Tools

California
Below are evaluation instruments developed by the CA SIG for use with our (ERIA) program (September 2007). The California evaluation team adapted the PBIS TIC/SET approach that sites are already familiar with, but the content of the questions is quite different. They also developed a much more extensive Site Action Plan instrument with questions that guide sites in the development and implementation of ERIA. Finally, they put together a ‘stages of development diagram’ that helps sites focus on what needs to happen at each phase.

ERIA Site Team Implementation Checklist (TIC) (Sep. 2007)

ERIA Site Action Plan (SAP) and Updates (Sep. 2007)

ERIA Schoolwide Evaluation Tool (SET) (Sep. 2007)

Vermont
RtI Fidelity of Implementation Checklist in DRAFT (Sep. 2007)

Illinois
Following up on "sharing our tools" topic, the tools that we are developing in Illinois are available at: http://www.luc.edu/cseit/aspireprogramcoordinator.shtml

Related Resources

• A guide for education personnel: Evaluating a program or intervention. (.pdf) Washington, DC: American Institutes for Research (by Paulsen , C.A. & Dailey, D. (September 2002).
  
  
• Educational  Evaluation Standards  from the American Education Association links to both Education Program and Personnel Evaluation standards.
  
  
  Topic Specific Evaluation Samples

• Elearning Program Evaluation  from State Educational Technology Directors Association. This resource includes the  "eLearning evaluation Lens" a method for considering critical issues and questions that frame successful eLearning program evaluations including components such as categories, goals, indicators, measures, lessons learned, models, and state eLearning initiatives.
• The Distance Education Clearinghouse (University of Wisconsin) An excellent collection of links to information about the evaluation and assessment of online learning.