logo

Main Content: Program Measures

NEW Evidence-based Professional Development Components Worksheet (Posted 1/26/16)

Rubric A: SPDG Evidence-based Professional Development Components Rubric (Posted 1/15/15)

2014 Exemplar Continuation Report

Exemplar Annual Performance Report (PDF, 8/24/2015)

Recent Program Measures Guidance (3/27/2014)

Guidance for Measure 1 (PDF)

Guidance for Measure 2 (PDF)

Guidance for Measure 3 (PDF)

Guidance for Measure 4 (PDF)

Rubric B (PDF)

Recent Program Measures Guidance, Event Recording

Recent Program Measures Guidance Presentation (PPT)

SPDG Competition Bidders’ Webinar # 1: New Program Measures (7/2/2012, J. Coffey) The  information presented in this webinar is applicable to all funded FY09-FY12 SPD grantees.

SPDG Program Measure Methodology (DOC, 2/27/2012). This document describes the metholodogy for all four performance measures adopted in 2011.

Program Measure Example Continuation Report (DOC, 1/7/2013). This is an example of what a grantee may provide relative to the new program measures in the qualitative and quantitative sections of the continuation report, also known as the grant annual performance report (APR).

Example Objectives with Program and Project Measures (DOC, 2/14/2012). A SPDG project created this list of their objecctives and program and project measure.

Colorado - Sample 2012 Continuation Report Using 2012 Program Measures (posted 5/31/12)

Program Measure 1: Evidence-based Professional Development.  Projects use evidence-based professional development practices to support the attainment of identified competencies.

2015 Annual Performance Report (APR) and EB-PD Program Measure 1 Rubric (January 2015, two part webinar: First part will be a short guidance Webinar about completing your annual performance report (APR). The second part of the Webinar will be dedicated to the revised Evidence-based professional development rubric for Program Measure1)

Resources

Guidance for Measure 1 (PDF)

NEW Evidence-based Professional Development Components Worksheet (Posted 1/26/16)

NEW Rubric A: SPDG Evidence-based Professional Development Components Rubric (Posted 1/15/15)


Program Measure 2: Improving Implementation. Participants in SPDG professional development demonstrate improvement in implementation of SPDG-supported practices over time.

Performance Measure #2 Webinar Recording (Nov 2011)

Resources

Guidance for Measure 2 (PDF)

Rubric B (PDF)


Program Measure 3: Ongoing Technical Assistance. Projects use SPDG professional development funds to provide follow-up activities designed to sustain the use of SPDG-supported practices. (Efficiency Measure)

SESSION RECORDING: Program Measure 3 & 4 Webinar (Jan. 2012)

Performance Measurement Webinar #3: Measure 3 & 4 (PPT, 12/2011, J. Coffey)

NOTES 12/1 & 1/5 - Program Measure Webinar 3 & 4 (DOC)

Resources

Guidance for Measure 3 (PDF)

ARKANSAS SPDG Drop Down Menu Options for Monthly Activity Report (by Item) (DOC, 7/2012) Target Audience: SPDG Directors, Coordinators, Evaluator and other project staff. 

Ongoing TA List (Word, 2012)

An Overview: SPDG Program Measures & Focus on Measure 3 & 4 (PPT, 12/2011, J. Coffey)  This PPT begins with introductory community slides (1-9) then follows with a overview of the SPDG Program Measures and specific information on Program Measures #3 & #4.

Rubric B (PDF)


Program Measure 4: Teacher Retention. Highly qualified special education teachers that have participated in SPDG supported special education teacher retention activities remain as special education teachers two years after their initial participation in these activities.

SESSION RECORDING: Program Measure 3 & 4 Webinar (Jan. 2012)

Performance Measurement Webinar #3: Measure 3 & 4 (PPT, 12/2011 and 1/2012, J. Coffey)

NOTES 12/1 & 1/5 - Program Measure Webinar 3 & 4 (DOC)

Resources

Guidance for Measure 4 (PDF)

An Overview: SPDG Program Measures & Focus on Measure 3 & 4 (PPT, 12/2011, J. Coffey)  This PPT begins with introductory community slides (1-9) then follows with a overview of the SPDG Program Measures and specific information on Program Measures #3 & #4.

Rubric B (PDF)

Other  Related Resources  - By Measure

Program Measure 1: Evidence-based Professional Development

LINK to Resource Library resources on evidence based professional development: /content_pages/175-evidence-based-professional-development

The School Improvement Coach Web Site, which includes a coaching manual and training modules: http://www.schoolimprovementcoach.org/.

Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M. & Wallace, F. (2005). Implementation Research: A Synthesis of the Literature. Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231).  Download all or part of the monograph for free at: http://www.fpg.unc.edu/~nirn/resources/detail.cfm?resourceID=31

An Evidence-Based Approach to Professional Development PPT (SPDG Directors' Webinar 2/2010) Carol M. Trivette, Ph.D. and Carl J. Dunst, Ph.D., Orelena Hawks Puckett Institute, Asheville and Morganton, North Carolina

Developing Training Capacity for Statewide Implementation of Michigan's Integrated Behavior & Learning Support Initiative (MiBLSi): A Response to Intervention Model for Reading & Behavior Support [DOC]

Trivette, C. M., Dunst, C. J., Hamby, D.W., & O’Herin, C. E. (2009). Characteristics and consequences of adult learning methods and strategies (Winterberry Research Synthesis, Vol. 2, No. 2). Asheville, NC: Winterberry Press.

 Dunst, C. J., & Trivette, C. M. (2009). Let’s Be PALS: An Evidence-Based Approach to Professional Development. Infants & Young Children 22. No. 3, 164–176. [Purchase Here: http://journals.lww.com/iycjournal/toc/2009/07000]

Guskey, T. R. (2000). Evaluating professional development (pp. 79-81). Thousand Oaks, CA: Corwin Press.

Iowa Professional Development Model (IPDM) Here is an example of what one state is doing. It doesn't necessary cover all the elements SPDG projects are capturing, but it's a good example.

 

Noonan, P., Langham, A., & Gaumer Erickson, A. (2013). Observation checklist for high-quality professional development in education. Center for Research on Learning, University of Kansas, Lawrence, Kansas.

Pre-Post Test Guidance Checklist For Multiple-Choice Tests. (Noonan, P. and Gaumer Erickson, A. (2012). The following checklist can be used to assure best practices in developing items for multiple-choice tests used for evaluating changes in teacher knowledge as a result of your professional development session.

Arkansas SPDG Research-Based Professional Development Evaluation Form (PDF, February 2011). 

Program Measure 2: Improving Implementation

Michigan’s Integrated Behavior & Learning Support (MiBLSi) Initiative Rubrics. Michigan's SPDG, MiBLSi uses rubrics to ensure consistency in their professional development system.

Signetwork Resource Library resources on Implementation:

/content_pages/176-implementation-science-scaling-up

ASPIRE implementation tools http://www.luc.edu/cseit/pdfs/Aspire_Documents/Aspire_FidelityToolv4.6_20090805.pdf

BEST PBS Implementation Rubric [XLS, July 2010, CalSTAT] This interactive template is used by school teams to record their implementation level for ten key elements. After entering their data teams can generate reports.

MiBLSi Building Leadership Team Response to Intervention Practice Profile [DOC, April 2011]

Dusenbury, L., Brannigan, R., Falco, M., & Hansen, W.B. (2003). A review of research on ?delity of implementation: Implications for drug abuse prevention in school settings. Health Education Research, 18, 237–256. Link to view article

Dane, A.V., & Schneider, B.H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23– 45. Link to purchase article (not available for free).

O’Donnell,C. L. (2008). Defining,conceptualizing,and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research,78,33–84. Download Article Link

Mowbray, C. T., Holter, M. C., Teague, G. B., & Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Evaluation, 24, 315–340. Link to Journal website

Blase “Innovation Fluency” presentation: /content_pages/154

From the PBIS Center:  the Implementation Blueprint and self-assessment tool  http://www.pbis.org/common/pbisresources/publications/SWPBS_Implementation_Blueprint_v_May_9_2010.pdf

From the PBIS Center: Team Time Implementation Workbook:  http://www.pbis.org/common/cms/documents/Forum10_Presentations/E3_Team%20Time%20Implementation%20Workbook.pdf

From the National Research Center on Learning Disabilities: 

A brief on implementation fidelity:  http://www.nrcld.org/rti_manual/pages/RTIManualSection4.pdf

RTI Essential Components Integrity Rubric (PDF, 2011) The RTI Essential Components Integrity Rubric is for use by individuals who are responsible for monitoring school-level fidelity of RTI implementation. The rubric is aligned with Essential Components of RTI: A Closer Look at Response to Intervention. (Developed by the National Center on Response to Intervention and RMC Research, 2010).  Link to RTI PLC 10/2011 Presentation by NCRTI materials and session recording.

RTI Essential Components Integrity Worksheet (PDF, 2011)  The RTI Essential Components Integrity Rubric and the RTI Essential Components Integrity Worksheet are for use by individuals responsible for monitoring the school-level fidelity of Response to Intervention (RTI) implementation. They may also be used by schools for self-appraisal; however, they were not designed for compliance monitoring and therefore should not be used for this purpose. The rubric and the worksheet are designed to be used together and are aligned with the Essential Components of RTI: A Closer Look at Response to Intervention (National Center on Response to Intervention, 2010). Link to RTI PLC 10/2011 Presentation by NCRTI materials and session recording.


Program Measure 3: Ongoing Technical Assistance

LINK to Resource Library resources on evidence based professional development: /content_pages/175-evidence-based-professional-development

Here is a link to the coach support page for Michigan's Integrated Behavior and Learning Support Project (MiBLSi): http://miblsi.cenmi.org/Coaching.aspx


Program Measure 4: Teacher Retention