Each Community Impact Project organization is assigned an MFF Grants Program Manager that will oversee and support their evaluation. Each program has a comprehensive evaluation plan that includes SMART Objectives, process and outcome measures with participants, and program tracking for fidelity. The evaluation plan addresses both local program considerations and aligns with statewide measures for behavioral and policy, systems, and environmental (PSE) change outcomes.
MFF Evaluation Team will:
- Provide online and Scantron® versions of surveys along with associated survey protocols, barcoding instructions, and an online educator log
- Streamline the PSE reporting process through the Partner Update Portal that includes planning, implementing, and long-term follow up stages of change
- Coordinate survey scanning services, data analysis, and reporting of evaluation results
MFF Grants Program Managers will oversee and support their Community Impact Project Organizations to:
- Implement a customized evaluation plan, including:
- SMART Objectives
- Customized locally-relevant evaluation as appropriate
- Direct Education (DE) statewide process and outcome evaluation
- Track on-hand quantity of Scantrons® and submit order form as needed
- Collect data in accordance with evaluation plans
- Ensure program fidelity through review of educator logs
- Submit PSE reporting through Partner Update Portal at least quarterly
- If using Scantrons®, submit data for scanning using cover sheets and barcodes
- Incorporate evaluation results into reporting and the cycle of program improvement
Resources
FY24 Statewide DE Evaluation Survey Planning Chart (links to new window)
FY24 Statewide DE Evaluation Survey Guide (links to new window) – Organizations will receive a customized version of this template including online survey links specific to each of their DE intervention(s).
FY24 Direct Education Educator Log (print version) (links to new window) – Educators should fill out an online log after completing all lesson series of this intervention. Click here for the online version.
Survey Protocols – Scantron® and Online – Each survey has a corresponding protocol document that should be followed to ensure data collection is done with fidelity. PDFs of online surveys are also linked to on this page. Educators may find them useful when providing instructions to participants.
Scantron® Preparation and Checklist (links to new window) – This page has everything you need to prepare your Scantrons®, including barcoding instructions.
Evaluation Plan Training (Local Project Leads) (links to new window)
Data Collection Training (Nutrition Educators and others working with surveys) (links to new window)
Fidelity Logs and Resources (links to new window) – This page includes a fidelity FAQ document, six intervention fidelity logs, and other fidelity materials. These materials are intended to support your organization and educators with maintaining and improving fidelity of DE program delivery.