Impact Evaluation. The M&E Plan will include a description of the methods to be used for impact evaluations and plans for integrating the evaluation method into Project design. Based on in-country consultation with stakeholders, the strategies outlined below were jointly determined as having the strongest potential for rigorous impact evaluation. The M&E Plan will further outline in detail these methodologies. Final impact evaluation strategies are to be included in the M&E Plan. The following is a summary of the potential impact evaluation methodologies:
Impact Evaluation. The WinStrong Savings program is part of an ongoing effort by MnCUN and Commonwealth, formerly D2D Fund, Inc. (Commonwealth) to assess the impact of prize-linked savings programs on consumers. Non-personally identifiable information provided to TruLync by the credit unions about account holders under the WinStrong program will be shared with Commonwealth for research purposes Commonwealth will be permitted to compile and analyze the data, and to share the data and analysis in furtherance of its charitable purposes. In the event that the data includes any personally identifiable information, Commonwealth will not disclose that personally identifiable information to any third party; provided, however, that, if an individual program participant has authorized disclosure of such information in writing to one or more third parties, Commonwealth may disclose such information in accordance with such participant’s written authorization.
Impact Evaluation. The WINcentive Savings program is part of an ongoing effort by MnCUN and Commonwealth, formerly D2D Fund, Inc. (D2D) to assess the impact of prize-linked savings programs on consumers. Non-personally identifiable information provided to Trulync by the credit unions about account holders under the WINcentive program will be shared with D2D for research purposes D2D will be permitted to compile and analyze the data, and to share the data and analysis in furtherance of its charitable purposes. In the event that the data includes any personally identifiable information, D2D will not disclose that personally identifiable information to any third party; provided, however, that, if an individual program participant has authorized disclosure of such information in writing to one or more third parties, D2D may disclose such information in accordance with such participant's written authorization.
Impact Evaluation. The WINcentive Savings program is part of an ongoing effort by MnCUN and Commonwealth (formerly D2D Fund, Inc., “D2D”) to assess the impact of prize-linked savings programs on consumers in Minnesota. Non-personally identifiable information provided to TruLync by the credit unions about account holders under the WINcentive program will be shared with D2D for research purposes D2D will be permitted to compile and analyze the data, and to share the data and analysis in furtherance of its charitable purposes. In the event that the data includes any personally identifiable information, D2D will not disclose that personally identifiable information to any third party; provided, however, that, if an individual program participant has authorized disclosure of such information in writing to one or more third parties, D2D may disclose such information in accordance with such participant’s written authorization.
Impact Evaluation. The granting authority may carry out impact evaluations of the action, measured against the objectives and indicators of the EU programme funding the grant. Such evaluations may be started during implementation of the action and until the time-limit set out in the Data Sheet (see Point 6). They will be formally notified to the coordinator or beneficiaries and will be considered to start on the date of the notification. If needed, the granting authority may be assisted by independent outside experts. The coordinator or beneficiaries must provide any information relevant to evaluate the impact of the action, including information in electronic format.
Impact Evaluation. 5.1. It is expected that applicants will work collaboratively with the DCHM programme and other providers to share lessons and capture learning in a structured way. This would include (but not limited to) scheme development with suppliers, being open and transparent about risks and opportunities, supporting proactive communications and celebrating achievements. Information shared will be strictly controlled and only used for the betterment of DCHM programmes or other NHSX schemes or other appropriate NHS bodies that would benefit from such learning or where it could support working at scale.
Impact Evaluation. 6.1. AMIDEAST will continue the use of a quasi-experimental design that includes “control” or comparison schools. Results of evaluation research conducted with Cohort I offered mixed evidence that using control schools enhanced the reliability and validity of data collection. However, after weighing the pros and cons of this approach with experts in the field of evaluation research, the consensus of opinion was that the continued the use of a sample of comparison schools for Cohort II schools is worthwhile for the sake of a robust design intended to determine LTD’s impact on trends in student outcomes over time.
Impact Evaluation. The Lucky Lagniappe Savings program is part of an ongoing effort by Louisiana Credit Union League (“LCUL”) and Commonwealth (formerly D2D Fund, Inc., “D2D”) to assess the impact of prize-linked savings programs on consumers in Louisiana. Non-personally identifiable information provided to TruLync by the Credit Union about account holders under the Lucky Lagniappe program will be shared with D2D for research purposes D2D will be permitted to compile and analyze the data, and to share the data and analysis in furtherance of its charitable purposes. In the event that the data includes any personally identifiable information, D2D will not disclose that personally identifiable information to any third party; provided, however, that, if an individual program participant has authorized disclosure of such information in writing to one or more third parties, D2D may disclose such information in accordance with such participant’s written authorization.
Impact Evaluation. The MCC will engage an independent evaluator to conduct an impact evaluation of specific Project Activities that lend themselves to rigorous evaluation (“Impact Evaluation”). The Impact Evaluation will be designed using rigorous methods to address selection bias and attribution issues. It will also take into consideration the anticipated time lag for each Project to realize expected benefits. It is anticipated that the Impact Evaluation may extend beyond the Compact Term and flexibility of design should be a priority. The following table outlines the methodologies currently under consideration, which may be modified to accommodate changes in Program design. In all cases, the most rigorous method possible will be implemented. Project/Activity Proposed Methodology Comparison Group(s) Variables of Interest Pemba Rural Road Upgrading Difference-in-difference using Propensity Score Matching Households located in communities affected by NORAD road upgrades compared to households located in MCC- affected communities Transport prices Input and output prices for agricultural goods Capital investment and employment figures Households living in communities without anticipated road upgrades during the Compact period compared to households located in MCC-affected communities Migration patterns Household health and income School enrollment (especially for girls) Mainland Trunk Road Upgrading Difference-in-difference using Propensity Score Matching, or simple difference-in-difference Individuals living along recently upgraded trunk roads compared to those living along MCC-upgraded roads Transport prices Input and output prices for agricultural goods Capital investment and employment figures Individuals living at least 2 kilometers from any trunk road compared to those living along MCC-upgraded roads Migration patterns Household health and income HIV/AIDS rates Expansion of Energy Distribution Networks (Malagarasi Hydro and T&D Activities) Regression discontinuity Communities who receive electricity early compared to those who receive electricity late in the Compact Improvements in health Households who live at the end of the distribution line compared to those who live just beyond the end of the distribution line Child schooling attainment (or at least intensity of study) Small-scale businesses using electricity
Impact Evaluation. The Contractor is required to evaluate the impact of NCS on young people (against a matched control group), both in the immediate and longer-term, across the following outcomes:
