Quality of Evaluation. Panelists will consider the expected quality of the evaluation that would be conducted with respect to the agreement. The panelists will assess the project’s evaluation design; the metrics that will be collected and analyzed in the evaluation to determine whether the outcomes have been achieved as a result of the intervention and how the metrics will be measured; and the applicant’s explanation of how the metrics used in the evaluation are independent, objective indicators of impact and are not subject to manipulation by the service provider (the organization delivering the services described in the project narrative portion of the proposal), intermediary, or funding partners, if any. Additionally, the panel will assess the independence of the evaluator from the other entities involved in the project and the evaluator’s experience in conducting rigorous evaluations of program effectiveness, including, where available, well-implemented evaluations on the intervention or similar interventions. Randomized control trials (RCTs) and designs with the ability to detect unambiguous causal impacts will receive a higher score, but strong evaluation designs will not outweigh poorly designed interventions. The panelists will assess whether the applicant’s plans to collaborate with the evaluator are clear and well-developed and demonstrate an ability to effectively and consistently support a rigorous evaluation. Additionally, the evaluation plan must demonstrate a clear legal and logistical ability and willingness to provide all required project data, including through any necessary data sharing agreements.
Quality of Evaluation. SSA will consider the expected quality of the evaluation that would be conducted with respect to the agreement. The panels will assess the project’s evaluation design; the metrics that will be collected and analyzed in the evaluation to determine whether the outcomes have been achieved as a result of the intervention and how the metrics will be measured; and the applicant’s explanation of how the metrics used in the evaluation are independent, objective indicators of impact and are not subject to manipulation by the service provider (the organization delivering the services described in the project narrative portion of the proposal), intermediary, or funding partners, if any. Additionally, the panel will assess the independence of the evaluator from the other entities involved in the project and the evaluator’s experience in conducting rigorous evaluations of program effectiveness, including, where available, well-implemented evaluations on the intervention or similar interventions. Randomized control trials (RCTs) and designs with 7 xxxxx://xxxxx.xxx.xxx/about the ability to detect unambiguous causal impacts will receive a higher score, but strong evaluation designs will not outweigh poorly designed interventions. The panelists will assess whether the applicant’s plans to collaborate with the evaluator are clear and well-developed, and demonstrate an ability to effectively and consistently support a rigorous evaluation. Additionally, the evaluation plan should demonstrate a clear legal and logistical ability and willingness to provide all required project data, including through any necessary data sharing agreements.
