Common use of Data Collection and Performance Measurement Clause in Contracts

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA). You must document your ability to collect and report the required data in “Section D: Evaluation Plan” of your application. Grantees will be required to report performance on the following performance measures: mental illness symptomatology; employment/education; crime and criminal justice; stability in housing; access, i.e., number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of care. This information will be gathered using the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]. Data will be collected at baseline, at 3- or 6- month follow-up depending on specific program requirements, and at discharge. Data are to be entered into TRAC (Transformation Accountability) Web system within seven days of data collection. TA related to data collection and reporting will be offered. The collection of these data will enable CMHS to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas relating to mental health. Performance data will be reported to the public, the Office of Management and Budget (OMB) and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You must document your ability to collect and report the required data in “Section DE: Evaluation Plan” Data Collection and Performance Measurement of your application. Grantees will be required to report performance on the following performance measures: mental illness symptomatology; employmentabstinence from use, housing status, employment status, criminal/education; crime juvenile justice system involvement, access to services, retention in services, and criminal justice; stability social connectedness, and units of analysis, including measures of disparities in housing; access, i.e.service use, number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of careoutcomes across subpopulations. This information will be gathered using a uniform data collection tool provided by XXXXXX. Grantees will be required to submit data via SAMHSA’s data-entry and reporting system; access will be provided upon award. An example of the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which type of data collection tool required can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1xxxx://xxx.xxxxxx.xxx/grants/gpra- measurement-877tools/csat-SAMHSA7 [TDD: 0gpra/csat-000gpra-000discretionary-0000]services. Data will be collected via a face-to-face interview using this tool at baselinethree data collection points: intake to services, at 3- or 6- month followsix months post-up depending on specific program requirementsintake, and at discharge. Data Grantees will be expected to do a GPRA interview on all clients in their specified unduplicated target number and are also expected to achieve a six-month follow-up rate of 80 percent. All data must be entered into TRAC (Transformation Accountability) Web system submitted through the specified online data submission tool within seven days of data collectioncollection or as specified after award. TA related to data collection and reporting Grantees will be offeredprovided extensive training on the system and its requirements post-award. The collection of these data will enable CMHS SAMHSA to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas outcome measures relating to mental healththe grant program. In addition to these outcomes, data collected by grantees will be used to demonstrate how SAMHSA’s grant programs are reducing disparities in access, service use, and outcomes nationwide. In addition to these measures, grantees will be expected to collect and report the following data: when the state conducts training events, they must also collect data on overall satisfaction with event quality and application of event information. Also, grantees will be expected to collect and report on the Office of Management and Budget (OMB)-approved state infrastructure measures. These measures can be found in Appendix VI. Grantees will be expected to report biannually on their progress and performance on achieving the goals and objectives of the grant project. Performance data will be reported to the public, the Office of Management and Budget (OMB) , and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain client-level data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You must document your ability to collect and report the required data in “Section DE: Evaluation Plan” Data Collection and Performance Measurement of your application. Grantees In addition to demographic data (gender, age, race, and ethnicity) on all clients served, grantees will be required to report performance on the following performance measures: mental illness symptomatology; employmentabstinence from use, housing status, employment status, criminal/education; crime juvenile justice system involvement, access to services, retention in services, and criminal justice; stability in housing; access, i.e., number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of care. This information will be gathered using a uniform data collection tool provided by XXXXXX. The current tool is being updated and will be provided upon award. An example of the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which type of data collection tool required can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]xxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx. Data will be collected via a face-to-face interview using this tool at baselinethree data collection points: intake to services, at 3- or 6- month follow-up depending on specific program requirementssix months post intake, and at discharge. Grantees will be expected to do a GPRA interview on all clients in their specified unduplicated target number and are also expected to achieve a six-month follow-up rate of 80 percent. Once data are collected, grantees are required to utilize the Common Data are to Platform (CDP), SAMHSA’s web-based data collection and reporting tool. All data must be entered into TRAC (Transformation Accountability) Web system submitted through the CDP within seven days of data collection. TA related When the state conducts training events, they must also collect data on overall satisfaction with event quality and application of event information (see Section 2.1). In addition to data collection and reporting these client measures, grantees will be offeredexpected to collect and report on the Office of Management and Budget (OMB) approved state infrastructure measures. These measures can be found in Appendix VI. Grantees and sub-awardees will be provided extensive training on the CDP system and its requirements post award. The collection of these data will enable CMHS SAMHSA to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas outcome measures relating to mental healthsubstance use. In addition to these outcomes, data collected by grantees will be used to demonstrate how SAMHSA’s grant programs are reducing disparities in access, service use and outcomes nationwide. Performance data will be reported to the public, the Office of Management and Budget (OMB) OMB and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You must document your ability to collect and report the required data in “Section D: Evaluation Plan” Data Collection and Performance Measurement of your application. Grantees In addition to demographic data (gender, age, race, and ethnicity) on all clients served, grantees will be required to report performance on the following GPRA performance measures: mental illness symptomatology; employment/education; crime abstinence from use, housing status, employment status, criminal justice system involvement, access to services, retention in services, and criminal justice; stability in housing; access, i.e., number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of care. This information will be gathered using a uniform data collection tool provided by XXXXXX. The current tool is being updated and will be provided upon award. An example of the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which type of data collection tool required can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]xxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx. Data will be collected via a face-to-face interview using this tool at baselinethree data collection points: intake to services, at 3- or 6- month follow-up depending on specific program requirementssix months post intake, and at discharge. Grantees will be expected to do a GPRA interview on all clients in their specified unduplicated target number and are also expected to achieve a six-month follow-up rate of 80 percent. Once data are collected, grantees are required to utilize the Common Data are to Platform (CDP), SAMHSA’s web-based data collection and reporting tool. All data must be entered into TRAC (Transformation Accountability) Web system submitted through the CDP within seven days of data collection. TA related to data collection Grantees and reporting sub-awardees will be offeredprovided extensive training on the system and its requirements post award. Data will be collected at baseline (i.e., the client’s entry into the project), discharge, and 6-months post-baseline. The collection of these data will enable CSAT and CMHS to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas outcome measures relating to substance use and mental health. In addition to these outcomes, data collected by grantees will be used to demonstrate how SAMHSA’s grant programs are reducing disparities in access, service use and outcomes nationwide. If you have an EHR system to collect and manage most or all client-level clinical information, you should use the EHR to automate GPRA reporting. Grantees are encouraged to explore using HIT to improve data collection, including integrating EHR systems with Homeless Management Information Systems and/or GPRA reporting systems to minimize provider re-entry of data. In addition to these measures, grantees will be expected to report biannually on their progress and performance on achieving the goals and objectives of the grant project resulting from the three primary grant activities (see Section 1.1 Purpose). Performance data will be reported to the public, the Office of Management and Budget (OMB) and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. ‌ All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You must document your ability to collect and report the required data in “Section D: Evaluation Plan” Data Collection and Performance Measurement of your application. Grantees will be required to report performance on the following performance measures: mental illness symptomatology; employment/education; crime and criminal justice; stability disparities in housing; access, i.e.service use, number of persons served by ageand outcomes among racial and ethnic minority populations, gender, race including but not limited to LGBT and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of caretraining recipients. This information will be gathered using CSAT Baseline and Follow-up Meeting Satisfaction Surveys, CSAT Baseline and Follow-up Training Surveys, and CSAT Baseline and Follow-up Technical Assistance Satisfaction Surveys. Grantees will be required to submit data via SAMHSA’s data-entry and reporting system; access will be provided upon award. An example of the CMHS NOMs Adult Consumer Outcome Measures type of data collection tool required can be found at xxxx://xxx.xxxxxx.xxx/grants/CSAT-GPRA/bestpractices.aspx. The data must be collected at the end of each event and 30 days post-event (e.g., trainings, technical assistance, distance learning activities, Xx. Xxxxxx X. Mitchell Behavioral Health Policy Academies). The data must be entered within 7 business days of the data being collected. Grantees are also expected to achieve a follow-up rate of 80 percent on the CSAT Follow-up Meeting Satisfaction Surveys, CSAT Follow-up Training Surveys, and the CSAT Follow-up Technical Assistance Surveys that are collected 30 days post event. Training and technical assistance on data collection and data entry will be provided. Data must be reported in bi-monthly teleconference meetings and quarterly written reports. The grantee will also be required to collect the following infrastructure development and mental health promotion/mental illness prevention measures: • The number of organizations or communities implementing mental health-related training programs as a result of the grant. • The number of people in the mental health and related workforce trained in mental health-related practices/activities that are consistent with the goals of the grant. • The number of individuals exposed to mental health awareness messages. • The number of individuals who have received training in prevention or mental health promotion. • The number and percentage of individuals who have demonstrated improvement in knowledge/attitudes/beliefs related to prevention and/or mental health promotion. • The number of individuals screened for Discretionary Programs mental health or the Child Consumer Outcome Measures for Discretionary Programs (Child related interventions. • The number of individuals referred to mental health or Adolescent Respondent Version or Caregiver Respondent Version)related services. This information will be gathered using SAMHSA’s data-entry and reporting system, which can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxxxxxxx://xxx.xxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]instructions. Data will be collected at baseline, at 3- or 6- month follow-up depending on specific program requirements, quarterly after entry of annual goals. Technical assistance for data entry and at discharge. Data are to be entered into TRAC (Transformation Accountability) Web system within seven days of data collection. TA related to data collection and reporting will be offered. The collection of these data will enable CMHS to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas relating to mental healthgeneration is available. Performance data will be reported to the public, the Office of Management and Budget (OMB) and Congress public as part of XXXXXXSAMHSA’s budget requestCongressional Justification. Evaluation: Section 565(c) No more than 10 percent of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will total grant award a contract to a private entity to develop a cross-site program evaluation that will may be used to comply with the requirements described for data collection and performance measurement, e.g., activities required in Section I-2.4 above. This cross-site evaluation is referred Be sure to include these costs in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals your proposed budget (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminatedsee Appendix B).

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA). You must document your ability to collect and report the required data in “Section D: Evaluation Plan” of your application. Grantees will be required to report performance on the following performance measures: mental illness symptomatology; employment/education; crime and criminal justice; stability in housing; access, i.e., number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of care. This information will be gathered using the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]. Data will be collected at baseline, at 3- or 6- month follow-up depending on specific program requirements, and at discharge. Data are to be entered into TRAC (Transformation Accountability) Web system within seven days of data collection. TA related to data collection and reporting will be offered. The collection of these data will enable CMHS to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas relating to mental health. Performance data will be reported to the public, the Office of Management and Budget (OMB) and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: •  Longitudinal studies of outcomes of services provided through systems of care; •  Other studies regarding service outcomes; •  Studies on the effect of systems of care on the utilization of hospital and other institutional settings; •  Studies on the barriers and achievements that result from interagency collaboration; and •  Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. All SAMHSA grantees are required to collect and report certain client level, services level, and systems level data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You In your application, you must clearly document your agreement and ability to collect and report the required data for GPRA in “Section DE: Evaluation Plan” Data Collection and Performance Measurement of your application. Data that are required to be collected include, but are not limited to, demographic data (gender, age, race, and ethnicity) on all clients served; measures of disparities in access, service use, and outcomes across subpopulations; client abstinence from use, housing status, employment status, criminal justice system involvement, access to services, retention in services, and social connectedness. Client data will be collected via face-to-face interviews at baseline (i.e., the client’s entry into the project), six months post intake while receiving services, and upon discharge. Grantees will be required expected to report performance do a GPRA interview on the following performance measures: mental illness symptomatology; employment/education; crime all clients in their specified unduplicated target number and criminal justice; stability in housing; access, i.e., number of persons served by age, gender, race and ethnicity; are also expected to achieve a follow-up rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of care80 percent at each data point. This information will be gathered using the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing ita uniform data collection tool provided by XXXXXX. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1-877-SAMHSA7 [TDD: 0-000-000-0000]. Data Grantees will be collected required to submit data via SAMHSA’s data-entry and reporting system; access will be provided upon award. The collection tool is available at baseline, at 3- or 6- month followxxxx://xxx.xxxxxx.xxx/grants/gpra- measurement-up depending on specific program requirements, and at dischargetools/csat-gpra/csat-gpra-best-practices. Data are to All data must be entered into TRAC (Transformation Accountability) Web SAMHSA’s data entry and reporting system within seven days of data collection. TA related to data collection Grantees and reporting sub-awardees will be offeredprovided extensive training on the system and its requirements post award. The collection of these data will enable CMHS SAMHSA to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas outcome measures relating to mental healththe grant program. In addition to these outcomes, data collected by grantees will be used to demonstrate how SAMHSA’s grant programs are reducing disparities in access, service use, and outcomes nationwide. In addition to these measures, grantees will be expected to report semi-annually on their progress and performance on achieving the goals and objectives of the grant project resulting from the three primary grant activities (see Section I.1 – Purpose). Performance data will be reported to the public, the Office of Management and Budget (OMB) ), and Congress as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.

Data Collection and Performance Measurement. ‌‌‌ All SAMHSA grantees are required to collect and report certain data so that SAMHSA can meet its obligations under the Government Performance and Results Act (GPRA)) Modernization Act of 2010. You must document your ability to collect and report the required data in “Section DE: Evaluation Plan” Data Collection and Performance Measurement of your application. Grantees will be required to report performance on the following performance measures: mental illness symptomatology; employmentabstinence from use, housing status, employment status, criminal/education; crime juvenile justice system involvement, access to services, retention in services, social connectedness, and criminal justice; stability units of analysis, including measures of disparities in housing; access, i.e.service use, number of persons served by age, gender, race and ethnicity; rate of readmission to psychiatric hospitals; social support/social connectedness; and client perception of careoutcomes across subpopulations. This information will be gathered using a uniform data collection tool provided by XXXXXX. Grantees will be required to submit data via SAMHSA’s data-entry and reporting system; access will be provided upon award. An example of the CMHS NOMs Adult Consumer Outcome Measures for Discretionary Programs or the Child Consumer Outcome Measures for Discretionary Programs (Child or Adolescent Respondent Version or Caregiver Respondent Version), which type of data collection tool required can be found at xxxxx://xxx.xxxxxx-xxxx.xxxxxx.xxx, along with instructions for completing it. Hard copies are available in the application kits available by calling the SAMHSA Information Line at 1at: xxxx://xxx.xxxxxx.xxx/grants/gpra- measurement-877tools/csat-SAMHSA7 [TDD: 0gpra/csat-000gpra-000discretionary-0000]services. Data will be collected via a face-to-face interview using this tool at baselinethree data collection points: intake to services, at 3- or 6- month followsix months post-up depending on specific program requirementsintake, and at discharge. Data Grantees will be expected to do a GPRA interview on all clients in their specified unduplicated target number and are also expected to achieve a six-month follow-up rate of 80 percent. All data must be entered into TRAC (Transformation Accountability) Web system submitted through the specified online data submission tool within seven days of data collectioncollection or as specified after award. TA related to data collection and reporting Grantees will be offeredprovided extensive training on the system and its requirements post-award. The collection of these data will enable CMHS SAMHSA to report on the National Outcome Measures (NOMs), which have been defined by SAMHSA as key priority areas outcome measures relating to mental healththe grant program. In addition to these outcomes, data collected by grantees will be used to demonstrate how SAMHSA’s grant programs are reducing disparities in access, service use, and outcomes nationwide. In addition to these measures, grantees will be expected to collect and report the following data: when the state conducts training events, they must also collect data on overall satisfaction with event quality and application of event information. Also, grantees will be expected to collect and report on the Office of Management and Budget (OMB)-approved state infrastructure measures. These measures can be found in Appendix F. Grantees will be expected to report biannually on their progress and performance on achieving the goals and objectives of the grant project. Performance data will be reported to the public, the Office of Management and Budget (OMB) and Congress public as part of XXXXXX’s budget request. Evaluation: Section 565(c) of the Public Health Service Act requires that evaluations be conducted to assess the effectiveness of systems of care. Specifically, these evaluations must include: • Longitudinal studies of outcomes of services provided through systems of care; • Other studies regarding service outcomes; • Studies on the effect of systems of care on the utilization of hospital and other institutional settings; • Studies on the barriers and achievements that result from interagency collaboration; and • Studies on parental perceptions of the effectiveness of systems of care. The Comprehensive Community Mental Health Services for Children and Their Families Program will award a contract to a private entity to develop a cross-site program evaluation that will be used to comply with the requirements described above. This cross-site evaluation is referred to in this RFA as the National Evaluation. It applies multiple methods for conducting the evaluation and it is designed to maximize the usefulness of the results for developing systems of care among awardees. It also is designed to create long-term capacity among the awardee communities to continue their evaluation, especially after Federal funding ends. Awardees are required to participate in the implementation of the National Evaluation. During the first year of the cooperative agreement, each awardee will receive detailed instructions about the design of the evaluation and the procedures for implementing each component of the evaluation. For example, one component requires implementation of a longitudinal outcome study that includes the enrollment and follow-up of approximately 100 children per service year, with a total representative sample of about 300 to 400 children over the 6-year Federal funding period. At the time of enrollment, a baseline assessment of the child and the child’s family will be administered. Follow-up assessments will occur at periodic intervals (e.g., every 6 months for up to 3 years) while children are receiving services and after these services have terminated.Congressional Justification.‌‌‌