Proposed list of indicators – covering main objectives and measures. On the basis of the principles set out above, CSES has developed a new set of indicators for each of the four main measures under Objectives A-D examined in Section 3. We also propose a more generic set of indicators for the most typical small size measures and activities implemented under EIP (studies/reports, campaign activities, training activities/seminars, information provision services and specific policy promotion measures). Given the variety of measures supported, this latter set will need to be adapted depending on the type of activity. In some cases, a combination of more than one of the proposed sets will be necessary. The indicator sets are presented in a consistent format, stating their nature, what type of evaluation question they are expected to address, the necessary data sources and the proposed frequency of reporting. With few exceptions, the indicators proposed have already been used in one or more measures although not all of them have been tested so far. We do not provide target or background values since we do not have the necessary information for most of the activities. It is appropriate, however, to point out one obvious contextual indicator that is relevant in each case, namely the budget devoted to the measure in question. Providing an indication of the budget, for instance, the sum devoted to the measure in the relevant time period allows the relative significance of the resources devoted to the measure to be easily seen. It also provides a basis against which other indicators can be used to assess efficiency. We therefore feel that the budget should be among any contextual indicators that are provided. The question of over-arching indicators has also been raised at various points. Following the discussion of the Interim Report, we also make some suggestions on how appropriate indicators might be developed. Finally, a comment on the reading of indicators is necessary. One of the important concerns raised during the workshop for Commission staff is the interpretation of indicators and especially the possible presumption of a direct cause and effect linkage between measures and outcomes that the indicators could be considered to provide. In many areas such a linkage is indirect – especially when referring to long term impacts - and strong claims are probably unfounded if they are not based on a thorough evaluation exercise which can only take place during a proper evaluation study. The indicator system proposed for the monitoring ...
