Indicators, Monitoring and Evaluation in ESIF Programme and Project Management

AddThis Social Bookmark Button
Interactive Workshop

26-27 April 2018 | Rome

Fully booked! This workshop will be offered again on 13-14 September 2018 in Copenhagen. For further information please contact Anya Zuschke.

Programme


Download Programme

Day 1: Thursday, 26 April 2018

08:30

Registration & Welcome Coffee

09:00 Welcome note by Lexxion and Chair, Introduction Round


 Session I: Monitoring and Evaluation (M&E) Framework in the
Programming Period 2014-2020


09:30

Monitoring and Evaluation (M&E) Framework in the Programming Period 2014-2020

  • Legal framework of M&E system in 2014-2020 and particular changes for member states in comparison to 2007-2013
  • Role and significance of M&E for Operational Programmes
  • Stakeholders involved and share of obligations
  • Relevant terminology: input, activities, outputs, results, impact
  • Performance framework verification: expectations and consequences of Mid-term evaluation

Lars Wirbatz, Team Leader (Financial Instruments, Financial Control), Senate of Berlin - ERDF Managing Authority, Berlin

10:15

Coffee Break

 
Session II: Indicators

10:45

Indicators - a Tool to Strengthen the Result Orientation

  • The role and selection of indicators: Successful measurement of results and its limits
  • Which indicators exist and how to use them?
  • Selection and implementation of result indicators
  • Use of indicators for different levels of implementation: OPs to priority axes/single projects
  • Measurement and verification of indicators
Bernd Schuh, Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

12:15

Lunch Break

13:15

Practical Group Exercise:
Practical group exercise on how to select and define indicators for a specific project/programme and which thresholds have to be met. Participants will work in groups. Each group will get a project or a programme axis and will define indicators for future evaluations. 

 

Bernd Schuh, Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna


Session III: Monitoring

14:00

Monitoring in Practice

  • Monitoring requirements and obligations
  • Monitoring systems and IT systems
  • Collection, processing and assessment of data (which data)
  • Data collection tools
  • Monitoring through life cycle of the project
  • Measurement and verification of indicators

Lars Wirbatz, Team Leader (Financial Instruments, Financial Control), Senate of Berlin - ERDF Managing Authority, Berlin

15:30

Coffee Break

16:00

Best Practice:
Practical example on monitoring process through the life cycle of a specific project. Speaker will introduce a real-life project/programme axis  and discuss with participants monitoring process through the whole life cycle of the project/programme axis: difficulties, obstacles, challenges. 

 

Lars Wirbatz, Team Leader (Financial Instruments, Financial Control), Senate of Berlin - ERDF Managing Authority, Berlin

16:30

End of Day 1


Day 2
: Friday, 27 April 2018

 
Session IV: Evaluation

08:00

 

Evaluation in Practice - Step-by-Step Perspective

  • Which activities can be conducted inhouse and which external
  • Contracting out and cooperation with independent external evaluators: What needs to be considered?
  • Drafting Terms of Reference
  • Use of evaluation results
  • ESIF real-life ToR examples

How to Implement Evaluation Plan?

  • The role of Evaluation Plan
  • Which evaluation method apply for which type of operation?
  • How to cope with difficulties?
  • Examination of amendment of evaluation plan

Stanisław Bienias, President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

9.30

Coffee break

10.00

Methodological Approaches in Evaluation of ESI Funds in 2014-2020 Programing Perspective

Theory based impact evaluation

  • What is "theory" in theory based impact evaluation
  • Foundations of causal inference in theory based impact evaluation
  • Good practice examples

Counterfactual impact evaluation (CIE) – What is it?

  • Random Control Trial as a “golden standard” for analysis of intervention effects
  • Quasi experimental methods as a substitute of Random Control Trial
  • Data requirements – precondition for counterfactual impact evaluation
  • Good practice examples

Processe evaluation of ESIF implementation

  • How process evaluation helps you to increase programme efficiency
  • What aspects of implementation process are worth to be evaluated
  • Good practice examples

Bernd Schuh, Member of the Board of Directors, Austrian Institute for Regional Studies and Spatial Planning (ÖIR), Vienna

Stanisław Bienias, President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

11.30

Workshop:
Writing Terms of Reference and Procurement of Evaluation Services in ESIF

  • Use your new knowledge of methods and write your own Terms of Reference for ESIF evaluation
  • Tips and tricks in procurement of evaluation services
 

Stanisław Bienias, President of IDEA Institute Ltd. and former Head of the National Evaluation Unit of the Polish Ministry of Regional Development, Warsaw

12.30

Lunch


Session V: Auditor´s Perspective to Monitoring and
Evaluation

13.30

Audit of Performance Data – New Responsibility of Audit Authorities

  • System audits on performance data reliability
  • Audits of operations with regard to indicators 
  • Verification of management declaration
  • Audit opinion: formation and considering fulfilment of indicators 
  • Results of the first audits of performance data

Olga Guza, Senior Expert of EU Funds Audit Department, Ministry of Finance of the Republic of Latvia, Riga 

14:15

Performance Audit - Perspective from the European Court of Auditors (including coffee break)

Performance Audit

  • Different types of audit: Financial, compliance and performance audits
  • Performance audit concepts
  • Performance audit approaches and methodologies; similarities and differences versus evaluation
  • Typical findings from Performance audits in ESIF
 

Best Practice:
Performance auditing in practice – a 'real life' performance audit

  • Results from an audit in the energy policy sector
  Kurt Bungartz, Principal Auditor, European Court of Auditors, Luxembourg

16:00
End of the Workshop and Distribution of Certificates

 *Programme may be subject to change.

 

Methodological approaches in evaluation of ESI Funds in 2014-2020 programing perspective


Theory based impact evaluation

-        What is "theory" in theory based impact evaluation

-        Foundations of causal inference in theory based impact evaluation

-        Good practice examples

Counterfactual impact evaluation (CIE) – What Is It?

-        Random Control Trial as a “golden standard” for analysis of intervention effects

-        Quasi experimental methods as a substitute of Random Control Trial

-        Data requirements – precondition for counterfactual impact evaluation

-        Good practice examples

Process Evaluation of ESIF Implementation

-        How process evaluation helps you to increase programme efficiency

-        What aspects of implementation process are worth to be evaluated

-        Good practice examples

 
 

EStIF
European Structural and Investment Funds Journal
Publication frequency: quarterly
approx. 80 pages
ISSN 21 96-82 68

Further information
Banner EStIF-Forum

EStAL
Journal
Publication frequency: quarterly
Subscription: € 442,-
ISSN 16 19-52 72

Further information

Banner SC FI

This website uses Google Analytics for internal evaluation purposes. To prevent Google’s collection and use of data: click this link. An opt-out-cookie will be implemented. Please find more information in our data privacy information