Managing for Aid Effectiveness: Introduction to key M&E approaches
Overview
What are the tools and systems used for M&E and performance management?
Key Terms and their use
Objectives definition: the specific intended results of the program observable within the life of the Program Outputs definition: the key deliverables or products provided by the Program which will bring about the intended objectives. Each output represents a completed set of activities or tasks. Outcomes definition: the changes, either intended or unintended, that did occur as a result of the program.
Framework and Tools
Country/Regional Strategy
Annual Program Performance Update
Quality Reporting System
Quality at Implementation Report
Initiative/ Activity level
Monitoring and Evaluation Frameworks (or other equivalent tools)
Other stuff (to be aware of)
Financial reporting Contract compliance Sectoral, thematic, policy reporting (sectors) Risk management
Tools and methods Approaches which ask people
Eg: stakeholder surveys; beneficiary impact assessment Eg: Biophysical data recording; organisational capacity assessment tool
Approaches which use an established measure
Approaches which draw upon the experience of others
Eg: Expert panels; commissioned research
Approaches which utilise the existing implementation and management arrangements in the activity
Eg: meetings; Activity Coordination meetings; existing data collection/reporting systems
Further.
Too high level objectives Too complex programs to synthesize easily Lack of appropriate information/evidence So what? from the data provided requires a judgment to be made (by whom)? Bad designs will never achieve stated objectives Diffuse or different relationship between outputs and objectives (for good reasons, not bad design) not your objectives but community's or others have to support Objectives not consistent or no causal relationship to sectoral or country strategy objectives Politically driven design and documentation
The project structure:
Link to CS objective
Objective
Output
Output
Output
Activity
Activity
Activity
Activity
Activity
Activity
Link to CS Objective
Objective
Activities or components of the facility
Activities or components of the facility
Activities or components of the facility
Projects
Approaches to M&E
Information collection and reporting on indicators is the basis for monitoring Internal reporting is largely undertaken by delivery organisation and partner government Look at context and risk to explain the links between objectives and outputs. May use external verification by TAGs/AusAID staff /technical panels Also use own observation and participation etc.
Performance Indicators
Indicators = QQT
Indicators at Output levels should be specific targets.
Examples:
Increased literacy 600 women functionally literate and numerate by Sept 2000. Trained farmers 276 farmers trained in use of hybrid seed and pesticide by October 2001.
M&E framework
M&E framework is a logic model, which provides a streamlined linear interpretation of a projects planned use of resources and its desired ends. Logic models have five essential components: Inputs Process Outputs Outcomes Impact