Terms of Reference for Evaluation Consultant / Evaluation Team

 

Terms of Reference for Evaluation Consultant/Evaluation Team

for Final Evaluation of the project funded by the European Union entitled:

Strengthening film as a means of promoting diversity and democratisation in Myanmar

Yangon Film School (YFS) is seeking to hire an Evaluation Consultant/Evaluation Team to carry out a final external evaluation for the project

“Yangon Film School – strengthening film as a means of promoting diversity and democratization”. For this consultancy, YFS seeks to procure the services of an independent, external Evaluation Consultant or Evaluation Team to design, plan and conduct a final evaluation. The objective is to generate results that demonstrate the project’s successes against set objectives, and highlights the project’s contribution in encouraging cultural expressions which promote diversity, intercultural dialogue and human and cultural rights in the context of reconciliation, conflict resolution and democratisation, as well as describing best practices and lessons learned for the future.

 

Position Title:    Evaluation Consultant / Evaluation Team

Location:            Yangon, Myanmar

Duration:             April – May 2017

Reports to:          Yangon Film School Country Director

Payment:             3,500 EUR including travel, per diems and accommodation

About Yangon Film School (YFS)
The YFS’s core activity is to strengthen film as a means of promoting diversity, peace and democratization in Myanmar. YFS aims to support civil society and enhance inter-cultural dialogue between conflicting national ethnicities by training a young, skilled multi -ethnic workforce capable of using film innovatively as a development tool whilst expanding the space for freedom of expression. Working at the powerful interface between culture and development, Yangon Film School is spearheading the creation of a free and diverse film and media culture in Myanmar.

In 11 years YFS has provided solid training in documentary filmmaking to 187 students from 11+ ethnicities (40% non-Bamar) and 3 religions. YFS has produced 180+ short films and documentaries filmed in 8 states by multi -ethnic crews. These works document both the challenges and the richness of life in this diverse country undergoing an unprecedented transition. Almost 70% + of YFS alumni are working in media, or using media in the development sector and/or to promote social cohesion. In the past decade YFS titles have screened at 233 festivals in Myanmar and abroad, winning 38 awards.

 

1. Introduction

Title of action:
Yangon Film School – strengthening film as a means of promoting diversity and democratisation.

Location:                   Myanmar, including all ethnically distinct regions/union states
Total duration:          41 months
Project period:          01.01.2014 – 31.05.2017
EU contribution:       1.000.000 EUR

 

Project objectives
Overall project objective: Encouragement of cultural expression in emergent democracy but conflicted, multi-ethnic Myanmar by training filmmakers to create films promoting diversity, inter-ethnic/-cultural dialogue and fundamental rights.

Specific objective: To consolidate the school as a recognised ‘centre of excellence’ and diversity
in filmmaking, expand its synergetic potential as part of a strong local and international network, and establish sufficient capacity to hand over YFS to local partners as a sustainable and fully operational media resource.

The project intends to achieve the following results at the end of the 41-month period:

Result 1: Inclusive, pluralistic educational opportunities in the media sector

Result 2: Local ownership and management of Myanmar’s only film school

Result 3: Increase means of expression and provide tools for filmmakers

Result 4: Diverse slate of independent films, also about underrepresented groups

Result 5: Cooperation between cultural actors, media, education professionals and civil society active in promoting human rights

Result 6: Promote equality, empower women in the media and promote women in managerial positions.

2. Task description
The main tasks for the Evaluation Consultant / Evaluation Team are drafted below. The suggested structure of the report is attached as an annex (Annex 1: Structure of reports and documents).

2.1 Key responsibilities
Review the documents relevant to conduct the evaluation (organisational background documents, project documents, ROM, etc.)

  • Further define the pre-prepared draft research questions with Yangon Film School
  • Design the evaluation methodology and data collection tools, and agree the methodology with
    Yangon Film School.
  • Evaluate the project as per the project objectives and verifiable indicators with stakeholders in Yangon, as well as Shan, Kachin, Rakhine and Chin States, with logistics support provided by Yangon Film School.
  • Submit a draft report to Yangon Film School, and collect and incorporate feedback into a final report.

2.2 Criteria for the assessment of the project
For the final evaluation of the project, the OECD/DAC criteria of relevance, effectiveness, efficiency, impact and sustainability apply. The evaluation should also cover criteria on coherence and complementarity (EU added value), as described below:

Mutual reinforcement (coherence)

The extent to which activities undertaken allow the European Union to achieve its development policy objectives without internal contradiction or without contradiction with other EU policies. Extent to which they complement country’s policies and other donors’ interventions.

• likeliness that results and impacts will mutually reinforce one another
• likeliness that results and impacts will duplicate or conflict with one another

Extent to which the project (its objectives, targeted beneficiaries, timing, etc .):

• is likely to contribute to / contradict other EU policies
• is in line with evolving strategies of the EU and its partners

EU value added

Extent to which the project (its objectives, targeted beneficiaries, timing, results, etc .)

  is complementary and coordinated to the intervention of EU Member States in the region/country/area
  is creating actual synergy (or duplication) with the intervention of EU Member States and involves concerted efforts by EU Member States and the EU to optimise synergies and avoid duplication

Further explanations of the content and guiding questions are attached as Annex 2.

2.3 Evaluation design and methodology
The Evaluation Consultant / Evaluation Team will design an adequate process and methodological approach for the evaluation, to be submitted with the proposal. In general, participatory methods that include the project’s target group, a mix of quantitative and qualitative methods, and a gender sensitive approach are recommended. A critical assessment and discussion of the project’s strengths and challenges is welcome.

2.4 Deliverables

• Evaluation methodology document / inception report (see Annex 1: Structure of reports and documents)
• Evaluation data collection tools
• Set of the raw data collected in hard format and entry data in electronic format
• Draft report
• Final report

 

3. Qualifications/experience

Essential

  • 5-7 years of experience in related field.
  • Qualification/training in evaluation and data collection tool design.
  • Experience in conducting project evaluation with participatory approaches.
  • Familiarity and sensitivity with socio-political environment of Myanmar.
  • Fluency in English language, written and spoken.
  • Knowledge and application of conflict sensitivity in everyday work.
  • Willingness to travel to remote states and interact with diverse groups of people.
  • Experience working in media/film industry and conflict transformation.

Preferred

  • Experience in conducting EU evaluations.
  • Experience in Myanmar and/or ability to speak Myanmar.

 

4. Evaluation schedule
The Evaluation Consultant / Evaluation Team is required in-country for an initial 10 days to conduct the evaluation and draft the report. After this time, the Evaluation Consultant / Evaluation Team can return to any preferred location whilst Yangon Film School takes 6 days to review and give feedback on the draft report by email. The Evaluation Consultant / Evaluation Team must have internet access at this point and will then take another 5 days to incorporate this feedback into the final report and forward the report back to Yangon Film School.

The evaluation schedule is such:
Total 21 days in April and May 2017 (negotiable)

Evaluation Schedule

 

5. Payment Schedule

1. Submission of tools/inception report – 50%

2. Submission of final paper – 50%

 

6. Application Procedure
Interested persons/teams should send current CV/CVs including reference contact details and a cover letter referring to all of the essential and preferred qualifications stated above, on or before 28 March 2017 to the following email address: applications@yangonfilmschool.org quoting the reference: ‘YFS Evaluation’
Late applicants will not be considered.

 

This position will be open until an appropriate candidate/team is identified.
Please note: Only shortlisted candidates will be contacted for interview. The interviews will be held either in person in Yangon, Myanmar, or otherwise by Skype.

 

Annexes

• Annex 1: Structure of reports and documents
• Annex 2: Information about DAC Criteria

Annex 1: Structure of reports and documents

1) Minutes of the kick-off meeting (1-2 pages)
The minutes of the kick off meeting provide initial feedback on how the evaluation will address the
Terms of Reference (ToR). This document might replace the inception report. It is a short report (1-2
pages) or a formless e-mail. It is a “lighter” form of documenting further steps of an evaluation than the
inception report. In the minutes, the decisions, specifications, agreed dates for field visits and reporting
are documented.

2) Debriefing paper (1-2 pages)
For the debriefing, a paper or a PowerPoint presentation (PPT) has to be prepared. In this
paper/presentation it is recommended to provide the most important findings concerning the specific
questions of interest, the evaluation criteria and recommendations.

3) Structure of the evaluation report (15-25 pages maximum plus annex)
Note: The report should be readily understandable to outsiders.

Cover page contains the information found in the following illustrative example:
Evaluation
on behalf of the Yangon Film School
Project Title: Yangon Film School – strengthening film as a means of promoting diversity and
democratisation
Evaluator’s name
Date
Optional: photo of project activity and/or logo of the Yangon Film School or relevant donor.
Standard EU disclaimer.

Content of the report:

Table of contents
List of abbreviations and acronyms
List of tables, illustrations, boxes, etc.
Acknowledgements and disclaimer
0 Executive summaries (3-4 pages, independent self-explanatory document)
1 Introduction
2 Description of project and context
3 Evaluation – process, methods and data quality
4 Findings – description, analysis and assessment
4.1 Relevance
4.2 Effectiveness
4.3 Efficiency
4.4 Impact
4.5 Sustainability
4.6 Coherence
4.7 Complementarity (EU added value)
5. Conclusions
6. Recommendations

Annex

• Terms of reference
• Project planning matrix
• Travel and work schedule
• Sources (resource persons, documents, baselines, surveys, etc.)
• Maps, photos, other
• Optional: Minutes of the final on-site meeting/ debriefing

 

Annex 2: Information about DAC Criteria

Source, 12 June 2015:
http://www.oecd.org/dac/evaluation/daccriteriaforevaluatingdevelopmentassistance.htm

DAC Criteria for Evaluating Development Assistance

When evaluating programmes and projects it is useful to consider the following criteria.

Relevance
The extent to which the aid activity is suited to the priorities and policies of the target group, recipient
and donor. In evaluating the relevance of a programme or a project, it is useful to consider the following
questions:

• To what extent are the objectives of the programme still valid?

• Are the activities and outputs of the programme consistent with the overall goal and the attainment of
its objectives?

• Are the activities and outputs of the programme consistent with the intended impacts and effects?

 

Effectiveness
A measure of the extent to which an aid activity attains its objectives. In evaluating the effectiveness of
a programme or a project, it is useful to consider the following questions:

• To what extent were the objectives achieved / are likely to be achieved?

• What were the major factors influencing the achievement or non-achievement of the objectives?
Efficiency

Efficiency measures the outputs — qualitative and quantitative — in relation to the inputs. It is an
economic term which signifies that the aid uses the least costly resources possible in order to achieve
the desired results. This generally requires comparing alternative approaches to achieving the same
outputs, to see whether the most efficient process has been adopted. When evaluating the efficiency of
a programme or a project, it is useful to consider the following questions:

• Were activities cost-efficient?

• Were objectives achieved on time?

• Was the programme or project implemented in the most efficient way compared to alternatives?

 

Impact
The positive and negative changes produced by a development intervention, directly or indirectly,
intended or unintended. This involves the main impacts and effects resulting from the activity on the
local social, economic, environmental and other development indicators. The examination should be
concerned with both intended and unintended results and must also include the positive and negative
impact of external factors, such as changes in terms of trade and financial conditions. When evaluating
the impact of a programme or a project, it is useful to consider the following questions:

• What has happened as a result of the programme or project?

• What real difference has the activity made to the beneficiaries?

• How many people have been affected?

 

Sustainability
Sustainability is concerned with measuring whether the benefits of an activity are likely to continue after
donor funding has been withdrawn. Projects need to be environmentally as well as financially
sustainable.
When evaluating the sustainability of a programme or a project, it is useful to consider the following
questions:

• To what extent did the benefits of a programme or project continue after donor funding ceased?

• What were the major factors which influenced the achievement or non-achievement of sustainability
of the programme or project?





Visit Us On Facebook