skip to main content

Research Developments from ACER

Subscribe
International
{rd-image-caption}

Image ©Shutterstock/Riccardo Mayer

Improving student learning in Mali

ACER has been working over the past two years to help develop an internal monitoring and evaluation system in Mali. Petra Lietz explains.

In 2015, ACER through its Centre for Global Education Monitoring was engaged by OMAES, a non-governmental organisation in Mali, to provide support for the development of an internal monitoring and evaluation system.

The system will enable OMAES to evaluate the influence of its communication and advocacy activities, and ascertain whether these activities will contribute to long-term policy change among education stakeholders in Mali.

Bεεkunko: Citizen-led assessment

In partnership with other civil-society organisations, OMAES manages Bεεkunko, a citizen-led assessment program. Bεεkunko is a household-based assessment of children’s learning outcomes in literacy and numeracy for six-to-14-year-old children in Mali, whether they are currently attending school or not.

Through Bεεkunko, OMAES aims to motivate stakeholders at various levels to take action in schools and communities, and become engaged in education policy reform with the ultimate goal of improving student learning. Its main strategy is to improve awareness among stakeholders, particularly parents, about the actual learning outcomes of children in Mali.

Education decision-making responsibilities in Mali have been decentralised over time to various local and regional levels. As a result, local, regional and national stakeholders are increasingly important in education reform and in improving the quality of education.

Developing an evaluation approach

Since Bεεkunko is an ongoing assessment program, OMAES has identified the need to develop an evaluation approach and tools to enable the ongoing collection of data for evaluation purposes, and to inform future communication and advocacy activities.

OMAES and ACER collaboratively determined that a prospective evaluation approach would best suit OMAES’s information needs. Using this approach, OMAES and ACER staff worked together to further refine stakeholder group definitions and develop measurable indicators for specific outcomes, as well as tools for data collection for the evaluation, and suggested sampling approaches. The evaluation framework also included guidelines for data analysis and reporting and data use. In addition, an evaluation schedule was proposed, with team members agreeing that the evaluation and monitoring system should be piloted before being upscaled to a greater number of Bεεkunko assessment regions in Mali.

OMAES has now adapted this evaluation approach for three prioritised stakeholder groups:

  • parents
  • school management committees, and
  • decentralised education committees at the commune level.

OMAES has administered surveys and conducted focus-group interviews to a sample of these key stakeholder groups in one region of Mali to pilot this evaluation approach, and its procedures and tools. OMAES plans to upscale the evaluation activities in 2017, after a review of insights from the pilot which will soon be available, to a nationally representative sample of regions that have participated in Bεεkunko and to other stakeholder groups. ■

Further information:
Read the full report, Measuring the impact of citizen-led assessments for improving the quality of education, by Petra Lietz and Mollie Tobin, ACER (2016).

Learn more about the ACER Centre for Global Education Monitoring.

RD

About the author

Dr Petra Lietz is a Principal Research Fellow in ACER's Australian Surveys research program. 

More [rd] articles by Petra Lietz

View selected works of Petra Lietz

Related articles

Higher Education
University completions and equity | RD

University completions and equity

06 May 2015

University students from disadvantaged groups have a lower completion rate than their more advantaged peers, but most disadvantaged students do complete their degrees, research reveals.

Evaluation, Quality & Standards, Higher Education, Indigenous, Featured higher education

International
Teacher absenteeism in Indonesia | RD

Teacher absenteeism in Indonesia

16 March 2015

A comprehensive new study reveals that teacher absenteeism in Indonesia is declining, and provides evidence for policy makers focused on improving teaching and learning, as Phil McKenzie explains.

Evaluation, Quality & Standards, Survey, School, International, Featured international

Vocational & Adult
What employers really want | RD

What employers really want

18 October 2017

New research investigates whether vocational training focuses on the skills employers value most.

Evaluation, Quality & Standards, Higher Education, Vocational & Adult, Featured vocational & adult