skip to main content

Research Developments from ACER

Higher Education

Image ©

Improving assessment processes and quality in medical specialisations

ACER’s work for a number of specialist colleges in medicine is contributing to higher quality education, as Daniel Edwards explains.

The Australian Council for Educational Research (ACER) has been engaged by a number of specialist colleges in medicine to evaluate the quality of assessment and data collection processes, and of test item development.

In undertaking this work, ACER has found that there is considerable knowledge and effort in some colleges to collate psychometric data about their assessment, but less practice in using this evidence to improve test items, exams and development processes.

Through workshops with colleges and their Fellows, ACER helps to provide that link – illustrating how to make improvements to these areas based on what the data shows.

Many of the colleges ACER works with have long established regimes for running their exams and, while these have served them well up until now, advances in technology for storage and ongoing development of item banks and more streamlined methods for reporting are now widely accessible. With some expert advice assessment in these colleges can be transformed.

ACER’s researchers are well equipped for providing advice and recommending processes in these very high stakes assessments, with prior experience working in medical admissions for universities, the Australian Medical Assessment Collaboration and in a range of school-level tests.

Questions explored by ACER on behalf of the medical colleges include:

  • Are the current assessments assessing what they are intended to assess?
  • Are pass marks realistic and defensible?
  • Are assessments at a standard that is considered best practice?
  • What tools and processes are needed to enable ongoing evaluation and review of assessments?

ACER’s work with the colleges is leading to higher quality assessments, a closer match between examinations and curriculum, and substantial efficiencies in the development of test items and reporting of results.

These projects significantly help the colleges in streamlining processes, produce much higher quality examinations and result in better and fairer outcomes for students. ■


About the author

Dr Daniel Edwards is the Research Director of ACER's Tertiary Education research program. 

More [rd] articles by Daniel Edwards

View selected works of Daniel Edwards

Related articles

Higher Education
University completions and equity | RD

University completions and equity

06 May 2015

University students from disadvantaged groups have a lower completion rate than their more advantaged peers, but most disadvantaged students do complete their degrees, research reveals.

Evaluation, Quality & Standards, Higher Education, Indigenous

Education & Development
Teacher absenteeism in Indonesia | RD

Teacher absenteeism in Indonesia

16 March 2015

A comprehensive new study reveals that teacher absenteeism in Indonesia is declining, and provides evidence for policy makers focused on improving teaching and learning, as Phil McKenzie explains.

Evaluation, Quality & Standards, Survey, School, Education & Development

Assessing learning of students with disabilities | RD

Assessing learning of students with disabilities

13 February 2020

ACER and NEQMAP reviewed existing inclusive education policies and practices in the Asia-Pacific region with a particular focus on learning assessment of children with disabilities.

Assessment, School, Education & Development, Featured school, Australia, India, Indonesia, Malaysia