Outcome indicators of unis must be defined, measured

While it has been agreed upon that international rankings of universities are imperfect, little has been said on the specific measures or outcome indicators that Singapore universities may adopt and how this information can be communicated to the public (Stepping out of the uni-ranking race; July 19).

Even less has been said on how stakeholders beyond the administration and academics - such as students and their parents - would be consulted.

In other words, if the current rankings are problematic because they privilege broad-based universities with research prowess and are biased towards old legacy universities in the West, then universities that point to the importance of other abstract factors need to not only identify these factors, but also define and specify how they can be measured.

Take for instance the emphasis on teaching and career readiness.

It was argued that faculty-to-student ratios and the number of staff with PhDs do not accurately reflect the quality of the teaching environment; yet, there was no elaboration on how to quantify and qualify indicators such as the learning experience of students, internships, and career preparation.

Tangentially, it is not enough for universities to mention the student feedback or peer reviews they use to evaluate teaching quality.

Data on aggregate and average performance - made available to both the educators and their students - ought to be benchmarked and shared.

Professor Cheong Hee Kiat of the Singapore University of Social Sciences is right to posit that beyond the creation and dissemination of research knowledge, universities also "educate graduates who can contribute to the economy and society". These statistics ought to be tracked over time.

Put otherwise: It is tempting, easy, and convenient to get away with lacklustre instruction, for the system allows for it. And, unless the universities are more specific and open about their measurements, most will revert to the status quo of international rankings.

Because, central to this discourse are incentives, which in turn are shaped by the measures or outcomes specified by the universities.

The quality of teaching, for instance, may be mooted by the administration as an important measure or outcome indicator, though around the world - in the research universities, in particular - research endeavours take precedence for academics, since the criteria for academic tenure are more often than not weighted disproportionately in that direction.

Talk of change or reform is gaining traction.

But, unless changes are implemented or the incentives match the desired output, the discourse will remain in a tired, generic loop.

Kwan Jin Yao

A version of this article appeared in the print edition of The Straits Times on July 25, 2018, with the headline 'Outcome indicators of unis must be defined, measured'. Print Edition | Subscribe