Thursday, October 08, 2009

How Universiti Malaya did it

A standard feature of the annual release of the THE QS rankings is the chorus of derision that greets the fall of a Malaysian university or of congratulation for a rise.

This year Universiti Malaya (UM) rose 50 places from 230 to 180.

Acccording to the Vice-Chancellor it was because:

"The redefinition of key performance indicators for the academics and the new initiatives implemented in international networking, recruitment of international staff and students have produced a quick, positive impact,” he said."

According to Ben Sowter, QS's head of research,

" UM’s resurgence into the top 200 was clearly impressive.
“The apparent collective effort at the university to attract a greater proportion of international students suggests a progressive outlook,” he said in an e-mail interview."


But was this what actually happened?

First, between 2008 and 2009 UM dropped quite a bit on the academic survey from 64 out of 100 to 60 (top score is 100 and the mean is 50) and on the recruiter survey from 70 to 68. This may have been the result of a subtle change in the surveys that required respondents to type in the name of selected universities rather than clicking and dragging from a list. This could have worked to the disadvantage of less well known universities.

The fall on the surveys was almost exactly balanced by a rise in the score for international students from 46 to 65 and for international faculty from 63 to 72. The effect of the change in these indicators was reduced by the low weighting thet they receive.

There was also a slight improvement in citations per faculty from 20 to 21.

UM had an overall improvement from 50.8 to 56.5. This was almost entirely the result of a massive improvement in the faculty student ratio indicator, from 38 to 68, worth a 6 full points on the weighted total.

In 2008 UM,according to QS's Top Universities Guide, had a ratio of 14.8 students per faculty.

According to the QS topuniversities web site, the ratio has fallen to 8.9 this year. This appears to have been achieved by reducing the number of students by about 6,000 and by increasing the number of faculty by about 600.

Performance indicators may get UM into the Shanghai or Taiwan rankings but they were not relevant in this particular case.

No comments: