THE World Reputation Rankings 2019: methodology

Browse the full Times Higher Education World Reputation Rankings 2019 results

The Times Higher Education World Reputation Rankings are created using the world’s largest invitation-only academic opinion survey – a unique piece of research.

The Academic Reputation Survey, available in 16 languages, uses United Nations data as a guide to ensure that the response coverage is as representative of world scholarship as possible. It is also evenly spread across academic disciplines.

The questionnaire, which is administered on behalf of THE by Elsevier, targets only experienced, published scholars, who offer their views on excellence in research and teaching within their disciplines and at institutions with which they are familiar.

The 2019 rankings are based on a survey carried out between November 2018 and February 2019, which received a total of 11,554 responses from 135 countries.

The best represented subject was engineering and technology (accounting for 17.5 per cent of responses), followed by physical sciences (14.4 per cent). Also well represented were business and economics (11.1 per cent), clinical and health (10.9 per cent), life sciences (10.7 per cent), arts and humanities (10.7 per cent) and computer science (10 per cent). The rest of the responses came from social sciences (8.1 per cent), psychology (3.1 per cent), education (2.5 per cent) and law (1 per cent).

However, to better reflect the opinion of scholars from a wide range of disciplines and to make direct comparisons with previous editions of the ranking, THE ’s data team weighted the responses based on the share of votes in each subject from the 2017 and 2018 surveys. These were as follows: physical sciences (14.6 per cent), clinical and health (14.5 per cent), life sciences (13.4 per cent), business and economics (13.1 per cent), engineering (12.7 per cent), arts and humanities (12.5 per cent), social sciences (8.9 per cent), computer science (4.2 per cent), education (2.6 per cent), psychology (2.6 per cent), law (0.9 per cent).

We have also maintained a fair distribution of survey responses across the regions. A total of 39 per cent of responses hail from the Asia-Pacific region. The rest of the responses break down as follows: western Europe accounted for 22 per cent, North America for 20 per cent, eastern Europe for 11 per cent, Latin America for 5 per cent, Africa for 2 per cent and the Middle East for 1 per cent. Where countries were over- or under-represented, THE ’s data team weighted the responses to more closely reflect the actual geographical distribution of scholars, based on UN data.

Share of votes by region

In the survey, scholars are questioned at the level of their specific subject discipline. They are not asked to create a ranking themselves or to list a large range of institutions; they only name at most 15 universities that they believe are the best in each category (research and teaching), based on their own experience.

The survey data will be used alongside 11 objective indicators to help create the THE World University Rankings 2020, which will be unveiled in September 2019.

The reputation table ranks institutions according to an overall measure of their esteem that combines data on their reputation for research and teaching.

The two scores are combined at a ratio of 2:1, giving more weight to research because our expert advisers have suggested that there is greater confidence in respondents’ ability to make accurate judgements about research quality.

The scores are based on the number of times that an institution is cited by respondents as being the best in their field. The number one institution, Harvard University, was the one selected most often. The scores for all other institutions in the table are expressed as a percentage of Harvard’s, which is set at 100.

For example, the University of Oxford received 71.3 per cent of the number of nominations that Harvard gained, giving it a score of 71.3 against Harvard’s 100. This scoring system, which differs from that used in the THE World University Rankings, is intended to give a clearer and more meaningful perspective on the reputation data in isolation.

The top 100 universities by reputation are listed, but THE has decided to rank only the top 50 because the differentials between institutions after that point become narrow. The institutions that make up the second half of the table are listed in groups of 10, in alphabetical order, although the number in each group may vary owing to some institutions at the thresholds having the same scores.