Times Higher Education World University Rankings

The inaugural 2010–2011 methodology contained 13 separate indicators grouped under five categories: Teaching (30 per cent of final score), research (30 per cent), citations (research impact) (worth 32.5 per cent), international mix (5 per cent), industry income (2.5 per cent). The number of indicators is up from the Times-QS rankings published between 2004 and 2009, which used six indicators.[17]

A draft of the inaugural methodology was released on 3 June 2010. The draft stated that 13 indicators would first be used and that this could rise to 16 in future rankings, and laid out the categories of indicators as "research indicators" (55 per cent), "institutional indicators" (25 per cent), "economic activity/innovation" (10 per cent), and "international diversity" (10 per cent).[18] The names of the categories and the weighting of each was modified in the final methodology, released on 16 September 2010 [17] The final methodology also included the weighting assigned to each of the 13 indicators, shown below [17] (with some updates from 2022–23 released methodology [19]):

The Times Higher Education billed the methodology as "robust, transparent and sophisticated," stating that the final methodology was selected after considering 10 months of "detailed consultation with leading experts in global higher education," 250 pages of feedback from "50 senior figures across every continent" and 300 postings on its website.[17] The overall ranking score was calculated by making Z-scores all datasets to standardize different data types on a common scale to better make comparisons among data.[17]

The reputational component of the rankings (34.5 per cent of the overall score – 15 per cent for teaching and 19.5 per cent for research) came from an Academic Reputation Survey conducted by Thomson Reuters in spring 2010. The survey gathered 13,388 responses among scholars who, according to THE, were "statistically representative of global higher education's geographical and subject mix."[17] However, the response rate of the survey in 2022 was a mere 1.8 %.[20] The magazine's category for "industry income – innovation" came from a sole indicator, institution's research income from industry scaled against the number of academic staff." The magazine stated that it used this data as "proxy for high-quality knowledge transfer" and planned to add more indicators for the category in future years.[17]

Data for citation impact (measured as a normalized average citation per paper), comprising 32.5 per cent of the overall score, came from 12,000 academic journals indexed by Thomson Reuters' Web of Science database over the five years from 2004 to 2008. The Times stated that articles published in 2009–2010 have not yet completely accumulated in the database.[17] The normalization of the data differed from the previous rankings system and is intended to "reflect variations in citation volume between different subject areas," so that institutions with high levels of research activity in the life sciences and other areas with high citation counts will not have an unfair advantage over institutions with high levels of research activity in the social sciences, which tend to use fewer citations on average.[17]

The magazine announced on 5 September 2011 that its 2011–2012 World University Rankings would be published on 6 October 2011.[21] At the same time, the magazine revealed changes to the ranking formula that will be introduced with the new rankings. The methodology will continue to use 13 indicators across five broad categories and will keep its "fundamental foundations," but with some changes. Teaching and research will each remain 30 per cent of the overall score, and industry income will remain at 2.5 per cent. However, a new "international outlook – staff, students and research" will be introduced and will make up 7.5 per cent of the final score. This category will include the proportion of international staff and students at each institution (included in the 2011–2012 ranking under the category of "international diversity"), but will also add the proportion of research papers published by each institution that are co-authored with at least one international partner. One 2011–2012 indicator, the institution's public research income, will be dropped.[21]

On 13 September 2011, the Times Higher Education announced that its 2011–2012 list will only rank the top 200 institutions. Phil Baty wrote that this was in the "interests of fairness," because "the lower down the tables you go, the more the data bunch up and the less meaningful the differentials between institutions become." However, Baty wrote that the rankings would include 200 institutions that fall immediately outside the official top 200 according to its data and methodology, but this "best of the rest" list from 201 to 400 would be unranked and listed alphabetically. Baty wrote that the magazine intentionally only ranks around 1 per cent of the world's universities in a recognition that "not every university should aspire to be one of the global research elite."[22] However, the 2015/16 edition of the Times Higher Education World University Rankings ranks 800 universities, while Phil Baty announced that the 2016/17 edition, to be released on 21 September 2016, will rank "980 universities from 79 countries".[23][24]

The methodology of the rankings was changed during the 2011–12 rankings process, with details of the changed methodology here.[25] Phil Baty, the rankings editor, has said that the THE World University Rankings are the only global university rankings to examine a university's teaching environment, as others focus purely on research.[26] Baty has also written that the THE World University Rankings are the only rankings to put arts and humanities and social sciences research on an equal footing to the sciences.[27] However, this claim is no longer true. In 2015, QS introduced faculty area normalization to their QS World University Rankings, ensuring that citations data was weighted in a way that prevented universities specializing in the Life Sciences and Engineering from receiving undue advantage.[28]

In November 2014, the magazine announced further reforms to the methodology after a review by parent company TES Global. The major change being all institutional data collection would be bought in house severing the connection with Thomson Reuters. In addition, research publication data would now be sourced from Elsevier's Scopus database.[29]

The reception to the methodology was varied.

Ross Williams of the Melbourne Institute, commenting on the 2010–2011 draft, stated that the proposed methodology would favour more focused "science-based institutions with relatively few undergraduates" at the expense of institutions with more comprehensive programmes and undergraduates, but also stated that the indicators were "academically robust" overall and that the use of scaled measures would reward productivity rather than overall influence.[4] Steve Smith, president of Universities UK, praised the new methodology as being "less heavily weighted towards subjective assessments of reputation and uses more robust citation measures," which "bolsters confidence in the evaluation method."[30] David Willetts, British Minister of State for Universities and Science praised the rankings, noting that "reputation counts for less this time, and the weight accorded to quality in teaching and learning is greater."[31] In 2014, David Willetts became chair of the TES Global Advisory Board, responsible for providing strategic advice to Times Higher Education.[32]

Times Higher Education places a high importance on citations to generate rankings. Citations as a metric for effective education is problematic in many ways, placing universities who do not use English as their primary language at a disadvantage.[33] Because English has been adopted as the international language for most academic societies and journals, citations and publications in a language different from English are harder to come across.[34] Thus, such a methodology is criticized for being inappropriate and not comprehensive enough.[35] A second important disadvantage for universities of non-English tradition is that within the disciplines of social sciences and humanities the main tool for publications are books which are not or only rarely covered by digital citations records.[36]

Times Higher Education has also been criticized for its strong bias towards institutions that taught 'hard science' and had high quality output of research in these fields, often to the disadvantage of institutions focused on other subjects like the social sciences and humanities. For instance in the former THE-QS World University Rankings, the London School of Economics (LSE) was ranked 11th in the world in 2004 and 2005, but dropped to 66th and 67th in the 2008 and 2009 edition.[37] In January 2010, THE concluded the method employed by Quacquarelli Symonds, who conducted the survey on their behalf, was flawed in such a way that bias was introduced against certain institutions, including LSE.[38]

A representative of Thomson Reuters, THE's new partner, commented on the controversy: "LSE stood at only 67th in the last Times Higher Education-QS World University Rankings – some mistake surely? Yes, and quite a big one."[38] Nonetheless, after the change of data provider to Thomson Reuters the following year, LSE fell to 86th place, with the ranking described by a representative of Thomson Reuters as 'a fair reflection of their status as a world class university'.[39] LSE despite being ranked continuously near the top in its national rankings, has been placed below other British universities in the Times Higher Education World Rankings in recent years, other institutions such as Sciences Po have suffered due to the inherent methodology bias still used. Trinity College Dublin's ranking in 2015 and 2016 was lowered by a basic mistake in data it had submitted; education administrator Bahram Bekhradnia said the fact this went unnoticed evinced a "very limited checking of data" "on the part of those who carry out such rankings". Bekhradnia also opined "while Trinity College was a respected university which could be relied upon to provide honest data, unfortunately that was not the case with all universities worldwide."[40]

In general it is not clear who the rankings are made for. Many students, especially the undergraduate students, are not interested in the scientific work of a facility of higher education. Also the price of the education has no effects on the ranking. That means that private universities on the North American continent are compared to the European universities. Many European countries like France, Sweden or Germany for example have a long tradition on offering free education within facilities of higher education.[41][42]

In 2021, the University of Tsukuba in Ibaraki Prefecture, Japan, was alleged to have submitted falsified data on the number of international students enrolled at the university to the Times Higher Education World University Rankings.[43] The discovery resulted in an investigation by THE and the provision of guidance to the university on the submission of data,[43] however, it also led to the criticism amongst faculty members of the ease with which THE's ranking system could be abused. The matter was discussed in Japan's National Diet on April 21, 2021.[44]

Seven Indian Institutes of Technology (Mumbai, Delhi, Kanpur, Guwahati, Madras, Roorkee and Kharagpur) have boycotted THE rankings from 2020. These IITs have not participated in the rankings citing concerns over transparency.[45]

Additionally, Times Higher Education provides a THE Universities Under 50 list (formerly only 150 Under 50 Universities) with different weightings of indicators to accredit the growth of higher education institutions that are under 50 years old.[58] In particular, the ranking attaches less weight to reputation indicators: for instance, the University of Canberra, established in 1990, is placed at the 17th position, while the Paris Sciences et Lettres University (2010) is ranked 1st in 2022.[59]

Various academic disciplines are sorted into six categories in THE's subject rankings: "Arts & Humanities"; "Clinical, Pre-clinical & Health"; "Engineering & Technology"; "Life Sciences"; "Physical Sciences"; and "Social Sciences".[60]

From 2013 to 2015, the outcomes of the Times Higher Education Asia University Rankings were the same as the Asian universities' position on its World University Rankings. In 2016, the Asia University Rankings was revamped and it "use the same 13 performance indicators as the THE World University Rankings, but have been recalibrated to reflect the attributes of Asia's institutions."[75]

Times Higher Education Asia University Rankings as shown below – Top 10[Note 1]

Institution	2023[76]	2022[77]	2021[78]	2020[79]	2019[80]	2018[81]	2017[82]	2016[75]	2015[83]	2014[84]	2013[85]
Tsinghua University	1	1	1	1	1	2	3	5	5	6	6
Peking University	2	2	2	2	5	3	2	2	4	5	4
National University of Singapore	3	3	3	3	2	1	1	1	2	2	2
University of Hong Kong	4	4	4	4	4	4	5	4	3	3	3
Nanyang Technological University	5	5	5	6	6	5	4	2	10	11	11
Chinese University of Hong Kong	6	7	7	8	7	7	11	13	13	12	12
Hong Kong University of Science and Technology	7	9	8	5	3	5	6	6	7	9	9
University of Tokyo	8	6	6	7	8	8	7	7	1	1	1
Fudan University	9	10	11	17	17	16	16	19	24	25	24
Shanghai Jiao Tong University	9	13	16	19	24	=20	18	=32	39	47	40

The Times Higher Education Emerging Economies Rankings (Formerly known as BRICS & Emerging Economies Rankings) only includes universities in countries classified as "emerging economies" by FTSE Group, including the "BRICS" nations of Brazil, Russia, India, China and South Africa. Hong Kong institutions are not included in this ranking.

Times Higher Education BRICS & Emerging Economies Rankings – Top 10[Note 1]

Institution	2022[86]	2021[87]	2020[88]	2019[89]	2018[90]	2017[91]	2016[92]	2015[93]	2014[94]
Peking University	1	2	2	2	1	1	1	1	1
Tsinghua University	2	1	1	1	2	2	2	2	2
Zhejiang University	3	3	3	3	6	9	8	21	22
Fudan University	4	4	7	6	4	6	17	9	8
Shanghai Jiao Tong University	5	5	6	8	7	7	7	16	27
Lomonosov Moscow State University	6	6	5	5	3	3	3	5	10
University of Science and Technology of China	7	7	4	4	5	5	7	11	6
Nanjing University	8	9	9	7	8	11	14	22	18
National Taiwan University	9	8	8	10	10	10	5	6	4
Moscow Institute of Physics and Technology	10	11	12	12	11	12	93	69	–