Dr Javaid R. Laghari Chairperson Higher Education Commission Sector H-9, Islamabad. Subject: Incorrect and Misleading Ranking of Higher Education Institutions in Pakistan by the HEC Dear Dr Laghari, As you are aware, I was closely involved in the founding of the HEC and have been associated with it in various capacities over the last decade. I also firmly believe that the HEC is a very valuable institution and has played an extremely important role in supporting higher education in Pakistan. For this reason, I would like to raise the critical issue of the incorrect and highly misleading rankings of higher education institutions on Pakistan released by the Higher Education Commission (HEC) for 2012 and last week for 2013. Despite the best intentions of the HEC in evaluating higher education institutions, the rankings released by the HEC are marked by serious mistakes. If actions are not taken immediately to correct these highly inaccurate and misleading rankings, the reputation of the HEC will be irreparably harmed at the local and international level. In addition, institutions like the Lahore School of Economics, which are amongst the leading academic institutions in academic quality, research, quality of learning and teaching and student placement will be irreparably harmed. The criteria for the ranking of higher education institutions has never been discussed at any meeting of Vice-Chancellors and Rectors and certainly not at any forum where the Lahore School of Economics was invited. This has resulted in the entire process being non-transparent and having critical mistakes both in its formulation and its implementation. This has also resulted in the process being subject to no level of scrutiny or accountability to stakeholders. For this reason I had expressed my deepest concerns after the 2012 ranking exercise to Dr Sohail Naqvi, then Executive Director of the HEC, at the HEC Vice-Chancellors and Rectors meeting in 2012, and he had assured me that the problems in the ranking methodology (which are detailed below) would be corrected both for 2012 and for subsequent years. This has obviously not been done and the ranking is now even more inaccurate and misleading as a consequence. The critical mistakes in the HEC’s ranking methodology are as follows: First, the HEC has allowed either large multi-disciplinary general category institutions or universities with unrelated specialisations to be included as a whole in the rankings for specific sub-disciplines. So large multi-disciplinary universities or universities with large science and engineering schools are included in the rankings for business schools, which both biases the rankings and is contrary to international ranking standards. The correct approach is to place large multi-disciplinary institutions in the general university category, or to only evaluate departments related to the business field (based on internationally accepted practices) from within these institutions in the ranking process. Second, contrary to all internationally accepted practices of ranking higher educational institutions, the HEC has completely arbitrarily based a significant portion of the weights in their rankings on criteria related largely to HEC financing. More specifically, 14 percent of the total ranking score of an institution in 2012 is related to whether the HEC finances a quality enhancement or research activity. In the 2012 ranking the HEC has given an institution zero points for the ‘Quality Enhancement Cell (QEC) Categorisation’ simply because the institution’s Quality Assurance Department has not been financed by the HEC. Similarly, an institution has received zero points in the ‘Conferences’ criteria because the institution has not taken any funding from the HEC for conferences, even though it may have held multiple international conferences on a yearly basis. Similarly, institutions have been awarded zero points for ‘HEC travel grants’ simply because they have not taken funding from the HEC for faculty travelling for international conferences, and have also received zero points for ‘Indigenous Scholars’ simply because the institutions have not taken any money from the HEC for students scholarships even though the institutions may have a large scholarship programme. The above is only a partial list of HEC related criteria that have no connection in any way with actual quality assurance or research quality. The Lahore School of Economics, which performs exceptionally well against all the above criteria, has received no credit for its performance in these fields because as a matter of policy it does not seek funding from the HEC or any other government agency, and in fact is being penalised for being financially autonomous. Two important points should be made about these arbitrary HEC ranking criteria used in 2012 and largely apparently used in 2013: First, no ranking system in the world takes these completely irrelevant criteria in evaluating higher educational institutions. Attached in Annexes A and B to this letter are the ranking criteria (highlighted) of two international ranking programmes: (A) QS University Rankings Asia and (B) QS University World Rankings. As you will note, there is absolutely no criteria in any of these rankings that measures the amount of funding an organisation receives from the government or other sources. Also, as the QS rankings show, the majority of the ranking is based on perceptions of academic quality based on surveys of other institutions or based on surveys of employers, and both criteria have been arbitrarily ignored by the HEC in the 2012 and apparently in the 2013 rankings despite being part of the stated ranking methodology [see (3) below]. The second point regarding the arbitrary HEC ranking criteria is that they are biased in favour of institutions that receive funding from the HEC, which is completely wrong and also out of line with international standards of ranking of educational institutions. Third, on the HEC website, the ‘Explanatory Notes’ on the rankings show that an ‘Employer Perception Survey’ and a ‘Peer Perception Survey’ would be used to contribute 10 percent to the total points awarded to a institution. These surveys were completed as a part of the 2013 ranking process and the Lahore School itself completed such a peer perception ranking survey twice since the HEC’s list of business schools was revised. The 2013 rankings have apparently ignored this criteria that would have given a significantly higher score to institutions like the Lahore School of Economics, which enjoys an extremely strong reputation amongst other academic institutions worldwide and both local and international employers. Again, this apparent change would run contrary to the stated ranking methodology of the HEC itself and also the QS International University ranking criteria, which places a very large weight (of a minimum of 40 percent) on these as mentioned above. I request that the following measures be taken immediately: HEC immediately withdraw the incorrect and misleading rankings of higher educational institutions in Pakistan for 2012 and 2013. HEC immediately call a meeting of Vice-Chancellors and Rectors of all public and private sector higher educational institutions in Pakistan to meet and decide upon the appropriate ranking criteria for all higher educational institutions in line with international standards. HEC immediately restart the process of ranking universities based on transparent, internationally accepted criteria, which should have been agreed upon by all the Vice-Chancellors and Rectors of higher educational institutions in Pakistan. HEC immediately release the data from the ‘Employer Perception Survey’ and the ‘Peer Perception Survey’, which the HEC has collected regarding all academic institutions as part of the 2013 ranking exercise. If these actions are not taken, there will be irreparable harm to the academic institutions like the Lahore School of Economics that have had the ranking biased against them and also to the international and local reputation of the HEC. I urge you to proceed quickly in this regard. Yours Sincerely, Dr Shahid Amjad Chaudhry cc. Dr. Mukhtar Ahmed, Executive Director, Higher Education Commission, Pakistan The writer is the Rector of Lahore School of Economics