Dictating researchFeminist philosophy and the RAEIn an essentially contested subject such as philosophy, it makes little sense for a small Research Assessment Exercise (RAE) Panel to make judgements across the whole breadth of the discipline, however well-intentioned that panel might be. As I work between the ʻcontinentalʼ and ʻanalyticalʼ traditions – in the ﬁeld of feminist philosophy, which was (and always has been) completely unrepresented on the RAE Panel – I feel this very acutely.
In practice, little work in feminist philosophy was submitted in the course of the RAE to the Philosophy Panel. But that is precisely the problem. I know from discussions in the Society of Women in Philosophy (UK) that many junior (and sometimes also senior) colleagues working in this ﬁeld were either dissuaded by their heads of department from submitting ʻfeministʼ pieces, or were persuaded to submit ʻoutsideʼ Philosophy, under the entirely inappropriate heading of Sociology, for example. Such a strategy prevents the development of the discipline of philosophy – and also fails to register the 180 plus women who are part of this network, including those who have responded to recent SWIP questionnaires in ways that show that many see their academic future in fairly grim terms.
If we have to continue with the absurd process of RAE assessment (as I fear we must), it is absolutely essential that the discipline recognizes the need for separate sub-panels for different philosophical traditions. There was nobody on the panel this time, for example, who had skills in recent French philosophy, and ʻContinental Philosophyʼ is certainly not a homogeneous tradition, even though it is often equated with all that is not ʻanalyticʼ. In Europe, after all, a similar RAE exercise would have a variety of ʻContinentalsʼ, and probably only one person who was supposed to have skills in the whole ʻAnalyticʼ area.
My suggestion is that next time round there be at least four sub-panels. It has been suggested by some that there might be sub-panels in ʻanalyticʼ, ʻcontinentalʼ and ʻappliedʼ philosophy. However, I would like to add to this suggestion by requesting that consideration be given to a further sub-panel that should be set up to deal with interdisciplinary work in philosophy. Furthermore, I would propose that some person or persons on this interdisciplinary sub-panel should have the skills necessary to judge work on sexual difference and race: work that emerges from a variety of philosophical traditions, but that is usually not ʻapplied philosophyʼ. It should be clear that ʻapplied philosophyʼ is an inappropriate category for assessing work in such lively research areas as feminist epistemology, feminist meta-ethics or feminist political philosophy. Nor can ʻapplied philosophyʼ embrace my own two primary areas of research specialism: feminist metaphysics and feminist aesthetics.
Interestingly, when I recently assembled the self-descriptions of the women serving on the editorial board of the Womenʼs Philosophy Review (UK), what was striking was the impossibility of telling from the lists of research expertise whether a particular board member was trained in the analytic or continental traditions. Here, what matters more is the necessity forced on those working within
The case of economics
The Research Assessment Exercise carried out by the Higher Education Funding Councils (HEFC) for England, Wales, Scotland, and Northern Ireland and their predecessors was established as an institutional mechanism to provide the government with a rationale for distributing research funds among university departments of a given subject area. Central to the Exercise is the subject assessment panel made up of pre-eminent peers who rate the research excellence of a department and thereby determine the amount of research monies it will get. Perhaps not initially intended to affect the areas of research carried out by British academics, the assessment panels in fact have that capability through their control of the allocation of research monies.
The ﬁrst exercise seemed to have little impact on economists and their research.
However, by the time of the 1989 RAE, the so-called ʻDiamond Listʼ of core mainstream economic journals had been drawn up and there was a strong belief amongst economists that this list was used by the assessors to inform their judgement of the quality of research in economics departments in British universities.
Attempts were made to extend this list for use in the 1992 RAE. At the 1994 Royal Economic Society Annual Conference the chairman of the economics panel for the 1992 RAE claimed that the assessors did not discriminate against nonmainstream research and that the research assessment exercise should not be used by economic departments to do so. He added that he did not believe that British economists would actively discriminate against non-mainstream economists and their research. However, at the same conference a ﬂyer appeared which announced feminist philosophy to familiarize themselves with a broad range of philosophical argument and interdisciplinary debates.
The RAE process is already acting like the Medusaʼs gaze, freezing the discipline of philosophy into anachronistic modes of self-deﬁnition that block innovation. If the only philosophy that is ﬁnancially rewarded as ʻgoodʼ philosophy is ʻpureʼ philosophy – and if ʻpureʼ philosophy is judged in a way that marginalizes interdisciplinarity – then we might expect further ʻcutsʼ and ʻblocksʼ to the development of radical and ʻnon-standardʼ philosophy (including feminist philosophy). And what should be a vigorous discipline, open to a plurality of voices and conceptions of philosophy, will be unable to defend itself effectively against those university managers and administrators who are looking for easy targets in this time of ﬁnancial stringency. As we are already seeing, the RAE judgements have already meant that posts are ʻaxedʼ or ʻfrozenʼ, and at least one English philosophy department is threatened with dispersal and closure. It is urgent that we discuss questions of future strategy now before too much more damage is done.
Department of Philosophy, University of WarwickThe preceding article is reprinted from the ʻViews and Commentsʼ section of the Womenʼs Philosophy Review, no. 17, Summer 1997. It represents the personal views of the editor of that journal, which is afﬁliated to the Society of Women in Philosophy (UK). It is based on a letter that was posted to the e-mail discussion group for philosophers, firstname.lastname@example.org one old university was in the market for nine economists who would raise its economics department research proﬁle in mainstream economics. Advertisements for posts in other institutions similarly speciﬁed that applicants must be working within mainstream economics and linked this explicitly to either maintaining or improving their ranking in the assessment exercise. It is clear that, as a result of the RAE, economics departments were discriminating positively in their hiring practices towards mainstream economists and their research as a way to maintain and/or enhance their rating in the next research assessment exercise.*Central to the assessment exercise is the peer review system, which can be deﬁned as a system by which the intellectual excellence of a piece of research is judged by a committee or panel of researchers working in, or close to, the ﬁeld in question. According to researchers on peer review, for the system to work it is necessary that each member of the panel be pre-eminent in the specialism(s) they have to evaluate; that the pre-eminent panel members be selected from across the relevant academic community; that the actual method of selection is open, democratic, and involves as much of the academic community as possible; and that the panel be open to unorthodox and interdisciplinary research. Since the RAE utilizes the peer review system, the HEFC based the selection of panel members on preeminence in research and on the range of specialized expertise needed to cover the spread of research in the subject area to be assessed; however, they were not concerned whether or not the methods of selection of the panel peers were open and democratic and whether the peers may have an interest in the outcome of their deliberations.
The process by which economists were selected for the economic panels for the 1989, 1992 and 1996 RAEs was not open or democratic in that the majority of economists had little say in the selection process. In particular, the panellists were selected by the HEFC and its predecessors, the Royal Economic Society in conjunction with the heads of economic departments, and the chair of the economics panel. All in all, less than 10 per cent of British economists had any real say in the selection of the panels; moreover, the selection of nearly a third of the panel members was done without any consultation whatsoever. Although the main criterion for panel selection was pre-eminence in research, nearly a third of the nineteen panel members in the three RAEs had published on average fewer than three articles over a twenty-ﬁve year period and hence did not fulﬁl the criterion of pre-eminence in research. As for the subject coverage criteria for panel selection, after closely examining the journal publication records of the panel members, it can be concluded that none of the assessment panels covered all of mainstream economics as represented by the core mainstream journals. Furthermore, our examination revealed the near absence of publications in non-mainstream economic journals by members of all three panels (except for the lone Post-Keynesian economist on the 1996 assessment panel), which suggests that the panel members did not have the expertise or knowledge to judge the quality of non-mainstream economics submissions. The consequences of this is made clear in our survey of the 1992 RAE publication submissions of seven 5-rated, eight 4-rated, eleven 3-rated, and three 2-rated university economics departments. The survey revealed twenty-ﬁve publications in non-mainstream core journals. Four of those publications were in three 5-rated departments, none were in 4-rated departments, fourteen were in eight 3-rated departments, and seven were in two 2-rated departments. Thus it appears that if a department publication submission included a signiﬁcant propor* Economics can be divided into a mainstream, called neoclassical economics, and a non-mainstream, which broadly consists of Marxian, Post-Keynesian, Institutional and Srafﬁan economics.tion of publications in core non-mainstream journals, it would most likely receive a 2 or 3 rating.
The combination of peer review and the RAE has produced an institutional arrangement in the form of an economics panel which, because of its control over funding, has the power to affect the type of economic research carried out by British economists. Since the selection process ensured that the members of the economics panels were nearly all mainstream economists, the message that the panels sent out was that research in mainstream economics and publication in core mainstream journals were what was necessary for university economics departments to maintain or increase their research funding. This message was reinforced by the evaluation of research submitted to them and the ranking of departments.
Consequently, since the 1992 RAE economic departments have taken steps in the areas of recruitment policy and the direction of both departmental and individual work to emphasize mainstream research and de-emphasize and discriminate against non-mainstream research.
A shift towards the mainstream
We undertook a questionnaire survey of British economists regarding the RAE.
The ﬁndings of the survey showed that there has been a noticeable shift towards a mainstream recruitment policy, with a concurrent positive disinclination to recruit non-mainstream economists. Advertisements for posts ranging from lectureships to chairs predominantly favoured mainstream economists, while departmentsʼ criteria for making appointments narrowed to publications in core mainstream journals.
This resulted in interviews where candidates were directly asked in which core mainstream journals they intended to publish. It also meant that non-mainstream economists on probation or temporary contracts were coerced into doing mainstream research. Thus the impact of the RAE on hiring has been to reduce the employment possibilities of non-mainstream economists in British university economics departments and to ʻpressureʼ those departments most open to nonmainstream economists to hire mainstream economists as well. Furthermore, the survey revealed that large numbers of British economists felt themselves directly affected by the economics panelʼs apparent view that national and international research excellence was restricted to mainstream economics and publishing in core mainstream journals.
The real threat of ﬁnancial sanction by the economics panel has, in light of the declining ﬁnancial support for universities and research, driven British economics departments to discriminate against non-mainstream research and the hiring of non-mainstream economists, as well as to restrict if not eliminate the teaching of non-mainstream economics to students. This cleansing process clearly gained steam after the 1992 RAE and has been accentuated by the results of the 1996 RAE. The ongoing discrimination against non-mainstream economists and their research has resulted in few young non-mainstream economists obtaining university teaching and research positions. As a consequence, within ten years or so, the number of non-mainstream economists in British university economics departments will decline signiﬁcantly. Such a decline will result in the virtual disappearance of non-mainstream economists from the vast majority of economics departments, with the remainder ageing and increasingly invisible.
From the beginning, it has been apparent that the research assessment exercises represent a thrust towards managerialism in UK higher education, with increased competition among institutional providers in quasi-markets and the introduction of ʻperformance indicatorsʼ to judge quality and determine funding. The fact that this has been achieved under cover of peer review is of no consolation, as it ignores This article is based on research on the impact of the RAE on economics, the full results of which are contained in S. Harley and F. Lee, ʻThe Academic Labour Process and the Research Assessment Exercise: Academic Diversity and the Future of Non-Mainstream Economics in UK Universitiesʼ (Human Relations, forthcoming), and F. Lee and S. Harley, ʻEconomics Divided: The Limitations of Peer Review in a Paradigm Bound Social Scienceʼ (unpublished). Radical Philosophy readers who would like copies of these articles are welcome to write to Dr Frederick S. Lee, Department of Economics, De Montfort University, The Gateway, Leicester LE1 9BH.intellectual authority relations. The RAEs give those dominant within a discipline the power not only to deﬁne quality but also to ensure that only that type of research is done which ﬁts in with their often narrow deﬁnition of excellence.
Whilst this is most obvious in a paradigm-bound social science such as economics, preliminary analysis of Harleyʼs new research ﬁndings in other disciplines would indicate that similar processes may be at work.
Frederick S. Lee and Sandra Harley
De Montfort UniversityHISTORICAL MATERIALISM is a new journal which seeks to play a part in the recovery and renewal of the critical and explanatory potential of classical Marxism.
It will provide a forum for:• the reappropriation and reﬁnement of the classical Marxist tradition for emancipatory purposes. • A genuine and open dialogue between individuals working in different traditions of Marxism • Interdisciplinary debate and communication on an international scale between graduates, researchers and academics
the ﬁrst issue includes: Ellen Meiksins Wood The Non-History of Capitalism Colin Barker Reﬂections on Two Books by Ellen Wood Esther Leslie Woman and Ware, Craving and Corpse in Benjaminʼs Arcades Project Michael Lebowitz The Silences of Capital John Holloway A Note on Alienation Peter Burnham Globalisation: States, Markets and Class Relation John Weeks The Law of Value and the Analysis of Underdevelopment
Historical materialism research in critical marxist theorysubscribe now!
For annual subscription (2 issues), send cheque or international money order payable to
Personal rate: UK £10 Overseas £13/US$20 Airmail £16/US$25 Institutional rate: UK £30 Overseas £38/US$60 Airmail £41/US$65