This book is designed to introduce teachers and students to the practice of language testing, so that they will be able to design, build, and evaluate their own tests. There is a strong focus on classroom assessment, as well as providing an introduction to standardized and standards-based testing. The themes of the book also integrate with material on this website. Each chapter also has extensive discussion, practice and writing activities, providing an ideal introductory course in language testing and assessment. Read the blurb for more detailed information.
As it says on the cover, this is an advanced resource book. Its focus is on test and assessment validation set within a new approach that draws on the philosophy of pragmatism to relate test design to intended effects and consequences. Written for people working with language tests and assessments in their professional lives, and graduate students at masters and doctoral levels, it also provides key readings from the field as well ideas for projects and research. Read the blurb for more detailed information.
The first and most extensive treatment of testing second language speaking. After a brief historical account of the evolution of speaking tests, the book discusses how we can define speaking, and describes the range of tasks that we can use to elicit speech. It also deals with the process of test design with a special focus on designing rating scales to score speaking performances, and the writing of test specifications. Other chapters look at rater and interlocutor training, test administration, speaking test evaluation, and the tools and techniques we can use in researching speaking tests. Examples and illustrations are used throughout.
INTERNATIONAL LANGUAGE TESTING ASSOCIATION BEST ARTICLE AWARD
The award committee found the paper by Fulcher and Davidson an excellent conceptual paper that emphasizes the centrality of test purpose in test design decisions, and proposes a systematic approach to evaluating test revisions and test retrofit. The paper is very well-written and the authors guide the reader step by step through the processes of careful decision-making that language testers should undergo when changing tests or test purposes. The use of the architecture metaphor is well-chosen and makes the argument compelling and accessible to a broad audience including practitioners. Test retrofit has been heatedly debated in public forums but has never seen such a systematic treatment in the scientific literature as in this paper. The authors make a strong and timely contribution to the field of language testing in a period where tests are being used for purposes they were not originally intended for, or misused entirely, but the consequences of test change or change of test purpose for the validation process can hardly be found in the literature. Fulcher and Davidson provide the language testing field with the appropriate terminology and guidance for this important and timely topic.
The Routledge Handbook of Language Testing offers a critical and comprehensive discussion of language testing and assessment within the fields of applied linguistics and language study.
An understanding of language testing is essential for applied linguistic research, language education, and a growing range of public policy issues. This handbook is an indispensable introduction and reference to the study of the subject. Specially commissioned chapters by leading academics and researchers of language testing address the most important topics facing researchers and practitioners, including:
* An overview of the key issues in language testing
* Key research methods and techniques in language test validation
* The social and ethical aspects of language testing
* The philosophical and historical underpinnings of assessment practices
* The key literature in the field
* Test design and development practices through use of practical examples
The Routledge Handbook of Language Testing is the ideal resource for postgraduate students, language teachers, and those working in the field of applied linguistics.
I am Professor of Education and Language Assessment in the
School of Education at the University of Leicester in the United Kingdom. My main interests lie in the field of language testing and the
philosophy of educational assessment. I have extensive experience of working on test design (paper and computer based) and development projects, including the design and creation of test specifications, item/task design and prototyping, item/task review procedures, pre-testing, test analysis and assembly. I have specific expertise in the design and development of rating instruments for performance assessments, particularly for L2 speaking and communication. I developed the first data-based rating scales between 1987 and 1993, and continue to conduct research in this area. I have worked for a number of major testing companies in a research or consultancy capacity on test development projects, alignment studies, and conducting item writer/rater training. I have published widely in the field, and you can see (and download) some of my work below. Finally, I am interested in teaching language testing. I offer two modules each year, both on campus and by distance learning, supported by innovative electronic materials to enhance the student experience.
I am co-editor of Language Testing (Sage) with April Ginther (Purdue University). I am also a member of the editorial board of
Assessing Writing (Elsevier).
I served on the Executive Board of the
International Language Testing Association (ILTA) from 1998 - 2000. In 2005 I was elected Vice President, served as President in 2006, and then as ex-officio Immediate Past President from 2007 - 2008. During 2009 I was a Leverhulme Research Fellow. I am grateful to the Leverhulme Trust which awarded me a substantial grant to pursue research leading to the publication of Practical Language Testing.
I teach language testing and assessment, and research methods, on the MA in Applied Linguistics and TESOL, and doctoral programmes. I undertake research and consultancy work as a member of the University, sometimes through Consult Leicester. Please contact me for further information.
When I'm not working, reading, walking, swimming or practising guitar, I enjoy listening to the radio, usually while cooking! My favourite programmes include comedy from the BBC, philosophy, history, statistics, and world news. Here is a selection of good stuff. Why not listen while you explore this page?
MoreOrLess: Trouble on the Greek railways (WS) 11 May 12
Would it be cheaper to send every Greek rail passenger by taxi instead? This programme was first broadcast on the BBC World Service.
IOT: Clausewitz's On War 17 May 12
Melvyn Bragg and his guests discuss On War, a treatise on the theory and practice of warfare written by the Prussian soldier and intellectual Carl von Clausewitz. First published in 1832, Clausewitz's magnum opus is commonly regarded as the most important book about military theory ever written. Its influence is felt today not just on the battlefield but also in politics and business. Melvyn Bragg is joined by Saul David, Professor of War Studies at the University of Buckingham; Hew Strachan,
Chichele Professor of the History of War at the University of Oxford and Beatrice Heuser, Professor of International Relations at the University of Reading.
NIck Bostrom on the Status Quo Bias
Are we systematically biases against changing the status quo? It seems that we are. In this interview, originally released as part of the Bioethics Bites series, Nick Bostrom discusses this tendency and its implications when it comes to making decisions about cognitive enhancement. Bioethics Bites is made in association with the Oxford University Uehiro Centre for Practical Ethics and made possible by a grant from the Wellcome Trust.
The research for this book has kindly been supported by the The Leverhulme Trust, which awarded me a Leverhulme Research Fellowship to fund the research and study leave. I am also grateful to the University of Leicester, which granted me study leave.
'This thorough and comprehensive introduction to the practical and theoretical dimensions of language testing and assessment is set to become a standard reference. With chapters by leading international authorities in the field, it is both intellectually stimulating and practically useful, and is a must-read for those involved in language testing as test developers, test users, policy makers and researchers.'
Tim McNamara, The University of Melbourne, Australia
'I found this book to be the finest collection of cogent articles on language testing to date. The Handbook solidifies language testing as a discipline in its own right - one that has real-world impacts on society at large. Stimulating and clear, the articles will be a valuable resource for decades to come.'
Paula Winke, Michigan State University, USA
Fulcher, G. (2012). "Scoring Performance Tests." In Fulcher, G. and Davidson, F. (Eds.) The Routledge Handbook of Language Testing. London and New York: Routledge, 378 - 392.
Fulcher, G., Davidson, F. & Kemp, J. (2011). "Effective rating scale development for speaking tests: Performance Decision Trees." Language Testing 28, 1, 5 - 29.
Fulcher, G. (2008). "Assessing Language Quality".
In Shohamy, E. (Ed.) Language Testing and Assessment. Vol. 7, Encyclopedia of Language and Education. New York: Springer Publishers, 157 - 176.
Fulcher, G. (2007). "Evaluating quality in second language performance tests." English Language Assessment 1, 3 - 19.
Fulcher, G. (1998). "Testing Speaking". In Clapham, C. (Ed). Language Testing and Assessment. Vol. 7. of the Encyclopaedia of Language and Education, Kluwer Academic Publishers, 75 - 86.
Fulcher, G. (1997). "Assessing Writing". In Fulcher, G. (Ed) Writing in the English Language Classroom. Phoenix ELT/Prentice Hall Macmillan.
Fulcher, G. (1996). "Testing tasks: issues in task design and the group oral." Language Testing 13, 1, 23 - 51.
Fulcher, G. (1996). "Does thick description lead to smart tests? A data-based approach to rating scale construction". Language Testing 13, 2, 208 - 238.
Fulcher, G. (1994). "Some priority areas in oral language testing research." Language Testing Update 15, 39 - 47.
Fulcher, G. (1989). Lexis and reality in oral evaluation. US Department of Education, Office of Educational Research and Improvement, and the Centre for Applied Linguistics. ERIC document number: ED 298759.
Fulcher, G. (1987). "Tests of Oral Performance: the need for data-based criteria." English Language Teaching Journal 41, 4, 287 - 291.
Fulcher, G. (2009). The commercialization of language provision at University. In Alderson, J. C. (Ed.) The Politics of Language Education: Individuals and Institutions. London: Multilingual Matters, 125 - 146.
Fulcher, G. (2007). "Universities undermine their own foundations." Guardian Education, 13 April.
Marquez Reiter, R., Rainey, I. and Fulcher, G. (2005). "A comparative study of conventional indirectness in British English and Peninsular Spanish." Applied Linguistics 26, 1, 1 - 31
Fulcher, G. and Locke, D. (1999). "Distance Education: The future of library and information services requirements." Distance Education 20, 2, 313 - 329.
Fulcher, G. (1999). "Library and Information Services Requirements: A Course Developer's Perspective." In D. A. Lock (ed.)
Library Services for Distance Learners. Surrey: Proceedings of the first Conference on Library Services for Distance Education. 3 - 8.
Fulcher, G. (1997). "Text difficulty and accessibility: Reading formulae and expert judgement." System 25, 4, 497 - 513
Fulcher, G. (1991). "Conditionals Revisited." English Language Teaching Journal 45, 2, 164 - 168.
Fulcher, G. (1989). "Cohesion and coherence in theory and reading research." Journal of Research in Reading 12, 2, 146 - 163.
Fulcher, G. (1988). "The EFL Classroom as a place for research." Education Today 38, 4, 44 - 52.
Fulcher, G. (1988). "Teaching vocabulary for writing." Modern English Teacher 15, 1, 25 - 30.
Fulcher, G. (1987). "Contextual Hyponymy: a communicative approach to teaching lexis in context." Modern English Teacher 14, 3, 14 - 17.
Online Features
On this website I periodically publish short articles on subjects that are topical or relevant to what is going on in my language testing classes. You can access a selection from the Features Page.
Social, Political and Ethical Uses of Tests
Fulcher, G. (2011). Cheating gives lie to our test dependence, Guardian Weekly, 11th October 2011. Or you can download a pdf.
Fulcher, G. (2010). "The reification of the Common European Framework of Reference (CEFR) and effect-driven testing." In Psyaltou-Joycey, A. and Matthaioudakis, M. (Eds.) Advances in Research on Language Acquisition and Teaching. Greece, Thessaloniki: GALA, 15 - 26.
Fulcher, G. (2009). "Test use and political philosophy."
Annual Review of Applied Linguistics 29, 3 - 20.
Fulcher, G. and Davidson, F. (2008).
"Tests in Life and Learning: A Deathly Dialogue."
Educational Philosophy and Theory, 40, 3, 407 - 417.
Fulcher, G. (2008). "Testing Times Ahead?"
Liaison Magazine, Issue 1: July, 20 - 24.
Published by the UK Subject Centre for Languages, Linguistics and Area Studies, University of Southampton.
Fulcher, G. (2005). "Language Framework Documents and the Hallmark of Political Purpose." In Niakaris, C. I. and Nebel, A. (Eds.) Testing and Evaluation. Athens: Hellenic American Union, 28 - 31.
Fulcher, G. (2004). "Deluded by artifices? The Common European Framework and harmonization."
Language Assessment Quarterly, 1, 4, 253 - 266.
Fulcher, G. (2004). "Are Europe's tests being built on an unsafe framework?". Guardian Education, 18 March.
Fulcher, G. (2003). "Few ills cured by setting scores." Guardian Education, 17 April.
Fulcher, G. (1999). "Ethics in Language Testing." TAE SIG Newsletter 1, 1, 1 - 4.
Fulcher, G. and Bamford, R. (1996). "I didn't get the grade I need. Where's my solicitor?" System 24, 4, 437 - 448.
Computers, Technology and Testing
Fulcher, G. (2005). "Better Communications Test will Silence Critics".
Guardian Education, 18 November.
Fulcher, G. (2003). "Interface design in computer based language testing." Language Testing 20, 4, 384 - 408.
Fulcher, G. (2001). "Machines get cleverer at testing." Guardian Education, 17th May.
Fulcher, G. (2000). "Computers in language testing." In Brett P. and Motteram, G. (Eds.) A special interest in computers: Learning and teaching with information and communications technologies. Manchester: IATEFL publications, 93 - 107.
Fulcher, G. (1999). "Computerizing an English language placement test." English Language Teaching Journal 53, 4, 289 - 299
Fulcher, G. (1998). "Computer-based language testing: The call of the internet." In Coombe, C. A. (Ed.) Current Trends in English Language Testing. UAE: Al Ain University Press. 1 - 14.
Teaching, Learning and Assessment
Fulcher, G. (2012). "Assessment literacy for the language classroom." Language Assessment Quarterly 9, 2, 113 - 132.
Fulcher, G. (2010). "Assessment Literacy for the English Language Classroom." Testing, Evaluation and Assessment Newsletter, IATEFL, September, 6 - 8.
Fulcher, G. (2003). "Scaling the peak of writing assignments/dissertations." Guardian Education, November 21.
Fulcher, G. (2002). "Managers face the tests." Invited editorial for the EFL Gazette, April, Issue 267.
Fulcher, G. (2001). "Communicative Language Testing." In Coombe, C., Riley, S. and Troudi, S. (Eds.) Bridging the Gap between Teacher and Learner. TESOL Arabia, 52 - 68.
Fulcher, G. (2000). "The 'communicative' legacy in language testing." System 28, 4, 483 - 497
Fulcher, G. (2000). "Assessment in Independent Language Learning." In the Curriculum and Independence for the Learner Network Handbook (CIEL)
Fulcher, G. (1996). "Writing in the Classroom" Modern English Teacher, 5, 3, 45 - 48.
Fulcher, G. (1991). "The role of assessment by teachers in schools." In Caudery, T. (ed) New Thinking in TEFL. (The Dolphin Series No. 21), Denmark: Aarhus University Press, 138 - 158.
Fulcher, G. (1990). A GCE O Level Workbook. Mavromatis Books, Nicosia, Cyprus.
Book and Software Reviews
Fulcher, G. (2005). "Educational Test Analysis." Language Testing Update,36, 152 - 154.
Fulcher, G. (2000). Review of Chalhoub-Deville, M (Ed.) 1999. Issues in computer-adaptive testing of reading proficiency: selected papers. Studies in Language Testing Vol. 10. Cambridge: Cambridge University Press. Language Testing 17, 3, 361 - 367.
Fulcher, G. (1999). Review of Barnwell, D. P. 1996: A History of Foreign Language Testing in the United States: from its beginnings to
the present. Tempe, Arizona: Bilingual Press. Language Testing 16, 3, 389 - 394.
Fulcher, G. (1997). "QM Web: A World Wide Web Test Delivery Program." Language Testing Update 21, 45 - 49.
Fulcher, G. (1996). "Brief report on the Language Testing Forum 1995". Language Testing Update, 19, 79 - 80.
Fulcher, G. (1996). "Cyberspace revisited". Language Testing Update, 19, 43 - 51.
Fulcher, G. (1995). "The Language Tester's Guide to Cyberspace." Language Testing Update 17, 62 - 65.
Fulcher, G. (1990). "Review of Testing Spoken Language by Nic Underhill, CUP 1987. English Language Teaching Journal 41, 1, 80 - 82.
Oddities from the Past
Fulcher, G. (1993). "Synonymy RIP." I came across this in a dusty drawer recently. Strange how we sometimes do stuff and forget about it. Anyway, I thought it was worth resurrecting ;-)
Fulcher, G. (1983). "Structuralism." Before Applied Linguistics and Language Testing I studied philosophy and theology. Here's an early publication from my previous life!
I make a quarterly podcast to accompany the journal Language Testing, which I currently co-edit. Visit the podcast page to listen, or download for your iPod.
Other Volumes
Fulcher, G. (2000). Expanding perspectives on language testing in the 21st century.
Guest Editor of a special edition of System, Volume 28, Number 4.
Fulcher, G. (1997). Writing in the English Language Classroom
Pearson Education/Phoenix ELT/Prentice Hall Macmillan.
ISBN: 0-13-626417-4
1993: University of Lancaster. PhD in Applied Linguistics and Language Testing. Thesis: The Construction and Validation of Rating Scales for Oral Tests in English as a Foreign Language.
1987: University of Birmingham, English Language Research. MA in Applied English Linguistics. Dissertation: Discourse Analysis and the Testing of Reading Comprehension.
1982: University of London, King's College. MTh. Dissertation: Structuralism as a New Exegetical Method.
1981: University of Cambridge: Christ's College. Post-graduate Certificate in Education (PGCE).
1980: University of London, King's College. BD and Associate of King's College (AKC). Major:
Textual Analysis of first century Greek texts.
1979: Exchange scholarship in philosophy to Dartmouth College, Hanover, New Hampshire, USA.
I enjoy playing guitar, particularly blues and prog rock, with a little jazz thrown in. I'd never be able to make a living out of it, but it's a great way to switch off from the world for a while. I also listen to a wide range of guitar music. My favourites? Joe Bonamassa, Jeff Beck, Garry Moore, Peter Green, David Gilmour, Steve Howe, Wes Montgomery, Django Reinhardt, Martin Taylor, Derek Trucks. And many more. Why not try these great blues podcasts from around the web?
Roadhouse 377 (12 May, 2012)
Nothing But The Blues #191 (12 May, 2012)
So here's a track of me playing a piece adapted from a favourite prog band of mine, YES. Done on a virtual 32 track recorder, the lead is played on a Les Paul and the backing track on a semi-acoustic Ibanez Artcore. Steve Howe would have used a Gibson ES-175. Drums courtesy of the on-board percussion computer, effects from a Boss Phaser.
Most guitar players learn major key pieces by the Shadows at some stage. Here's my version of Wonderful Land. To get the Shadows sound I use a Boss ME50 with a fair amount of sustain and a 100-500 second delay with lots of feedback. On top of that I use a Dava nickel silver tipped pick. Very punchy.
And this track is based on a theme from one of Wes Montgomery's jazz classics. I'm playing my Les Paul, but I've put it through a semi-acoustic simulator to try to get a tone similar to Montgomery's favourite Gibson L-5CES.
I've always been addicted to Gibson guitars, the Les Paul in particular. I prefer the '59 neck with jumbo frets, and my favourite is an iced tea burst like the one in this image. My other is a desert sunburst with the much thinner '60 neck. But all Gibson guitars are wonderful to play. Below is the latest music news from Gibson.
This Day in Music: April 5th
Born on this day:
1928, Tony Williams, vocals, The Platters
1942, Allan Clarke, vocals, The Hollies
1948, Dave Holland, drums, Judas Priest
1950, Agnetha Faltskog, vocals, ABBA
1964, Christopher ?Kid? Reid, rapper, Kid ?n Play
1966, Mike McCready, guitar, Pearl Jam
1968, Paula Cole, singer-songwriter
1970, Miho Hatori, vocals, keyboards, Cibo Matto
1973, Pharrell Williams, singer, producer, N.E.R.D., The Neptunes
Wham, Bam, Thank You Man! Gibson & Floyd Rose®
Few gadgets have divided guitarists quite like the Floyd Rose® bridge. Call it a tremolo, call it a whammy bar, call it a wiggle-stick ? under whatever name you choose to use for it, that little bar and the hefty bridge it attaches to has created some brilliantly tender ? and some woefully overwrought ? performances. And although Gibson guitars might not be the first instruments that come to mind when you think of the Floyd Rose® (that honor probably goes to Kramer, who secured the first Floyd Rose® distribution deal back in the early ?80s), there have been several Gibson models throughout the years that have paid tribute to this most whale-sound-inviting of guitar gadgets.
Eric Clapton?s $4.6m Bespoke Ferrari
Eric Clapton has famously sold his most famous guitars, with proceeds going to his Crossroads charity. But the U.K. rock-blues legend obviously still has money to burn. He recently ordered a bespoke Ferrari sports car that reportedly cost $4.6 million. Clapton worked with the car company?s Special Projects division to re-body a Ferrari 458 Italia ? itself worth $275,000 in standard issue.
Neil Young Trademarks MP3-Replacement Audio Format
Legendary guitarist Neil Young appears to working on new audio formats. Young is a vocal critic of MP3 quality ? he doesn?t even like CD audio, particularly ? and has designs on something better.
Favourite Internet Sites
Like everyone else I have a number of favourite internet sites that aren't about language testing! They cover language, art, history, travel, free e-books for my kindle - and more. You may like to take a look at what I currently like on the net in my favourite links.