Language testing projects


ERIDA Project, British Council Nepal (2015 - present)


Work involves:

  • Training team members in the development of reading and listening tasks for use in secondary school.
  • Providing distance feedback on task development.
  • Providing advice on field trials and statistical interpretation.
  • Training team members in the analysis of quantitative and qualitative data.

                                                                                                                                                    



Ministry of Foreign Affairs, Bangkok, Thailand (2010 - present)


Work involves:

  • Training of two teams in the production of reading, listening, writing an speaking tasks to be used by diplomats and civil servants.
  • Advice in running field trials and collecting quantitative and qualitative data
  • Training in statistical analyses (SPSS/Winsteps)
  • Carrying out stakeholder meetings covering all four skills on both tests.
  • Advising on webpage and rollout issues.


 

VerA6 / Abitur examinations. Ministry of Education, Mecklenburg-Pomerania, Germany (2006 - present)


Work involves:

The training of three teams of teachers in all aspects of test development including statistical analyses to produce tasks aimed at:

  • 11-12 year olds (A1/A2 CEFR)

  • 15-16 year olds (B1 CEFR)
  • 18 year olds (B2/C1 CEFR)


 

ETP, INVALSI, Italy  2017-present


Work involves:

  • Training team members in the development of reading, listening and language in use tasks for use in school targeting CEFR A1, A2 and B2 levels.
  • Providing distance feedback on task development.
 

Completed projects


Lancaster University – Foreign Language Teaching & Research Press / Beijing Foreign Studies University, Beijing, China (DIALANG) (2013 - 2016)

Work involved:

  • Training of three teams in all aspects of language test development.
  • Providing distance feedback on language test tasks developed.
  • Providing advice on field trials and statistical interpretation.
 
 
 

Institut zur Qualitätsentwicklung im Bildungswesen (IQB), Berlin, Germany (2005-2007 & 2011-2016)

Work involved:

  • Training of secondary school teachers in all aspects of task development.
  • Providing on-line feedback on task development and analysis of resulting trial data.

 
 

University of Innsbruck / BMB, Austria (2007-2014)

Work involved:

  • Training of 7 teams of secondary school teachers representing English, French, Spanish & Italian languages) from both regular and vocational schools in all aspects of test development including statistical analyses.
  • Levels targeted: CEFR B1 & B2 levels.
  • Development of B1/B2 rating scales (writing).
  • Teacher training in the use of the rating scales (writing).
  • Carrying out standard setting seminars on an annual basis
  • Training a pool of language experts to become standard setters.
 

University of Granada, Spain (2009-2014)

Work involved:

  • Training of two teams (English and Spanish native speakers) in all aspects of test development including statistical analyses for exams targeting CEFR B1/B2/C1.
  • Providing feedback on tasks developed.
  • Providing advice on trials and statistical interpretation.
 

British Council-State Testing Centre, University Entrance Test (UET), Uzbekistan (2001-2009)


Work involved:

  • Reviewing existing UET papers and presenting recommendations for the improvement of the validity and reliability of the test scores.
  • Training a team of test developers to develop and analyse a series of stakeholder feedback questionnaires.
  • Developing Reading and Use of English test specifications and tasks.
  • Trialling and statistical analyses.
  • Assisting the team to develop a UET handbook (reading/Use of English).
  • Providing advice on the incorporation of the new generation of test items into the 2006 and 2007 UET.
 

British Council- State Testing Centre, University Entrance Test Extension (UETX), Uzbekistan (2006-2009)

Work involved:

  • Training experts from six subject areas (maths, physics, chemistry, history, Uzbek language and literature, and Russian language and literature) in the development of valid and reliable multiple-choice items for the annual UET test taken by approximately 400,000 candidates.
  • Developing test specifications, tasks, administration guidelines and a UETX handbook.
  • Trialling of all tasks and delivery of feedback questionnaires. 


EUROCONTROL Air Traffic Controllers' Project (ELPAC) Luxembourg (2006-2009) (http://elpac.info) 

Work involved:

  • Reviewing the existing English language assessment system and recommendations. 
  • Working on the design of a new test for air traffic controllers' in compliance with ICAO language requirements.
  • Developing test specifications, item writers’ guidelines, tasks and trials for Papers I & II: Listening & Speaking.
  • Carrying out interlocutor/examiner training.
  • Advising on the development of the ELPAC website.
  • Carrying out standard setting versions and advising on the sustainability and monitoring of the ELPAC testing system.


FCO / Ministry of Defence (PEP). Military English Reform Project, Romania (2002-2005)

Work involved:

  • Reviewing the existing assessment system in use by military colleges/ academies in Romania and making recommendations for a three-year plan to bring this into line with STANAG 6001 requirements.
  • Working with both core and regional teams on the development, trialling and statistical analysis of Level 2 and Level 3 STANAG Reading, Listening, Writing and Speaking Tests.
  • Acting as lead facilitator at an international language testing seminar attended by the delegations of 17 Ministries of Defence in order to develop a draft code of procedures for developing valid and reliable tests in accordance with STANAG 6001.
  • Assisting in the evaluation of the Romanian Speaking Evaluation (RoSE) system aimed at STANAG Levels 1, 2 and 3
  • Making recommendations for the revision and streamlining of the RoSE system in preparation for the annual RoSE seminar. 
 


British Council – Ministry of Education, Armenia. English Language Test for Secondary School Leavers Project (2000-2003)

Work involved:

  • Training the team in the development of tests for secondary school leavers.
  • Advising the team on the statistical findings of the trials and making recommendations for the next stage of the project.
  • Carrying out a writing standardisation sessions with test developers and markers.


Department for International Development (DfID) Secondary & Technical English Project (STEP), Mozambique (2000-2001)

Work involved:

  • Establishing a procedure for obtaining data on the English language performance of secondary school students across the 10 provinces of Mozambique.
  • Analysing the data resulting from these provinces and summarising the findings on secondary school examination performance.
  • Running an assessment workshop for the country's ten Provincial English Advisers.
  • Drafting a handbook targeted primarily at secondary school teachers of English.


British Council – Ministry of Education, Georgia. English Language Test for Secondary School Leavers Project (2000)

Work involved:

  • Analysis of initial field trial results from the secondary school tests.
  • Task development.