1、BRITISH STANDARD BS ISO/IEC 23988:2007 Information technology A code of practice for the use of information technology (IT) in the delivery of assessments ICS 35.240.99 BS ISO/IEC 23988:2007 This British Standard was published under the authority of the Standards Policy and Strategy Committee on 28
2、February 2007 BSI 2007 ISBN 978 0 580 50224 8 National foreword This British Standard was published by BSI. It is the UK implementation of ISO/IEC 23988:2007. It supersedes BS 7988:2002 which is withdrawn. The UK participation in its preparation was entrusted to Technical Committee IST/43, Informati
3、on technology for learning, education and training. A list of organizations represented on IST/43 can be obtained on request to its secretary. Additional information General ISO/IEC 23988 is an international Code of Practice based on the former UK Code of Practice BS 7988:2002. The substance of the
4、Code remains unchanged, but some editing has been undertaken to make the document suitable for an international audience and therefore to remove specifically UK references. Scope In the UK context, the Code is relevant to a wide range of organizations involved in the use of IT for the delivery of as
5、sessments. These include organizations of all the types listed in the Introduction to the International Code of Practice and also: awarding bodies, independent organizations that design, deliver or award educational or vocational assessments. Scenarios 1 and 2 in the Annex are relevant to awarding b
6、odies. In the UK, the Code of Practice will also be of interest to regulatory and other statutory bodies whose responsibilities include ensuring the quality of assessment in educational and other contexts. UK-specific legislation and codes of practice Attention is drawn to the following UK legislati
7、on, which is relevant to some uses of IT in assessment: Equality Act 2006 Disability Discrimination Acts 1995 and 2005 Special Educational Needs and Disability Act 2001 Freedom of Information Act 2000 Data Protection Act 1998 Welsh Language Act 1993 Health and Safety (Display Screen Equipment) Regul
8、ations 1992 Health and Safety at Work etc. Act 1974. This publication does not purport to include all the necessary provisions of a contract. Users are responsible for its correct application. Compliance with a British Standard cannot confer immunity from legal obligations. Amendments issued since p
9、ublication Amd. No. Date Comments Reference number ISO/IEC 23988:2007(E)INTERNATIONAL STANDARD ISO/IEC 23988 First edition 2007-02-01Information technology A code of practice for the use of information technology (IT) in the delivery of assessments Technologies de linformation Code de pratique pour
10、lemploi des technologies de linformation (TI) dans la livraison des valuations BS ISO/IEC 23988:2007ii iii Contents Page Foreword .iv Introduction .v 1 Scope.1 2 Normative references 3 3 Terms and definitions4 4 Guiding principles.7 5 Interface between assessment content and IT delivery .8 6 IT deli
11、very of assessments general.9 7 Software for IT delivery of assessments navigation and usability issues 15 8 Instant automated scoring, result determination and feedback .18 9 Preparation and transmission of assessment content and correct responses .20 10 Software and procedures for recording and tr
12、ansmission of candidates details and responses and for their storage by assessment distributors.22 11 Provision of instructions and assessment-specific information for assessment centres24 12 Provision of information and practice material for candidates .25 13 Equipment and facilities at assessment
13、centre, including storage of responses27 14 Staffing of assessment centre 30 15 Preparation for the assessment session31 16 Conduct of assessment session32 17 Procedures relating to emergencies, technical failures and irregularities .34 Annex A (informative) Scenarios 35 Bibliography38 BS ISO/IEC 23
14、988:2007iv Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards thr
15、ough technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, als
16、o take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives, Part 2. The main task of the joint technical committee is to pre
17、pare International Standards. Draft International Standards adopted by the joint technical committee are circulated to national bodies for voting. Publication as an International Standard requires approval by at least 75 % of the national bodies casting a vote. Attention is drawn to the possibility
18、that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. ISO/IEC 23988 was prepared by BSI (as BS 7988) and was adopted, under a special “fast-track procedure”, by Joint Technical Committe
19、e ISO/IEC JTC 1, Information technology, in parallel with its approval by the national bodies of ISO and IEC. BS ISO/IEC 23988:2007 v Introduction Growth in the power and capabilities of information technology (IT) has led to the increasing use of IT to deliver, score and record responses of tests a
20、nd assessments in a wide range of educational and other contexts. Suitably used, IT delivery offers advantages of speed and efficiency, better feedback and improvements in validity and reliability, but its increased use has raised issues about the security and fairness of IT-delivered assessments, a
21、s well as resulting in a wide range of different practices. The aims of this Standard are to provide a means of: showing that the delivery and scoring of the assessment are fair and do not disadvantage some groups of candidates, for example those who are not IT literate; showing that a summative ass
22、essment has been conducted under secure conditions and is the authentic work of the candidate; showing that the validity of the assessment is not compromised by IT delivery; providing evidence of the security of the assessment, which can be presented to regulatory and funding organisations (includin
23、g regulatory bodies in education and training, in industry or in financial services); establishing a consistent approach to the regulations for delivery, which should be of benefit to assessment centres who deal with more than one assessment distributor; giving an assurance of quality to purchasers
24、of “off-the-shelf” assessment software. It is envisaged that the achievement of these aims will enhance the status of IT-delivered assessments and assessment software and encourage their wider use in situations where they are beneficial. Users attention is drawn to any existing domain-specific legis
25、lation covering the subject matter of this Standard. This could include, but is not limited to legislation relating to disability, special educational needs, data protection, privacy, freedom of information, language and health and safety in relation to equipment or a broader work environment contex
26、t. This Standard takes the form of guidance and recommendations. It should not be quoted as if it were a specification, and particular care should be taken to ensure that claims of compliance are not misleading. A Standard does not purport to include all the necessary provisions of a contract. Users
27、 of Standards are responsible for their correct application. Compliance with a Standard does not of itself confer immunity from legal obligations. This Standard is intended for organisations involved in the use of IT for the delivery of assessments, including (but not limited to): universities, coll
28、eges, learning centres, and schools who assess their students, for diagnostic, formative and summative (final test) purposes; organisations which deliver and/or award educational examinations; professional bodies, industry organisations and others who deliver and/or award examinations or assessments
29、 in vocational subjects; producers and distributors of IT certification tests; assessment centres which administer assessments locally; BS ISO/IEC 23988:2007vi open, distance, or e-learning centres and other organisations which may provide assessment facilities on an occasional basis; training compa
30、nies, employers and governmental/military organisations providing assessments as part of vocational education and training; organisations providing assessments required for regulatory purposes, for example a financial services company might be required to assess its sales people for product knowledg
31、e, or a pharmaceutical company might be required to assess its staff on safety procedures; open learning and distance learning material providers, including on-line universities and commercial publishers and distributors of learning materials, who incorporate assessments in their material; producers
32、 of item banks, quizzes and “tests” available as revision aids. This Standard is also relevant to developers of software for delivering assessments, who will need to provide software which enables their clients to comply with this Standard. This Standard distinguishes three main roles in the IT deli
33、very of assessments: assessment sponsors, responsible for assessment content and award of certificates; assessment distributors, responsible for delivering assessments via IT including developing or specifying the delivery software; assessment centres, where the assessments are taken. The roles invo
34、lved in the different stages of the assessment life cycle (see 1.3) are combined in different ways by the organisations involved and not all organisations are involved in all roles. Thus, a university may combine the roles of assessment sponsor, assessment distributor and assessment centre, whilst t
35、he assessments distributed by an awarding body (as assessment sponsor and distributor) are normally taken in assessment centres which are separate organisations. This Standard therefore recommends the action to be taken in relation to each of these three roles, irrespective of the type of organisati
36、on undertaking the role. The scenarios in Annex A give examples of how this can work in practice. The roles of the different organisations are often inter-related, especially in high-stakes assessment. For example, the assessment distributor or awarding organisation might have an overall responsibil
37、ity for the integrity of the whole process, including monitoring assessment centres. Assessment centres need to comply with the general regulations of assessment distributors, as well as with those which are specific to the use of IT. It should be noted that some of the organisations to which this S
38、tandard is relevant may also need to comply with domain-specific requirements of regulatory authorities in relation to the design and conduct of assessments, including pedagogical aspects. Where the candidates are employees of the assessment centre, there may also be more specific legislative requir
39、ements. BS ISO/IEC 23988:2007 1 Information technology A code of practice for the use of information technology (IT) in the delivery of assessments 1 Scope 1.1 General This Standard gives recommendations on the use of information technology (IT) to deliver assessments to candidates and to record and
40、 score their responses. Its scope is defined in terms of three dimensions: the types of assessment to which it applies, the stages of the assessment “life cycle” to which it applies and this Standards focus on specifically IT aspects. 1.2 Types of assessment This Standard is relevant to a wide range
41、 of assessments, including: assessments used in education (both compulsory and post-compulsory), training and compliance (e.g. compliance with legislation relating to health and safety or financial services); assessments of knowledge, understanding and skills (i.e. “achievement tests”), but not psyc
42、hological tests of aptitude and personality; high-stakes assessments and examinations and also low-stakes assessments used for feedback on progress, identification of learning needs, self-assessment and remediation; assessments which include feedback, as well as those which provide only a result; bo
43、th fixed-date, test-windows and on-demand assessments; both items which can be scored by computer and the delivery (but not scoring) of items or tasks which are delivered using IT, but have to be referred to a human marker for scoring; however, the use of IT for scoring lengthy free-text responses (
44、“essays” and similar) is excluded; a wide range of computer-scorable assessments, including not only “objective tests” (multiple-choice and other item types), but also assessments of keyboarding skills and software use; NOTE Items can include graphics, multimedia and access to data, case studies, et
45、c. This Standard does not, however, cover the use of specialist simulations (e.g. of industrial processes or driving/piloting). assessments taken in universities, academies, colleges, high-schools, training centres, schools and assessment centres and also assessments taken in less formal settings, i
46、ncluding learning centres and in the workplace; assessments which are set, taken and scored within a single organisation (for example a university or a company) and assessments taken in an organisation separate from the one responsible for the assessment content; assessments delivered in a variety o
47、f ways, including on-line, on local networks and on stand-alone computers. Clause 9 of this Standard is also applicable to the use of IT for the transmission of candidates coursework. BS ISO/IEC 23988:20072 1.3 Assessment life cycle Although assessment procedures vary, the typical life cycle of asse
48、ssment consists of the following steps: a) identification of need to assess; b) design of outcomes/assessment methodology; c) preparation and calibration; d) pre-registration (includes payment); e) distribution 1) ; f) authentication (includes identification) 1 ) ; g) delivery 1) ; h) response retur
49、n 1) ; i) scoring, result determination and/or feedback 1) ; j) data return 1) ; k) analysis; l) appeals; m) certification. Preparation of assessment content is outside the scope of this Standard, but where pretesting is undertaken using IT for delivery, the relevant clauses of this Standard should be taken into consideration. 1.4 Focus on specifically IT aspects The emphasis throughout this Standard is on the additional or
