1、_ SAE Technical Standards Board Rules provide that: “This report is published by SAE to advance the state of technical and engineering sciences. The use of this report is entirely voluntary, and its applicability and suitability for any particular use, including any patent infringement arising there
2、from, is the sole responsibility of the user.” SAE reviews each technical report at least every five years at which time it may be reaffirmed, revised, or cancelled. SAE invites your written comments and suggestions. Copyright 2008 SAE International All rights reserved. No part of this publication m
3、ay be reproduced, stored in a retrieval system or transmitted, in any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, without the prior written permission of SAE. TO PLACE A DOCUMENT ORDER: Tel: 877-606-7323 (inside USA and Canada) Tel: 724-776-4970 (outside USA)
4、 Fax: 724-776-0790 Email: CustomerServicesae.org SAE WEB ADDRESS: http:/www.sae.org J2450/1 MAY2008 SURFACE VEHICLE INFORMATION REPORT Issued 2008-05 SAE J2450 Supplemental Training Document RATIONALE Not Applicable. FOREWORD The SAE J2450 Translation Quality Metric includes detailed explanation of
5、the rules and instructions for scoring documents. However, SAE J2450 is a reference document, not a training document. This Supplemental Training Document addresses practical application of the Translation Quality Metric. The objectives of this document are as follows: To present experiences of some
6、 clients who have used SAE J2450 as part of their translation process. To describe the skills of and the resources available to an ideal evaluator. To demonstrate application of SAE J2450 through detailed examples and commentary. To capture some frequently asked questions and answers. SAE J2450/1 Is
7、sued MAY2008 - 2 - TABLE OF CONTENTS 1. SCOPE 2 2. REFERENCES 2 2.1 Applicable Publications . 2 2.1.1 SAE Publication 2 3. HOW TO USE THIS DOCUMENT 3 4. TECHNICAL REQUIREMENTS / CONTENT. 3 4.1 Overview for Clients 3 4.1.1 Experiences of Companies that have Used SAE J2450 3 4.1.2 Practical Applicatio
8、n 3 4.1.3 Setting Requirements . 4 4.2 Overview for Evaluators 5 4.2.1 Materials Required 5 4.2.2 Qualifications. 5 4.3 Training for Evaluators 6 4.3.1 General Comments. 6 4.3.2 Quiz. 6 4.3.3 Demonstration. 7 4.3.4 Exercise 11 4.4 FAQ. 11 5. NOTES 13 5.1 Marginal Indicia. 13 APPENDIX A PRACTICE TEXT
9、S . 14 A.1 ENGLISH CANADIAN FRENCH 15 A.2 ENGLISH EUROPEAN FRENCH 35 A.3 ENGLISH EUROPEAN SPANISH . 59 A.4 ENGLISH MEXICAN SPANISH. 81 A.5 ENGLISH DUTCH 98 A.6 ENGLISH GERMAN 119 1. SCOPE This supplement, which is a living document, is meant to provide both clients and translation suppliers with som
10、e suggestions for integrating SAE J2450 into their business practices. It is intended for the use of clients, trainers who wish to develop new evaluators, and those who wish to self-train. 2. REFERENCES 2.1 Applicable Publications The following publications form a part of this specification to the e
11、xtent specified herein. Unless otherwise indicated, the latest version of SAE publications shall apply. 2.1.1 SAE Publication Available from SAE International, 400 Commonwealth Drive, Warrendale, PA 15096-0001, Tel: 877-606-7323 (inside USA and Canada) or 724-776-4970 (outside USA), www.sae.org. SAE
12、 J2450 Translation Quality Metric SAE J2450/1 Issued MAY2008 - 3 - 3. HOW TO USE THIS DOCUMENT The Overview for Clients section gives background information and suggests strategies for translation clients who use SAE J2450 as part of their quality assurance process. The Overview for Evaluators secti
13、on advises evaluators and their trainers on the materials and skills needed to use the metric. The Training for Evaluators section demonstrates the application of the metric in detail. Questions of general interest are addressed in the FAQ. Trainees can try their hand at scoring documents by using t
14、he practice texts in the Appendix. 4. TECHNICAL REQUIREMENTS / CONTENT 4.1 Overview for Clients 4.1.1 Experiences of Companies that have Used SAE J2450 The experiences of two automotive companies that have made extensive use of SAE J2450 are recounted in the following articles: Don Sirena. Mission I
15、mpossible: Improve Quality, Time and Speed At the Same Time (Using SAE J2450 to Do the Impossible). Nestor Rychtyckyj. An Assessment of Machine Translation for Vehicle Assembly Process Planning at Ford Motor Company. 4.1.2 Practical Application Each client must decide how best to apply SAE J2450 and
16、 how to use the information that it yields. The following scenarios demonstrate a few possible methods. One client company has used SAE J2450 in order to review both the quality of translation and the efficiency of the translation process. The company translates millions of words of service informat
17、ion into six target languages. It was decided to evaluate small samples of each deliverable, and to pay more attention to high-level trends of scores than to scores of individual projects. The translation process for each language pair allowed for draft and final translation phases; samples were eva
18、luated at each phase. The following benefits were reaped: The client was able to chart linguistic quality improvement for each language pair, predicting how long it would take a provider to meet quality expectations for new target languages. As quality scores at the two phases grew closer for each l
19、anguage pair, the client and provider were able to confidently strike the edit phase from the process. This cut time off the process without sacrificing quality. Taking the other extreme, a company might decide to evaluate each file of a deliverable in its entirety, and issue a pass/fail status to e
20、ach. The pass/fail could be based upon the overall document score, or on the types of errors. For example, a client who was particularly concerned about consistent terminology might decide not to publish files that contain Wrong Term errors. Such files would be corrected before publication. One proj
21、ect issued machine-translated service information text that was post-edited by human translators before publication. The client instructed the translation provider to correct only errors that fell into the SAE J2450 categories. This instruction made the role of the post-editor very clear. The final
22、product was free of linguistic errors, and the lean process of machine translation was not encumbered by unnecessarily time-consuming editing. SAE J2450/1 Issued MAY2008 - 4 - A client might also see benefits in modifying their application of SAE J2450. A client may stipulate that specific errors al
23、ways receive a predetermined categorization. For example, many languages have equivalent terms. A client could require that violation of the glossary always be categorized as a Wrong Term Serious, even if a translated term is perfectly comprehensible in the target language. A client might ask evalua
24、tors to provide comments along with the markups (this is out of the scope of SAE J2450, as written). In very specialized situations where the authoring and translation of text occur in the same system, and SAE J2450 evaluators are familiar with both phases, a client might graft causal analysis into
25、the quality evaluation process. This could be done with tags or meta-rules that additionally classify errors according to their cause. For example, in systems that have built-in bilingual glossaries, it could be noted that a source term was mapped to an incorrect target term. (This, too, is out of t
26、he scope of SAE J2450, as written.) The purpose of this Supplemental Training Document is to support SAE J2450 as it is written. 4.1.3 Setting Requirements A client company that chooses to make SAE J2450 evaluation part of its business practice must determine how best to do so. Experienced translati
27、on providers can certainly advise a client, but it is ultimately the responsibility of the client to set the following requirements: Which texts require evaluation, and for which target languages. Whether evaluation should be conducted on samples or entire deliverables. If samples are to be evaluate
28、d, a client must decide on a meaningful sample size. If a deliverable contains translated segments from more than one source (e.g., human translation, machine translation, and translation memory), the client must decide whether these segments should be considered separately. The point in the transla
29、tion process at which evaluation will occur. Reporting methods and timing. Acceptable scores for each deliverable type and language pair. The client must also determine what action will be taken for scores that are not acceptable. Any special requirements. It is also recommended that the client prov
30、ide a glossary, if one is available, and inform the translation provider of any preferred published glossaries or dictionaries. Please note: The Wrong Term category is the only error category in SAE J2450 that instructs an evaluator to refer to an external reference source. A robust glossary, whethe
31、r client-defined or not, can contribute greatly to consistency and accuracy in text. Coupled with such a glossary, the WT error category can be a powerful tool for ensuring consistent use of approved terminology. (Such an application is outside the scope of the metric, which measures quality rather
32、than prescribing corrections to errors. However, it is worth mentioning.) It is recommended that the evaluator remain anonymous to the team and, in turn, that the identity of the individual translators is not known to the evaluator. These steps help to ensure objectivity in scoring and independence
33、on the part of the evaluator. There may, however, be process advantages to incorporating the evaluation into process steps, such as the edit or proofread process and these options could be explored by either client or translation provider depending on needs. Regardless of the scenario employed, resu
34、lts from the evaluation should be shared with the translators in such a way as to improve performance and increase learning. SAE J2450/1 Issued MAY2008 - 5 - FIGURE 1 ACCEPTABLE THRESHOLD Figure 1 illustrates two features of possible trends in translation quality, as measured by SAE J2450: progressi
35、vely lower scores and a tendency of scores to remain under a clients acceptable threshold. SAE does not provide certification of SAE J2450 evaluators, nor does SAE regulate the use of the metric in client-provider relationships. Any requirements of providers in regards to SAE J2450 are contractual m
36、atters between clients and providers. 4.2 Overview for Evaluators 4.2.1 Materials Required Evaluators must have the following items at hand in order to conduct an SAE J2450 evaluation: SAE J2450 Translation Quality Metric. Source and target language versions of the files. The clients glossary and/or
37、 any other agreed-upon glossaries, if available. The evaluator must be sure to use the same glossary and reference documentation used by the translation team. Any special instructions set by the client. 4.2.2 Qualifications SAE J2450 states that an evaluator should have thorough knowledge of the met
38、ric, including the general comments as well as the categories. An experienced translation company suggests these additional qualifications, which it seeks in new evaluators: Thorough knowledge of the source language and native fluency in the target language. Experience in evaluating translation work
39、. Technical training and more than 5 years of experience as a specialized automotive translator. The ability to be objective and fair. SAE J2450/1 Issued MAY2008 - 6 - 4.3 Training for Evaluators 4.3.1 General Comments Refer to section 4.2 of SAE J2450, Guidelines for Evaluators, for detailed instru
40、ctions on identifying and marking errors in text, and for scoring documents. Experienced evaluators add these comments: Essentially, the metric takes a functional approach. It measures the effect of a translation on the end user, in the intended environment. The metric measures linguistic errors onl
41、y. It is designed for evaluation of translated service information, where style, tone and register are not as important as they might be for owners manuals or marketing material. One of the distinguishing features of this metric is the meta-rules. They ensure that all evaluators follow the same prac
42、tice when an arbitrary choice is necessary, thus achieving greater consistency overall. The two sub-categories serious and minor can suggest the effect of an error on the end user. If following incorrectly translated instructions could cause injury to a user, then the errors in question should be ma
43、rked as “serious.” If the meaning of the text is substantially changed or obscured by a translation error, then the error is probably serious. Remember at all times that, as an evaluator, you are not meant to hide, correct, or approve of errors. The goal of SAE J2450 is nothing more than to give a s
44、core to a translation. Deciding whether a translation is good or bad, or assessing the reason for errors, is beyond the task of an evaluator. 4.3.2 Quiz This quiz offers evaluators an opportunity to test their knowledge of the error categories before looking at the Demonstration. To which error cate
45、gory does each of the following descriptions refer? _ 1. A graphic which contains source language text has been deleted from the target language deliverable. _ 2. There is a superfluous or extra block of text that has no relevance to the source text. _ 3. A term is inconsistent with other translatio
46、ns of the source language term in the same document or type of document (unless the context for the source language term justifies the use of a different target language term). _ 4. The target language text contains an error according to the punctuation rules for that language. _ 5. A target languag
47、e term is written in an incorrect or inappropriate writing system for the target language. _ 6. The target language words are correct, but in the wrong linear order according to the syntactic rules of the target language. _ 7. A translation denotes a concept in the target language that is different
48、from the concept denoted by the source language. 1 OM, 2 ME, 3 WT, 4 PE, 5 SP, 6 SE, 7 WM SAE J2450/1 Issued MAY2008 - 7 - 4.3.3 Demonstration The following pages are an illustration of the instructions given in section 4.2 of SAE J2450. A typical repair procedure is considered. For the sake of simp
49、licity, the text is presented in English only. Please consider the version “Mode Actuator Replacement Correct” a flawless target-language rendering of this service procedure (for the purpose of this illustration, the source language is not relevant). The second version, “Mode Actuator Replacement With Errors” is
