1、INTERNATIONAL TELECOMMUNICATION UNION ITU-T TELECOMMUNICATION STANDARDIZATION SECTOR OF ITU DATA NETWORKS AND OPEN SYSTEM COMMUNICATIONS CONFORMANCE TESTING OPEN SYSTEMS INTERCONNECTION - X.293 (04/95) OS1 CONFORMANCE TESTING METHODOLOGY AND FRAMEWORK FOR PROTOCOL RECOMMENDATIONS REALIZATION FOR ITU
2、-T APPLICATIONS - TEST ITU-T Recommendation X.293 (Previously “CCITT Recommendation“) ITU-T RECMM*X=293 %5 H 4Ab259L Ob09335 524 M FOREWORD The IT-T (Telecommunication Standardization Sector) is a permanent organ of the International Telecommunication Union (). The -T is responsible for studying tec
3、hnical, operating and tariff questions and issuing Recommen- dations on them with a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Conference (WTSC), which meets every four years, establishes the topics for study by the ITU-T Study Groups w
4、hich, in their turn, produce Recommendations on these topics. The approval of Recommendations by the Members of the -T is covered by the procedure laid down in WTSC Resolution No. 1 (Helsinki, March 1-12, 1993). -T Recommendation X.293 was revised by -T Study Group 7 (1993-1996) and was approved und
5、er the WTSC Resolution No. 1 procedure on the 10th of April 1995. NOTE In this Recommendation, the expression “Administration” is used for conciseness to indicate both a telecommunication administration and a recognized operating agency. O 1996 All rights reserved. No part of this publication may be
6、 reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from the ITU. ITU-T RECMN*X-273 95 = 4862573 060733b 460 = Subject area PUBLIC DATA NETWORKS Services and Facilities Interfaces Transmission, Signalling
7、and Switching Network Aspects Maintenance Administrative Arrangements OPEN SYSTEMS INTERCONNECTION Model and Notation Service Definitions ITU-T X-SERIES RECOMMENDATIONS Recommendation Series X. l-X. 19 X.20-X.49 X.50-X.89 X.90-X. 149 X.150-X.179 X.180-X. 199 x.200-x.209 X.210-X.219 DATA NETWORKS AND
8、 OPEN SYSTEM COMMUNICATIONS Connection-mode Protocol Specifications Connectionless-mode Protocol Specifications (February 1994) X.220-X.229 X.230-X.239 ORGANIZATION OF X-SERIES RECOMMENDATIONS PICS Proformas Protocol Identification Security Protocols X.240-X.259 X.260-X.269 X.270-X.279 t Layer Manag
9、ed Objects Conformance Testing; X.280-X.289 . X.290-X.299 - 1 INTERWORKING BETWEEN NETWORKS General x.300-x.349 Mobile Data Transmission Systems X.350-X.369 Management X.370-X.399 MESSAGE HANDLING SYSTEMS x.400-x.499 DIRECTORY x.500-x.599 L I OS1 NETWORKING AND SYSTEM ASPECTS I I Networking X.600-X.
10、649 Naming, Addressing and Registration Abstract Syntax Notation One (ASN. 1) X.650-X.679 X.680-X.699 OS1 MANAGEMENT SECURITY x.700-x.799 X. 800-X. 849 OS1 APPLICATIONS Commitment, Concurrency and Recovery Transaction Processing Remote Operations OPEN DISTRIBUTED PROCESSING X.850-X.859 X.860-X.879 X
11、.880-X.899 x.900-x.999 ITU-T RECMN*X-293 95 m 4862591 Ob09337 3T7 m CONTENTS 1 Scope 2 References 3 Definitions 4 Abbreviations . 5 Test realization overview . 5.1 Introduction 5.2 5.3 5.4 Selected and parameterized test suites 5.5 The Parameterized Executable Test Suites (PETS) Requirements concern
12、ing test realization . 6.1 Introduction 6.2 6.3 6.4 6.5 6.6 Means of Testing composition Means of Testing (MOT) functionality 6 Requirements concerning the Means of Testing . Requirements concerning Executable Test Suite (ETS) denvation Requirements concerning conformance log Requirements on the pro
13、gression of the KIT proforma(s) 7 Compliance Appendix I - Additional guidance on test realization Additional guidance on the Means of Testing (MOT) Additional guidance on conformance log . Requirements concerning other documentation 1.1 1.2 1.3 1.4 Additional guidance on the Executable Test Suite (E
14、TS) derivation process Additional guidance on documentation Page 1 1 2 2 3 3 3 3 4 4 4 4 4 5 6 7 7 8 8 8 11 12 12 Recommendation X.293 (04/95) i ITU-T RECMN*X.293 95 9 48b259L Ob09338 233 W SUMMARY This Recommendation specifies requirements and gives guidance concerning the realization of Means of T
15、esting (MOT) for Implementation under Test (IiJTs), in conformance with a reference Abstract Test Suite (ATS) specified in compliance with Recommendation X.29 1. Test realization involves a protocol, multiple protocols or profile. The text was developed jointly with ISODEC JTC 1 and the main intent
16、of this revision is to reflect the changes as a result of the work on Protocol Profile Testing Methodology (PPTM) and on Multi-Party Testing Methodology (MPyTM). ii Recommendation X.293 (04/95) INTRODUCTION Recommendations X.290 and X.291 define a general methodology for testing the conformance of i
17、mplementations to OS1 protocol specifications and/or transfer syntaxes issued as -T Recommendations or International Standards; these Recommendations also put requirements on the production of OS1 conformance testing specifications and Abstract Test Suites (ATS) specifications. Recommendation X.292
18、defines a standardized test notation, the Tree and Tabular Combined Notation (TCN), for the specification of an ATS. Once OS1 conformance testing specifications and ATSs in compliance with Recommendation X.291 are available, the test results obtained by different test laboratories should be comparab
19、le, they they base their test operations on the same reference ATS specification. Recommendation X.294 puts requirements on the conformance assessment process, so that test results can be compared with those of other test laboratories, and can have a wide acceptance. This Recommendation concentrates
20、 on the intermediate stage, namely, test realization. Before the test preparation can begin, a Means of Testing (MOT) the Implementation under Test (IUT) has to be made available. Test realization are those organizations which take responsibility for providing such an MOT. Recommendation X.295 defin
21、es a general methodology for specifying the requirements for the production of Profile Test Specification (PTS) for conformance testing against profiles. Recommendation X.296 defines how to express and document the conformance of systems to base specifications and profiles, using Implementation Conf
22、ormance Statements (ICs) based on standardized ICs proformas and profile Requirements Lists (RLs). This Recommendation places requirements on test realization, to ensure that the execution of test cases reflects the behaviour specified in the reference ATS specification. In this way, the purpose of
23、the ATS is achieved. This Recommendation is also published as ISO/IEC 9646-4: 1994. Recommendation X.293 . (04/95) iii ITU-T RECMN*X.293 95 4882571 Ob09340 771 = I- - ITU-T RECMN*X=293 95 m 48b259L 0607341 828 m Recommendation X.293 OS1 CONFORMANCE TESTING METHODOLOGY AND FRAMEWORK FOR PROTOCOL RECO
24、MMENDATIONS FOR ITU-T APPLICATIONS - TEST REALIZATION) (Geneva, 1992; revised in 1995) 1 Scope This Recommendation specifies requirements and gives guidance concerning the realization of a Means of Testing (MOT), in conformance with a reference Abstract Test Suite (ATS) specification, specified in c
25、ompliance with Recommendation X.29 1. This Recommendation is applicable to producing MOTS for testing a single protocol, multiple protocols or a profile. NOTE - This implies the use of ATSs as defined in Recommendation X.292. However, within this Recommendation, the term ATS also applies to the addi
26、tional abstract test cases designed for testing a specific profile, and included in the Profile Specific Test Specification (PSTS). These requirements are limited to those aspects of an MOT which can be mapped on to the abstract testing functions defined in Recommendation X.290, or which are essenti
27、al to a proper use of the ATS. Such aspects might include a facility to produce conformance log, or the progression of the Implementation extra Information for Testing UT) proformas. Further implementation details of test systems and Upper Testers are outside the scope of this Recommendation. Accept
28、ance, validation and installation of MOT are outside the scope of this Recommendation. 2 References The following Recommendations, and other references contain provisions which, through reference in this text, constitute provisions of this Recommendation. At the time of publication, the editions ind
29、icated were valid. All Recommendations and other references are subject to revision: all users of this Recommendation are therefore encouraged to investigate the possibility of applying the most recent edition of the Recommendations and other references listed below. A list of currently valid IT-T R
30、ecommendations is regularly published. IT-T Recommendation X.200 (1994) I ISO/IEC 7498-1:1994, Information technology - Open Systems Interconnection - Basic Reference Model: The Basic Model. - ITU-T Recommendation X.290 (1995). OS1 conformance testing methodology and framework for protocol Recommend
31、ations for ITU-T applications - General Concepts. ISOAEC 9646- 1 : 1994, Information technology - Open Systems Interconnection - Conformance testing methodology and framework - Part I: General concepts. ITU-T Recommendation X.291 (1993, OS1 conformance testing methodology and framework for protocol
32、Recommendations for ITU-T applications -Abstract test suite specification. ISOIEC 9646-2: 1994, Information technology - Open Systems Interconnection - Conformance testing methodology andframework - Part 2: Abstract test suite specification. CCITT Recommendation X.292 (1992). OSI conformance testing
33、 methodology and framework for protocol Recommendations for CCIT applications - The Tree and Tabular Combined Notation (TTCN). ISOIEC 9646-3: 1992, Information technology - Open Systems Interconnection - Conformance testing methodology and framework - Part 3: The Tree and Tabular Combined Notation (
34、TTCN). 1 Recommendation X.293 and ISOAEC 9646-4, Information technology - Open Systems Interconnection - Conformance Testing Methodology and Framework - Part 4: Test realization, are technically aligned. Recommendation X.293 . (04/95) 1 ISO/IEC 9646-3:( 1992) Amd 12), Information technology - Open S
35、ystems Interconnection - Conformance testing methodology and framework - Part 3: The Tree and Tabular Combined Notation (TCN) -Amendment 1: TCN extensions. U-T Recommendation X.294 (1995), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications - Require
36、ments on test laboratories and clients for the conformance assessment process. ISOmC 9646-5: 1994, Information technology - Open Systems Interconnection - Conformance testing methodology andframework - Part 5: Requirements on test aboratories and clients for the conformance assessment process. ITU-T
37、 Recommendation X.295 (1999, OS1 conformance testing methodology and framework for protocol Recommendations for ITU-T applications - Protocol profile testing specification. ISO/IEC 9646-6: 1994, Information technology - Open Systems Interconnection - Conformance testing methodology and framework - P
38、art 6: Protocol profile test specification. ITU-T Recommendation X.29631, OSI conformance testing methodology and framework for protocol Recommendations for PU-T applications - Implementation conformance statements. ISO/IEC 9646-7: 1995, Information technology - Open Systems Interconnection - Confor
39、mance testing methodology and framework - Part 7: Implementation conformance statement. - - - 3 Definitions For the purposes of this Recommendation, all the definitions given in Recommendation X.290 apply. In addition, the definition of TCN coordination point is given in Recommendation X.292. 4 Abbr
40、eviations For the purpose of this Recommendation, the following abbreviations given in Recommendation X.290 apply: ASP Abstract Service Primitive ATS Abstract Test Suite BIT Basic Interconnection Tests ETS Executable Test Suite ICs Implementation Conformance Statement ISP International Standardized
41、Profile IUT Implementation under Test IXIT LT Lower Tester LTCF Lower Tester Control Function MOT Means of Testing IUTs MPyT Multi-Party Testing OS1 Open Systems Interconnection PATS Parameterized Abstract Test Suite PCO Point of Control and Observation PDU Protocol Data Unit Implementation extra In
42、formation for Testing 2, To be published. 3, Presently at the stage of draft. 2 Recommendation X.293 (04/95) ITU-T RECMN*X=293 95 48b259L Ob09343 bTO PETS PSTS PTS RL SATS SETS SPyT SUT TCP TMP TTCN UT Parameterized Executable Test Suite Profile Specific Test Specification Profile Test Specification
43、 Requirements List Selected Abstract Test Suite Selected Executable Test Suite Single-Party Testing System under Test Test Coordination Procedures Test Management Protocol Tree and Tabular Combined Notation Upper Tester 5 Test realization overview 5.1 Introduction Test realization is the process of
44、producing a Means of Testing (MOT) for testing the conformance of ITs to OS1 protocol specification, based on a conformance testing specification and its Abstract Test Suite (ATS). 5.2 Means of Testing composition An MOT is a combination of equipment and procedures that can perform: a) the derivatio
45、n of test cases; b) the selection of test cases; c) the parameterization of test cases; d) the execution of test cases; and e) the production of a conformance log. With respect to a conformance assessment for a base protocol specification, the MOT provides a realization of an ATS for that protocol,
46、in conformance with a reference ATS specification. With respect to a conformance assessment for a profile, the MOT provides a realization of each ATS, including the additional abstract test cases, if any, in conformance with the Profile Test Specification Summary (PTS-Summary). 5.3 In the derivation
47、 process, the abstract test cases of the ATS are converted into executable test cases forming an Executable Test Suite (ETS). The selection process for a base specification begins with the complete ATS. The inappropriate test cases for the IUT are deselected according to the provisions of the Implem
48、entation Conformance Statement (ICs) and the Implementation Extra Information for Testing (EUT). In the case of profile testing, the selection process begins with the list of test cases applicable to the profile, which is part of the Profile Specific Test Specification (PSTS). The inappropriate test
49、 cases for the IUT are deselected, according to the provisions of the profile ICs and profile EUT. In the parameterization process, the parameters in the selected test cases are given appropriate values, according to the provisions of the appropriate KIT (and possibly of the ICSs). The MOT is then used in the conformance assessment process for an IUT, executing the test cases in a test campaign, resulting in the production of a conformance log. Means of Testing (MOT) functionality Recommendation X.293 . (04/95) 3 5.4 I
