1、 International Telecommunication Union ITU-T Series XTELECOMMUNICATION STANDARDIZATION SECTOR OF ITU Supplement 4(09/2008) SERIES X: DATA NETWORKS, OPEN SYSTEM COMMUNICATIONS AND SECURITY ITU-T X.290-series Supplement on generic approach to interoperability testing ITU-T X-series Recommendations Sup
2、plement 4 ITU-T X-SERIES RECOMMENDATIONS DATA NETWORKS, OPEN SYSTEM COMMUNICATIONS AND SECURITY PUBLIC DATA NETWORKS X.1X.199 OPEN SYSTEMS INTERCONNECTION X.200X.299 INTERWORKING BETWEEN NETWORKS X.300X.399 MESSAGE HANDLING SYSTEMS X.400X.499DIRECTORY X.500X.599 OSI NETWORKING AND SYSTEM ASPECTS X.6
3、00X.699 OSI MANAGEMENT X.700X.799 SECURITY X.800X.849 OSI APPLICATIONS X.850X.899 OPEN DISTRIBUTED PROCESSING X.900X.999 INFORMATION AND NETWORK SECURITY General security aspects X.1000X.1029 Network security X.1030X.1049 Security management X.1050X.1069 Telebiometrics X.1080X.1099 SECURE APPLICATIO
4、NS AND SERVICES Multicast security X.1100X.1109 Home network security X.1110X.1119 Mobile security X.1120X.1139 Web security X.1140X.1149 Security protocols X.1150X.1159 Peer-to-peer security X.1160X.1169 Networked ID security X.1170X.1179 IPTV security X.1180X.1199 CYBERSPACE SECURITY Cybersecurity
5、 X.1200X.1229 Countering spam X.1230X.1249 Identity management X.1250X.1279 SECURE APPLICATIONS AND SERVICES Emergency communications X.1300X.1309 Ubiquitous sensor network security X.1310X.1339 For further details, please refer to the list of ITU-T Recommendations. X series Supplement 4 (09/2008) i
6、 Supplement 4 to ITU-T X-series Recommendations ITU-T X.290-series Supplement on generic approach to interoperability testing Summary Supplement 4 to ITU-T X.290-series Recommendations defines the relevant principles, methodology and architectures to serve as a foundation for interoperability testin
7、g and the development of interoperability test suites. Source Supplement 4 to ITU-T X-series Recommendations was agreed on 19 September 2008 by ITU-T Study Group 17 (2005-2008). ii X series Supplement 4 (09/2008) FOREWORD The International Telecommunication Union (ITU) is the United Nations speciali
8、zed agency in the field of telecommunications, information and communication technologies (ICTs). The ITU Telecommunication Standardization Sector (ITU-T) is a permanent organ of ITU. ITU-T is responsible for studying technical, operating and tariff questions and issuing Recommendations on them with
9、 a view to standardizing telecommunications on a worldwide basis. The World Telecommunication Standardization Assembly (WTSA), which meets every four years, establishes the topics for study by the ITU-T study groups which, in turn, produce Recommendations on these topics. The approval of ITU-T Recom
10、mendations is covered by the procedure laid down in WTSA Resolution 1. In some areas of information technology which fall within ITU-Ts purview, the necessary standards are prepared on a collaborative basis with ISO and IEC. NOTE In this publication, the expression “Administration“ is used for conci
11、seness to indicate both a telecommunication administration and a recognized operating agency. Compliance with this publication is voluntary. However, the publication may contain certain mandatory provisions (to ensure e.g. interoperability or applicability) and compliance with the publication is ach
12、ieved when all of these mandatory provisions are met. The words “shall“ or some other obligatory language such as “must“ and the negative equivalents are used to express requirements. The use of such words does not suggest that compliance with the publication is required of any party. INTELLECTUAL P
13、ROPERTY RIGHTS ITU draws attention to the possibility that the practice or implementation of this publication may involve the use of a claimed Intellectual Property Right. ITU takes no position concerning the evidence, validity or applicability of claimed Intellectual Property Rights, whether assert
14、ed by ITU members or others outside of the publication development process. As of the date of approval of this publication, ITU had not received notice of intellectual property, protected by patents, which may be required to implement this publication. However, implementers are cautioned that this m
15、ay not represent the latest information and are therefore strongly urged to consult the TSB patent database at http:/www.itu.int/ITU-T/ipr/. ITU 2009 All rights reserved. No part of this publication may be reproduced, by any means whatsoever, without the prior written permission of ITU. X series Sup
16、plement 4 (09/2008) iii CONTENTS Page 1 Scope 1 2 References. 1 3 Definitions 2 4 Abbreviations and acronyms 3 5 Types of testing 3 5.1 Interoperability testing 3 5.2 Conformance testing. 4 5.3 Combining interoperability testing and conformance testing 5 6 Interoperability testing process overview.
17、6 7 Basic concepts 6 7.1 Means of testing . 7 7.2 Equipment under test (EUT) 7 7.3 Qualified equipment (QE) 7 7.4 System under test (SUT) 8 7.5 Test interface 8 7.6 Test driver. 8 7.7 Test coordinator 9 7.8 Interoperability test cases . 9 7.9 Means of communication (MoC) . 9 8 Generic interoperabili
18、ty test architectures 9 8.1 Test architectures with a single QE 9 8.2 Test architectures with multiple QEs . 10 9 Developing interoperability tests 12 9.1 Overview 12 9.2 Specify abstract architecture. 13 9.3 Prepare draft IFS proforma. 14 9.4 Specify test suite structure 15 9.5 Write test purposes
19、. 15 9.6 Write test cases. 16 9.7 Validate test cases. 23 9.8 Finalize IFS 23 10 Interoperability testing process. 23 10.1 Overview 23 10.2 Prepare for testing. 24 10.3 Testing 26 10.4 Write test report 27 iv X series Supplement 4 (09/2008) Page Appendix I Example IFS (Internet Key Exchange protocol
20、, IKEv2). 28 I.1 Introduction 28 I.2 Instructions for completing the IFS proforma 28 I.4 IKEv2 entities. 29 Appendix II Example IFS (TIPHON Profile of SIP, Release 3) 34 II.1 Introduction 34 II.2 Instructions for completing the IFS proforma 34 II.3 IFS proforma 35 II.4 SIP entities 35 Bibliography.
21、40 X series Supplement 4 (09/2008) v Introduction This supplement provides a generic framework and methodology for interoperability testing of interconnected communication systems. The need for interoperability testing arises when it is required to demonstrate that two or more systems or system comp
22、onents are capable of communicating with each other. This supplement defines the relevant principles, methodology and architectures to serve as a foundation for interoperability testing and the development of interoperability test suites and is applicable to interoperability testing of protocols and
23、 also to interoperability testing of all areas of software. This supplement is complementary to, and may be used in conjunction with, testing methodologies and test specification languages defined in related ITU-T Recommendations such as: ITU-T X.290 through ITU-T X.296, and ITU-T Z.161 through ITU-
24、T Z.163 where the X.290-296 series addresses conformance and provides the methodology and framework for conformance, and the Z.161-163 series defines a general test scenarios description language for conformance testing and interoperability testing. A particularly related document in terms of it tec
25、hnical contents is Supplement 5 to ITU-T X-series Recommendations: ITU-T X.290-series: Supplement on interoperability testing framework and methodology, which deals with the foundational principles and issues that underlie specific interoperability testing approaches and on the basis of which intero
26、perability testing approaches can be carried out and assessed. On the other hand, this Supplement 4 to the ITU-T X.290-series of Recommendations targets at providing a general guidance on the specification and execution of interoperability tests for communication systems in next generation networks
27、(NGN). It is meant to be applied to communication equipment interoperability testing and in many places it gives specific guidance on how test suites can be written and interoperability testing can be carried out. In addition, Recommendations concerning ITU-T formal languages such as ASN.1, MSC, SDL
28、 and UML can be used in relation with this supplement for test data description, system behaviours and test scenarios descriptions, communication system modelling, and software modelling, respectively. This supplement is intended to assist ITU-T study groups responsible for developing protocol speci
29、fications, conformance test suites and interoperability test suites. It is also intended as a guide to the developers of interoperability test suites, test tool developers and test operators with the objective of achieving a common framework for testing. Specification writers would understand non-in
30、teroperation phenomena and their causes better so that they can be more informed and prepared to write interoperable specifications. System developers would be helped in developing interoperable systems and services. Interoperability test suites developers would know how to write practically complet
31、e interoperability test suites (i.e., they would know what needs to be tested and would also know the gap between what should be tested and what can be tested). Test operators would get help in understanding the causes of interoperability problems and in finding out how to fix problems. X series Sup
32、plement 4 (09/2008) 1 Supplement 4 to ITU-T X-series Recommendations ITU-T X.290-series Supplement on generic approach to interoperability testing 1 Scope This supplement gives general guidance on the specification and execution of interoperability tests for communication systems. It provides a fram
33、ework within which interoperability test specifications for a wide range of product types can be developed. The guidelines are expressed as recommendations rather than strict rules and leave enough freedom to allow test specifiers to adopt and adapt processes to suit each particular project while st
34、ill ensuring that test specifications accurately reflect the requirements of the base standards and can be executed consistently across a range of configurations. Interoperability testing is the structured and formal testing of functions supported remotely by two or more items of equipment communica
35、ting by means of standardized protocols. It is not the detailed verification of protocol requirements specified in a conformance test suite, neither is it the less formal development testing often associated with “plug-fest“ and “interop“ events (frequently referred to as “bake-offs“). Although some
36、 consideration is given within the methodology to the operating and reporting aspects of interoperability testing, the primary focus of this supplement is on the specification of interoperability testing architectures, test plans and test suites. 2 References ITU-T X.290 Recommendation ITU-T X.290 (
37、1995), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications General concepts. ITU-T X.291 Recommendation ITU-T X.291 (1995), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications Abstract test suite spec
38、ification. ITU-T X.292 Recommendation ITU-T X.292 (2002), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications The Tree and Tabular Combined Notation (TTCN). ITU-T X.293 Recommendation ITU-T X.293 (1995), OSI conformance testing methodology and framew
39、ork for protocol Recommendations for ITU-T applications Test realization. ITU-T X.294 Recommendation ITU-T X.294 (1995), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications Requirements on test laboratories and clients for the conformance assessment
40、process. ITU-T X.295 Recommendation ITU-T X.295 (1995), OSI conformance testing methodology and framework for protocol Recommendations for ITU-T applications Protocol profile test specification. ITU-T X.296 Recommendation ITU-T X.296 (1995), OSI conformance testing methodology and framework for prot
41、ocol Recommendations for ITU-T applications Implementation conformance statements. 2 X series Supplement 4 (09/2008) ITU-T Z.161 Recommendation ITU-T Z.161 (2007), Testing and Test Control Notation version 3: TTCN-3 core language. ITU-T Z.163 Recommendation ITU-T Z.163 (2007), Testing and Test Contr
42、ol Notation version 3: TTCN-3 graphical presentation format (GFT). ETSI TS 101 884 ETSI TS 101 884 V1.1.1 (2002), Telecommunications and Internet Protocol Harmonization Over Networks (TIPHON) Release 3; Technology Mapping; Implementation of TIPHON architecture using SIP. ETSI EG 202 107 ETSI EG 202
43、107 V1.1.1 (1999), Methods for Testing and Specification (MTS); Planning for validation and testing in the standards-making process. IETF RFC 3261 IETF RFC 3261 (2002), SIP: Session Initiation Protocol. IETF RFC 4306 IETF RFC 4306 (2005), Internet Key Exchange (IKEv2) Protocol. 3 Definitions This su
44、pplement defines the following terms: 3.1 conformance: Compliance with requirements specified in applicable ITU-T X.290-series of Recommendations. 3.2 conformance testing: Testing the extent to which an implementation under test (IUT) satisfies both static and dynamic conformance requirements. NOTE
45、The purpose of conformance testing is to determine to what extent a single implementation of a particular standard conforms to the individual requirements of that standard. 3.3 device: Item of software or hardware which either alone or in combination with other devices implements the requirements of
46、 a standardized specification. 3.4 equipment under test (EUT): Grouping of one or more devices which has not been previously shown to interoperate with previously qualified equipment (QE). 3.5 interoperability: Ability of two systems to interoperate using the same communication protocol. 3.6 interop
47、erability test suite: Collection of test cases designed to prove the ability of two (or more) systems to interoperate. 3.7 interoperability testing: Activity of proving that end-to-end functionality between (at least) two communicating systems is as required by the base standard(s) on which those sy
48、stems are based. 3.8 Interworking function (IWF): Translation of one protocol into another one so that two systems using two different communication protocols are able to interoperate. 3.9 qualified equipment (QE): Grouping of one or more devices that has been shown, by rigorous and well-defined tes
49、ting, to interoperate with other equipment. NOTE Once an EUT has been successfully tested against a QE, it may be considered to be a QE, itself. 3.10 system under test (SUT): One or more QEs and an EUT. 3.11 test case: Specification of the actions required to achieve a specific test purpose, starting in a stable testing state, ending in a stable testing state and defined in either natural language for manual operation or in a machine-readable language (such as TTCN-3) for automatic executio
