1、 Reference number ISO 16100-4:2006(E) ISO 2006INTERNATIONAL STANDARD ISO 16100-4 First edition 2006-12-15 Industrial automation systems and integration Manufacturing software capability profiling for interoperability Part 4: Conformance test methods, criteria and reports Systmes dautomatisation indu
2、strielle et intgration Profil daptitude du logiciel de fabrication pour interoprabilit Partie 4: Mthodes dessai, critres et rapports de conformit ISO 16100-4:2006(E) PDF disclaimer This PDF file may contain embedded typefaces. In accordance with Adobes licensing policy, this file may be printed or v
3、iewed but shall not be edited unless the typefaces which are embedded are licensed to and installed on the computer performing the editing. In downloading this file, parties accept therein the responsibility of not infringing Adobes licensing policy. The ISO Central Secretariat accepts no liability
4、in this area. Adobe is a trademark of Adobe Systems Incorporated. Details of the software products used to create this PDF file can be found in the General Info relative to the file; the PDF-creation parameters were optimized for printing. Every care has been taken to ensure that the file is suitabl
5、e for use by ISO member bodies. In the unlikely event that a problem relating to it is found, please inform the Central Secretariat at the address given below. ISO 2006 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any me
6、ans, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Case postale 56 CH-1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E-mail copy
7、rightiso.org Web www.iso.org Published in Switzerland ii ISO 2006 All rights reservedISO 16100-4:2006(E) ISO 2006 All rights reserved iiiContents Foreword .iv Introductionv 1 Scope.1 2 Normative references .1 3 Terms and definitions.2 4 Abbreviated terms 5 5 Conformance framework5 5.1 Conformance te
8、sting 5 5.2 Types of UUTs .6 5.3 Conformance test methodology 6 6 Conformance testing process9 6.1 “Create CSI“ activity .9 6.2 “Create ATC“ activity 11 6.3 “Create ETC“ activity11 6.4 “Test UUT“ activity11 7 Conformance of UUTs 12 7.1 Conformance of a capability class structure 12 7.2 Conformance o
9、f a capability template.14 7.3 Conformance of a capability profile 16 7.4 Conformance of a capability profile matcher23Annex A (informative) Conformance test for a capability profile24 Annex B (informative) Conformance test for a type 1 matcher.28 Bibliography.32 ISO 16100-4:2006(E) iv ISO 2006 All
10、rights reservedForeword ISO (the International Organization for Standardization) is a worldwide federation of national standards bodies (ISO member bodies). The work of preparing International Standards is normally carried out through ISO technical committees. Each member body interested in a subjec
11、t for which a technical committee has been established has the right to be represented on that committee. International organizations, governmental and non-governmental, in liaison with ISO, also take part in the work. ISO collaborates closely with the International Electrotechnical Commission (IEC)
12、 on all matters of electro-technical standardization. International Standards are drafted in accordance with the rules given in the ISO/IEC Directives. Draft International Standards adopted by the technical committees are circulated to the member bodies for voting. Publication as an International St
13、andard requires approval by at least 75 % of the member bodies casting a vote. Attention is drawn to the possibility that some of the elements of this part of ISO 16100 may be the subject of patent rights. ISO shall not be held responsible for identifying any or all such patent rights. ISO 16100 was
14、 prepared by Technical Committee ISO/TC 184, Industrial automation systems and integration, Subcommittee SC 5, Architecture, communications and integration frameworks. ISO 16100 consists of the following parts, under the general title Industrial automation systems and integration Manufacturing softw
15、are capability profiling for interoperability Part 1: Framework Part 2: Profiling methodology Part 3: Interface services, protocols and capability templates Part 4: Conformance test methods, criteria and reports The following part is under preparationPart 5: Methodology for profile matching using mu
16、ltiple capability classes ISO 16100-4:2006(E) ISO 2006 All rights reserved vIntroduction The motivation for ISO 16100 stems from the industrial and economic environment noted in the ISO/TC 184/SC5 strategic plan, in particular: a) a growing base of vendor-specific solutions; b) user difficulties in
17、applying standards; c) a need to move to modular sets of system integration tools; and d) a recognition that application software and the expertise to apply that software are assets of the enterprise. ISO 16100 is an International Standard for the computer-interpretable and human readable representa
18、tion of a software capability profile. Its goal is to provide a method to represent the capability of manufacturing software relative to its role throughout the life cycle of a manufacturing application, independent of a particular system architecture or implementation platform. Certain diagrams in
19、this part of ISO 16100 are constructed following UML conventions. Because not all concepts embodied in these diagrams are explained in the text, some familiarity with UML on the part of the reader is assumed. INTERNATIONAL STANDARD ISO 16100-4:2006(E) ISO 2006 All rights reserved 1Industrial automat
20、ion systems and integration Manufacturing software capability profiling for interoperability Part 4: Conformance test methods, criteria and reports1 Scope This part of ISO 16100 specifies the test method, the associated test criteria and the statement format used to evaluate and declare the degree o
21、f conformance of an implementation, i.e. a unit under test (UUT), to the requirements specified in other parts of ISO 16100. This part of ISO 16100 includes definitions intended to assist a manufacturer or supplier (first party), a user or purchaser (second party), or an independent body (third part
22、y) to perform the assessment for type evaluation. This part of ISO 16100 contains the following: an enumeration of those conformance aspects that can be used to determine whether an implementation conforms to ISO 16100; a definition of the conformance tests and statements used in declaring which asp
23、ects are met by an implementation; a description of the aspects to be included in a conformance statement; a set of rules to select valid or invalid combinations of aspects when they are combined. The following topics are not addressed in this part of ISO 16100: matters relating to marks or labels o
24、f conformance, certificates of conformance or manufacturers or suppliers declarations of conformance; dates of implementation or allocation of responsibilities to various parties making use of ISO 16100; requirements for production, execution or delivery procedures, unless it is impossible to specif
25、y adequately the conforming product, process or service, respectively, without doing so; requirements for quality control during production, execution or delivery of the product, process or service, respectively. 2 Normative references The following referenced documents are indispensable for the app
26、lication of this document. For dated references, only the edition cited applies. For undated references, the latest edition of the referenced document (including any amendments) applies. ISO 16100-1:2002 Industrial automation systems and integration Manufacturing software capability profiling for in
27、teroperability Part 1: Framework ISO 16100-2:2003 Industrial automation systems and integration Manufacturing software capability profiling for interoperability Part 2: Profiling methodology ISO 16100-4:2006(E) 2 ISO 2006 All rights reservedISO 16100-3:2005 Industrial automation systems and integrat
28、ion Manufacturing software capability profiling for interoperability Part 3: Interface services, protocols and capability templates REC-xml-20000814 Extensible Markup Language (XML) 1.0 Ed. 2 W3C Recommendation REC-xmlschema-1-20010502 XML Schema Part 1: Structures REC-xmlschema-2-20010502 XML Schem
29、a Part 2: Datatypes 3 Terms and definitions For the purposes of this document, the following terms and definitions apply. Some of these terms and definitions have been taken verbatim or were adapted from other standards. In such cases this is indicated in brackets with the specific part and subclaus
30、e of the standard given. 3.1 abstract test case specification, encapsulating at least one test purpose, that is independent of implementation platform, parameter values, and method adapted from ISO 10303-31:1994, 3.2.1 3.2 abstract test suite set of abstract test cases 3.3 capability set of function
31、s and services with a set of criteria for evaluating the performance of a capability provider ISO 16100-1:2002, 3.3 NOTE This definition differs from that given in ISO 15531-1 and ISO/DIS 19439, where capability is defined as the quality of being able to perform a given activity. See IEC 62264-1 for
32、 a general definition of capability. 3.4 capability class element within the capability profiling method that represents software unit functionality and behaviour with regard to the software units role in a manufacturing activity ISO 16100-2:2003, 3.3 3.5 capability profiling selection of a set of o
33、ffered services defined by a particular interface within a software interoperability framework ISO 16100-1:2002, 3.4 ISO 16100-4:2006(E) ISO 2006 All rights reserved 33.6 conformance conformity relation between a specification and a real implementation that is realized when any proposition that is t
34、rue in the specification is also true in the implementation EXAMPLE A profile implementation is in conformance with the template specification that is created according to the rules in ISO 16100. 3.7 conformance point specific requirement contained in a set of subclauses in ISO 16100 that are used a
35、s a basis to generate and perform a test to determine if an implementation is conformant 3.8 conformance statement statement that identifies conformance points of a specification and the behaviour that must be satisfied at these points adapted from ISO/IEC 10746-2:1996, 15.1 3.9 conformance testing
36、conformity assessment testing of a candidate product for the existence of specific characteristics required by a standard in order to determine the extent to which that product is a conforming implementation ISO 10303-31:1994, 3.2.22 3.10 conformance test report document written at the end of the co
37、nformance assessment process, that provides the overall summary of the conformance of the UUT to the standard for which conformance testing was carried out, and that gives the details of the testing ISO 10303-31:1994, 3.2.23 3.11 conforming implementation implementation which satisfies the conforman
38、ce requirements, consistent with the capabilities stated in the CSI adapted from ISO 10303-31:1994, 3.2 24 3.12 executable test case implementation of an abstract test case that is platform-dependent and is associated with parameter values and a specific test method 3.13 executable test suite set of
39、 executable test cases 3.14 falsification testing test method developed to find errors in the implementation adapted from ISO 10303-31:1994, 3.2.32 ISO 16100-4:2006(E) 4 ISO 2006 All rights reserved3.15 interface abstraction of the behaviour of an object that consists of a subset of the interactions
40、 of that object together with a set of constraints on when they may occur ISO 16100-3:2005, 3.3.3 3.16 manufacturing software unit class of software resource, consisting of one or more manufacturing software components, performing a definite function or role within a manufacturing activity while sup
41、porting a common information exchange mechanism with other units ISO 16100-1:2002, 3.12 NOTE A manufacturing software unit can be modeled as a software object using a UML convention. 3.17 matcher mechanism to compare an offered capability profile with a required capability profile. ISO 16100-3:2005,
42、 3.1.6 3.18 matching level qualitative measure of how closely a capability profile of an MSU meets the software functional requirements of a manufacturing activity ISO 16100-3:2005, 3.1.7 3.19 MSU interoperability capability of a MSU to support a particular usage of an interface specification in exc
43、hanging a set of application information with another MSU ISO 16100-3:2005, 3.1.8 3.20 profile set of one or more base specifications or sub-profiles or both, and, where applicable, the identification of chosen classes, conforming subsets, options and parameters of those base specifications, or sub-
44、profiles necessary to accomplish a particular function, activity, or relationship ISO 16100-2:2003, 3.10 3.21 reference capability class structure schema representing a hierarchy of capability classes to be used for capability profiling ISO 16100-3:2005, 3.1.11 3.22 template schema for a manufacturi
45、ng software capability profile ISO 16100-3:2005, 3.1.14 ISO 16100-4:2006(E) ISO 2006 All rights reserved 53.23 unit under test capability profile, capability template, capability class structure or profile matcher being evaluated to determine if it meets or provides specific characteristics describe
46、d in ISO 16100 4 Abbreviated terms ATC Abstract test case ATG Abstract test group ATS Abstract test suite CITI Conformance information for testing the implementation CSI Conformance statement for the implementation ETC Executable test case ETG Executable test group ETS Executable test suite MSU Manu
47、facturing software unit UML Unified Modeling Language UUT Unit under test XIPI eXtra information for platform implementation XITI eXtra information for testing the implementation XML eXtensible Markup Language 5 Conformance framework 5.1 Conformance testing A UUT, such as capability profile, templat
48、e, reference capability class structure, or profile matcher shall be called conforming if its externally visible behaviour fulfils specific conformance requirements in this part of ISO 16100. Conformance testing shall be used to verify if an implementation meets the requirements of a standard or spe
49、cification. Conformance testing is a necessary step toward achieving interoperability, but is not a guarantee for interoperability. Conformance testing provides developers and users the assurance and confidence that the conforming UUT behaves as expected, performs functions in a known manner, or possesses a prescribed interface or format. The basic conformance testing strategy for ISO 16100 shall be falsification testing. Falsification testing subjects an
