1、Information technology Media context and control Part 5: Data formats for interaction devices Technologies de linformation Contrle et contexte de supports Partie 5: Formats des donnes pour dispositifs dinteraction INTERNATIONAL STANDARD ISO/IEC 23005-5 Reference number ISO/IEC 23005-5:2016(E) Third
2、edition 2016-03-15 ISO/IEC 2016 ii ISO/IEC 2016 All rights reserved COPYRIGHT PROTECTED DOCUMENT ISO/IEC 2016, Published in Switzerland All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form or by any means, electronic or mech
3、anical, including photocopying, or posting on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below or ISOs member body in the country of the requester. ISO copyright office Ch. de Blandonnet 8 CP 401 CH-1214 Vernier, Geneva,
4、Switzerland Tel. +41 22 749 01 11 Fax +41 22 749 09 47 copyrightiso.org www.iso.org ISO/IEC 23005-5:2016(E)ISO/IEC 23005-5:2016(E) ISO/IEC 2016 All rights reserved iii Contents Page 1 Scope 1 2 Normative references 2 3 Terms, definitions, abbreviated terms and prefixes 3 3.1 Terms and definitions .
5、3 3.2 Abbreviated terms . 3 4 Interaction information description language 3 4.1 General . 3 4.2 Schema wrapper conventions . 3 4.3 Root element and top-level tools . 4 4.4 Device commands . 12 4.5 Sensed information description tools . 15 5 Device command vocabulary . 20 5.1 General . 20 5.2 Schema
6、 wrapper conventions . 20 5.3 Light type 21 5.4 Flash type . 23 5.5 Heating type . 25 5.6 Cooling type . 26 5.7 Wind type 28 5.8 Vibration type . 29 5.9 Sprayer type . 31 5.10 Scent type. 32 5.11 Fog type 34 5.12 Color correction type 36 5.13 Initialize color correction parameter type . 39 5.14 Rigi
7、d body motion type . 46 5.15 Tactile type . 61 5.16 Kinesthetic type . 66 5.17 Global position command type 71 5.18 Bubble type 74 6 Sensed information vocabulary . 75 6.1 General . 75 6.2 Schema wrapper conventions . 75 6.3 Light sensor type . 75 6.4 Ambient noise sensor type. 80 6.5 Temperature se
8、nsor type 82 6.6 Humidity sensor type 84 6.7 Distance sensor type 86 6.8 Atmospheric pressure sensor type . 88 6.9 Position sensor type . 90 6.10 Velocity sensor type 95 6.11 Acceleration sensor type 100 6.12 Orientation sensor type 107 6.13 Angular velocity sensor type . 112 6.14 Angular accelerati
9、on sensor type 118 6.15 Force sensor type 123 6.16 Torque sensor type . 125 6.17 Pressure sensor type 127 6.18 Motion sensor type 129 6.19 Intelligent camera type 137 ISO/IEC 23005-5:2016(E) iv ISO/IEC 2016 All rights reserved 6.20 Multi Interaction point sensor type . 145 6.21 Gaze tracking sensor
10、type . 148 6.22 Wind sensor type 151 6.23 Global position sensor type 152 6.24 Altitude sensor type . 154 6.25 Bend sensor type 156 6.26 Gas sensor type 158 6.27 Dust sensor type . 161 6.28 Body height sensor type 163 6.29 Body weight sensor type . 164 6.30 Body temperature sensor type 166 6.31 Body
11、 fat sensor type 168 6.32 Blood type sensor type 169 6.33 Blood pressure sensor type 171 6.34 Blood sugar sensor type 174 6.35 Blood oxygen sensor type . 175 6.36 Heart rate sensor type 177 6.37 Electrograph sensor type 178 6.38 EEG sensor type . 181 6.39 ECG sensor type . 185 6.40 EMG sensor type.
12、189 6.41 EOG sensor type . 200 6.42 GSR sensor type . 203 6.43 Bio sensor type . 205 6.44 Weather sensor type 210 6.45 Facial expression sensor type 216 6.46 Facial morphology sensor type . 231 6.47 Facial expression characteristics sensor type 234 6.48 Geomagnetic sensor type 238 6.49 Proximity sen
13、sor . 240 6.50 Switch sensor 242 6.51 Camera sensor type . 244 6.52 Spectrum camera sensor type 247 6.53 Color camera sensor type 250 6.54 Depth camera sensor type . 252 6.55 Stereo camera sensor type 254 6.56 Thermographic camera sensor type . 255 6.57 Engine oil temperature sensor type 257 6.58 In
14、take air temperature sensor type . 259 6.59 Tire pressure monitor system sensor type 261 6.60 Distance traveled sensor type . 263 6.61 Speed sensor type 264 6.62 Vehicle speed sensor type . 266 6.63 Mass air flow sensor type 267 6.64 Percentage sensor type . 269 6.65 Fuel level type . 270 6.66 Manif
15、old absolute pressure sensor type 271 6.67 EngineRPM sensor type . 273 6.68 CoM sensor type . 275 Annex A (informative) Schema documents . 277 A.1 Schemas for this part of ISO/IEC 23005 . 277 A.2 Associated MPEG-7 Schema . 277 Annex B (informative) Classification schemes . 278 B.1 Waveform Label CS
16、of EEG . 278 B.2 Waveform Label CS of ECG . 280 B.3 Waveform Label CS of EMG 282 B.4 Waveform Label CS of EOG . 291 B.5 Wave Pattern CS . 292 B.6 GasTypeCS 292 ISO/IEC 23005-5:2016(E) ISO/IEC 2016 All rights reserved v B.7 WeatherCS . 294 B.8 WindDirectionTypeCS . 295 B.9 FacialExpressionBasisIDCS .
17、 296 Annex C (informative) Patent statements . 304 ISO/IEC 23005-5:2016(E) vi ISO/IEC 2016 All rights reserved Foreword ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National
18、 bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Ot
19、her international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work. In the field of information technology, ISO and IEC have established a joint technical committee, ISO/IEC JTC 1. The procedures used to develop this document and those intende
20、d for its further maintenance are described in the ISO/IEC Directives, Part 1. In particular the different approval criteria needed for the different types of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org
21、/directives). Attention is drawn to the possibility that some of the elements of this document may be the subject of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details of any patent rights identified during the development of the document
22、will be in the Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents). Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement. For an explanation on the meaning of ISO specific terms and exp
23、ressions related to conformity assessment, as well as information about ISOs adherence to the WTO principles in the Technical Barriers to Trade (TBT) see the following URL: Foreword - Supplementary information The committee responsible for this document is ISO/IEC JTC 1, Information technology, SC 2
24、9, Coding of audio, picture, multimedia and hypermedia information. This third edition cancels and replaces the second edition (ISO/IEC 23005-5:2013), which has been technically revised. ISO/IEC 23005 consists of the following parts, under the general title Information technology Media context and c
25、ontrol: Part 1: Architecture Part 2: Control information Part 3: Sensory information Part 4: Virtual world object characteristics Part 5: Data formats for interaction devices Part 6: Common types and tools Part 7: Conformance and reference software ISO/IEC 23005-5:2016(E) ISO/IEC 2016 All rights res
26、erved vii Introduction This International Standard (MPEG-V) provides an architecture and specifies associated information representations to enable interoperability between virtual worlds, e.g. digital content provider of a virtual world, gaming (serious), simulation, DVD, and the real world, e.g. s
27、ensors, actuators, vision and rendering, robotics (e.g. for revalidation), (support for) independent living, social and welfare systems, banking, insurance, travel, real estate, rights management and many others. Virtual worlds (often referred to as 3D3C for 3D visualization and navigation and the 3
28、Cs of Community, Creation and Commerce) integrate existing and emerging media technologies (e.g. instant messaging, video, 3D, VR, AI, chat, voice, etc.) that allow for the support of existing and the development of new kinds of social networks. The emergence of virtual worlds as platforms for socia
29、l networking is recognized by businesses as an important issue for at least the following two reasons: a) it offers the power to reshape the way companies interact with their environments (markets, customers, suppliers, creators, stakeholders, etc.) in a fashion comparable to the Internet; b) it all
30、ows for the development of new (breakthrough) business models, services, applications and devices. Each virtual world, however, has a different culture and audience making use of these specific worlds for a variety of reasons. These differences in existing metaverses permit users to have unique expe
31、riences. Resistance to real-world commercial encroachment still exists in many virtual worlds, where users primarily seek an escape from real life. Hence, marketers should get to know a virtual world beforehand and the rules that govern each individual universe. Although realistic experiences have b
32、een achieved via devices such as 3D audio/visual devices, it is hard to realize sensory effects only with presentation of audiovisual contents. The addition of sensory effects leads to even more realistic experiences in the consumption of audiovisual contents. This will lead to the application of ne
33、w media for enhanced experiences of users in a more realistic sense. Such new media will benefit from the standardization of control and sensory information which consists of sensory effect metadata, sensory device capabilities/commands, user sensory preferences, and various delivery formats. The MP
34、EG-V architecture can be applicable for various business models for which audiovisual contents can be associated with sensory effects that need to be rendered on appropriate actuators. This part of ISO/IEC 23005 contains the tools for exchanging information for interaction devices. To be specific, i
35、t specifies normative command formats for controlling actuators and data formats for receiving information from sensors. It also specifies some non-normative examples. The International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC) draw attention to t
36、he fact that it is claimed that compliance with this document may involve the use of patents. ISO and the IEC take no position concerning the evidence, validity and scope of these patent rights. The holders of these patent rights have assured ISO and the IEC that they are willing to negotiate licenc
37、es under reasonable and non-discriminatory terms and conditions with applicants throughout the world. In this respect, the statements of the holders of these patent rights are registered with ISO and the IEC. Information may be obtained from the companies listed in Annex C. Attention is drawn to the
38、 possibility that some of the elements of this document may be the subject of patent rights other than those identified in Annex C. ISO and the IEC shall not be held responsible for identifying any or all such patent rights. INTERNATIONAL STANDARD ISO/IEC 23005-5:2016(E) ISO/IEC 2016 All rights rese
39、rved 1 Information technology Media context and control Part 5: Data formats for interaction devices 1 Scope This part of ISO/IEC 23005 specifies syntax and semantics of the data formats for interaction devices, i.e. Device Commands and Sensed Information, required for providing interoperability in
40、controlling interaction devices and in sensing information from interaction devices in real as well as virtual worlds as depicted in Figure 1. This part of ISO/IEC 23005 aims to provide data formats for industry-ready interaction devices: sensors and actuators. The same data formats for interaction
41、devices can be utilized by various applications supported by different MPEG technologies. Not only this International Standard but also other International Standards such as ISO/IEC 23007 (MPEG-U) and scene representation specifications (for example ISO/IEC 14496-20) can simply refer to this part of
42、 ISO/IEC 23005 to use the defined data formats. Two cases can occur for controlling a virtual world by using the MPEG tools. When the virtual world is using a scene description defined by MPEG tools (BIFS, Laser, etc.), the sensors and actuators can be directly connected to it through an MPEG-U inte
43、rface. When the virtual world is defined by non MPEG tools, an adaptation engine and common formalism for effects are needed. In Figure 1, the first case is illustrated by VirtualWorld2 and the second by VirtualWorld1. When this part of ISO/IEC 23005 is used in the context of pure ISO/IEC 23005, the
44、 adaptation engine (RV or VR engine), which is not within the scope of standardization, performs bi-directional communications using data formats specified in this part of ISO/IEC 23005. The adaptation engine can also utilize other tools defined in ISO/IEC 23005-2, which are users sensory preference
45、s (USP), sensory device capabilities (SDC), sensor capabilities (SC), and sensor adaptation preferences (SAP) for fine controls of devices in both real and virtual worlds. On the other hand, the defined data formats (Sensed Information and Device Command) can be mapped to MPEG-U defined interfaces w
46、hen this part of ISO/IEC 23005 is utilized in the context of other standards such as MPEG-U Framework. For example, the interface can be provided as ISO/IEC 23007-2 in the context of MPEG-U. Also defined, Sensed Information can be used by scene representation specifications as input data formats for
47、 a scene. The Device Command data format can also be used as output data formats to communicate with the outer world by mapping onto the interfaces defined in specific specifications. ISO/IEC 23005-5:2016(E) 2 ISO/IEC 2016 All rights reserved Real World (Sensors) User Sensed Information (5) Sensor D
48、evice Capability (2) Virtual World Sensor Adaptation Preferences (2) : converts Sensed Info from RW to VW Object Char./Sensed Info applied to VW Sensed Information (5) VW Object Characteristics (4) #2: R2V: Real World Adaptation Virtual World Real World (Actuators) User Sensory Device Capability (2)
49、 Device Commands (5) Sensory Effects Preferences (2) Virtual World Sensory Effects (3) : converts Sensory Effects from VW into Device Cmds applied to RW #1: V2R: Virtual World Adaptation Real World VW Object Characteristics (4)Figure 1 Scope of the data formats for interaction devices In Figure 1, V R adaptation takes Sensory Effects (ISO/IEC 23005-3) from a Virtual World, optionally Sensory Device Capabilities (I
