Foreword

ISO (the International Organization for Standardization) and IEC (the International Electrotechnical Commission) form the specialized system for worldwide standardization. National bodies that are members of ISO or IEC participate in the development of International Standards through technical committees established by the respective organization to deal with particular fields of technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the work.

The procedures used to develop this document and those intended for its further maintenance are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the different types of document should be noted. This document was drafted in accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or www.iec.ch/members_experts/refdocs).

ISO and IEC draw attention to the possibility that the implementation of this document may involve the use of (a) patent(s). ISO and IEC take no position concerning the evidence, validity or applicability of any claimed patent rights in respect thereof. As of the date of publication of this document, ISO and IEC had not received notice of (a) patent(s) which may be required to implement this document. However, implementers are cautioned that this may not represent the latest information, which may be obtained from the patent database available at www.iso.org/patents and https://patents.iec.ch. ISO and IEC shall not be held responsible for identifying any or all such patent rights.

Any trade name used in this document is information given for the convenience of users and does not constitute an endorsement.

For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and expressions related to conformity assessment, as well as information about ISO's adherence to the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.

This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology, Subcommittee SC 24, Computer graphics, image processing and environmental data representation.

Any feedback or questions on this document should be directed to the user’s national standards body. A complete listing of these bodies can be found at www.iso.org/members.html and www.iec.ch/national-committees.

Introduction

Mixed and augmented reality (MAR) refers to the contents and the underlying technology that can overlay/insert (or augment) and display information over/in the real world. The augmentation means certain “virtual” or “artificial” information is spatially registered in a proper position and orientation within the 3D real world. To realize this “spatial” registration, the MAR system includes a functionality, called “positioning”, that can recognize and understand the real world in 3D, track the position and orientation of the user so that the mixed reality scene can be composed and displayed to the user in the right way. When the positioning function implementation is based primarily on the camera images, it is referred to as the “Visual” positioning system (VPS).

This document outlines the basic reference MAR architecture, especially the detailed system components for the VPS and relevant informational constructs. Such a reference model can serve as a basis for discovering opportunities for future MAR standardization.

The focus is given to the system components and information constructs for image (visual) based scene recognition and tracking. The document also provides definitions for terms as related to pertaining domains, and illustrate typical VPS/MAR use cases. Note that the detailed processes or algorithms for different system components are out of scope.

1 Scope

This document specifies the concept of visual positioning system (VPS) in the context of mixed and augmented reality (MAR) and describes a reference model for it in terms of the essential system components and information constructs.

2 Normative references

3 Terms, definitions and abbreviated terms

3.1 Terms and definitions

3.2 Abbreviated terms

4 Concept: Visual positioning system in mixed and augmented reality

4.1 VPS and MR

4.2 System architecture of VPS

5 Standardization opportunities

5.1 Data representation and interoperability among major VPS components

5.2 Image/Data set for map and image DB

5.3 Image based 2D/3D map

5.4 Pre-existing map

5.5 Integrated 2D/3D image based and registered map

5.6 Features characterization and descriptor

5.7 Image/object characterization and descriptor

5.8 Semantics (labels)

6 Use cases

6.1 Indoor MAR guidance/service (navigation/advertisement/games/tourism)

6.2 Accurate outdoor MAR services (navigation/advertisement/games/tourism)

6.3 MAR based tele-assistance