Introduction

0.1 Foundations of the ISO 8000 series

Digital data deliver value by enhancing all aspects of organizational performance including:

— operational effectiveness and efficiency;
— safety and security;
— reputation with customers and the wider public;
— compliance with statutory regulations;
— innovation;
— consumer costs, revenues and stock prices.

In addition, many organizations are now addressing these considerations with reference to the United Nations Sustainable Development Goals1.

The influence on performance originates from data being the formalized representation of information2. This information enables organizations to make reliable decisions. This decision making can be performed by human beings and also automated data processing, including artificial intelligence systems.

Organizations become dependent on digital data through widespread adoption of digital computing and associated communication technologies. This dependency amplifies the negative consequences of the lack of quality in these data, leading to the decrease of organizational performance.

The biggest impact of digital data comes from two key factors:

— the data having a structure that reflects the nature of the subject matter;

EXAMPLE 1

A research scientist writes a report using a software application for word processing. This report includes a table that uses a clear, logical layout to show results from an experiment. These results indicate how material properties vary with temperature. The report is read by a designer, who uses the results to create a product that works in a range of different operating temperatures.
— the data being computer processable (machine readable) rather than just being for a person to read and understand.

EXAMPLE 2

A research scientist uses a database system to store the results of experiments on a material. This system controls the format of different values in the data set. The system generates an output file of digital data. This file is processed by a software application for engineering analysis. The application determines the optimum geometry when using the material to make a product.

ISO 9000 explains that quality is not an abstract concept of absolute perfection. Rather, quality is the conformance of characteristics to requirements. This means that any item of data can be of high quality for one purpose but not for a different purpose. The quality is different because the requirements are different between the two purposes.

EXAMPLE 3

Time data are processed by calendar applications and also by control systems for propulsion units on spacecraft. These data include start times for meetings in a calendar application and activation times in a control system. These start times require less precision than the activation times.

The nature of digital data is fundamental to establishing requirements that are relevant to the specific decisions made by each organization.

EXAMPLE 4

ISO 8000‑1 identifies that data have syntactic (format), semantic (meaning) and pragmatic (usefulness) characteristics.

To support the delivery of high‑quality data, the ISO 8000 series addresses:

— data governance, data quality management and maturity assessment;

EXAMPLE 5

ISO 8000‑61 specifies a process reference model for data quality management.

— creating and applying requirements for data and information;

EXAMPLE 6

ISO 8000‑110 specifies how to exchange characteristic data that are master data.

— monitoring and measuring information and data quality;

EXAMPLE 7

ISO 8000‑8 specifies approaches to measuring information and data quality.

— improving data and, consequently, information quality;

EXAMPLE 8

ISO/TS 8000‑81 specifies an approach to data profiling, which identifies opportunities to improve data quality.

— issues that are specific to the type of content in a data set.

EXAMPLE 9

ISO/TS 8000‑311 specifies how to address quality considerations for product shape data.

Data quality management covers all aspects of data processing, including creating, collecting, storing, maintaining, transferring, exploiting and presenting data to deliver information.

Effective data quality management is systemic and systematic, requiring an understanding of the root causes of data quality issues. This understanding is the basis for both correcting existing inconsistencies and implementing solutions that prevent future reoccurrence of those nonconformities.

EXAMPLE 10

If a data set includes dates in multiple formats including “yyyy‑mm‑dd”, “mm‑dd‑yy” and “dd‑mm‑yy”, then data cleansing can correct the consistency of the values. Such cleansing requires additional information, however, to resolve ambiguous entries (such as, “04‑05‑20”). The cleansing also does not address any process issues and people issues, including training, that have caused the inconsistency.

0.2 Understanding more about the ISO 8000 series

ISO 8000‑1 provides a detailed explanation of the structure and scope of the whole ISO 8000 series.

ISO 8000‑2 specifies the single, common vocabulary for the ISO 8000 series. This vocabulary supports understanding the overall subject matter of data quality. ISO 8000‑2 presents the vocabulary structured by a series of topic areas (for example, terms relating to quality and terms relating to data and information).

ISO has identified ISO 8000‑1, ISO 8000‑2 and ISO 8000‑8 as horizontal deliverables3.

0.3 Role of this document

As a contribution to the overall capability of the ISO 8000 series, this document describes quality characteristics and related data anomalies of data produced by sensors. This document focuses, in particular, on data that are a stream of individual, discrete digital values. The quality characteristics and data anomalies can serve as the basis for quality criteria to measure and improve the quality of sensor data. Such criteria are suitable when preparing data prior to data analysis or exploitation of the data.

Sensors are a fundamental enabler of digital transformation, which has resulted in the proliferation of sensor networks and sensing devices connected to the Internet‑of‑Things (see ISO/IEC 30141). Such sensors capture data about a wide range of aspects of the physical world. These data have significant volume, velocity and variety, making them an essential asset serving as the basis for insight and foresight that improves decision making across organizations of all types.

While offering this potential, sensor data are also vulnerable to disruption from a wide range of sources, including limited capacity of hardware (such as processors, memory and batteries), software, congested wireless communications and impact from harsh operating environments. The data are, therefore, likely to include data anomalies, which require detection and handling in order to improve the quality of sensor data. The anomalies can affect various characteristics of the data, including the time‑variant aspects of sensors.

The quality characteristics are appropriate for use when preparing sensor data for subsequent data analysis and exploitation. This use involves measuring and improving the quality of the data. These characteristics are relevant to any type of industrial application, including smart manufacturing, social infrastructure and healthcare.

This document supports activities that affect:

— one or more information systems;
— data flows within the organization and with external organizations;
— any phase of the data life cycle.

Organizations can use this document individually or in conjunction with other parts in the ISO 8000 series.

Annex A contains an identifier that conforms to ISO/IEC 8824‑1. The identifier unambiguously identifies this document in an open information system.

0.4 Benefits of the ISO 8000 series

By implementing parts of the ISO 8000 series to improve organizational performance, an organization can achieve the following benefits:

— objective validation of the foundations for digital transformation of the organization;
— a sustainable basis for data in digital form becoming a fundamental asset class that the organization relies on to deliver value;
— securing evidence‑based trust from other parties (including supply chain partners and regulators) about the repeatability and reliability of data and information processing in the organization;
— portability of data with resulting protection against loss of intellectual property and reusability across the organization and applications;
— effective and efficient interoperability between all parties in a supply chain to achieve traceability of data back to original sources;
— readiness to acquire or supply services where the other party expects to work with common understanding of explicit data requirements.

BS ISO 8000-210:2024

Data quality - Sensor data: Data quality characteristics

Current

Published:

31 Dec 2024