Data Routing and Preprocessing (DR&P)

Definition

There may be a need for dynamic routing of data to the proper data-processing node (as part of a dynamic data-routing function). The building block for data routing and preprocessing is usually a data middleware platform (or a combination of two or more such platforms). These address different technical requirements, depending on the nature of the data that is collected and routed (e.g. streaming data, data at rest).

Role and Scope

Features

Components and Technologies

Design Principles Position Paper

• Stream-processing middleware platforms (e.g. Apache Kafka) can be used to support the routing and preprocessing of streaming data.

• Horizontal and vertical scalability.

• Aspects esulting from data usage policies, like jurisdiction for data processing, data egress, or combination with other data.

Technical Reference Implementation

Business Use Cases Implementation

Best practices identification and recommendations

Gap or what is missing?

TRL

Comments

Additional Information