Subproject D02

RaumLink: Spatial linking of heterogeneous information in infrastructure con-struction

The recording, inspection and assessment of existing bridges and other infrastructure structures are broadly structured by a large number of methodological approaches, technical procedures, standardised codes, guidelines and underlying data models. The further development of basic methods and procedures has been driven in recent years by:

  1. increasing availability and cost-effectiveness of measurement and acquisition technologies (high-resolution point clouds from LIDAR and SfM methods, networked sensors in SHM, digital photography, etc.).
  2. and the development of object-oriented, parametric building information models (BIM, IFC for Bridge, IFC for Infra, OKSTRA, ASB-ING).

 

A wide range of data, information and media forms are used for the currently established measurement, documentation and testing procedures. However, this information is only loosely and mostly implicitly available and so far not in common conceptual and explicit information spaces. Therefore, they can only be viewed, analysed and evaluated together to a limited extent and, in the medium term, merged into comprehensive iterative digital twins: 2D planning documents, photo-documented damages of annotated image areas (crack images, gravel nests, corrosion) stand next to semi-structured point cloud data sets of different provinces, large-scale parametric BIM models and high-frequency data streams of sensor data for remote monitoring in the course of structural health monitoring. The combination of these partial views and representations into an analytical overall view can so far only be carried out by experienced technical planners and remains mostly implicit. Only through explicit, machine-readable links, however, can data be structured and made accessible, for example, on a large scale for nationwide overview dashboards, machine learning methods for damage classification, comparative testing methods, multi-scale digital twins and similar data-intensive applications.

 

For the explicit linking of information, the concepts of multi-models (Scherer et al), information containers in common data environments (Common Data Environments, DIN SPEC 91391) and Information Containers for linked Document Delivery (ISO 21597, ICCD) have established a series of conceptual foundations and technical standards for relating object- and attribute-specific information fragments to each other. However, creating these relationships involves enormous curatorial effort and usually remains at the level of superficial document assignments ("Photo of crack X belongs to bridge Y. Bridge Y shown in drawing Z").

The approach pursued in this sub-project is to transfer the different spatial descriptions of stationary artefacts of the built environment in order to assign the different types of information to each other. What is located in the same spatial areas based on the location descriptions in the respective format belongs together in different gradations: It refers to the same conceptual entity, is related to it or describes partial aspects.

Broad spatial assignments as prescribed by RI-EBW-PRÜF 2017 ("slab, concrete, one spot, spalling with exposed reinforcement, area 0.05 m2, 1. field, start of field, see sketch") cannot yet be automated and linked with a component group, segmented point cloud clusters, or marked areas of a photo in a precise or fuzzy manner. Furthermore, no procedures have yet been established for projecting into other spatial models and dimensions (2D plan → 3D model, CAD/BIM → GIS). In existing systems such as SIB-Bauwerke for data storage, explicit spatial links with future growing numbers of multi-dimensional parametric models, close-meshed and high-frequency sensor data and simulation models are missing as they are being researched and developed in other sub-projects of the SPP.

The partial information differs in spatial scales: From the geographic and topological position in the overall infrastructure system of the rail and road network to millimetre-precise descriptions of damage to building components. Different conceptual approaches to information granularity, semantics and mapping depth of the respective underlying model schemas and instances make merging (mapping and alignment) with Linked Data and Semantic Web approaches difficult or even impossible, despite successfully overcoming syntactic and format-related challenges of interoperability ( Beetz and Borrmann 2018).