Data Lake or Data Landfill?

Big data software.

A hallway of servers for big data in test and measurement and with IoT (Internet of Things) technology

August 10, 2024

Graphic with icons representing the binary system of the world wide web in the computer and the data lake spreading into the search and cloud

Big data for durability and reliability engineers

The term big data is used in many ways and for many applications. The increased connectivity and availability of sensor data is driving new big data opportunities for both the design engineering and asset operations communities.

Text graphic about the quantity of data and the product design and operations or asset performance

However, the reality of unleashing this potential is perhaps more challenging than is often portrayed by major information technology vendors. What is promoted as a data lake…

Blue lake surrounded by green trees with snowy mountains in the background

…often ends up being more like a data landfill.

Yellow truck collecting garbage in a huge rubbish dump

Data of good quality is hard to find and only a small percentage of available data is actually used by engineering. But there is a huge amount of potential if the true value of all that data can actually be realized.

Product designers and OEMs, for instance, may be interested in understanding real product usage to take important design decisions that might affect durability and warranty returns globally. Meanwhile, operators responsible for a fleet of vehicles or plant equipment are typically looking to enhance product reliability.

One of the primary challenges is how to scale the data handling, data management and data analytics of measured sensor data to real world applications. A scalable framework capable of performing real-world engineering analysis is needed to handle and process the volume of time series data in order to make timely decisions on performance, reliability, and operations.

Big Data for Durability and Reliability Engineers

If you would like to explore how this type of technology can be made available, how it can positively impact your engineering processes, or just wish to understand more then please connect with Jon to collaborate further.

Jon Aldred

Director of Product Management – HBK Prenscia

Contact Jon

Connect with Jon on LinkedIn