The client is a leading technology and manufacturing company. This company creates smart solutions, pushing the digitalization and therefore supporting the departments by delivering a digital knowledge base.
About the Client
Problem Statement
- monitor the quality of supplied products and systems
- ensure ongoing maintenance and quality.
Further, the client wants to improve service provision and provide custom offers to the corresponding department or customer, which potentially leads to cost reduction as well as revenue growth.
The Challenge
- Poor data quality
- Integration of data sources
- Systemic deficiency in ensuring data reliability and integrity
- Performance issues
- Scalability issues
These challenges take on a special dimension, as they involve a wide range of heterogeneous source systems.
That’s why they were looking for a consulting partner, which provides knowledge and is also capable of promoting a suitable solution.
The Solution
- Collaborating with the client to create the data model
- Integrating various data sources
- Introducing dbt cloud with Scalefree’s Data Vault 2.0 package, datavault4dbt for standardized development processes
- Creating dbt Macros and Models to integrate and relocate the business logics into the new solution approach to ensure data reliability and quality
- Development of a strategy for the ETL process to meet the specified loading times and targets
Tangible Results for the Client
It emphasizes the benefits of:
- Streamlined production
- Cost reduction and revenue growth
- Compliance
- Efficient decision-making through centralized data management.
Technologies involved
- Snowflake
- dbt Cloud with datavault4dbt
- Microsoft Azure DevOps
- Kafka
- GitLab