LinkedIn - pmOne

Data Warehouse Architecture

Definition von Data Warehouse

A data warehouse is a central repository that contains a copy of the data stored in multiple corporate sources. This data is later used for analyzing business data and supporting decision-making processes. In many companies a data warehouse serves as the heart of their individual Performance Management and Business Intelligence strategies. 

 

Good design dístinguishes an efficient and useful data warehouse is based on three guiding principles:

  • Integrating data from disparate, heterogeneous databases to create a single version of the truth and enable comprehensive analysis
  • Separating operational business data from management data for reporting, decision support and analysis
  • Sound data modelling and mapping

Why do I need Data Warehouse?

Excellent question. There is ample literature on this very topic – not to mention many different views on the “one true” methodology and implementation. Our experience shows that the pragmatic approach of building smaller data marts for one single purpose (e.g. enterprise planning) can be beneficial.

Sooner or later, however, most companies will expand their activities into the performance management spectrum at which point a data warehouse approach will be necessary. For this reason, we create well-structured architectures from business as well as technical points of view for even the smallest of data marts to ensure future system scalability.

In support of this important specification process between business and IT the pmOne offers Solutions tools for Modelling to be effectiv.

Extracting, transforming, ...

During the ETL process, data and metadata structures are extracted from different sources, transformed (i.e. cleaned and standardized) and then loaded into a data warehouse. This process is executed on a regular schedule so that the data warehouse contains the widest breadth of information over the longest possible time frames and ultimately enables powerful comparative analysis and transparent planning criteria.

Our teams at pmOne have successfully designed and implemented data warehouse solutions from departmental data marts to enterprise data warehouses. In time and in budget. Giving our customers the competitive edge.

Model Data Warehouse Architecture with Staging Area, CDW and Star Schema
Model Data Warehouse Architecture with Staging Area, CDW and Star Schema. Sounds complicated, it is sometimes too. The integration of heterogeneous IT systems is still an exciting task. Our experts help!

Is data warehouse in the cloud worth considering?

Cloud computing as a delivery option of IT applications is becoming increasingly popular. The main reasons for this are economic factors as well as an increase in flexibility and agility. But what exactly is the readiness of companies to use when integrating DWH solutions into the cloud?

Free download after registration (german-speaking)

Group-wide improvement of reporting and analysis with an Enterprise Data Warehouse

How Heraeus, as a global corporation, has standardized its business intelligence processes and applications

Read the user report

Data Lake as a supplement to the data warehouse

In the context of big data, businesses are increasingly gaining access to new information such as unstructured documents, blogs and images from the Web or semi-structured XML, HTML and sensor data. In contrast to this, the Data Warehouse, which is usually located in the finance or controlling area, is primarily designed to process structured data that originates from the business systems such as ERP.



Companies that manage to combine these different types of data for analysis purposes increase their analytical quotient, gain new insights for corporate management, and thus gain a competitive advantage. In this respect, there is no question that information that is available beyond the operational management systems must also be prepared.

 

 

Analytics Platform as an extension

This is where Data Lake comes into play as a complementary concept that can turn the data warehouse into a analytics platform . The Data Lake offers the possibility of parallel processing in combination with very high storage capacities. Here, you can store large amounts of data first of all, in order to be able to set up prediction models and the like, if required. consulted. In contrast to the Data Warehouse, the Data Lake is therefore large on storage Datasets designed and very flexible in terms of processing different formats. While the data in the data warehouse is generally available in such a way that the business users from the finance and controlling departments can evaluate them independently with the appropriate tools, the purposeful use of the heterogeneous data lake information, which often benefits sales and marketing, First of all, the special skills of data scientists asked.

 

 

In a data lake, the ETL process changes to an ELT process. After extracting data from different systems, they are first loaded into the Data Lake in their respective raw form (from un-, semi-structured). Transformations (mostly aggregations) are now executed on this raw data. The transformations give rise to new information that answers a specific question and is thus structured. They are then presented and analyzed in dashboards, reports, or in interactive tools.

Concept Architecture of an Analytics Platform

Closing the gap to real-time information

Over the years companies have increased their load cycles so that their data warehouses contain virtually real-time information from the source systems. This allows them to analyze the latest information without hindering the performance of operational systems. Companies in retail, telecommunications or other industries that need to closely monitor daily business activities can then act upon emerging trends and events more quickly and effectively.

Partnership with Datameer

[Translate to English:] pmOne further expands its analytics expertise By adding a holistic Big Data Analytics application to its portfolio and offering the right services / customers benefit from agile data analysis in a self-service manner.

Read press release (german)

Data warehouse summarized

A data warehouse is a topic-driven, historical and autonomous database of a company that integrates and manages data from multiple independent source systems. The data is provided and loaded from the data sources, where it is stored for long-term data analysis, business decision support and data mining.

Christian Fürstenberg
VP - BI & Analytics Platform
pmOne AG
Vorsetzen 53
20459 Hamburg
+49 40 881478-00
Christian Fürstenberg