Database Modeling

1. Types of DBs

2. Data Vault Modeling

   1. Data vault modeling is a database modeling method that is designed to provide long-term historical storage of data coming in from multiple operational systems. It is also a method of looking at historical data that deals with issues such as auditing, tracing of data, loading speed and resilience to change as well as emphasizing the need to trace where all the data in the database came from. This means that every row in a data vault must be accompanied by record source and load date attributes, enabling an auditor to trace values back to the source. It was developed by Daniel (Dan) Linstedt in 2000. - wikipedia

   2. its a design pattern to build dwh for enterprise analytics. it has hubs (core business concepts) links (relationshipts between hubs) satellites store info about these two. good for lakehouse paradigm. link has a good image. - databricks

3. Data Fabric

   1. Data Fabric - is a data architecture, that follows a set of steps that determine its flow. The first step takes data through an integration phase. In the integration phase, data is ingested and then cleaned, transformed and loaded into storage. Then, there is the data quality phase where quality assessment is performed on the stored data. This data is then made available for different use cases through a combination of a data lake and a data warehouse, Typical use cases are BI, analytics and machine learning. Data governance policies are defined for the ingested data and a data catalog is used for discoverability - by preeti hemant.

   2. (short) Netapp

   3. (good) IBM - Data Management layer, Data Ingestion Layer, Data Processing, Data Orchestration, Data Discovery, Data Access.

   4. (good) Gartner - the pillars of data fabric

   5. talend

   6. (good but lengthy) spiceworks - architectural components, best practices

   7. (good) k2view - has a great figure of integration storage catalog, cleansing & masking, transformation & enrichment, governance, webservices.

   8. (good) tibco - application & services, dev & integration, security, storage management, transport, endpoints.

   9. mesh vs fabric

4. data virtualization - single view without movement of data.

5. tools for deploying data models in prod

Data Warehouse

1. (good) a guide from strategy to implementation