At Kleene, we use the Ingest-Master-Insights (IMI) framework when modelling data. The point of the framework is to be simple and allow the analyst/engineer to always keep in mind the overarching stages of the data modelling process.
Below is a summary of the many modelling steps used at Kleene, which can be navigated via the left-hand side menu or clicking on the links at the bottom of this page.
|1||Raw Data||Where raw data comes from|
|How Kleene handles the raw data|
|2||Cleaned||Cleaning field names|
|Data type casting|
|3||Subentity||Beginning of true transformation|
|4||Mastering||What the mastering step is|
|5||Entity||What an entity is|
|6||Domain||What a domain is|
|Domains on the DAG|
|7||Reporting||What a reporting table is|
|8||Views||Views vs tables|
The journey from ingest to insight involves multiple steps of transformation in the data modelling process. But it all begins with handling raw data.
Updated about 2 months ago