The Hub-lemma (a.k.a. Hub Dilemma)
When I started to learn and work with Data Vault, I encountered the brilliance of hubs. It has taken me some time to adapt to the idea, that a hub can be loaded from more than 1 source system – if the Business Keys are well defined. Then I got my training and I still see […]
OPTION(RECOMPILE)
Again, a technical topic for SQL Server. At the beginning as an analyst you are going to learn to write standard SQL queries to get your desired results. With time your skills evolve, and you learn how to optimize the queries, maybe using a temporary table or a common table expression. The more you learn, […]
How to organize a Raw Data Lake
How many times did you hear in the last few years the words “Data Lake”? And how many times have you asked yourself how it should be organized? And how often did you ask Google for more information and didn’t get any valuable results and only funky buzzwords? I did a lot and found not […]
Praise be to the LoadDate
The best invention in my Business Intelligence career is the adoption of the concept of having a LoadDate. This should be a post to give credit to Dan Linstedt and thank him for inventing Data Vault and introducing LoadDate. When I encountered the hub-and-spoke concept of Data Vault I thought, why on earth do I […]
My indexing journey
The unprepared From my background as an accountant and controller I had by nature a good feeling for numbers. This helped me to understand, how to structure data. A couple of years ago when I started to work in a startup, I usually grabbed data directly from source systems to support our cause to tackle […]
Timeline calculation for Satellite views
My last blogpost about the universal loading pattern has generated a huge number of visitors to my blog. In the recent months I have been working and refining the model. Today I would like to talk about the last part in that model. Views based on satellites. Satellites are usually built with INSERT only. Any logic interpreting […]
Love-hate relationship with WhereScape
Well, I don’t know if this is the right way. But I want to share my experience about it with others. First, I want to say that WhereScape enabled me to reach my goals faster. At least now. It took a year to get to full speed. This is due to the fact that I […]
Universal Loading Pattern
While working on the templates I published recently, I came across similar looking pattern between object types. E.g. the persisted history of a satellite looks the same as in a persistent staging area (except of the primary key of course). Or loading a dimension is like loading a hub (just that hubs have no change […]
Data Warehouse Naming Conventions
As the amount of objects in my data warehouse is increasing, structuring them became an important topic. The goal is, that also new employees will grasp the content immediately. There are different naming conventions on the internet, but they usually just tell about prefixing objects. This is probably the easy part. How about structuring hubs […]
By ecki • Business Intelligence • 0