My last blogpost about the universal loading pattern has generated a huge number of visitors to my blog. In the recent months I have been working and refining the model. Today I would like to talk about the last part in that model. Views based on satellites. Satellites are usually built with INSERT only. Any logic interpreting […]

[Update see below] Well, I don’t know if this is the right way. But I want to share my experience about it with others. First, I want to say that WhereScape enabled me to reach my goals faster. At least now. It took a year to get to full speed. This is due to the […]

While working on the templates I published recently, I came across similar looking pattern between object types. E.g. the persisted history of a satellite looks the same as in a persistent staging area (except of the primary key of course). Or loading a dimension is like loading a hub (just that hubs have no change […]

In all my previous blog posts you would have had to go to my GitHub repository, loading each file to your environment and trying to get it up and running. Maybe it is time now, to package them all up into an application, which is ready to be loaded into your environment. You get templates […]

So far, we have been discussing the creation of stored procedures to pump data into our hubs, satellites, facts and all the other objects. In an ideal world, I would specify my objects and good is. All data would come into their place automatically. Unfortunately, that doesn’t happen too often. Currently we create tables and […]

With WhereScape you have the freedom to do whatever you want. With time passing, I figured out, what is important to me and what not. But how to ensure that things are done always the same way? And not only for me but also for my collegues? We started to create meta views for objects, […]

Loading data to a fact table is quite a difficult beast within WhereScape without templates. First, do I set business keys or not? If I set business keys the whole loading procedure is based on a cursor which updates or inserts 1 record at a time. Not good if I’m going to load 100 mio. […]

Loading data to a dimension is straight forward. Prepare the data in a stage table and load it to dimension. The interesting stuff is how to define and load the dimension. What are the requirements: Stage Nothing special. Just make sure that the business key is unique. Dimensions This has taken me some time to […]