Comparison of data changes between data loads
We are getting more and more requests from clients to be able to see the data changes between data refreshes. My idea was to firstly load both the old and new data into the same elasticube, and the...
Forum Discussion
Hi Lily,
Thanks so much, I played around with it a bit, but I think my use case requires me to be able to dive a bit deeper into the changes itself. Although the accumulation does help, I want to be able to identify not only new / changed records in a dataset level, but by a row level, drilled down to a subject level. So if there is 10 subjects in the first data load, each with 2 records, and with the next load, 5 of the subjects have 2 new records loaded each, each of the new records should be flagged as new, and if 2 of the original subjects have had 3 variable values changed or updated, to be able to flag that record as changed based on all the fields that changed, not just a date. Hope this makes sense! I am busy playing around with flagging with SQL as I can use more defined group by values so will let you know what I manage with that.
francoisvv Got it! Thanks for the additional details. If you find a SQL solution for your use-case, please share it with us!
Please also take a look at the post following the link below. It provides an example on how to see the historical data per the dimension and not just the current state: https://community.sisense.com/t5/knowledge/slowly-changing-dimension/ta-p/8925
