Etl Agreement

19. září 2021 | Vít Zemčík | Nezařazené | Sdílet na Facebooku

There is no point in optimizing an ETL transformation step from 2 minutes to 40 seconds if the next step is only triggered after 3 or 4 hours, because the step waits for an overloaded team member to check the output. Combined with small, decoupled and focused tests, we can use a SQL unit test framework for our ETL code (these frameworks don`t really test at the same unit level as the application code, but the unit name has remained blocked). With sufficiently small and focused recordings, it is possible to develop ETL logic with a test-first approach, without the need for comprehensive final tests. A great advantage is that the tests clearly record our expectations about the nature of the resulting data at each stage and help us think about the necessary processing. These are Intertek ETL Semko and Light Metrics, incorporated with Garwood Laboratories…

Komentáře jsou uzavřené.