Skip to main content
Data Dare data transformation L4 sticker: the findi360 mascot analysing Enterprise Data Transformation and Performance Lab.

DD-TRF-004

Enterprise Data Transformation and Performance Lab

Decide what each monthly partition adds that the export does not yet hold, which partitions drifted, and whether the pipeline reconciles at scale.

  • Data Transformation
  • L4 · PARQUET
  • ~6,179,937 rows
  • 18 tables
  • 60 questions
Get the data 60 questions

Get the data

v1.0 · 6 files

Files are for members. A free account takes a minute, and you come straight back here.

Create a free account Sign in
  • Question Book PDF DD-TRF-004_Question_Book.pdf 1.3 MB · v1.0
  • Dataset Documentation / Data Dictionary XLSX DD-TRF-004_Data_Dictionary.xlsx 14.1 KB · v1.0
  • Business Introduction PDF DD-TRF-004_Business_Introduction.pdf 614.6 KB · v1.0
  • Relationship Diagram PDF DD-TRF-004_Relationship_Model.pdf 616.1 KB · v1.0
  • Raw fact data DD-TRF-004_FactDataPipelineEvents.parquet 139.3 MB · v1.0
  • Dimension / supporting data DD-TRF-004_Supporting_Tables.zip 16.3 MB · v1.0

Questions

Open one to discuss it
  1. Q040 Very Hard Checksum of the final table
  2. Q041 Very Hard Conflicting duplicates: amount at stake
  3. Q042 Very Hard Survivorship by latest load
  4. Q043 Very Hard Customers collapsed by alias mapping
  5. Q044 Very Hard Sales re-tiered by the SCD change
  6. Q045 Very Hard Schema drift in batch Partition_2025_03
  7. Q046 Very Hard Schema drift in batch Partition_2025_07
  8. Q047 Very Hard Schema drift in batch Partition_2025_11
  9. Q048 Very Hard Incremental load across all batches
  10. Q049 Very Hard Incremental rows from partition Partition_2025_01
  11. Q050 Very Hard Incremental rows from partition Partition_2025_02
  12. Q051 Very Hard Incremental rows from partition Partition_2025_03
  13. Q052 Very Hard Incremental rows from partition Partition_2025_04
  14. Q053 Very Hard Incremental rows from partition Partition_2025_05
  15. Q054 Very Hard Incremental rows from partition Partition_2025_06
  16. Q055 Very Hard Incremental rows from partition Partition_2025_07
  17. Q056 Very Hard Incremental rows from partition Partition_2025_08
  18. Q057 Very Hard Incremental rows from partition Partition_2025_09
  19. Q058 Very Hard Incremental rows from partition Partition_2025_10
  20. Q059 Very Hard Incremental rows from partition Partition_2025_11
  21. Q060 Very Hard Incremental rows from partition Partition_2025_12

General discussion

Anything about this dataset that is not one question — loading the files, which tool, how you set it up.

A free account takes a minute. Your draft is kept while you sign in.

Create a free account Sign in