Skip to main content

Command Palette

Search for a command to run...

🧨 And Now, Data Preboarding Disasters

Stories from the field. Bad stories!

Updated
•2 min read
🧨 And Now, Data Preboarding Disasters

We all know bringing data into the enterprise from data partners that you don't control is hard. Monday mornings you yearn for green lights across the pipeline status board. Sometimes you get them. On those other days, how about a hot mug of it-all-happens-to-everyone-else-too?

Over the next few weeks I'm going to tell real, though slightly anonymized, stories of data partnerships in jeopardy, data operations on fire, and spend control out the window. Basically, just plain DataOps breaking bad in the absence of solid data preboarding. Why is this helpful? Well, schadenfreude, a bit. But mainly to show how you're not in it alone. And that better data preboarding can make a difference in making the ouch stop.

These thumbnail stories are all true, unexaggerated, and accurately told, though names, data domains, and products have been changed to protect confidentiality. They are not intended to push the envelope -- bigger disasters for sure happen!

These modest problem cases just happen to be handy and photogenic. They are a few of the reasons CsvPath Framework, its implementation of the Collect Store Validate Publish architecture, and FlightPath were born. I hope you will see how the stories made the tools what they are and the tools address the needs the stories illustrate.

And I hope you enjoy the tales. And I really hope your Monday gets better! ☕

Look for these blockbusters coming soon!

  • The Bermuda Triangle Of Data

  • Oh crap, we have to run it again... and again...

  • Ouch, the number 11 is not in fact the same as 1...

  • What happens when a 45-day payment window falls on your hand...

  • How use very expensive SMEs, badly. A.k.a why people shouldn't check the work of computers...

  • What happens when the only guy-who-knows goes and becomes COO...

  • How to make enemies and influence external people using files...

Data Preboarding Disasters

Part 2 of 2

Data ingestion works better with a solid preboarding process. Otherwise, data can go sideways in interesting ways. These are real stories (names changed!) of data disasters due to poor preboarding processes. What could go wrong? Everything!

Start from the beginning

The Bermuda Triangle Of Data

A story of data preboarding disaster on the high seas