Automated data wrangling for easy analytics
He needed a Data Wrangler, or Data Janitor, to help him build the bridge between all the data he was collecting in his MES system and the insights he hoped to gain from that data. “I had one of my engineers build some macros in Excel that go into our MES system and extract the data to an Excel workbook. Once it is there, he has to spend hours scrubbing the data before he can do any useful analysis.” He went on to say, “It might be ok for an occasional study, but we need to be looking at this data throughout the day, every day. This manual process is just not sustainable.” My customer was pointing out the obvious: wrangling data is not a value added activity. Not only that, it isn’t sustainable for daily operations.