We assisted a major smart meter technology company in the United States that had been struggling with an inefficient system for processing millions of data rows daily into their business intelligence tool. After they faced significant challenges with previous data consultants and firms, we successfully reduced their data storage from 1.5 billion rows to 240 million.

Additionally, we delivered an effective solution to their issue of high-frequency updates combined with slow ETL (Extract, Transform, Load) runtimes. Our responsibilities included auditing their datasets and flows, creating optimized data ETLs and dashboards, and managing several of their external data engineering team members. Our work involved adding new custom API connections to DOMO, as well as overseeing their BigQuery database and its connections. Moreover, we established their documentation system from the ground up.

One of the significant achievements my team and I accomplished for this client was the prompt halt of a hacking attempt on their Google Cloud Project. Following that event, we took over administration of their Google Cloud Platform, conducted a security audit, and implemented best practice security measures.