Data Engineering Excellence

A global software business needed to build a single view of data to facilitate operational and sales reporting across the business.

‍

They needed both the skills to deliver project milestones, and also the very specific data expertise to design and build the infrastructure.The talent needed to be able to design and build the architecture to support storage, retrieval and analysis, creating and using large and complex data sets, moving from source systems to data warehouses and data lakes, and other data pipelines.

‍

As well as evaluating and improving current processes, there was a requirement to build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies and then build analytics tools to convert the raw data from the pipeline into actionable business metrics. Once established, the consultant was then required to create new analytics tools, design new reporting packages, develop training and skills transfer to teams for ongoing analysis.

‍

From a pool of 15 matched consultants, the client decided to work with a consultant who had previously designed and migrated data warehouses, and had extensive experience in application of data principles to support growth in SaaS businesses. The talent had strong technical skills in building and designing robust architectures for data warehousing and generating insights and analytics, and had detailed knowledge of the full data stack including GCP, Python, R, NoSQL, SQL, Tableau, Looker, and MarTech and successfully led a three month implementation to deliver the rigorous approach and improvements.