EndorsedendorsedCompleted

Data Pipeline Design and Development for Systematik

Services Covered:

Data Engineering • Data Integration • Big Data Analytics and Business Intelligence • IT Consulting • Business Consulting
Project hero — replace with case study imagery
Industry
Industry

Advertising & Marketing

Duration
Duration

2 months

Budget
Budget

Less than 10K

Start Date
Start Date

1 May 2022

Team Size
Team Size

21-25

Engagement Model
Engagement Model

Offshore

Project Capability Score (PCS)

gauge meter
71/100
Good

Project Capability Score (PCS) estimates how capable Data Pilot is of successfully delivering a project like this, based on its past experience, track record, and ability to handle similar work. Learn more about PCS


Client

Systematik

map Canada

Project Summary

A data consulting firm (Systematik) hired Data Pilot to develop a reusable data pipeline template that connected clients' platforms, extracted and transformed data using dbt, stored results in BigQuery, and visualized outputs in Data Studio. The delivered pipeline was solid and scalable, accelerating the client's product. The client noted fast communication and access to a large pool of specialists.

Key Challenges

  • Need to streamline and productize a data pipeline after winning a larger project
  • Need to connect multiple client platforms and extract consistent data for transformation

Project Deliverables

  • Data pipeline template
  • Platform connectors to extract data
  • Transformed tables in BigQuery
  • Data Studio visualizations/dashboards

Project Solution

Data Pilot analyzed typical client characteristics to design a template pipeline, implemented connectors to multiple platforms to extract required data, transformed the data using dbt, stored transformed tables in BigQuery, and built visualizations in Data Studio. Two vendor resources worked on the engagement: the CEO as project manager and one data engineer.

Project Outcome

  • Built a solid, scalable data pipeline that accelerated the client's product
  • Fast communication and responsiveness via Slack
  • Access to a large team (20+ specialists) providing varied skills

Platforms

  • CloudCloud

Tech Stack

  • Google Big QueryGoogle Big Query

Client Endorsement

Overall Review Rating

4.5star5 out of 5 stars

Timeliness

Cost Rating

Willing to Refer

Quality of Deliverables

Data Pilot helped us build a robust, scalable data pipeline that supported the next stage of our product's development. With a team of more than 20 data engineers, they provided access to diverse resources and skill sets to meet our project needs.

Eric Boissonneault

CEO & Founder

Note: This endorsement is based on publicly available client feedback from external review sources.

More Projects by Data Pilot