Principal Data Engineer

Reference: BH-299c
Job Type: Contract
Duration: 6 months
Day Rate: £600 (Inside IR35)
Location: UK

Job Role: Principal Data Engineer

Job Type: Contract

IR35: Inside IR35

Day Rate: £600/Day

Contract Duration: 6 months

Working Hours: 5 days per week

Remote Working: 4 days remote working. 1 day on-site in London

Location:  Hybrid Remote/London (UK only)

Reference: BH-299c

Role Overview:

We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management.

Key Responsibilities:

  • A cross-discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them
  • Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines.
  • Document compliance, security, and data sovereignty in alignment with regulatory standards.
  • Define strategies for cost optimisation and lifecycle management.
  • Establish processes for data discovery, profiling, and quality rule implementation.
  • Set up a data quality rules engine and initiate ongoing data quality monitoring.
  • Define data access controls and encryption standards.
  • Implement a comprehensive framework for data compliance, security, sovereignty, and lifecycle management.
  • Establish data remediation processes to address data quality issues.
  • Implement strategies for data access controls and encryption.
  • Develop and optimise data pipelines for synchronous replication and ad hoc data transfers.
  • Provide thorough training and documentation to upskill the Platform and Data Engineering teams.
  • Ensure teams are equipped to manage and modify the solution independently.

Required Skills and Experience

  • Extensive experience in
  • Data Warehousing
  • Data Engineering, overall
  • Data Analytics
  • Data Visualisation

  • Proficiency in:
  • Google Cloud (GCP)
  • GCP BigQuery
  • Python
  • DBT or similar
  • FastAPI or similar
  • Airflow or similar

  • Desirable:
  • Google Apigee (as an application developer)
  • Exposure to Machine Learning projects
  • Exposure to DataOps
  • Exposure to dataproc or similar