Senior Data Engineer (Databricks Specialist) - 6 month contract - UK Remote
£500-600 per day Inside IR35
bigspark, a UK based consultancy delivering next level data platforms and solutions with a focus on exciting technologies including Apache Spark, Apache Kafka and working on projects within Machine Learning, Data Engineering, Streaming and Data Science is looking for a Senior Data Engineer to join our team on a contract basis in a remote, work from home capacity.
We provide the backbone for modern analytics to our clients through expertise in DevOps, distributed computing, machine learning and adoption of proven open source projects. We specialise in backend development, infrastructure automation and performance engineering for data workloads at scale.
Your Skills and Experience
SME level Databricks Engineer/Expert
Solve engineering issues with the project team eg: API development, integration with wider AWS stack like DynamoDB, S3, import/export source code from GitHub repos, Terraform scripting etc.
Collaborate with cross-functional teams to integrate data from multiple sources, ensuring data quality and consistency.