Data Engineer

Req ID:  5241
Job Type:  Hybrid
Location: 

Pune, MH, IN

Oct 28, 2026

This role is offered on a Contract-to-Hire basis, with an initial pre-defined contractual period. Upon successful completion of this period, the position is intended to transition to Burckhardt Compression’s permanent payroll.

 

 

Main responsibilites and tasks:

  • Develop and operate the Azure Databricks data platform and enterprise data lake for analytics, AI and production data products.
  • Design, implement and optimize production-grade data pipelines and transformation workflows using Python, SQL, PySpark and, where required, Scala.
  • Translate business requirements into scalable ingestion, transformation, mapping and data-quality solutions.
  • Administer Databricks workspaces, Unity Catalog, identities, permissions, clusters, jobs and platform integrations.
  • Maintain the supporting Azure infrastructure, connectivity, security configuration and infrastructure-as-code deployments.
  • Ensure reliable platform operations through monitoring, troubleshooting, upgrades, incident recovery and controlled production changes.
  • Manage platform cost, technical documentation and operational continuity in collaboration with Data Science, MLOps, Cloud Infrastructure and Cybersecurity teams.
  • Potentially extend development and operations scope into Microsoft Fabric for business intelligence and AI use cases.
  • Strong data-engineering skills in Python, SQL and PySpark; Scala knowledge is an advantage.
  • Hands-on experience with Azure Databricks, Apache Spark, Workflows, clusters, runtime management and performance tuning.
  • Strong knowledge of Unity Catalog, cloud storage, identities, access controls and external locations.
  • Practical Azure experience covering storage, networking, private endpoints, containers, identities and secrets.
  • Experience with Terraform, Azure DevOps, Git, CI/CD and controlled production deployments.
  • Ability to build and support scalable batch, event-driven and container-based data pipelines integrating files, APIs, IoT and cloud sources.
  • Strong capability in platform security, monitoring, troubleshooting, performance optimization and cloud cost management; Microsoft Fabric, Power BI and Azure AI knowledge are advantages.

 

 

Education, Experience and Languages:

  • Bachelor’s or Master’s degree in computer science, data engineering, software engineering or a comparable technical discipline.
  • 5–8 years of relevant data engineering experience, including at least 3 years with Azure Databricks, Apache Spark and Azure cloud services.
  • Proven experience developing and operating production data platforms, including data integration, modelling, performance tuning and DevOps practices.
  • Experience in an industrial environment and with IoT or machine-generated data is preferred.
  • English proficiency at B2 level or higher; German is an advantage.

 

Burckhardt Compression creates leading compression solutions for a sustainable energy future and the long-term success of its customers. The Group is the only global manufacturer that covers a full range of reciprocating compressor technologies and services. Since 1844, its passionate, customer-oriented and solution-driven workforce has set the benchmark in the gas compression industry.