Data Engineer
Pune, MH, IN
Main responsibilities:
- Maintain & develop data platforms based on Microsoft Fabric for Business Intelligence & Databricks for real-time data analytics.
- Design, implement and maintain standardized production-grade data pipelines using modern data transformation processes and workflows for SAP, MS Dynamics, on-premise or cloud.
- Develop an enterprise-scale cloud-based Data Lake for business intelligence solutions.
- Translate business and customer needs into data collection, preparation and processing requirements.
- Optimize the performance of algorithms developed by Data Scientists.
- General administration and monitoring of the data platforms.
Competencies to be demonstrated:
- Working with structured & unstructured data.
- Experienced in various database technologies (RDBMS, OLAP, Timeseries, etc.)
- Solid programming skills (Python, SQL, Scala is a plus).
- Experience in Microsoft Fabric (incl. Warehouse, Lakehouse, Data Factory, DataFlow Gen2, Semantic Model) and/or Databricks (Spark).
- Proficient in PowerBI.
- Experienced working with APIs.
- Proficient in security best practices.
- Data centered Azure know-how is a plus (Storage, Networking, Security, Billing).
Education, Experience and Languages:
- Bachelor or Master degree in business informatics, computer science, or equal.
- A background in software engineering (e.g., agile programming, project organization) and experience with human centered design would be desirable.
- Extensive experience in handling large data sets.
- Experience working at least 8 years as a data engineer, preferably in an industrial company.
- Analytical problem-solving skills and the ability to assimilate complex information.
- Programming experience in modern data-oriented languages (SQL, Python).
- Experience with Apache Spark and DevOps.
- Proven ability to synthesize complex data advanced technical skills related to data modelling, data mining, database design and performance tuning.
- English language proficiency.
- Looking for Diversity Candidate.
Burckhardt Compression creates leading compression solutions for a sustainable energy future and the long-term success of its customers. The Group is the only global manufacturer that covers a full range of reciprocating compressor technologies and services. Since 1844, its passionate, customer-oriented and solution-driven workforce has set the benchmark in the gas compression industry.