Senior Data Engineer (Databricks)

the company is a consulting & technology company, helping enterprises create the most important applications by leveraging AI & cloud-native technologies and modern ways of delivering software.

At the company, we transform businesses by unlocking the potential of AI and data through innovative software solutions.

We partner with industry leaders, from the automotive, aviation and manufacturing industries, to build sophisticated Data & Analytics platforms that transform how organizations manage and leverage their data assets. Our solutions provide comprehensive capabilities spanning data storage, management, advanced analytics, machine learning, and AI, enabling enterprises to accelerate innovation and make data-driven decisions.

Responsibilities

• Design and implement a scalable architecture capable of handling the high volume of sensor, telemetry, and simulation data

• Build a flexible data preprocessing pipelines that are extensible and that can be integrated into customer’s existing platform

• Develop and implement processes and best practices for data management and governance

• Optimize and enhance system setup and improve data structures following industry best practices

• Collaborate effectively with data engineering team members while partnering closely with analytics and data science teams to meet user needs

• Collaborate with business stakeholders and technical teams to understand data requirements, translate business needs into technical solutions
  

Requirements

• Master’s degree in computer science, Data Engineering, AI, or a related field

• 5+ years of professional experience in Data Engineering and Big Data, building production-grade data platforms and pipelines

• Proven experience with the Databricks platform (Azure Databricks or Databricks on AWS), including Unity Catalog and Delta Lake / Lakehouse architecture

• Strong experience with Apache Spark (PySpark), including performance optimization, and large-scale data processing

• Proficiency in Python and SQL for data transformations and analytics workloads

• Experience with data pipeline orchestration

• Experience with data governance and quality frameworks

• Strong problem-solving skills and ability to work independently

• Fluency in English and Polish, both written and spoken
  

Nice to have

• Data Engineer (Databricks) certificate

• Experience processing high-volume Automotive or IoT data (e.g., telemetry, sensor, or event-based data)

• Experience with streaming tools like Kafka, Azure Event Hubs, or similar

• Experience with Infrastructure as Code (Terraform, CloudFormation)
  

Benefits

• Non-corporate work environment among experienced engineers

• Individual growth & development plan supported by cyclical feedback sessions

• Access to knowledge platforms (e.g. Pluralsight)

• Equipment of your choice

• Financing of conferences, external trainings, and certifications

• Language lessons (English, German and Polish for foreigners)

• LuxMed private medical care

• Weekly Lunch & Learn where we meet up in the office, lunch together, and share our knowledge

• Employee referral program

• Rewards for the success of the month and year awarded by our employees

• Special rewards for your years with us (G-Man)

• Integration activities