Grid DynamicsRemote

Lead Data Engineer

Description

🚀 Lead Data Engineer (EU) We’re looking for a Lead Data Engineer to join a high-impact data transformation initiative focused on modernizing data pipelines and enabling scalable, future-ready data architecture. This role is ideal for someone who enjoys working на стику data engineering, architecture, and cross-team collaboration, and хоче впливати на стратегічні рішення у data ecosystem. 🌍 About the Project You will be part of a large-scale initiative aimed at transforming how data is ingested, processed, and consumed across the organization. The key focus is on migrating and optimizing data flows, ensuring seamless integration with modern platforms such as Databricks Unity Catalog, and enabling more efficient and scalable data consumption. 🧩 Key Responsibilities Analyze existing data pipelines and codebase to identify data entry points Design and execute data source migration strategies (source-to-target mapping, adapters development) Redesign data consumption processes to support integration with Databricks Unity Catalog Collaborate closely with cross-functional teams (data foundation & product teams) Ensure smooth transition and alignment across systems, including permissions and dependencies Drive best practices in data engineering and contribute to architectural improvements 🛠️ Tech Stack Python / Spark / SQL Azure Data Factory Apache Airflow Databricks ecosystem (Unity Catalog)

Skills

AirflowDatabricksPythonAzureSQLData EngineeringApacheApache SparkSpark

Want AI to find more roles like this?

Upload your CV once. Get matched to relevant assignments automatically.

Try personalized matching