JobMatch
← Back to jobs

Data Engineer

Avanade

RemoteCracow Metropolitan AreaFull-time
Posted
1 month ago
Source
LinkedIn (remote, Europe)
Field
Engineering, Data & Analytics

Skills

Machine LearningKubernetesTensorFlowSecurityPythonDockerAzureLLMsSQLETLAI

Description

Come join us What You’ll Do In the Data Engineer role, you’ll expand your expertise by contributing to modern initiatives across a variety of industries and business domains. You’ll work with a broad toolset, with responsibilities including: - Creating, developing, and operating scalable, efficient, and dependable data pipelines - Delivering end-to-end data platforms, including data architecture and ETL implementations - Partnering with data scientists, analysts, and engineering teams to integrate data and improve end-to-end performance - Applying best practices for data governance, quality, and security across the data estate - Tuning and streamlining data workflows to maximize reliability and throughput - Keeping current with new trends and advancements in data engineering - Supporting and coaching junior data engineers through mentoring and knowledge sharing - Opportunity to grow your skills in advanced AI technologies Tech stack You’ll use a range of tools depending on the project, however our core stack typically includes: Databricks, PySpark, Azure cloud and services (Data Lake, SQL Database, Azure Databricks, Azure Data Factory), SQL, Python, MS Fabric Qualifications Skills and experiences : Must-have Skills To be successful in this position, you should have hands-on commercial experience with: - Azure cloud and services (e.g. Azure Data Factory, Data Lake, SQL Database, Azure Databricks) - Databricks (commercial project experience) - Python and PySpark for building and operating data solutions - SQL for querying, transforming, and validating data - Core data engineering practices (ETL, data modeling, data warehousing, data governance) - English at B2 level (or higher) Nice To Have - Hands-on experience with MS Fabric - Familiarity with containerization and orchestration (Docker/Kubernetes) - Understanding of machine learning concepts and frameworks (e.g. MLflow, TensorFlow) - Knowledge or experience with LLMs and orchestration frameworks

JobMatch aggregates public listings. Always apply through the original posting.