Databricks Engineer - Data Analytics & AI Division

The Project We are looking for a Data Engineer (Databricks) to join our partner's international team. The role focuses on building and optimizing modern data platforms, developing scalable data pipelines, and supporting cloud-based analytics solutions in a dynamic environment. Requirements Requirements - Bachelor's degree in Computer Science, Information Technology, or a related field - More than 4 years of experience in data engineering, big data, or cloud-based analytics, with a strong preference for experience in banking or fintech sector - More than 2 years of hands-on experience with Databricks (Workflows, Jobs, Notebooks, and Clusters), including Delta Lake, Spark Structured Streaming - Expertise in Apache Spark (PySpark/Scala) for large-scale data processing and real-time analytics - Advanced experience in SQL and Python/Scala, with experience in data transformations and ETL pipelines - Strong understanding of Delta Lake architecture for data versioning, ACID transactions, and schema evolution - Experience with Cloud Platforms, particularly Databricks on Azure - Knowledge of Lakehouse architecture and designing scalable, secure, and cost-efficient data pipelines is a plus - Familiarity with streaming architectures (Kafka) is a plus - Experience in MLOps and model deployment using MLflow in Databricks is a plus - Ability to collaborate with data scientists, analysts, and business teams to understand data needs - Strong problem-solving skills, with the ability to troubleshoot performance bottlenecks and optimize workloads - Excellent communication skills to explain technical concepts to non-technical stakeholders Benefits Benefits - Full-remote working - International working environment - Modern technologies and challenging projects - Opportunity to work with experienced professionals - Long-term career opportunities Originally posted on Himalayas