Databricks Practice Lead

We are seeking an experienced Databricks Practice Lead to drive the technical vision, growth, and delivery excellence of our Databricks practice. This role combines deep hands-on expertise in modern data engineering with leadership responsibilities, including defining technical standards, mentoring engineering teams, supporting business development, and delivering scalable cloud-based data solutions for enterprise clients. You will work closely with clients, engineering teams, solution architects, delivery leaders, and business stakeholders to design innovative data platforms, guide technical decision-making, and expand the organization's Databricks capabilities. The ideal candidate is both a strong technical leader and a trusted advisor who can bridge business objectives with modern data engineering solutions. Responsibilities - Lead the technical direction and growth of the Databricks Practice, establishing standards, best practices, and reusable solution accelerators. - Design and review enterprise-scale data platform architectures using Databricks, Apache Spark, and Microsoft Azure. - Provide technical leadership and architectural guidance across multiple client engagements. - Partner with clients to understand business challenges and recommend scalable data and analytics solutions. - Lead technical discovery sessions, solution workshops, architecture reviews, and design discussions with clients. - Mentor and coach Data Engineers, Technical Leads, and Solution Architects, fostering technical excellence and career development. - Define best practices for data engineering, software engineering, DevOps, security, governance, and operational excellence. - Establish standards for ETL/ELT development, data quality, monitoring, performance optimization, and production support. - Drive adoption of modern data architectures, including Lakehouse, Delta Lake, and event-driven data processing. - Collaborate with Delivery Managers and Engineering Managers to support project planning, staffing, technical risk management, and solution quality. - Support pre-sales activities, including solution design, technical proposals, effort estimation, client presentations, and proof-of-concept initiatives. - Stay current with Databricks platform capabilities and emerging technologies, identifying opportunities to improve services and expand practice offerings. - Promote the adoption of AI-assisted software development and engineering best practices across the practice. - 8+ years of professional experience in Data Engineering, Data Platform Engineering, or related disciplines. - 3+ years of experience leading technical teams, architecture initiatives, or data engineering practices. - Deep expertise with Databricks, including workspace administration, notebooks, jobs, workflows, Unity Catalog, Delta Lake, and Lakehouse architecture. - Strong experience developing scalable data pipelines using Apache Spark (PySpark). - Extensive experience with Microsoft Azure, including services such as Azure Data Lake Storage (ADLS), Azure Data Factory, Azure Event Hubs, Azure Key Vault, and Azure DevOps. - Strong programming skills in Python, including clean coding practices and object-oriented programming principles. - Experience with orchestration tools such as Apache Airflow or Dagster. - Experience working with streaming technologies such as Apache Kafka or Azure Event Hubs. - Strong understanding of data architecture, dimensional data modeling, metadata management, and enterprise data platform design. - Experience implementing data governance, data quality, security, and compliance practices. - Experience building and optimizing enterprise ETL/ELT solutions. - Strong knowledge of SQL and relational database concepts. - Experience deploying cloud-native data solutions, preferably on Microsoft Azure. - Excellent consulting, presentation, and stakeholder management skills with experience interacting directly with enterprise clients. - Experience leading architecture discussions, technical governance, and solution reviews. - Ability to lead multiple initiatives simultaneously while providing technical direction across distributed teams. - Experience working in Agile development environments. Perks you enjoy at KMSMexico - Mexican law benefits - 15 days of PTO (in year zero, from the first year onwards it is 3 days per year). - 5 days' leave for the death of immediate family members, negotiable. - Major Medical Expenses Insurance with coverage for immediate dependents (spouse and children). - Annual performance bonus (≈10% of annualized salary). - Annual salary adjustment. - Employee Referral Bonus. - Paid Certifications / Courses - Coursera License. - 5% Savings Fund. - 5% Grocery Vouchers. At KMS Technology Mexico, we are passionate about building innovative software solutions that drive impact. As part of an international tech company, we offer a collaborative and inclusive environment where your ideas matter and your growth is our priority. Originally posted on Himalayas