Data Engineer

We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats. KEY RESPONSIBILITIES Develop and optimize Spark workloads in cloud environments Work with large datasets using Parquet and Iceberg Translate requirements into robust engineering solutions Ensure performance, reliability, and maintainability Contribute to monitoring, documentation, and deployment MUST HAVE Strong Python and PySpark Hands-on Apache Spark, cloud preferred Databricks experience Large-scale data systems expertise Client-facing delivery background Independent problem-solving in ambiguous settings NICE TO HAVE AWS Glue and Lake Formation Airflow and orchestration tools Distributed data architectures Capital markets exposure Originally posted on Himalayas