Glint Tech Solutions LLC

Data Engineer Focused on Spark Workloads

📍 toronto, on, Canada ⏰ Full-time

Description

Total Fund Management is seeking a hands-on Data Engineer to elevate cloud data systems using Spark. Join a dynamic team to tackle large datasets for superior performance.
As a Data Engineer within the Portfolio Management Technology team, you will build and optimize data systems that leverage Spark and modern storage formats. This role demands strong analytical skills to translate diverse requirements into scalable engineering solutions while ensuring maintainability and reliability.
Key Responsibilities:
• Optimize large-scale workloads using Spark in cloud environments
• Handle datasets with Parquet and Iceberg formats effectively
• Translate business requirements into engineering solutions
• Maintain system performance and reliability
• Document and support deployment efforts
Requirements:
• Expertise in Python and PySpark
• Experience with Apache Spark, preferably in cloud environments
• Knowledge of Databricks and distributed data systems
• Bac...
Apply Now