Spark Scala Developer At Infosys Mississauga

Join Infosys as a Spark Scala Developer to craft scalable big-data solutions. This role focuses on building effective data pipelines using the Hadoop ecosystem and Apache Spark. As a Spark Scala Developer, you will design and optimize large-scale data processing systems.

Your responsibilities include creating high-performance batch and real-time workflows with Spark, Kafka, and Hadoop, collaborating with data engineers and architects to meet business needs. You will leverage your problem-solving skills to develop and maintain complex data lakes and data processing pipelines.

Key Responsibilities

• Design large-scale data processing pipelines using Apache Spark
• Optimize batch and real-time workflows with Spark and Kafka
• Develop Spark applications using RDDs, DataFrames, and SQL
• Implement streaming pipelines in Kafka and Spark Streaming
• Collaborate with cross-functional teams to fulfill business requirements