Your new companyWorking for a renowned financial services organisation Your new roleWe are seeking a Data Engineer to support the replacement of a legacy ETL tool with a modern Apache Spark based data platform. This is a hands-on engineering role focused on building and supporting Spark jobs, with an emphasis on performance, reliability, and scalability.The role is focused on building nonperformance Apache Spark jobs, with a strong emphasis on performance optimisation. It is primarily Java-based, with Python strongly encouraged; experience across Java, Python, and Scala is ideal, with Java and Python being the preferred combination.The role sits within a small Agile delivery team of four engineers (two onshore and two in Shenzhen), working closely with a Senior Data Engineer. You will be responsible for development work, sprint delivery, demos, documentation, and stakeholder engagement. This position suits a mid-level engineer with strong Spark development experience rather than design, infrastructure, or management responsibilities.What you''ll need to succeedStrong hands-on experience with Apache Spark - Writing and tuning Spark jobs /PySpark development experienceStrong Java or Java Spring boot development backgroundExperience with programming in Python or ScalaExposure to Big Data technologies and distributed data processingWorking with containerised environments using Kubernetes/ Airflow.Agile ways of working (Scrum, sprints, demos)Comfortable working in a distributed te