Position: Salary: Ref: Job Type: Published On: Start Date: Contact Name: Client:
Big Data Engineer - Rates Technology Central London, London GBP80000 - GBP100000 per annum JBU/201/2/CTY/BD/PRI_1558429905 Permanent 21/05/2019 Adam Mohammad Anson McCade

Big Data Engineer - Rates Technology

This opportunity would allow you to work in an Innovation Lab which is backed by a Tier-1 Investment bank!

This means you would be working out of one of the most heavily funded Innovation Labs in the UK alongside highly intelligent and professional colleagues. You would be based in a luxurious WeWork Office in the heart of London, with all the perks you have come to expect - micro-roasted coffee, yoga and pilates sessions, and lunch and learn lessons where you can explore educational avenues you may have not delved into previously.

You could expect to gain a strong salary increase along with further responsibility; furthermore, the opportunities to climb the ladder as the team expands are exceptionally strong.

We are looking for a Big Data Engineer with experience of working with online and offline time-series data. You will be building data processing pipelines across bounded and unbounded datasets, powering models integrated into the decision-making systems and enabling end users to gain greater insights on their data.

You have the opportunity to work with the Rates team handling huge amounts of data. This data is used by the data science team to perform analysis which influences decision making!

Key responsibilities

  • Meet the data needs of a Full Stack Data Science Engineering Team
  • Build a strong partnership with our centralized Big Data DevOps Team
  • Work closely with product owners to develop client solutions for new and existing channels
  • Grow the catalogue of common assets
  • Troubleshoot performance and scalability issues

Skills and Qualifications

  • Expertise in Spark
  • Expertise in Python
  • Knowledge of the Hadoop framework (and ecosystem using a popular distribution
  • Knowledge of streaming platforms, especially Apache Kafka and Spark Streaming
  • Proficiency in SQL
  • Containerisation experience
  • You are educated to degree level or above

Big Data Engineer - Rates Technology

If you are ambitious, hungry and looking for a Big Data challenge then please give me a call on 0207 780 6700. Alternatively, please email me at