Position: Location: Salary: Ref: Job Type: Published On: Start Date: Contact Name: Client:
Big Data Enginner London GBP86500 - GBP115000 per annum JBU/201/2/CI/BD_1560268133 Permanent 11/06/2019 Adam Mohammad Anson McCade

Big Data Engineer

The opportunity would allow you to work in our collaborative start-up environment in an Innovation Lab working on solely Greenfield applications.

Our lab is backed by a Tier 1 Investment Bank and is one of the most heavily funded in the UK. Here a Big Data Engineer is provided with the flex and innovation of a tech hub but with the financial backing and security of a major bank as you work on a revolutionary new cloud-based risk platform.

You could expect to gain a strong salary increase along with further responsibility; furthermore, the opportunities to climb the ladder as our team expands.

We are looking for a Big Data Engineer with experience of working with online and offline time-series data. You will be building data processing pipelines across bounded and unbounded datasets, powering models integrated into the decision-making systems and enabling end users to gain greater insights on their data.

You have the opportunity to work with the Rates team handling huge amounts of data. This data is used by the data science team to perform analysis which influences decision making!

Big Data Engineer

Key responsibilities

  • Meet the data needs of a Full Stack Data Science Engineering Team
  • Build a strong partnership with our centralized Big Data DevOps Team
  • Work closely with product owners to develop client solutions for new and existing channels
  • Grow the catalogue of common assets
  • Troubleshoot performance and scalability issues

Skills and Qualifications

  • Expertise in Spark
  • Expertise in Python
  • Knowledge of the Hadoop framework (and ecosystem using a popular distribution
  • Knowledge of streaming platforms, especially Apache Kafka and Spark Streaming
  • Proficiency in SQL
  • Containerisation experience
  • You are educated to degree level or above

Big Data Engineer

This is an exclusive position for the best Big Data Engineers in the City.

If you think you are strong enough then give me Joe Burke a call on 0207 780 6700 or send across an email