Position: Location: Salary: Ref: Job Type: Published On: Start Date: Contact Name: Client:
Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes) London GBP70000 - GBP90000 per annum + listed in ad *AMC*AMI\BDE/IGC01_1566991561 Permanent 28/08/2019 Adam Mohammad Anson McCade

Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes)

Quick Summary

  • We are one of the largest independent business and technology services firms on the planet, with no sign of our rapid expansion halting.
  • We offer our services to clients from a vast range of industries and we're looking for a talented Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes) to join our dynamic analytics team to help develop and manage Big Data tools and infrastructure and tools, mostly designing and building platforms and pipelines.
  • On top of your salary you'll receive opportunities for development and learning, a vibrant social scene, health and wellbeing benefits, opportunities for share purchases and more.

The Firm:

As one of the world's largest technology and business services in the world, we are at the centre stage of digital transformation. We're passionate about our clients' digital journeys and take pride in offering our professionals opportunities within some of the most renowned firms on the planet, in developing cutting edge products.

Our success comes down to the talent and commitment of our unique workforce. As one big team, we share both the rewards and challenges of our work together, reinforcing our celebrated culture of ownership. We're offering an unmissable opportunity to contribute to the growth of our analytics department as it moves away from our rapidly expanding new technology practice.

The Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes) role:

  • You will work on collecting, storing, processing, and analysing massive sets of data.
  • Your main focus will be selecting optimal solutions to use for these purposes, then managing, implementing, and monitoring them.
  • You will also integrate these solutions with the architecture used firm-wide.
  • As a lead consultant, you will implement ETL best practices in a big data environment, featuring big data pipelines, real time streaming through the use of Kafka and leveraging elevated levels of proficiency across various distributed computing principles.
  • You will choose and integrate any Big Data frameworks and tools needed to provide requested capabilities, implementing ETL process, working with Cloud big data architecture such as AWS and Azure.
  • You will act as an SME regarding your knowledge of big data tools and platforms, data management tools and required infrastructure changes.

Requirements for the Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes) role:

  • Demonstrable past success in building scalable big data solutions as a hands-on architect or team lead
  • Knowledge of a range of tools and platforms such as Hadoop, Snowflake, Talend, Pentaho, Power BI, Informatica and Tableau
  • Knowledge of data management tools like Collibra and Alation
  • Knowledge of memory frameworks such as NoSQL, Marklogic, Mongodb, Cassandra, Memsql and Neo4j
  • Ablity to manage Hadoop, with all included services
  • Familiarity with building stream-processing systems through the use of solutions like Storm or Spark-Streaming
  • Knowledge of Big Data querying tools such as Impala, Pig or Hive, and Impala
  • Familiarity with Spark, integration of data from various data sources and multiple messaging systems including Kafka or RabbitMQ
  • Beneficial tools may include Mahout, SparkML, or H2O
  • Knowledge of Lambda Architecture, Cloudera/MapR/Hortonworks, Azure big data stacks, AWS, CI/CD using Docker and Kubernetes, Spark/Scala/Java/Python, Redis, Elastic.
  • Flexibility to travel is essential for movement across customer sites.

If this role sounds like it could be a perfect fit for you, please call Annie - 02077806700

Senior Big Data Engineer (ETL, Hadoop, Docker, Kubernetes)

Reference: *AMC*AMI\BDE/IGC01

Location: London

Duration: Permanent

Day Rate: £70,000-£90,000 + package

Agency: Anson McCade

Contact: Annie McIlhatton

Job Benefits:

listed in ad