Lead Data Engineer
We are currently looking for a lead/senior data engineer to work for a leading global investment bank based in London. The role is within the Markets Data & Analytics department, working on their Big Data Lake which is the largest aggregation of data they've ever had.
The team partners IT to deliver an ecosystem of sets of data created from global, raw, structured and unstructured sources. The major aim of this hands on role is to design optimal solutions, integrating with the architecture used across the bank to build out some core services that power Machine Learning and analytics systems.
The tech stack includes: Scala, Python, Spark (PySpark), Hive, Hadoop, Hortonworks/Cloudera, GCP (not mandatory to have), ELK, Javascript/HTML5/CSS3, Git/Gitlab, CI/CD and Anaconda/Python based ML model deployment.