Big data Engineer
o Work closely with Enterprise Risk CTO vertical Equity Aggregation team to understand the data requirements.
o Analyze incoming data requests for Equity Aggregation and determine appropriate target solutions.
o Develop data service design
o Lead the data service build, test and deployment
o Partner with Enterprise data teams such as Data Management & Insights and Enterprise Data Environment (Data Lake) and identify the best place to source the data
o Work with business analysts, development teams and project managers for requirements and business rules.
o Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
o Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
o Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
o Work with DBAs in Enterprise Database Management group to troubleshoot problems and optimize performance
o Support ongoing data management efforts for Development, QA and Production environments
o Utilizes a thorough understanding of available technology, tools, and existing designs.
• Acts as expert technical resource to programming staff in the program development, testing, and implementation process.
• Spark rdd, scala/python, hive, pig are required.
• ETL know how is good to have.
Apply now to have the opportunity to be considered for similar jobs at leading companies in the Seen network for FREE.
Zero stress and one profile that can connect you directly to 1000s of companies.
We’ll take it from there. After you tell us what you’re looking for, we’ll show you off to matches.
Boost your interview skills, map your tech career and seal the deal with 1:1 career coaching.
Join now and be seen.