We are looking for an energetic Big data lead who has a passion for data and analytics. The Big Data Engineer would lead a team of high caliber data engineers to develop and build the next generation big data platform for advanced analytics using variety of technologies. The person in this role will definite and shape the competency in terms of frameworks, best practices and techniques.
• BS or higher in Computer Science or similar field.
• Prior experience in Java development or Data warehousing
• Experience architecting and developing big data solutions for multiple projects including Machine Learning.
• Strong concepts of Machine Learning
• 5+ years in big data ( Cloudera preferred ) with deep understanding of Hadoop ecosystem including Kafka, HDFS, Kudu, Hbase, DeltaLake etc.
• Developing applications onprem as well in cloud ( Azure preferred )
• Developed numerous workflows for structured and unstructured data sets
• Strong design experience.
• Deep experience in building spark pipelines using Python, Scala or Java.
• Executed multiple full life cycle development processes and own the design and development from data ingestion to data transformation to insights.
• Experience implementing machine learning models using Spark ML
• Strong data analysis skills using Python, Pandas, Koalas.
• Strong Unix/Linux experience
• Integration technologies like Web Services, Kafka
• Strong SQL experience using analytical functions
• Excellent Communication, Documentation and project management skills
• Ability to work on multiple projects in parallel
• Experience in DevOps ( an emerging focus area for the group )
• Deep Big Data understanding and experience – 5+ yrs
• PySpark – 2+
• Knowledge of Supervised and Unsupervised algorithms
• Experience working on ML based projects
• SQL – 4+ yrs
• Unix – 2+
Apply now to have the opportunity to be considered for similar jobs at leading companies in the Seen network for FREE.
Zero stress and one profile that can connect you directly to 1000s of companies.
We’ll take it from there. After you tell us what you’re looking for, we’ll show you off to matches.
Boost your interview skills, map your tech career and seal the deal with 1:1 career coaching.
Join now and be seen.