Spark (Batch processing)
Programing Back ground (preferred Scala and java)
At least 4 years of hands experience on design and development using Bigdata related technologies - Spark, Hive, Oozie, HDFS, YARN etc
Good Understanding of Bigdata Ecosystem and related technologies
Must have strong programming knowledge on Scala.
Must have hands on experience in Developing Spark using Scala.
Strong understanding of Hadoop Ecosystem (HDFS, Oozie, Elastic Search and Kafka)
Strong understanding of Oozie and any other scheduling and data pipeline tools.
Write highly efficient and optimized code that is easily scalable.
Experience in development and design of big data applications with clean code and TDD kind of environment.
Build and manage data pipeline to collect and process data at scale.
Hands on experience on CI / CD tools, build tools like Maven ,test-driven development, Schell scripting and Java is a plus.
Working in Agile environment is a plus
Good communication skills and good team member.
Good Hands-on on Hive and Hue
We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, sexual or gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.