Software Engineer - Big data [Scala / Spark]
Responsibilities
Build and optimize performance of Hadoop/Scala-Spark batch jobs.
• Build and optimize performance of Kafka, ELK, NIFI and other components of real-time pipelines
• Participate and contribute to the design, architecture and development of high quality data-lake data models
• Build data pipeline orchestration
• Ensuring code quality and conformance of code to applicable rules, norms and relevant best practices
• Coaching, mentoring and developing new hires and less experienced developers to work on Big Data projects
Profile required
• 2+ years of overall experience should be in Big Data and related technologies. Prior experience in Java development would be required.
• B.E./B.Tech/MCA/M.S. in Computer Sciences and/or Information Technology with additional specialized education and
training in Big Data technologies.
Strong understanding of distributed systems and distributed computation.
• Strong working knowledge in Scala / Spark
• Demonstrated working knowledge with data Apache Hadoop ecosystem like Spark, Hive, Oozie, Hue, NiFi
• Demonstrated working knowledge of data modeling
• Demonstrated working knowledge of Java 1.8 feature
• Experience in designing and running Unit, Integration, and Load testing
• Hands-on exposure to NoSQL technologies like MongoDB and HBase
• ELK Stack
• Git
• SBT or Maven
• Unix/Linux
• Jenkins & Ansible
• Knowledge of TDD & BDD methodologies, tools and practices
Why join us
“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”
Business insight
At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious. Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating, and taking action are part of our DNA. If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.
We are committed to support accelerating our Group’s ESG strategy by implementing ESG principles in all our activities and policies. They are translated in our business activity (ESG assessment, reporting, project management or IT activities), our work environment and in our responsible practices for environment protection.