Big Data Engineer (Spark)

Permanent contract|Bangalore|Data

Big Data Engineer (Spark)

Bangalore, India Permanent contract Data

Responsibilities

Setup of Datalake Infrastructure SG Cloud

Setup of Azure environment for use cases/feeders hosted in Azure

Setup and maintain the CI/CD Pipeline for BAN topics (Jenkins, Maven, Sonar, Nexus)

Container/orchestrator: as part of CI/CD, building Doker images and deployment within Kubernetes

Implementation/maintenance of Scheduler/Orchestrator: Airflow

Set up of Workspace in Datalake Lucid

Setup and maintain Datamart

Assist the team to deploy the Dashboards in SG dashboard

Participate to API Development

 

Profile required

• Require 4+ years relevant experience (Spark)

• Programming experience Using Spark - Java/Scala

• Working knowledge on CI/CD Pipeline

• Experience in Hadoop and HIVE on AZURE is mandatory

• Participate to API Development

• Experience on Unix and SQL is a must.

• Experience on support activities.
• Ability to work closely in a team environment is highly recommended.
• Worked on at least one project with minimum 12 months period

• Programming experience Using Spark - Java/Scala

• Working knowledge on CI/CD Pipeline

• Experience in Hadoop and HIVE on AZURE is mandatory

• Participate to API Development

Why join us

“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

Business insight

At Societe Generale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.

Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.

If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices, and sharing their skills with charities. There are many ways to get involved.

We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, sexual or gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.

Reference: 20000M96
Entity: SG Global Solution Centre
Starting date: 2021/02/01
Publication date: 2020/11/02
Share