Specialist Software Engineer-Spark & Scala
Responsibilities
Job Title: Data Engineer (Spark/Big Data Platform)
Experience: 3 to 5 Years
Location: Bangalore
Employment Type: Full-Time
Objective
Design, build, and operate scalable data processing pipelines to deliver trusted, business-ready data to analytics and BI platforms.
Key Responsibilities
- Develop and optimize data processing jobs using Apache Spark (Scala).
- Build operational scripts and services with Shell and Python (INGAAS context).
- Orchestrate and schedule workflows using Apache Airflow.
- Work within Cloudera/Lucid ecosystems: Hadoop (Hortonworks), Kafka, HDFS, Hive, YARN.
- Knowledge on Medallion and Layered Data Architectures.
- Model data and expose curated datasets to Power BI via StarBurst/Trino.
- Ensure data quality, reliability, and performance across large-scale data lakes.
Deliverables
- Clean, structured, and consumable data assets for BI and Big Data use cases.
- Secure and performant data exposure to Power BI.
Profile required
Job Title: Data Engineer (Spark/Big Data Platform)
Experience: 3 to 5 Years
Location: Bangalore
Employment Type: Full-Time
Objective
Design, build, and operate scalable data processing pipelines to deliver trusted, business-ready data to analytics and BI platforms.
Key Responsibilities
- Develop and optimize data processing jobs using Apache Spark (Scala).
- Build operational scripts and services with Shell and Python (INGAAS context).
- Orchestrate and schedule workflows using Apache Airflow.
- Work within Cloudera/Lucid ecosystems: Hadoop (Hortonworks), Kafka, HDFS, Hive, YARN.
- Knowledge on Medallion and Layered Data Architectures.
- Model data and expose curated datasets to Power BI via StarBurst/Trino.
- Ensure data quality, reliability, and performance across large-scale data lakes.
Deliverables
- Clean, structured, and consumable data assets for BI and Big Data use cases.
- Secure and performant data exposure to Power BI.
Why join us
"We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.
Business insight
At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.
Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.
If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.