Data Engineer- Streaming Data

From 4 to 9 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description

Roles and Responsibilities

Position: Software Developer – Data Engineering

Location: Pune (Currently WFH, Post pandemic you need to relocate in Pune)

About the Organisation:

It provides a dynamic, fun workplace filled with passionate individual with a truly global footprint, headquartered in Singapore and offices in Australia, United States, United Kingdom, and India.

You will gain work experience in a global environment. It speaks over 20 different languages, from more than 16 different nationalities and over 42% of our staff are multilingual.

We are looking for exceptional Data Engineers who can contribute to building a world class big data engineering stack that will be used to fuel a Machine Learning product pipeline. This position will be contributing to the architecture, operation, and enhancement of:

A petabyte-scale data platform with a key focus on finding solutions that can support the Machine Learning product road--map. This platform ingests terabytes of data daily which need to be made available to a variety of Machine Learning use cases.

Bespoke Machine Learning pipelines. This will also provide opportunities to contribute to the prototyping, building and deployment of Machine Learning models.

The candidate should have significant experience developing and operating a modern data pipeline platform and should have a keen interest in Machine Learning and Data Science


Have at least 4+ years’ Experience.

Deep technical understanding of Java or Golang.

Production experience with Python is a big plus, extremely valuable supporting skill for


Exposure to modern Big Data tech: Cassandra/Scylla, Kafka, Ceph, the Hadoop Stack,

Spark, Flume, Hive, Druid etc while at the same time understanding that certain

problems may require completely novel solutions.

Exposure to one or more modern ML tech stacks: Spark ML-Lib, Tensorflow, Keras,

GCP ML Stack, AWS Sagemaker - is a plus.

Experience includes working in Agile/Lean model

Experience with supporting and troubleshooting large systems

Exposure to configuration management tools such as Ansible or Salt

Exposure to IAAS platforms such as AWS, GCP, Azure

Good addition - Experience working with large-scale data

Good addition - Good to have experience architecting, developing, and operating data

warehouses, big data analytics platforms, and high velocity data pipelines

Good to have:

  • Experience working with large-scale data
  • Experience architecting, developing, and operating data warehouses, big data analytics platforms, and high velocity data pipelines.

Role:Full Stack Developer

Salary: Not Disclosed by Recruiter

Industry:Software Product

Functional Area:Engineering - Software

Role Category:Software Development

Employment Type:Full Time, Permanent


UG:B.Tech/B.E. in Electronics/Telecommunication, Computers, Electrical

PG:M.Tech in Computers,MCA in Computers

Doctorate:Doctorate Not Required

Company Profile

RS Consultants

A series B funded product based company, headquartered in Singapore and offices in Australia, United States, Germany, United Kingdom, and India.
Company Info
View Contact Details+

Recruiter Name:Biswadip

Contact Company:RS Consultants

Email:[email protected]

Reference Id:SWDE0621