Senior Data Engineer

Cobalt Streamworks is hiring via Cobalt Streamworks Senior Data Engineer job (Remote only) | Cutshort

Senior Data Engineer
Senior Data Engineer

3
\- 6 yrs
₹15L - ₹30L / yr
Remote only
Skills
PySpark
Scala
databricks
Data engineering
Job Title: Senior Data Engineer
No. of Positions: 3
Employment Type: Full-Time, Permanent
Location: Remote (Pan India)
Shift Timings: 10:00 AM – 7:00 PM IST
Experience Required: Minimum 3+ Years
Mandatory Skills: Scala & PySpark
Role Overview
We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and architectures. The ideal candidate should have hands-on experience working with Big Data technologies, distributed systems, and ETL pipelines. You will work closely with cross-functional teams including Data Analysts, Data Scientists, and Software Engineers to ensure efficient data flow and reliable data infrastructure.
Key Responsibilities
– Design and build scalable data pipelines for extraction, transformation, and loading (ETL) from various data sources.
– Enhance internal processes by automating tasks, optimizing data workflows, and improving infrastructure performance.
– Collaborate with Product, Engineering, Data, and Business teams to understand data needs and provide solutions.
– Work closely with machine learning and analytics teams to support advanced data modeling and innovation.
– Ensure systems are highly reliable, maintainable, and optimized for performance.
Required Qualifications & Skills
– Bachelor’s degree in Computer Science, Engineering, or related field.
– 3+ years of hands-on experience in Data Engineering.
– Strong experience with Apache Spark, with solid understanding of distributed data processing.
– Proficiency in Scala and PySpark is mandatory.
– Strong SQL skills and experience working with relational and non-relational data.
– Experience with cloud-based data platforms (preferably Databricks).
– Good understanding of Delta Lake architecture, Parquet, JSON, CSV, and related data file formats.
– Comfortable working in Linux/macOS environments with scripting capabilities.
– Ability to work in an Agile environment and deliver independently.
– Good communication and collaboration skills.
– Knowledge of Machine Learning concepts is an added advantage.
Reporting
– This role will report to the CEO or a designated Team Lead.
Benefits & Work Environment
– Remote work flexibility across India.
– Encouraging and diverse work culture.
– Paid leaves, holidays, performance incentives, and learning opportunities.
– Supportive environment that promotes personal and professional growth.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma
Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort

Founded
:
2022
Type
:
Services
Size
Stage
:
Profitable
About
At Cobalt Streamworks, we specialize in delivering India’s fastest hiring solutions, tailored to meet the unique needs of businesses across various industries. Our mission is to connect companies with exceptional talent, enabling them to achieve their growth and operational goals swiftly and efficiently.
We are able to achieve a success rate of 87% in relevancy of candidates to the job position and 62% success rate in closing positions shared with us.
Read more
Company social profiles

Similar jobs

Posted by
Apoorva Lakshkar
Mumbai
7
\- 10 yrs
₹15L - ₹23L / yr
Google Cloud Platform (GCP)
Amazon Web Services (AWS)
DevOps
Kubernetes
Job Overview
We are seeking an experienced Senior Solution Architect to join our dynamic DevOps organization. The ideal candidate will have a strong background in cloud technologies, with expertise in migration projects across platforms such as GCP, AWS, and Azure. The candidate should possess a deep understanding of DevOps principles, Kubernetes orchestration, Data migration & management and automation tools like CI/CD pipelines and Terraform.The individual should be highly skilled in designing scalable application architectures capable of handling substantial workloads while ensuring the highest standards of quality.
Key Responsibilities
– Lead and drive cloud migration projects from on-premises data centers or other cloud platforms to GCP, AWS, or Azure.
– Design and implement migration strategies that ensure minimal downtime and maximum efficiency.
– Demonstrate proficiency in GCP, AWS, and Azure, with the ability to choose and optimize solutions based on specific business requirements.
– Provide guidance on selecting the appropriate cloud services for various workloads.
– Design, implement, and optimize CI/CD pipelines to streamline software delivery.
– Utilize Terraform for infrastructure as code (IaC) to automate deployment processes.
– Collaborate with development and operations teams to enhance the overall DevOps culture.
– Possess in-depth knowledge and practical experience with Kubernetes orchestration for containerized applications.
– Architect and optimize Kubernetes clusters for high availability and scalability.
– Engage in research and development activities to stay abreast of industry trends and emerging technologies.
– Evaluate and introduce new tools and methodologies to enhance the efficiency and effectiveness of cloud solutions.
– Architect solutions that can handle large-scale workloads and provide guidance on scaling strategies.
– Ensure high-performance levels and reliability in production environments.
– Design scalable and high-performance database architectures tailored to meet business needs.
– Execute database migrations with a keen focus on data consistency, integrity, and performance.
– Develop and implement database pipelines to automate processes such as data migrations, schema changes, and backups.
– Optimize database workflows to enhance efficiency and reliability.
– Work closely with clients to assess and enhance the quality of existing architectures.
– Implement best practices to ensure robust, secure, and well-architected solutions.
– Drive migration projects, collaborating with cross-functional teams to ensure successful execution.
– Provide technical leadership and mentorship to junior team members.
Required Skills and Qualifications:
– Bachelor's degree in Computer Science, Information Technology, or related field.
– Relevant industry experience in a Solution Architect role.
– Proven experience in leading cloud migration projects across GCP, AWS, and Azure.
– Expertise in DevOps practices, CI/CD pipelines, and infrastructure automation.
– In-depth knowledge of Kubernetes and container orchestration.
– Strong background in scaling architectures to handle significant workloads.
– Sound knowledge in database migrations
– Excellent communication skills and the ability to articulate complex technical concepts to both technical and non-technical stakeholders.
Read more

WrkSpot
Agency job
Bengaluru (Bangalore)
6
\- 9 yrs
₹10L - ₹15L / yr
RESTful APIs
Angular (2+)
React.js
Relational Database (RDBMS)
mobx
+2 more
Role: Sr. Frontend Developer
– Exp: 6 -9 Years
– CTC: up to 35 LPA
What we Require
– To convert our existing web application into a micro front-end architecture. The ideal candidate should have experience in AngularJS, ReactJS, MobX, and SCSS. Exposure to socket integration, mqtt integration would be a plus.
– Identify our existing web application’s different components and modules. Separate them into independent micro front-ends.
– Develop and maintain micro front-ends using AngularJS, ReactJS, MobX and SCSS
– Implement and configure Module Federation in Webpack 5 to share components between micro front-ends.
– Optimize micro front-ends for maximum speed and scalability.
Read more

Posted by
Nandini Goyal
Noida
3
\- 5 yrs
₹3L - ₹6L / yr
AngularJS (1.x)
Angular (2+)
React.js
NodeJS (Node.js)
MongoDB
+5 more
Duties and responsibilities
– Responsible for the development of new highly responsive, web-based user interface
– Construct visualisations that are able to depict vast amounts of data
– Work and collaborate with the rest of the engineering team
– Work with the product team and graphic designers
– Learn and understand user interactions
– Develop a flexible and well-structured front-end architecture, along with the APIs to support it