Sr. Data Engineer

Aperture Cloud is hiring Sr. Data Engineer job (Remote only) | Cutshort

Sr. Data Engineer
Sr. Data Engineer

at Aperture Cloud

Posted by
Bhoomika Varshney
4
\- 8 yrs
₹10L - ₹30L / yr
Remote only
Skills
Python
databricks
SQL
Spark
PySpark
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Microsoft Windows Azure
The Sr AWS/Azure/GCP Databricks Data Engineer at Aperture Cloud will use comprehensive
modern data engineering techniques and methods with Advanced Analytics to support
business decisions for our clients. Your goal is to support the use of data-driven insights
to help our clients achieve business outcomes and objectives. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and
patterns, insights, and trends to decision-makers. You will help design and build data
pipelines, data streams, reporting tools, information dashboards, data service APIs, data
generators, and other end-user information portals and insight tools. You will be a critical
part of the data supply chain, ensuring that stakeholders can access and manipulate data
for routine and ad hoc analysis to drive business outcomes using Advanced Analytics. You are expected to function as a productive member of a team, working and
communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. Requirements:
 Strong experience as an AWS/Azure/GCP Data Engineer and must have
AWS/Azure/GCP Databricks experience.  Expert proficiency in Spark Scala, Python, and spark
 Must have data migration experience from on-prem to cloud
 Hands-on experience in Kinesis to process & analyze Stream Data, Event/IoT Hubs, and Cosmos
 In depth understanding of Azure/AWS/GCP cloud and Data lake and Analytics
solutions on Azure.  Expert level hands-on development Design and Develop applications on Databricks.  Extensive hands-on experience implementing data migration and data processing
using AWS/Azure/GCP services
 In depth understanding of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib
 Hands-on experience with the Technology stack available in the industry for data
management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc
 Hands-on knowledge of data frameworks, data lakes and open-source projects such
asApache Spark, MLflow, and Delta Lake
 Good working knowledge of code versioning tools \[such as Git, Bitbucket or SVN\]
 Hands-on experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair
 Experience preparing data for Data Science and Machine Learning with exposure to- model selection, model lifecycle, hyperparameter tuning, model serving, deep
learning, etc
 Demonstrated experience preparing data, automating and building data pipelines for
AI Use Cases (text, voice, image, IoT data etc. ).  Good to have programming language experience with. NET or Spark/Scala
 Experience in creating tables, partitioning, bucketing, loading and aggregating data
using Spark Scala, Spark SQL/PySpark
 Knowledge of AWS/Azure/GCP DevOps processes like CI/CD as well as Agile tools
and processes including Git, Jenkins, Jira, and Confluence
 Working experience with Visual Studio, PowerShell Scripting, and ARM templates.  Able to build ingestion to ADLS and enable BI layer for Analytics
 Strong understanding of Data Modeling and defining conceptual logical and physical
data models.  Big Data/analytics/information analysis/database management in the cloud
 IoT/event-driven/microservices in the cloud- Experience with private and public cloud
architectures, pros/cons, and migration considerations.  Ability to remain up to date with industry standards and technological advancements
that will enhance data quality and reliability to advance strategic initiatives
 Working knowledge of RESTful APIs, OAuth2 authorization framework and security
best practices for API Gateways
 Guide customers in transforming big data projects, including development and
deployment of big data and AI applications
 Guide customers on Data engineering best practices, provide proof of concept, architect solutions and collaborate when needed
 2+ years of hands-on experience designing and implementing multi-tenant solutions
using AWS/Azure/GCP Databricks for data governance, data pipelines for near real-
time data warehouse, and machine learning solutions.  Over all 5+ years' experience in a software development, data engineering, or data
analytics field using Python, PySpark, Scala, Spark, Java, or equivalent technologies.  hands-on expertise in Apache SparkTM (Scala or Python)
 3+ years of experience working in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.  Bachelor's or Master's degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience
 Ability to manage competing priorities in a fast-paced environment
 Ability to resolve issues
 Basic experience with or knowledge of agile methodologies
 AWS Certified: Solutions Architect Professional
 Databricks Certified Associate Developer for Apache Spark
 Microsoft Certified: Azure Data Engineer Associate
 GCP Certified: Professional Google Cloud Certified
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma
Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort

Founded
:
2020
Type
:
Products & Services
Size
:
100-1000
Stage
:
Raised funding
About
We work with you to understand your current technology landscape and strategic goals and connect you with solutions to modernize your technology platform. We help you leverage the power of technology to transform your business by reducing complexities and improving growth velocity. We support you at every step of the way as you modernize your data platforms: strategy, capability identification, execution, and organization while making ethical AI considerations to drive your initiatives. As a true consulting partner, Aperture Cloud does more than provide a technology solution; we guide you through the entire process so that you can make the best decisions for your company. ​​ Today's competitive marketplace requires innovation and agility to scale and outpace the competition. Are you harnessing the power of data for game-changing predictive insights? Let's discuss solutions that best support your strategy.
Read more
Company social profiles

Similar jobs

Posted by
tabbasum shaikh
Bengaluru (Bangalore)
9
\- 12 yrs
₹50L - ₹60L / yr
Software engineering
backend engineering
Java
Spring Boot
Microservices
+2 more
Role & Responsibilities
As a Staff Engineer at Locus, you will play a critical role in defining and driving our backend architecture as we scale globally. You’ll own key systems that handle high volumes of data and transactions, ensuring performance, reliability, and maintainability across distributed environments.
Key Responsibilities-
– Own one or more core applications end-to-end, ensuring reliability, performance, and scalability.
– Lead the design, architecture, and development of complex, distributed systems, frameworks, and libraries aligned with Locus’s technical strategy.
– Drive engineering operational excellence by defining robust roadmaps for system reliability, observability, and performance improvements.
– Analyze and optimize existing systems for latency, throughput, and efficiency, ensuring they perform at scale.
– Collaborate cross-functionally with Product, Data, and Infrastructure teams to translate business requirements into technical deliverables.
– Mentor and guide engineers, fostering a culture of technical excellence, ownership, and continuous learning.
– Establish and uphold coding standards, conduct design and code reviews, and promote best practices across teams.
– Stay ahead of the curve on emerging technologies, frameworks, and patterns to strengthen Locus’s technology foundation.
– Contribute to hiring by identifying and attracting top-tier engineering talent.
Ideal Candidate
– Strong staff engineer profile
– Mandatory (Experience 1): Must have 9+ years in backend engineering with Java, Spring/Spring Boot, and microservices building large and schalable systems
– Mandatory (Experience 2): Must have been SDE-3 / Tech Lead / Lead SE for at least 2.5 years
– Mandatory (Tech skills 1): Strong in DSA, system design, design patterns, and problem-solving
– Mandatory (Tech skills 2): Proven experience building scalable, reliable, high-performance distributed systems
– Mandatory (Tech skills 3): Hands-on with SQL/NoSQL databases, REST/gRPC APIs, concurrency & async processing
– Mandatory (Tech skills 4): Experience in AWS/GCP, CI/CD pipelines, and observability/monitoring
– Mandatory (Communication): Excellent ability to explain complex technical concepts to varied stakeholders
– Mandatory (Company): Product companies (B2B SAAS preferred)
– Mandatory (Stability): Must have stayed for at least 2 years with each of the previous companies
– Mandatory (Education): B.Tech in computer science from Tier 1, Tier 2 colleges
Read more

Posted by
Pankaj Tiwari
Remote, Delhi, Gurugram, Noida, Ghaziabad, Faridabad
2
\- 5 yrs
₹12L - ₹15L / yr
Investigation
Scorpion Detective A