Jobs · cutshort
Sr Spark Software Engineer
Keystone AI · Indexed today
About the role
Develop and maintain big data pipelines using Apache Spark and related technologies.
Technology service company is hiring Sr. Spark Software Engineer job (Remote only) | Cutshort
Sr. Spark Software Engineer
Technology service company
Sr. Spark Software Engineer
at Technology service company
Agency job
5
\- 10 yrs
₹10L - ₹20L / yr
Remote only
Skills
Java
J2EE
Spring Boot
Hibernate (Java)
Ansible
Git
JIRA
Apache Spark
Spark
Apache Kafka
Microservices
Kubernetes
Terraform
NOSQL Databases
API
Docker
– Bachelor’s or master’s degree in Computer Engineering, Computer Science, Computer Applications, Mathematics, Statistics, or related technical field. Relevant experience of at least 3 years in lieu of above if from a different stream of education.
– Well-versed in and 3+ hands-on demonstrable experience with: ▪ Stream & Batch Big Data Pipeline Processing using Apache Spark and/or Apache Flink.
▪ Distributed Cloud Native Computing including Server less Functions
▪ Relational, Object Store, Document, Graph, etc. Database Design & Implementation
▪ Micro services Architecture, API Modeling, Design, & Programming
– 3+ years of hands-on development experience in Apache Spark using Scala and/or Java.
– Ability to write executable code for Services using Spark RDD, Spark SQL, Structured Streaming, Spark MLLib, etc. with deep technical understanding of Spark Processing Framework.
– In-depth knowledge of standard programming languages such as Scala and/or Java.
– 3+ years of hands-on development experience in one or more libraries & frameworks such as Apache Kafka, Akka, Apache Storm, Apache Nifi, Zookeeper, Hadoop ecosystem (i.e., HDFS, YARN, MapReduce, Oozie & Hive), etc.; extra points if you can demonstrate your knowledge with working examples.
– 3+ years of hands-on development experience in one or more Relational and NoSQL datastores such as PostgreSQL, Cassandra, HBase, MongoDB, DynamoDB, Elastic Search, Neo4J, etc.
– Practical knowledge of distributed systems involving partitioning, bucketing, CAP theorem, replication, horizontal scaling, etc.
– Passion for distilling large volumes of data, analyze performance, scalability, and capacity performance issues in Big Data Platforms.
– Ability to clearly distinguish system and Spark Job performances and perform spark performance tuning and resource optimization.
– Perform benchmarking/stress tests and document the best practices for different applications.
– Proactively work with tenants on improving the overall performance and ensure the system is resilient, and scalable.
– Good understanding of Virtualization & Containerization; must demonstrate experience in technologies such as Kubernetes, Istio, Docker, OpenShift, Anthos, Oracle VirtualBox, Vagrant, etc.
– Well-versed with demonstrable working experience with API Management, API Gateway, Service Mesh, Identity & Access Management, Data Protection & Encryption.
Hands-on experience with demonstrable working experience with DevOps tools and platforms viz., Jira, GIT, Jenkins, Code Quality & Security Plugins, Maven, Artifactory, Terraform, Ansible/Chef/Puppet, Spinnaker, etc.
– Well-versed in AWS and/or Azure or and/or Google Cloud; must demonstrate experience in at least FIVE (5) services offered under AWS and/or Azure or and/or Google Cloud in any categories: Compute or Storage, Database, Networking & Content Delivery, Management & Governance, Analytics, Security, Identity, & Compliance (or) equivalent demonstrable Cloud Platform experience.
– Good understanding of Storage, Networks and Storage Networking basics which will enable you to work in a Cloud environment.
– Good understanding of Network, Data, and Application Security basics which will enable you to work in a Cloud as well as Business Applications / API services environment.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
Similar jobs
Posted by
Kunal Hendre
Ahmedabad
2
\- 5 yrs
₹2L - ₹6L / yr
J2EE
Spring
Java
Struts
Hibernate (Java)
+1 more
Expectations
– Sound knowledge of Core Java, JSP, Servlets & MVC, Spring
– Good knowledge of Java Script, Ajax
– Good knowledge of My SQL database server
– Experience in working with IDE like Eclipse or Netbeans
– Knowledge of Spring would be an advantage
– Great problem-solving attitude
– Strong OOP & OOAD fundamentals
– Knowledge of Java EE Design pattern
– Technical hands on Spring, Spring Security, Hibernate, JPA, Struts, OO JS, XML, Webservices (Restful, JAX-WS).
– Nice to have knowledge of Liferay, Amazon EC2, Google App Engine, Restful services, jQuery, YUI, EstJS (Sencha), frameworks.
Responsibilities
– Understand the BRS / SRS document
– Coordinate with Team lead/DBA to understand the System design and Database design
– Development and Unit Testing
– Bug fixing and Change Request implementation
Read more
Posted by
Karthik Kulkarni
Bengaluru (Bangalore)
2
\- 8 yrs
₹4L - ₹14L / yr
Java
We need someone with hands on Java and experience in Dropwizard/Rest APIs. Mature guy, who can collaborate across teams and drive his components.
Read more
Posted by
Akshatha Bhat
Bengaluru (Bangalore)
4
\- 9 yrs
₹15L - ₹25L / yr
Go Programming (Golang)
Ruby on Rails (ROR)
Ruby
Python
Java
+4 more
Configuration, administration, customization, and maintenance of Okta CIAM environments.
• Design and maintain configuration manuals and documentation required to sustain the Okta CIAM platform.
• Review Okta platform configurations to ensure the solution is optimized and secure for business needs.
• Support and resolve system incidents, problems, and changes.
Requirements
• 3+ years of hands-on experience with designing and building Okta solution platforms.
• At least one Okta certification in last 2 years - Okta Certified Administrator, Certified Consultant or Certified Developer certification
• Strong understanding of Single Sign On and relevant standards (OIDC, OAuth, SAML)
• 1+ year of development experience using RESTful APIs in any programming language
• Strong communication and documentation skills
• Ability to collaborate and interact productively with team members and key stakeholders.
Read more
Posted by
Soumya Jalan
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
4
\- 10 yrs
₹15L - ₹30L / yr
Java
J2EE
Spring Boot
Hibernate (Java)
Microservices
+2 more
Job Description
– Java engineer with 6-8 years of experience , person with strong Java, spring core, Springboot, Rest API , Microservices hands-on experience.
– Knowing Kafka is a plus.
– Well versed with CICD, Agile processes . good attitude, good communication skills.
Role
– Code development, testing, team coordination,
– Open to work on non-tech activities along with coding also.
– Should be ready and flexible to work from Impetus office and customer office as per the requirement of project.
Read more
Posted by
Vamshi Yamsani
Remote, Hyderabad
6
\- 20 yrs
₹28L - ₹60L / yr
Java
Spring Boot
SOA
Microservices
RESTful APIs
+1 more
Role
Backend engineers at AssetSprout work on our products. They include software for Certified Financial Planners, their clients, and also internal admin tools. They work with the CTO, frontend engineers, and other backend engineers to deliver towards the company’s vision.
Responsibilities
– Develop and own product features end to end in a scalable, secure and maintainable way. The buck stops with you on whatever you own.
– Provide technical solutions through design, architecture and implementation. Wear multiple hats in delivering greenfield projects from concept to production.
– Establish, advocate and bring your experience on coding styles, best practices, and in scaling the product from MVP to production.
– Iterate fast. Display maturity in prioritizing towards velocity while b
Read the full posting on cutshort →
FAQ
Is the Sr Spark Software Engineer role at Keystone AI remote?+
This Sr Spark Software Engineer position is listed as onsite.
What is the salary for the Sr Spark Software Engineer role at Keystone AI?+
The listing states 1070000-2140000 INR.
What seniority level is this Sr Spark Software Engineer role?+
This is a senior level position.
How do I apply for the Sr Spark Software Engineer role at Keystone AI?+
Use the "Apply on cutshort" button to open the original posting on cutshort, where you can submit your application directly to Keystone AI.