Lead Software Engineer - App Crawling

Anakin is hiring Lead Software Engineer - App Crawling job (Remote only) | Cutshort

Lead Software Engineer - App Crawling
Lead Software Engineer - App Crawling

at Anakin

Posted by
Siddharth Patra
3
\- 10 yrs
₹20L - ₹30L / yr (ESOP available)
Remote only
Skills
Python
Amazon Web Services (AWS)
Web Scraping
Selenium
NodeJS (Node.js)
Your Responsibilities would be to:
– Architect new and optimize existing software codebases and systems used to crawl, launch, run, and monitor the Anakin family of app crawlers
– Deeply own the lifecycle of software, including rolling out to operations, managing configurations, maintaining and upgrading, and supporting end-users
– Configure and optimize the automated testing and deployment systems used to maintain over 1000+ crawlers across the company
– Analyze data and bugs that require in-depth investigations
– Interface directly with external customers including managing relationships and steering requirements
Basic Qualifications:
– Extremely effective, self-driven builder
– 2+ years of experience as a backend software engineer
– 2+ years of experience with Python
– 2+ years of experience with AWS services such as EC2, S3, Lambda, etc.
– Should have managed a team of software engineers
– Deep experience with network debugging across all OSI layers (Wireshark)
– Knowledge of networks or/and cybersecurity
Preferred Skills and Experience
– Broad understanding of the landscape of software engineering design patterns and principles
– Ability to work quickly and accurately in a highly stressful environment during removing bugs in run-time within minutes
– Excellent communicator, both written and verbal
Additional Requirements
– Must be available to work extended hours and weekends when needed to meet critical deadlines
– Must have an aversion to politics and BS. Should let his/her work speak for him/her.
– Must be comfortable with uncertainty. In almost all the cases, your job will be to _figure it out_.
– Must not be bounded to comfort zone. Often, you will need to challenge yourself to go above and beyond.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma
Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort

Founded
:
2020
Type
:
Product
Size
:
0-20
Stage
:
Raised funding
About
Know your competitors' strategy and industry trends LIVE! We offer a full suite of competitive intelligence software for retailers and brands. We provide global coverage on real-time product assortments and pricing data from e-commerce websites on over 100 million SKUs. We collect web data at scale so that you don’t have to. We track and categorize all this data using AI and machine learning.
Read more
Connect with the team
Company social profiles
N/A
Similar jobs

Posted by
Dhanur Sehgal
Remote only
3
\- 8 yrs
₹6L - ₹12L / yr
Go Programming (Golang)
Python
Scalability
Infrastructure architecture
SQL
+6 more
We’re hiring a remote, contract-based Backend & Infrastructure Engineer who can build and run production systems end-to-end.
You will build and scale high-throughput backend services in Golang and Python, operate ClickHouse-powered analytics at scale, manage Linux servers for maximum uptime, scalability, and reliability, and drive cost efficiency as a core engineering discipline across the entire stack.
What You Will Do:
Backend Development (Golang & Python)
– Design and maintain high-throughput RESTful/gRPC APIs — primarily Golang, Python for tooling and supporting services
– Architect for horizontal scalability, fault tolerance, and low-latency at scale
– Implement caching (Redis/Memcached), rate limiting, efficient serialization, and CI/CD pipelines
Scalable Architecture & System Design
– Design and evolve distributed, resilient backend architecture that scales without proportional cost increase
– Make deliberate trade-offs (CAP, cost vs. performance) and design multi-region HA with automated failover
ClickHouse & Analytical Data Infrastructure
– Deploy, tune, and operate ClickHouse clusters for real-time analytics and high-cardinality OLAP workloads
– Design optimal table engines, partition strategies, materialized views, and query patterns
– Manage cluster scaling, replication, schema migrations, and upstream/downstream integrations
Cost Efficiency & Cost Optimization
– Own cost optimization end-to-end: right-sizing, reserved/spot capacity, storage tiering, query optimization, compression, batching
– Build cost dashboards, budgets, and alerts; drive a culture of cost-aware engineering
Linux Server Management & Infrastructure
– Administer and harden Linux servers (Ubuntu, Debian, CentOS/RHEL) — patching, security, SSH, firewalls
– Manage VPS/bare-metal provisioning, capacity planning, and containerized workloads (Docker, Kubernetes/Nomad)
– Implement Infrastructure-as-Code (Terraform/Pulumi); optionally manage AWS/GCP as needed
Data, Storage & Scheduling
– Optimize SQL schemas and queries (PostgreSQL, MySQL); manage data archival, cold storage, and lifecycle policies
– Build and maintain cron jobs, scheduled tasks, and batch processing systems
Uptime, Reliability & Observability
– Own system uptime: zero-downtime deployments, health checks, self-healing infra, SLOs/SLIs
– Build observability stacks (Prometheus, Grafana, Datadog, OpenTelemetry); structured logging, distributed tracing, alerting
– Drive incident response, root cause analysis, and post-mortems
Required Qualifications:
Must-Have (Critical)
– Deep proficiency in Golang (primary) and Python
– Proven ability to design and build scalable, distributed architectures
– Production experience deploying and operating ClickHouse at scale
– Track record of driving measurable cost efficiency and cost optimization
– 5+ years in backend engineering and infrastructure roles
Also Required
– Strong Linux server administration (Ubuntu, Debian, CentOS/RHEL) — comfortable living in the terminal
– Proven uptime and reliability track record across production infrastructure
– Strong SQL (PostgreSQL, MySQL); experience with high-throughput APIs (10K+ RPS)
– VPS/bare-metal provisioning, Docker, Kubernetes/Nomad, IaC (Terraform/Pulumi)
– Observability tooling (Prometheus, Grafana, Datadog, OpenTelemetry)
– Cron jobs, batch processing, data archival, cold storage management
– Networking fundamentals (DNS, TCP/IP, load balancing, TLS)
Nice to Have
– AWS, GCP, or other major cloud provider experience
– Message queues / event streaming (Kafka, RabbitMQ, SQS/SNS)
– Data pipelines (Airflow, dbt); FinOps practices
– Open-source contributions; compliance background (SOC 2, HIPAA, GDPR)
What We Offer
– Remote, contractual role
– Flexible time zones (overlap for standups + incident coverage)
– Competitive contract compensation + equity
– Long-term engagement opportunity based on performance
Read more

Posted by
Prabhu Singh
Remote, Gurugram
4.5
\- 10 yrs
Best in industry
NodeJS (Node.js)
Express
Docker
Javascript
Amazon Web Services (AWS)
👋🏼We're Nagarro.
We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (18000+ experts across 33 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in!
Please find the job details below
Experience: 7.5-10 years
Must Have: Microservices architecture (MSA)- General Experience
REQUIREMENTS:
– Strong technical background with node.js, event loop understanding, unit testing, developing web application & APIs, event & stream, call-back & closures, promise, async/await, accessing file system, Optimization techniques
– understanding of different components such as web server, storages, integrations
– should have worked on designing and building server-side solutions (in any technology), build process of node.js, CI/CD process of node.js, multi-tasking (working on multiple things at same time)
– Good knowledge of functional and Object-Oriented Programming
– Implementing effective security protocols, data protection measures, and storage solutions.
– Running diagnostic tests, repairing defects, and providing technical support.
– Recommending and implementing improvements to processes and technologies.
– Keeping informed of advancements in the field of Node.js development.
– Familiarity with Azure pipeline
– Should have experience in Identifying software application weaknesses and target areas and sketching out ideas for automated software test procedures. Reviewing software bug reports and highlighting problem areas.
– Knowledge of high-quality professional software engineering practices for agile software development cycle, including coding standards, code