Lead Consultant - Data Engineer

Thoughtworks is hiring Lead Consultant - Data Engineer job in Bengaluru (Bangalore) | Cutshort

Lead Consultant - Data Engineer
Lead Consultant - Data Engineer

10
\- 13 yrs
Best in industry
Bengaluru (Bangalore)
Skills
Data modeling
PySpark
Data engineering
Big Data
Hadoop
Spark
Apache Spark
Python
Scala
Java
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Apache Hive
Apache HBase
Cassandra
Lead Data Engineer
Data Engineers develop modern data architecture approaches to meet key business objectives and provide end-to-end data solutions. You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems. On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product. It could also be a software delivery project where you're equally happy coding and tech-leading the team to implement the solution.
Job responsibilities
·      You might spend a few weeks with a new client on a deep technical review or a complete organizational review, helping them to understand the potential that data brings to solve their most pressing problems
·      You will partner with teammates to create complex data processing pipelines in order to solve our clients' most ambitious challenges
·      You will collaborate with Data Scientists in order to design scalable implementations of their models
·      You will pair to write clean and iterative code based on TDD
·      Leverage various continuous delivery practices to deploy, support and operate data pipelines
·      Advise and educate clients on how to use different distributed storage and computing technologies from the plethora of options available
·      Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions
·      Create data models and speak to the tradeoffs of different modeling approaches
·      On other projects, you might be acting as the architect, leading the design of technical solutions, or perhaps overseeing a program inception to build a new product
·      Seamlessly incorporate data quality into your day-to-day work as well as into the delivery process
·      Assure effective collaboration between Thoughtworks' and the client's teams, encouraging open communication and advocating for shared outcomes
Job qualifications Technical skills
·      You are equally happy coding and leading a team to implement a solution
·      You have a track record of innovation and expertise in Data Engineering
·      You're passionate about craftsmanship and have applied your expertise across a range of industries and organizations
·      You have a deep understanding of data modelling and experience with data engineering tools and platforms such as Kafka, Spark, and Hadoop
·      You have built large-scale data pipelines and data-centric applications using any of the distributed storage platforms such as HDFS, S3, NoSQL databases (Hbase, Cassandra, etc.) and any of the distributed processing platforms like Hadoop, Spark, Hive, Oozie, and Airflow in a production setting
·      Hands on experience in MapR, Cloudera, Hortonworks and/or cloud (AWS EMR, Azure HDInsights, Qubole etc.) based Hadoop distributions
·      You are comfortable taking data-driven approaches and applying data security strategy to solve business problems
·      You're genuinely excited about data infrastructure and operations with a familiarity working in cloud environments
·      Working with data excites you: you have created Big data architecture, you can build and operate data pipelines, and maintain data storage, all within distributed systems
Professional skills
·      Advocate your data engineering expertise to the broader tech community outside of Thoughtworks, speaking at conferences and acting as a mentor for more junior-level data engineers
·      You're resilient and flexible in ambiguous situations and enjoy solving problems from technical and business perspectives
·      An interest in coaching others, sharing your experience and knowledge with teammates
·      You enjoy influencing others and always advocate for technical excellence while being open to change when needed
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.

Shubham Vishwakarma
Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort

Founded
:
1993
Type
:
Products & Services
Size
:
5000+
Stage
:
Profitable
About
Founded in 1993, we’ve grown from a small team in Chicago to a leading software consultancy of more than 8000 Thoughtworkers in 17 countries. Our cross-functional teams of strategists, developers, data engineers, and designers bring over two decades of global experience to every partnership.
Thoughtworks invented the concept of distributed agile and we know how to harness the power of global teams to deliver software excellence at scale. Today we help our clients to create their own path to digital fluency and to build organizational resilience to navigate the future.
Our job is to foster a vibrant community where people have the freedom to make an extraordinary impact on the world through technology.
As a Thoughtworker, you are free to seek out the most ambitious challenges. Free to change career paths. Free to use technology as a tool for social change. Free to be yourself.
Read more
Company video

Connect with the team
Similar jobs

Posted by
Roshni Rai
Mumbai, Navi Mumbai
8
\- 10 yrs
₹20L - ₹22L / yr
User Interface (UI) Design
Job Details
Description
We are looking for a passionate Senior User Experience Designer to join our fast growing team at LogiNext. You’ll collaborate with Product Managers and other UI designers to design new features, translate concepts into living and breathing prototypes, and rapidly iterate on interactions, animations, and details to deliver the best user experience. You will be responsible for conceptualizing & creating highly interactive user interfaces across all supported platforms.
You are passionate about design and are driven to create solutions for our clients that combine business objectives, design principles, and continuous user research into a compelling user experience. You have experience in designing a consistent and adaptable platform-based approach to user experience within a technology-driven and Software-as-a-Service (SaaS) based environment. You are a compulsive problem-solver with excellent visualization and communication skills.
Responsibilities:
– Gather, analyse & process data to determine the user needs & enhance the user experience
– Research & learn new, or re- emerging front- end technologies that facilitate improved user experience.
– Conceptualise designs through storyboards & concept presentations
– Design beautiful digital interfaces and present ideas in a compelling manner
– Perform usability testing with prototypes
– Create wireframes & prototypes to create a perfect user interface
– Create the best visual communication design with graphic design, website design, drawing and illustration, animation, client discussion and standard layouts.
– Mentor other team members in conceptualising and visually articulating design solutions
Requirements:
– Bachelor’s degree or higher in Arts/Commerce/Science/Technology
– 8 to 10 years of experience in UI/UX designing
– Must have experience in designing user interfaces for B2B SaaS Products
– Must have excellent experience using tools such as Sketch, Photoshop, Adobe Illustrator
– Able to work and thrive in a fast-paced, rapidly changing work environment
– Should have excellent communication skills, with an ability to convey ideas clearly & precisely
– Must have leadership skills & a good team player
– Must be pro-active & a self-starter
Read more

Posted by
Preeti Gupta
Remote only
2
\- 6 yrs
₹3L - ₹7L / yr
React Native
React.js
iOS App Development
Android Development
2+ years of professional experience working with React Native.
Firm grasp of JavaScript (or Typescript) and its nuances, including ES6+ syntax.
Experience working with Swift, Objective C, and Java/Kotlin a plus but not required.
Experience with architecting and implementing component-based UI frameworks and design systems
Read more

Posted by
Sujata Ranjan
Remote, Pune, Mumbai
4
\- 10 yrs
₹10L - ₹30L / yr
![skill icon](https://cutshort.io/_next/image?url=https%3A%2F%2Fcdn.cutshort.io%2Fpublic%2Fimages%2Fskill_icons%2Fr