Senior Data Engineer (PowerBI & Data Integration)

3Pillar is an AI transformation partner on a mission to help enterprises build the AI-native products and intelligent agents that will define the next era of business. With teams across North America, Europe, Latin America, and Asia, we work with the most ambitious companies in financial services, healthcare, media, and technology — helping them move faster, modernize boldly, and compete on their own terms. Our HelixAI platform and Helix Pods delivery model put our engineers at the center of real agentic transformation — doing work that is open, portable, and built to last. We are building the future of enterprise AI. 🌟 Accomplished Tech Visionary: Embark on an exciting journey into the realm of software development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries. If your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! Key Responsibilities Collaboration with U.S-based client stakeholders on solution design/definition. Identify solutions that solve business problems, translating requirements into technical specifications and actionable work. Writing code and implementing the proposed solutions Creating data pipelines, versioning and change management Manage the complexity inherent in versioned data pipelines Develop ETL/ELT processes to help extract and manipulate data from multiple sources. Design, build and maintain batch or real-time data pipelines in production. Automate data workflows such as data ingestion, aggregation, and ETL processing. Logging and instrumentation of pipelines and services. Ensure data accuracy, integrity, privacy, security, and compliance through quality control procedures. Minimum Qualifications Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role Advanced SQL skills and experience with relational databases and database design. Experience working with cloud Data Warehouse solutions (e.g., Snowflake, Redshift, BigQuery, Azure Synapse, etc.). Strong Python skills with hands-on experience on Pandas, NumPy and other data related libraries Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc Proficient in data pipeline and workflow management tools e.g. Airflow Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc Experience with the AWS/Azure/GCP data engineering services Knowledge of AWS services viz., S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM OR Knowledge of Azure services viz., ADF, Azure Synapse Analytics, ADLS Gen2, Azure SQL DB Very good exposure of working on Data Lakes & Data Warehouses solutions Excellent problem-solving, communication, and organizational skills. Proven ability to work independently and with a team. Ability to guide other data engineers. High level of English proficiency required to interact directly with U.S-based client. Additional Experience Desired Java and key Java-based frameworks (Spring, Springboot, Hibernate, Apache, etc) Good understanding of NoSQL databases like Redis. Client-Prioritized Values Multi-dimensional contributor Comfortable wearing multiple hats Excels at multitasking Operates with a sense of urgency Hands-on, tactical contributor Effectively pass along relevant context to the broader team Takes consultative approach Ability to formulate solutions from abstract requirements Balancing between what needs to be done and what should be done Forward-thinking approach, getting ahead of functionality that serves the business Takes ownership of the work item, drives progress forward, understands all the moving parts, pieces & impacts (from business side, product side, and implementation) Quick ramp, hands-on Quick digestion of product architecture/design & goals Technical curiosity and eagerness to understand the business and underlying drivers Benefits Medical Insurance benefits as per company policy. Life Insurance as per company policy 15 days of paid vacation, sick leave and paid holidays as per local law Paternity and maternity leave as per as per local law Marriage, bereavement and graduation leaves as per company policy Sick leave and paid holidays as per local law Christmas and Middle year bonuses as per local law Monthly productivity bonus as per local law Discounts in local shops Direct deposit of payroll. Paid professional certifications What is it like working for Cobalt Streamworks ? At 3Pillar, we offer a world of opportunity: Imagine a flexible work environment – whether it's the office,