Data Engineer

We are seeking a talented Data Engineer to join our Data Engineering & Analytics team. In this role, you will collaborate with our clients to address their most complex needs, working alongside a team of highly skilled engineers and architects. You will also be involved in strategic enterprise data projects and large-scale implementations. Responsibilities: Support projects leveraging an agile delivery model through requirements gathering and documentation, data ingestion pipeline development, and technical testing. Contribute to project delivery in the following ways: Add configurations for data enrichments such as lookups, type conversions, calculations, and concatenations · Add data quality rules · Connect to new data sources Map multiple sources into a single output Interpret error messages to troubleshoot data pipelines Create outputs that facilitate reporting, dashboarding, and semantic modeling for tools such as Tableau and Power BI · Test data pipelines to ensure accuracy Work closely with our clients as part of the development team to gather technical requirements and develop solutions Coordinate activities with data source application owners to understand the underlying data, ensure integration and data integrity Build relationships with clients through written and verbal communication Qualifications: 2+ years of hands-on professional development experience, consulting experience preferred. 1+ years of experience working with Databricks Experience writing complex SQL queries related to data manipulation strategies Experience building or working with metadata-driven ETL / ELT patterns and concepts. Experience with Spark, Databricks, Kafka, Kinesis, Hadoop, and/or Lambda. Exposure using ETL tools (Azure Data Factory, AWS Glue, Informatica, Talend, IBM DataStage, etc.), database platforms (Snowflake, Redshift, Azure Synapse, or Oracle), and data visualization tools (Tableau, Power BI, Looker). Experience in technical testing, issue identification and resolution Strong verbal and written communication skills Originally posted on Himalayas