Jobs · justjoinit

B

IngestOps Engineer Data Engineer

B2Bnetwork · Warszawa · Posted 16d ago

Full-timemid5-8 yrs🇵🇱 Poland
Apply on justjoinit

About the role

We are looking for an experienced professional to join a team responsible for data ingestion, processing, and loading. This position combines data engineering responsibilities with the operational maintenance of data-processing environments.ResponsibilitiesBuild and maintain data ingestion processes for external systems.Validate, transform, and prepare data for downstream processing.Monitor data pipelines and troubleshoot operational issues.Analyse logs and perform daily operations in a Linux environment.Create, analyse, and optimise SQL queries.Identify performance bottlenecks and improve data-processing efficiency.Ensure the quality, integrity, and consistency of data loaded into target systems.Cooperate with technical and business teams.Participate in deployments and the maintenance of data-processing solutions.RequirementsVery good knowledge of Linux, including log analysis, file operations, monitoring, and command-line tools.Very good knowledge of SQL, including joins, aggregations, stored procedures, and performance optimisation.Experience in building or maintaining data ingestion and integration processes.Practical knowledge of data validation, cleansing, and transformationAbility to analyse complex data flows and troubleshoot technical issuesExperience working with large data volumesEnglish proficiency sufficient for effective communication in an international project environmentIndependence, accountability, and strong problem-solving skills.Nice to haveKnowledge of Python.Experience with Apache Spark, PySpark, or the Hadoop ecosystem.Knowledge of Apache Airflow or other workflow orchestration tools.Experience with Apache Kafka and stream processing.Knowledge of Data Lake environments and ETL ELT processes.Experience with cloud solutions, particularly AWS.Familiarity with Docker, CI CD, Databricks, or Snowflake.

Read the full posting on justjoinit →

FAQ

Is the IngestOps Engineer Data Engineer role at B2Bnetwork remote?+

This IngestOps Engineer Data Engineer position is listed as unknown (Warszawa).

What seniority level is this IngestOps Engineer Data Engineer role?+

This is a mid level position.

How do I apply for the IngestOps Engineer Data Engineer role at B2Bnetwork?+

Use the "Apply on justjoinit" button to open the original posting on justjoinit, where you can submit your application directly to B2Bnetwork.