Senior Data Engineer (Python, Databricks)

Craftware is a technology company of over 500 experts, empowering large organizations to solve complex business challenges with modern IT solutions - from sales systems and automation to data platforms and AI. We operate where technology must be reliable, secure, and scalable. We deliver end-to-end projects: from analysis and architecture through implementation to development and maintenance. We are a trusted partner of industry leaders such as Salesforce, Veeva, UiPath, and Databricks.Model: remoteEngagement:: full-timeResponsibilitiesBuild and maintain DAB pipelines and YAML-based transformation configuration; migrate toward native Databricks Asset Bundle patternsKeep DEV / QAS / PRD environments consistent and drift-free across delivered marketsAssess new data sources before sprint commitment — shape, volume, quality risks — and write feasibility notes that gate scope entryDevelop PySpark transformations across Raw, Quality Integration, and Curated zones following CDA layer standardsDefine and run data reconciliation and acceptance criteria so business users aren't the primary quality gate at UATRequirementsAzure Databricks & PySpark — senior hands-on: jobs, clusters, Unity Catalog, transformation logic, unit testingDelta Lake — schema evolution, MERGE, time travel; DAB — YAML config and bundle deploymentSQL — advanced; able to read 10-year-old stored procedures without helpCI/CD — Azure DevOps, Git branching strategy, PR discipline — practised, not theoreticalAbility to profile source data, define acceptance criteria, and take a data problem from source assessment to UAT sign-off — without a BA intermediaryComfortable with incomplete documentation and evolving scope — you document decisions so others don't need a handover callWe offer:B2B contract Fully remote service deliveryBroad range of projects (internal, international) - genuine variety of clients and tasksBudget for skills development and certifications as part of the collaborationRegular collaboration reviews and discussion of project scopeAdditional benefits available as part of the collaborationNetworking and team-building events for project teams