Databricks Data Engineer

Salary: $175,000 - 195,000 per year Requirements: Bachelors degree in Computer Science, Data Engineering, or a related field, with deep Databricks expertise and experience developing or delivering technical training; 12 years of experience or commensurate experience. Hands-on expertise with Databricks SQL and PySpark notebooks, Jobs/Workflows, Delta Lake, Unity Catalog, and MLflow. Experience implementing vector search in Databricks and building, orchestrating, and integrating data pipelines, such as with Data Factory. Experience developing AI models, agentic workflows, and AI Gateway or agent tooling. Proficiency with Microsoft Power Platform, including canvas Power Apps, cloud and desktop Power Automate, and Power Fx. Strong skills in SQL—including joins, CTEs, and window functions—Python, regular expressions, and Git. Demonstrated experience developing and delivering technical training curricula, hands-on labs, or bootcamp-style instruction. Preferred: Experience integrating Databricks with SharePoint, Power BI, ESRI ArcGIS Pro/Online, and Genie. Preferred: Experience developing Train-the-Trainer SOPs or instructional design materials. Preferred: Experience supporting federal or DHS training, data modernization, or compliance-review programs. Ability to obtain and maintain a suitability/Public Trust clearance. Responsibilities: Serve as a Key Personnel Databricks Data Engineer and instructor, delivering customized training and a bootcamp for up to 20 FEMA-OEHP staff who are already proficient in Databricks. Collaborate with FEMA-OEHP stakeholders during a two-month planning phase to finalize the curriculum, project goals, and integration requirements. Develop and administer an approximately 25-question initial skills assessment, then tailor tutoring and curriculum depth to participants results. Deliver weekly virtual training aligned with project milestones and integration tasks, using DHS/EHP datasets and real-world data where appropriate. Provide two one-hour individual tutoring sessions per week for each participant during a one-month tutoring period. Lead weekly seminars with a core topic and an additional advanced track, combining instruction with hands-on labs. Guide project-based learning in which participants collaboratively build vector search tools; Databricks integrations with SharePoint, Power BI, ESRI ArcGIS Pro, and Power Platform; predictive and agentic compliance-review tools; and related audit, logging, and reporting features. Teach Databricks topics including advanced notebook development, catalog management and permissions, pipeline development and orchestration, MLflow, Delta Lake, Unity Catalog, Genie, AI Gateway and agents, vector search, Data Factory, dashboards, and security best practices. Teach data engineering concepts including SQL, regular expressions, Python data transformations, Power BI DAX/M, Git integration, medallion architecture ETL, lakehouse architecture, and distributed computing with Spark. Provide targeted Power Apps and Power Automate training, covering flow development and troubleshooting, basic Power Fx, monitoring and diagnostic tools, and security best practices. Administer an approximately 25-question exit assessment to measure participant growth for program evaluation. Develop a standalone beginner, intermediate, and advanced training program, along with a Train-the-Trainer SOP to help FEMA train future employees. Support the use of DHS/EHP datasets and help map and update the EHP data dictionary through hands-on exercises. Maintain access to DHS computers and comply with required firewall clearances and DHS security requirements. Technologies: AI Cloud Databricks DAX ETL Firewall Flow Git Support Microsoft Power Platform MLflow Power BI Python PySpark SQL Security SharePoint Spark Unity GameDev More: We are hiring through GovCIO for a client contract supporting FEMAs Office of Environmental Planning and Historic Preservation (OEHP) data engineering skills modernization program. This is one of two required Databricks Data Engineer Key Personnel positions. Training is delivered virtually through Microsoft Teams, and the role is fully remote within the United States, with access to DHS systems required. The posted salary range is USD $175,000–$195,000 per year. last updated 42 week of 2026