Job Summary We are seeking an experienced Senior Azure Databricks Data Engineer to join our team and play a key role in the development and enhancement of a modern Azure-based data platform supporting economic analysis, forecasting, modelling, and Business Intelligence initiatives. The successful candidate will be responsible for designing, developing, and optimising scalable data pipelines, implementing complex data transformations, and ensuring high standards of data quality, governance, and performance across the Azure ecosystem. This is an excellent opportunity for a highly skilled data engineering professional with strong Azure Databricks expertise and a passion for delivering reliable, scalable, and governed data solutions. Note: Must have active SC clearance Key ResponsibilitiesData Engineering andamp; Pipeline Development Design, build, and maintain scalable ETL/ELT data pipelines using Azure Databricks and Azure Data Factory. Develop robust data ingestion frameworks for structured, semi-structured, and streaming data sources. Optimise data processing workflows for performance, scalability, and cost efficiency. Implement data validation, monitoring, and quality assurance processes. Azure Databricks Development Develop data transformation logic using PySpark, Spark SQL, SQL, and related technologies. Work extensively with Delta Lake, Unity Catalog, and Azure Databricks best practices. Implement and optimise batch and streaming data processing solutions. Monitor and