Databricks Engineer

Job Title: Databricks Engineer Experience: 5+ Years Location: Remote Employment Type: Contract / Full-Time Job Summary We are seeking an experienced Databricks Engineer with strong expertise in Azure Databricks, Azure Data Factory (ADF), and Data Warehousing . The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, supporting data integration initiatives, and collaborating with internal teams to deliver enhancements and knowledge transfer. Experience working with HR data or HR systems is highly desirable. Key Responsibilities - Design, develop, and maintain scalable data solutions using Azure Databricks . - Build, monitor, and optimize Azure Data Factory (ADF) pipelines for data ingestion and transformation. - Develop ETL/ELT processes to support analytics and reporting requirements. - Design and implement data models aligned with business and reporting needs. - Work with structured and semi-structured data from multiple sources. - Collaborate with business and technical stakeholders to gather requirements and deliver solutions. - Support knowledge transfer activities and mentor internal teams on Databricks and ADF best practices. - Troubleshoot and resolve data pipeline and performance issues. - Implement data quality, governance, and security best practices. - Deliver backlog enhancements and continuous improvements to existing data platforms. - Create and maintain technical documentation for developed solutions. Required Skills & Qualifications - 5+ years of hands-on experience with Azure Databricks . - Strong experience building and maintaining Azure Data Factory (ADF) pipelines. - Strong proficiency in Python, SQL, and Spark . - Good understanding of Data Modeling and Data Warehouse concepts. - Experience designing and optimizing ETL/ELT processes. - Experience working with large-scale datasets and distributed data processing. - Knowledge of Azure data services and cloud-based data architectures. - Ability to work independently and collaborate effectively with cross-functional teams. - Strong problem-solving and analytical skills. - Excellent communication and documentation skills. Preferred Qualifications - Experience working with HR data, HR analytics, or HR systems . - Exposure to Azure Synapse Analytics, Delta Lake, or related Azure data technologies. - Experience with CI/CD processes for data engineering solutions. - Knowledge of data governance and security best practices.