Databricks Developer

Job Description: We are seeking a skilled Databricks Developer with strong expertise in designing, developing, and optimizing modern data solutions on the Databricks platform. The ideal candidate will have hands-on experience across data engineering, pipeline development, data modeling, visualization, governance, and DevOps practices. Key Responsibilities: - Design, build, and maintain scalable data solutions using the Databricks platform. - Develop and optimize batch and streaming data pipelines using Apache Spark , Python , and SQL . - Implement modern data pipelines using Spark Declarative Pipelines (SDP) , including streaming tables, materialized views, and embedded data quality rules. - Apply ETL design patterns and best practices for robust and efficient data processing. - Design and manage data models using medallion architecture , dimensional modeling , and Delta Lake optimization techniques. - Create and maintain dashboards and visualizations using Databricks SQL , Lakeview dashboards , notebook charting libraries, and BI tools such as Power BI and Tableau . - Manage Databricks workspaces, cluster configurations, notebooks, and Unity Catalog for secure and governed data access. - Implement CI/CD pipelines , job orchestration using Lakeflow Jobs , and deployment automation with Asset Bundles . - Ensure compliance with governance and security standards through Unity Catalog permissions , row/column-level security , and audit logging . - Collaborate with cross-functional teams to deliver high-quality, scalable, and secure data solutions. Required Skills & Qualifications: - Strong knowledge of Databricks platform fundamentals , including workspaces, clusters, notebooks, and Unity Catalog. - Proficiency in Python , SQL , and Apache Spark (batch and streaming). - Hands-on experience with Delta Lake and modern ETL/data engineering design patterns . - Experience with Spark Declarative Pipelines (SDP) . - Good understanding of data modeling techniques , including medallion architecture and dimensional modeling. - Experience in developing dashboards and reports using Databricks SQL , Lakeview , Power BI , or Tableau . - Familiarity with DevOps practices , including CI/CD and deployment automation. - Knowledge of data governance and security concepts within Databricks. Preferred Skills: - Experience with MLflow , Terraform , and REST APIs . - Exposure to cloud platforms such as AWS, Azure, or GCP .