Databricks Developer

Position Overview

• We are seeking an experienced Mid - Senior Databricks Developer with 8–10+ years of industry experience to design, develop, and optimize large‑scale data solutions. The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services. A minimum of a Bachelor’s degree is required.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
• Build and optimize Delta Lake architectures and data models.
• Develop high‑quality, reusable code in Python for data processing and automation.
• Write and optimize complex SQL queries for large datasets.
• Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high‑quality solutions.
• Ensure data quality, reliability, and performance across all pipelines.
• Troubleshoot production issues and perform root‑cause analysis.
• Follow best practices for version control, CI/CD, and cloud security.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement).
• 8–10+ years of experience in data engineering or software development.
• Strong hands‑on experience with Databricks (including notebooks, jobs, clusters, Delta Lake).
• Advanced proficiency in Python for data engineering.
• Strong expertise in SQL, including performance tuning.
• Solid experience with Microsoft Azure cloud services.

Experience working with large‑scale distributed data systems.

• Strong problem‑solving skills and ability to work independently.

Preferred Skills (Nice to Have)

Experience with CI/CD tools (Azure DevOps, GitHub Actions).

• Knowledge of Spark performance optimization.

Experience with data governance and security frameworks.

• Familiarity with Agile methodologies.