Job Title: Databricks Data
Engineer
Location: Remote
Experience: 6+ Years
Notice Period: Immediate Joiners Preferred
About the Role
We are looking for a skilled Databricks Data Engineerto
design, develop, and optimize scalable data solutions using Databricks SQL.
The ideal candidate should have strong expertise in SQL, performance tuning,
and cloud-based data platforms such as AWS, Azure, or GCP.
Key Responsibilities
- Develop,
maintain, and optimize SQL queries and notebooks in Databricks for
data transformation, aggregation, and analytics.
- Optimize Databricks SQL workloads for performance, scalability, and cost
efficiency.
- Monitor,
debug, and troubleshoot SQL queries, dashboards, and workflows.
- Work
with large-scale datasets in distributed computing environments.
- Collaborate
with data engineers, analysts, and stakeholders to deliver data-driven
solutions.
- Implement
best practices for query performance tuning, caching, and indexing
strategies.
- Build
and maintain data pipelines using Databricks Workflows and Delta
Live Tables.
Required Qualifications
- 6years
of hands-on experience in SQL development and query optimization.
- Strong
expertise in Databricks SQL, Delta Lake, and Lakehouse
architecture.
- Experience
with cloud platforms such as AWS, Azure, or GCP (preferably Azure
Databricks or AWS Databricks).
- Good
understanding of performance tuning, caching strategies, and query
optimization techniques.
- Familiarity
with ETL/ELT frameworks, Data Warehousing, and BI tools.
- Hands-on
experience with:
- Databricks
Notebooks
- Databricks
Workflows
- Delta
Live Tables
- Ability
to handle large datasets and distributed systems.
- Strong
analytical, problem-solving, and communication skills.
Preferred Qualifications
- Experience
using SQL for advanced data processing and analytics.
- Knowledge
of Medallion Architecture (Bronze, Silver, Gold layers).
- Exposure
to data visualization tools like Power BI, Tableau, or similar.