Databricks Engineer Job at Conquest Tech Solutions Inc, Arizona

dU1pYVpHUHl0MytEaC9GcUZwMXVjTDJVTnc9PQ==
  • Conquest Tech Solutions Inc
  • Arizona

Job Description

Role / Skills Databricks Engineer

Location Pheonix Day 1 Onsite min 3 days a week.

JD

Databricks Engineer

Role Overview

We are seeking a highly skilled Databricks Engineer to lead the design, implementation, and optimization of scalable cloud-based data platforms. This role requires deep expertise in Lakehouse architecture, Databricks, Apache Spark, and Delta Lake, along with proven experience delivering end-to-end enterprise data engineering solutions.

Key Responsibilities

  • Design and deliver end-to-end data engineering pipelines, including batch and real-time streaming solutions.
  • Lead implementation of:
  • Cloud-based data lakehouse platforms integrating diverse data sources.
  • Real-time data processing pipelines for operational and analytical use cases.
  • Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL.
  • Implement advanced data modeling solutions including 3NF, dimensional modeling, and enterprise data warehousing strategies.
  • Design and build incremental data loading frameworks and metadata-driven ingestion pipelines.
  • Establish data quality frameworks and governance standards.
  • Implement and manage Unity Catalog, including fine-grained security and access controls.
  • Leverage Databricks components such as:
  • Delta Live Tables
  • Autoloader
  • Structured Streaming
  • Databricks Workflows
  • Integration with orchestration tools (e.g., Apache Airflow)
  • Drive CI/CD automation, deployment strategies, and DevOps best practices.
  • Optimize performance of pipelines, Spark jobs, and compute resources.
  • Provide architectural guidance and technical leadership across cross-functional teams.
  • Engage with stakeholders and clients to translate business requirements into scalable technical solutions.

Deep expertise in :

  • Databricks and cloud-native storage/compute platforms
  • Apache Spark (batch & streaming)
  • Delta Lake & Lakehouse architecture
  • Distributed data processing systems
  • Strong hands-on programming skills in Python, PySpark, Scala, and SQL.

Job Tags

3 days per week, 1 day per week

Similar Jobs

Renner Corner Meats

Butcher/Meat Cutter Job at Renner Corner Meats

 ...Duties: 1. Butchery: Utilize knife skills, tools, equipment and butchering techniques to break down carcasses, cut, trim, and debone meat according to established standards and customer preferences. 2. Product Preparation: Receive and inspect incoming livestock or... 

Power Plus

Generator Technician Job at Power Plus

 ...Do you have over 5 years of diesel generator experience? Are you equally skilled in mechanical and electrical installation and troubleshooting...  ...has to be seen to be believed. Our Generator Service & Maintenance Division is seeking qualified Generator Service Technicians to... 

Midco

Customer Experience Specialist - Madison... Job at Midco

 ...working 40 hours per week (mid-morning to late afternoon) with evening and weekend availability essential. ~5%-15% shift...  ...customers by delivering exceptional experiences in a fast-paced call center environment. In this role, you will build strong relationships... 

Advisory Resource Group, LLC

Insurance Consultant Job at Advisory Resource Group, LLC

 ...About PCRG Insurance PCRG Insurance is an Independent Agency specializing in both Personal...  ...team members to thrive in a fully remote working environment, providing them with all...  ...relationships . You'll work independently from home, with the full support of a large... 

Domino's Franchise

Customer Service Rep - 5219 Dixie Hwy Job at Domino's Franchise

 ...in Louisville, United States is seeking a friendly and customer-focused Customer Service Representative to join our team at our 5219 Dixie Hwy location. As a key member of our front-line staff, you'll play a crucial role in ensuring our customers have a great experience...