Rishi Writes

Top Databricks Data Engineer Job in Washington, DC | 3 to 5 Years

Website Rishi Writes

About the Role

We are looking for a Databricks Data Engineer with strong hands-on Python and PySpark experience to support a fast-paced, high-impact delivery environment in Washington, DC. This is a hybrid role for an engineer who can step in quickly, take ownership and deliver scalable data solutions with minimal ramp-up.

Good AWS experience is mandatory. You will design and tune data pipelines, work with large datasets across cloud platforms and help keep data reliable and fast.

Key Responsibilities

Pipeline Engineering

  • Design, develop and optimize data pipelines and ETL workflows using Databricks.
  • Build scalable data processing solutions with PySpark and Python.
  • Implement and maintain Medallion architecture with Bronze, Silver and Gold layers.

Data Quality and Performance

  • Work with large-scale datasets across AWS and Azure.
  • Make sure pipelines are reliable, well performing and high in data quality.

Collaboration

  • Work with cross-functional teams to support data-driven initiatives.

Required Skills and Qualifications

  • 3 to 5 years of Databricks experience.
  • Good AWS experience, which is mandatory.
  • Strong hands-on experience with Databricks, Python, PySpark and SQL.
  • Proven experience building and optimizing ETL pipelines.
  • Experience with large-scale data environments.
  • Understanding of cloud platforms, especially AWS and Azure.
  • Familiarity with Medallion architecture and Delta Lake.
  • Ability to work independently in fast-paced, deadline-driven environments.

Preferred Skills

  • Experience with Delta Lake.
  • Exposure to data governance and data quality frameworks.
  • Experience in federal or regulated environments.

Tools and Technologies

  • Databricks and Delta Lake
  • Python, PySpark and SQL
  • AWS and Azure
  • ETL tooling

Work Environment and Collaboration

This is a hybrid role in Washington, DC. The listing asks for people who can start quickly and deliver on tight timelines.

Why This Databricks Data Engineer Role Stands Out

Editorial note: this section is general guidance for readers. It is not part of the confirmed job requirements.

The listing centers on pipelines that follow the Medallion approach, where raw data lands in a Bronze layer, is cleaned in a Silver layer and is shaped for use in a Gold layer.

The listing names AWS as mandatory and also mentions Azure. It also lists performance optimization and reliability among the duties.

Who Will Thrive Here

The listing asks for someone who can hit the ground running with minimal onboarding, shows strong ownership and accountability and delivers under tight timelines without lowering quality.

Professional Expectations

Editorial note: this section is general guidance for readers. It is not part of the confirmed job requirements.

The listing asks for a strong sense of ownership and accountability, a proactive problem-solving approach and a delivery-first mindset.

Application Process

Send your updated resume to jobs@rishiwrites.com with the job title in the subject line. Mention your Databricks years and your AWS experience.

Ready to Apply?

If you are ready to build data pipelines at speed, email your resume to jobs@rishiwrites.com today. You can also Check out other positions or Let’s discuss your next career move.

Frequently Asked Questions

1. What does a Databricks Data Engineer do?

You build and optimize pipelines and ETL workflows in Databricks using PySpark and Python.

2. Which skills are essential?

Databricks, Python, PySpark, SQL and AWS are essential.

3. How much experience is required?

The listing asks for 3 to 5 years of Databricks experience.

4. Is a degree or certification required?

The listing does not specify a degree or certification.

5. Which tools will I use?

Databricks, Delta Lake, PySpark, SQL and AWS or Azure services.

6. Where is this job located?

Washington, DC.

7. Is the role onsite, hybrid or remote?

It is hybrid.

8. What type of employment is this?

The listing does not state the employment type. Please ask when you apply.

9. What does a typical day look like?

The listed duties include building and optimizing pipelines, checking data quality and working with cross-functional teams. This is a general picture based on the listed duties, not a confirmed daily schedule.

10. What communication skills matter most?

The listing mentions collaboration with cross-functional teams and the ability to work independently.

11. Which concepts should I understand well?

Medallion architecture, ETL design, Delta Lake and performance tuning.

12. Are there any preferred skills?

Yes. Delta Lake, data governance frameworks and regulated environment experience.

13. How do I apply?

Email your resume to jobs@rishiwrites.com with the job title in the subject line.

14. What should I include in my application?

Your resume, your Databricks and AWS experience and examples of pipelines you built.

15. What qualities suit this role?

Ownership, accountability and a proactive approach to problems. These are general suggestions, not confirmed requirements.

To apply for this job email your details to jobs@rishiwrites.com

Scroll to Top