Job Description

• Location: New Jersey (Onsite/Remote)
• Duration: 24+ Months
• Experience: 12+ Years Total, 7-8 Years in Databricks
• Compensation: $75-80/hour
Company Introduction

Our cutting-edge technology organization is seeking a highly skilled Senior Lead Databricks Engineer to drive our data infrastructure and analytics capabilities. We are looking for an exceptional talent who can architect robust, scalable data solutions that transform raw data into strategic insights.

Job Responsibilities
• Design and implement complex data pipelines using Databricks platform
• Develop high-performance Spark and PySpark processes for advanced data transformation
• Integrate seamlessly with Azure or AWS cloud environments
• Manage version-controlled repositories using Git/GitHub
• Mentor junior team members and drive technical excellence
• Collaborate cross-functionally to deliver innovative data solutions
• Ensure optimal performance, cost-efficiency, and reliability of data workflows
• Troubleshoot and resolve complex data pipeline challenges
Required Technical Skills
• 7-8 years of hands-on Databricks platform experience
• Advanced Apache Spark and PySpark expertise
• Proficient in Azure or AWS Cloud technologies
• Expert-level Git and GitHub version control
• Strong distributed computing and big data processing knowledge
• Experience designing large-scale data architectures
Required Qualifications
• Bachelor's degree in Computer Science, Data Engineering, or related field
• Minimum 12+ years total professional experience
• Minimum 7-8 years specialized Databricks experience
• Proven track record of designing enterprise-scale data solutions
• Strong analytical and problem-solving capabilities
• Excellent communication and collaboration skills
Preferred Qualifications
• Databricks Certification
• Azure Data Engineer Certification
• AWS Cloud Certifications
• Delta Lake implementation experience
• CI/CD and DevOps expertise
• Data security and compliance background
Visa Requirements
• All visa types accepted (Except CPT/OPT)

Job Tags

Similar Jobs