Databricks Tech lead Job at Tata Consultancy Services, Columbus, OH

TWY4UnRjbTArV0ovY3RhWFlYLzRmLzFzUWc9PQ==
  • Tata Consultancy Services
  • Columbus, OH

Job Description

Skill: Databricks Tech Lead

  • Responsible for designing, building, and maintaining pipelines that transform raw data into actionable insights in the Databricks environment.
  • They utilize tools like Apache Spark to manage large datasets, optimize data flow, and ensure efficient data processing.
  • Experience in generating data models, delivering data collection, storage, access, and analytics data platform solutions, and implementing database back-up, recovery, and archiving strategy.
  • Real time data ingestion using Stream sets.
  • Experience UDM Model.
  • Experience in Dimensional Modelling, Data Migration, Data Cleansing, Data conversion and bridging, and ETL techniques on multiple databases and operating systems.
  • Python, Databricks, perl, spark, Kubernetes, dockers and other cloud native tools and technologies.
  • Provide solution design guidance to other technical staff, and assist in integrating various systems.
  • Consult with users to determine requirements needed to guide development of the data models.
  • Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
  • Write SQL, Python, and PySpark code for efficient data processing and transformation.
  • Understand and translate business requirements into technical designs.
  • Develop mapping documents and transformation rules as per project scope.
  • Communicate project status with stakeholders, ensuring smooth project execution.

Job Tags

Similar Jobs

The University of Iowa

RADIATION ONCOLOGIST Job at The University of Iowa

Full/Part Time Status:Full TimePosition Description:The Department of Radiation Oncology at the University of Iowa Carver College of Medicine is seeking applications for a clinical faculty physician. The position will be at the rank of Assistant Professor, Associate... 

Kapp Companies

Underground Utility Construction Foreman Job at Kapp Companies

 ...UNDERGROUND UTILITY CONSTRUCTION FOREMAN SALARY/ PAY: $28.00- $35.00 HOURLY (Wage determined by experience, verifiedby references and upon completion of interview). REPORTS TO: Project Manager, amp; Upper Management. SUMMARY/ ESSENTIAL FUNCTIONS: (Foreman... 

Singtel Group

Data Science (Singtel Internship Programme, May 2025) #GeneralInternship Job at Singtel Group

 ...The position is available for a full-time internship starting in May 2025, with a duration...  ...to 1 year. Make An Impact By Data Collection and Cleaning: Gather data from...  ...: Currently pursuing a degree in Data Science, Computer Science, Statistics, or a related... 

Encadria Staffing Solutions LLC

Scaler- TEMPORARY Job at Encadria Staffing Solutions LLC

 ...Encadria Staffing Solutions places employees at Georgia-Pacific and many other Koch companies across the country. The Koch family of companies is built on principles of integrity and respect. We pride ourselves on doing the right thing... for you, for us, and for the companies... 

Primoris Renewable Energy

Electrician Helper-Able Springs 10/16 Job at Primoris Renewable Energy

Job Description Job Description Responsibilities and Duties: *Ability to safely operate basic power tools including drills and saws to build racks and install PV equipment. *Ability to install PVC conduits underground and above per direction of JW or Foremen....