Position : Databricks Consultant
Location : Dallas, TX (Onsite)
Term : C2C/W2 role
Job Description :
Responsibilities
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problem-solving skills.
Must have experience in Data Engineering domain .
Minimum qualifications
Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functional requirements.
Demonstrated knowledge of relevant industry trends and standards.
Demonstrate strong analytical and technical problem-solving skills.
Must have excellent coding skills either Python or Scala, preferably Python.
Must have experience in Data Engineering domain .
Must have implemented at least 2 projects end-to-end in Databricks.
Must have at least experience on databricks which consists of various components as below
o Delta lake
o dbConnect
o db API 2.0
o Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline
Must have good knowledge of Data structure & algorithms.
Must be strong in SQL and sprak-sql.
Must have strong performance optimization skills to improve efficiency and reduce cost.
Must have worked on both Batch and streaming data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
Must be strong in writing unit test case and integration test
Must have strong communication skills and have worked on the team of size 5 plus
Must have great attitude towards learning new skills and upskilling the existing skills.
Preferred Qualifications
Good to have Unity catalog and basic governance knowledge.
Good to have Databricks SQL Endpoint understanding.
Good To have CI/CD experience to build the pipeline for Databricks jobs.
Good to have if worked on migration project to build Unified data platform.
Good to have knowledge of DBT.
Good to have knowledge of docker and Kubernetes.
Cloud BC Labs Inc is a digital transformation organization aimed at creating seamless solutions for clients to effectively manage their business operations. The company specializes in Business and Management Consulting, AI/ML, Data Analytics & Visualization, Cloud Data Warehouse Migration, Snowflake Implementation, Informatica Implementation & Upgrade, Staffing Services and Data Management Solutions
...Food Development Scientists Location: Cincinnati, OH Position Type: 5 years contract or longer (benefits are offered) Shift: Mon-Fri 8am-5pm Pay Rate: $48-$52 per hour POSITION SUMMARY Provide strategic leadership and depth of knowledge in food technology...
6 Months Experience - No Touch Freight - Local Home Daily PAY: $71,500 - $75,000 / Year .67 cpm Local Lane Operates In A 300 Mile Radius of Van Buren OH Mon-Fri / 6 pm Start Time 10-14 Hour Shift No Touch Freight HazMat Required Within 90 Days (Company...
...benefit areas: Position TypeFaculty Work Hours/Week Description of Work Unit The Department of Anthropology houses a diverse faculty that includes cultural anthropologists, archaeologists, biological anthropologists, and geographers whose scholarship spans the...
...Peacebuilding Affairs focuses primarily on five action areas in international peace and security, ensuring sound analysis and early warning,... ...coordination, review and presentation of budget proposals and related materials and issues, as well as on other administrative...
...Temporary Faculty Anthropology Job ID: 278562 Location: Statesboro, Georgia Full/Part Time: Regular/Temporary: About Us Join Our Team at Georgia Southern! Georgia Southern is a dynamic university with three vibrant campuses in Hinesville, Savannah...