Job Description

The Data Engineer will partner with a wide range of business teams to implement analytical and data solutions that drive business value and customer satisfaction. He or She will be responsible for collecting, storing, processing, analyzing, modeling large sets of data and building applications and solutions using data. The primary focus will be on building, maintaining, implementing, monitoring, supporting and integrating analytical and data solutions with the architecture used across the company.

How You'll Shine:

• Maintain and monitor our analytics data warehouses and data platform.
• Design, Implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates.
• Responsible for hands-on development, deployment, maintenance and support of variety of Cloud and on-premise Solutions, web service infrastructure and supporting technologies.
• Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
• Works closely with project managers, business analysts, data scientists and other groups in the organization to understand and translate functional requirements and processes into technical specifications.
• C ollaborate with key stakeholders to make sure our data infrastructure meets our business needs in a scalable way.
• Keep a critical eye on our technical strategy, identify gaps, and come up with creative solutions.

What You'll Bring:

• Bachelor’s degree in computer and information science required
• Master’s degree preferred.
• Snowflake and Python certification preferred but not required
• Excellent listening, interpersonal, communication (written & verbal) and problem-solving skills.
• Ability to collect and compile relevant data
• Extremely organized with great attention to detail
• Excellent ability to analyze information and think systematically
• Strong business analysis skills
• A strong team player with some ability to work independently
• Good understanding of the company’s business processes and the industry at large
• Good working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Experience building and optimizing data pipelines and data sets leveraging various scripting languages or ETL tools.
• Ability to perform root cause analysis on internal and external data processes to answer specific business questions and identify opportunities for improvement.
• Good analytic skills related to working with unstructured datasets.
• Ability to build and use APIs to push and pull data from various data systems and platforms.
• Build processes supporting data extraction, transformation, and loading of data into data structures.
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
• Ability to build data models and manage data warehouses
• 3 years of related data engineering/IT experience
• 1+ years of proven experience working with Apache Spark framework, Hadoop, Java/Scala, Python and AWS architecture.
• 1+ years of proven experience in Microsoft .Net technologies such as C#, VB.Net and experience in designing, developing and deploying Windows & Web applications
• 2+ years of experience in data modeling/database development using PL/SQL and SQL Server 2016 or later and Snowflake
• 1+ years of proven experience building data pipelines and ETL flows in Cloud and on-premise environments using Snowpipe, Informatica, Airflow, Kafka etc.

Job Tags

Similar Jobs