Azure Data Engineer Job at Apptad Inc, Dallas, TX

MFVhTGZHUmNnU0FGZHRtbG4zVWFPbUc4RHc9PQ==
  • Apptad Inc
  • Dallas, TX

Job Description

Desired Skills

1Possess a minimum of 5 years of experience in data engineering and development

2Strong experience in designing and implementing data solutions using Azure data services Azure Databricks Azure Data Lake Azure Synapse Analytics Azure Data Factory

3Have a strong background in Retail CPG domain

4Proficiency in SQL TSQL and data modelling techniques

5Experience with PySpark and orchestration tools like Apache Airflow are highly desirable

6Hands on experience with scripting languages such as Python for data processing and manipulation

7Strong analytical and problemsolving skills

8Excellent communication and interpersonal skills with ability to work effectively in a collaborative team environment

9Knowledge on Databricks Unity Catalog and visualization tools like Power BI is a plus

Roles and responsibilities

1Develop and optimize data workflows using PySpark ADLS and Databricks workflows to support business objectives

2Implement and maintain data pipelines to ensure efficient data processing and storage

3Collaborate with crossfunctional teams to gather requirements and deliver data solutions that meet business needs

4Provide technical expertise in the design and implementation of data solutions ensuring scalability and performance

5Monitor and troubleshoot data workflows to ensure reliability and accuracy of data processing

6Apply Spark in Python for advanced data processing and analytics

7Build automation solutions and utilities to eliminate manual efforts and repetitive tasks

8Utilize Databricks SQL for effective data management and querying

9Implement monitoring solutions in Azure to track resource utilization performance and health of data workflows

10Manage and organize data assets using Databricks Unity Catalog

11Leverage Azure DevOps for continuous integration and deployment of data solutions

12Secure data workflows using Azure Key Vault and ensure compliance with data security standards

Skills

Mandatory Skills : Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory,Azure Functions,Azure SQL,Azure Synapse Analytics,AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight

Job Tags

Similar Jobs

Tech Observer

Control Technician Job at Tech Observer

 ...About this Position The Automation Technician acts as a technical resource to our teams to ensure they have the proper support needed...  ...improving performance, and reducing scrap Perform electrical/control based preventative maintenance tasks as assigned Provide... 

Accenture

Creative Agency Senior Copywriter Job at Accenture

 ...are: Accenture Song is the world's largest tech-powered creative group. We accelerate growth and value for our clients through sustained...  ...of copywriting experience (B2B or B2C)+ Minimum 2 of years agency or equivalent industry experience in the creative field across... 

Compunnel Inc.

Client Relations Associate Job at Compunnel Inc.

 ...focuses on handling written client complaints and senior investor concerns in compliance with regulatory requirements. As a Client Relations Analyst , youll investigate, research, and formally respond to client issues through written communication, ensuring that each... 

RecruitPod Global

Title Agent Job at RecruitPod Global

 ...Our growing Firm has established a positive work culture that focuses on exceptional client...  ...experienced and motivated Licensed Title Agent & Closer to join our team. This person...  ...of the Firm. We have a flexible work-from-home (WFH) policy, as well as an unlimited PTO... 

Calculated Hire

Email Marketing Developer Job at Calculated Hire

 ...Sr. Email Marketing Developer Remote - Columbus, OH 6-12 month contract with possible extension and/or conversion Qualifications: ~ A Bachelors degree in related field ~3-5+ years of experience building, execuiting, testing, and deploying email campaigns in...