Title : Azure Data Engineer
Location : Dallas, TX
Rate : On C2C
Job Summary:The Azure Data Engineer (Senior) is a highly experienced role responsible for leading the design, development, and maintenance of large-scale, complex data processing systems on the Azure platform. They work with data architects, data scientists, and other stakeholders to ensure data solutions are scalable, reliable, and secure.
Job Description:
Job Responsibilities
Design and implement Data Ingestion from multiple sources to Azure Data Storage services.
Implement Azure data services and tools to ingest, egress, and transform data from multiple sources.
Responsible for creating an ETL pipeline with Azure Ecosystem like Azure Data Bricks, Azure Data Factory.
Build simple to complex pipelines, activities, Datasets & data flows
Utilize Azure compute services [Databricks, Data Lake Store, PySpark, Apache Spark, Synapse, Data Factory] to implement transformation logic and stage transformed data.
Design data ingestion into data modelling services to create cross domain data models for end user consumption.
Implement ETL, related jobs to curate, transform and aggregate data to create source models for end user analytics use cases.
Scheduling automation and monitoring instrumentation for data movement jobs.
Working experience with Azure monitor and Azure log Analytics.
Background work on legacy data warehouses and Big Data will be plus.
Should have fair knowledge of the consumption layer (BI) and the business processes.
Implement/Support Azure DBaaS infrastructure and services
Experience working in Agile/Scrum/Kanban team environments
Candidate Profile / Qualification
A Minimum of a Bachelor's degree in Computer Science or related software engineering discipline, or equivalent
7-9 years of experience managing SQL Queries, Data Lake, Data Bricks, PySpark, Synapse, Data factory etc.
Strong ETL pipeline development experience with Azure Ecosystem like Azure Data Bricks, Azure Data Factory. Build simple to complex notebooks, pipelines, activities, Datasets & data flows.
Experience with message ingestion systems like Kafka / Azure Event Hub.
Experience in data modelling and Proficient in SQL developer skills in writing stored procedures, functions, transformations etc.
Experience in PySpark and data factory is must
Knowledge in Service provisioning, scripted provisioning, blueprint development for data service deployment etc.
Excellent oral and written communication skills.
Candidate should possess a strong work ethic, good interpersonal and communication skills, and a high energy level
Class A Owner Operators Wanted for container freight out of Charleston Jobpull containers from Charleston SC to deliver to SC, NC, GA... ...ApplyCityCharleston StateSOUTH CAROLINAMinimum Years of Experience Required1-2 yrsDoes the driver need to have a Hazardous...
...Amazon DSP Delivery Driver Helper: Full-time delivery driver helper positions are available. Overtime rate of time and a half after 8 hours in a day and 40 hours in a week. Weekly Safety and Quality Bonuses Year Round. Summary: ~ Amazon Warehouse - DLX7...
...Join our team as a day shift , full-time , PBX Telecom Operator in Albuquerque, NM . Why Join Us? Thrive in a People... ..., assisting with general information, and providing after-hour phone services. Adheres to policies, procedures, and regulations to ensure...
Project Security OfficerDepartment: Project Security OfficerLocation: Tuscon, AZ NIKA is hiring for a Project Security Officer who will provide facilities operations support services for the Customs Border Protection (CBP) Arizona in Phoenix, AZ!Named a Top...
...Analytics, Operations, and Technology(IPAOT) team supports NBCUniversals content globally with four key areas: (1) developing more secure and scalable frameworks for Internet-based video distribution, (2) improving security technologies and processes in content...