Sr Azure Data Engineer Job at Zapcom, Dallas, TX

SzYvaUZxQUttU2lJblVUMkljUXpLenFLZHc9PQ==
  • Zapcom
  • Dallas, TX

Job Description

  • Design and implement data ingestion, transformation, and movement using Azure Data Factory (ADF), Azure Synapse, and Data Lake.
  • Collaborate with business stakeholders, data scientists, and engineers to build robust data solutions.
  • Develop and manage high-volume, real-time, and batch data ingestion pipelines using Azure Data Factory (ADF).
  • Implement event-driven architectures for real-time data movement and processing.
  • Develop large-scale data processing solutions using Azure Databricks and Apache Spark with PySpark, Scala, or Python.
  • Optimize data partitioning, caching, and indexing for efficient performance.
  • Manage complex transformations and aggregations for structured and unstructured datasets.
  • Design and implement high-performance data models in Azure Synapse Analytics using dedicated SQL Pools and Spark Pools.
  • Optimize query performance, workload management, and cost efficiency in Synapse Analytics.
  • Implement column store indexes, partitioning strategies, and data caching to enhance performance.
  • Design and manage secure, scalable data lakes using Azure Data Lake Storage Gen2 (ADLS Gen2).
  • Implement RBAC (Role-Based Access Control), encryption, and data masking to ensure security.
  • Implement Azure Monitor, Log Analytics, and Application Insights for data pipeline monitoring and troubleshooting.
  • Optimize cost management, auto-scaling, and performance tuning across Azure services.

Requirements

  • 8+ years of experience in data engineering, ETL development, and cloud-based data integration,
  • Strong experience with Azure Data Factory (ADF): ETL/ELT pipeline orchestration and data movement.
  • Azure Databricks: Large-scale data transformation and big data processing with Apache Spark, PySpark, Scala, or Python.
  • Azure Synapse Analytics: Data warehousing, SQL Pools, Spark Pools, and performance tuning.
  • Azure Data Lake Storage Gen2 (ADLS Gen2): Secure, scalable data lake architecture.
  • SQL Server: Advanced T-SQL, stored procedures, indexing, and query optimization.
  • Power BI, Tableau, or other BI tools for data visualization.
  • Financial/Banking experience.

Job Tags

Full time,

Similar Jobs

Get It Recruit - Transportation

Tracking and Tracing Team Lead - Overnight - Remote | WFH Job at Get It Recruit - Transportation

 ...Tracking Supervisor, you'll be responsible for leading a Tracking and Tracing Team, ensuring shipments are monitored effectively, and...  ...lead or supervisory experience. Work Environment This is a remote position; however, training will take place at our headquarters... 

Sky Zone Trampoline Park

Sky Zone Flight Crew Member Job at Sky Zone Trampoline Park

Sky Zone Trampoline Park in Louisville, KY is looking for one sky zone flight crew member to join our 28 person strong team. We are located on 4200 Outer Loop. Our ideal candidate is self-driven, motivated, and engaged. Benefits ~ We offer many great benefits, including...

Convoy

Graphic Designer Job at Convoy

We're looking for a talented graphic designer who can take concepts and ideas and create visual representations, in both print and electronic media. The ideal candidate will have expert knowledge of Adobe Create Suite. Collaborating with marketing/product development,... 

LaborOne Staffing

Ship Fitter Job at LaborOne Staffing

 ...minimal supervision, steel structural work in all stages of new construction of marine vessels. The position requires a working...  ...pay M-Th = 10 hours / Fri = 8 hours PLUS some Sats & Sun Per-diem available for those that qualify Call Clara for full details... 

Galaxy Technology Hires LLC

Flight Software Engineer Job at Galaxy Technology Hires LLC

 ...Flight Software Engineer - Boulder, CO About the Company: Have you ever wanted to be part of a start-up culture, but perhaps within a company that has established itself with financial stability and overcome some of the start-up company challenges? Our client...