Databricks & Azure Data Platform Principal Engineer - HYBRID Job at Kanshe Infotech, New Jersey

TGEzaEVLQU5rQ3lNbUUveklNRXdLRFdKZEE9PQ==
  • Kanshe Infotech
  • New Jersey

Job Description

Job Description: Databricks & Azure Data Platform Principal Engineer
Location: Warren, NJ (Hybrid - 3 days in-office required)

Overview:
We are seeking a highly skilled Databricks & Azure Data Platform Principal Engineer for a Re-Insurance client based in Warren, NJ . This is a senior-level role focused on designing, building, and optimizing data solutions using Databricks and Azure Data Platform technologies. The Principal Engineer will oversee the architecture, integration, development, and deployment of reusable data solutions, ensuring they are scalable, secure, and efficient.

Key Responsibilities:

  • Platform Architecture & Integration: Design and develop data solutions using Databricks and Azure Data Platform to meet business needs. Ensure the architecture is scalable, secure, and highly efficient.
  • Data Pipeline Development: Work closely with developers, analysts, and data scientists to implement data pipelines, real-time analytics, and machine learning models.
  • Automation & Optimization: Manage the platform effectively by implementing automation solutions. Optimize costs, performance, and system reliability through emerging capabilities in the marketplace.
  • Best Practices & Governance: Establish modern best practices for data governance , data architecture , and DataOps within the cloud data ecosystem. Ensure best practices are adhered to by all teams.
  • Performance Tuning & Reliability: Provide guidance on performance tuning, data pipeline optimization, and system reliability. Ensure systems are highly available and performant.
  • Collaboration & Leadership: Collaborate with cross-functional teams, including developers, analysts, and stakeholders, to ensure successful design, development, and deployment of data solutions.
  • Cloud Data Ecosystem Leadership: Act as the subject matter expert for the cloud data ecosystem, ensuring its evolution in line with the latest technologies and industry trends.

Key Skills & Experience:

  • Databricks & Azure Expertise: Proven experience with Databricks and Azure Data Platform in a production environment, including data integration, management, and optimization.
  • Data Pipeline & Analytics: Strong background in building and managing data pipelines, real-time analytics, and machine learning workflows.
  • Automation & Cloud Management: Experience implementing automation in cloud platforms, specifically Azure, for cost and performance optimization.
  • Data Governance & DataOps: Knowledge of data governance and DataOps best practices in cloud environments.
  • Performance & Cost Optimization: Experience with tuning cloud data systems for optimal performance and cost efficiency.
  • Leadership & Collaboration: Ability to lead teams and collaborate effectively with various stakeholders, including developers, data scientists, and business analysts.

Job Tags

Similar Jobs

Walgreens

IT Infrastructure & Engineering Internship Job at Walgreens

Job Summary: Interacts and participates with various divisions within Walgreens to assist in influencing key business decisions. Assists with and completes projects that contribute to the strategic initiatives and department goals of the function the role supports. ...

KFC

Shift Leader Job at KFC

 ...At KFC, our meals matter, and when we serve our customers with southern hospitality, we make our customers day. By serving hot and fresh food and keeping the restaurant clean, you leave a positive impression on the experiences of other people. So you can see that our... 

Broad River Rehabilitation

Occupational Therapy Assistant / COTA / OTA Job at Broad River Rehabilitation

Broad River Rehab is Coming to Macon!! Occupational Therapist Assistant- Part Time Flexible Hhours Carlyle Place Macon, GA We...  ...Waycross, GA. Broad River Rehab is a rapidly growing, NC based therapy company that partners with providers across all settings including... 

Northeast Family Services

DSP / Direct Support Professional Job at Northeast Family Services

 ...Supports (PASS) programs. Part-time Positions (6-20 hours) including after school, evening, and weekend hours. Responsibilities for DSP position : Working directly with individuals from ages 3-21 with special needs Implementing behavior plans and programs... 

Aerotech, Inc.

Outsourcing Clerk Job at Aerotech, Inc.

 ...providing the following exceptional benefits and more!~ Competitive compensation ~ Bi-annual bonus ~ Annual raise eligibility ~ UPMC Health Insurance ~ Dental insurance ~ Vision insurance ~ Life insurance ~ Retirement Plan ~ Employee Stock Ownership Trust...