Databricks & Azure Data Platform Principal Engineer - HYBRID Job at Kanshe Infotech, New Jersey

TGEzaEVLQU5rQ3lNbUUveklNRXdLRFdKZEE9PQ==
  • Kanshe Infotech
  • New Jersey

Job Description

Job Description: Databricks & Azure Data Platform Principal Engineer
Location: Warren, NJ (Hybrid - 3 days in-office required)

Overview:
We are seeking a highly skilled Databricks & Azure Data Platform Principal Engineer for a Re-Insurance client based in Warren, NJ . This is a senior-level role focused on designing, building, and optimizing data solutions using Databricks and Azure Data Platform technologies. The Principal Engineer will oversee the architecture, integration, development, and deployment of reusable data solutions, ensuring they are scalable, secure, and efficient.

Key Responsibilities:

  • Platform Architecture & Integration: Design and develop data solutions using Databricks and Azure Data Platform to meet business needs. Ensure the architecture is scalable, secure, and highly efficient.
  • Data Pipeline Development: Work closely with developers, analysts, and data scientists to implement data pipelines, real-time analytics, and machine learning models.
  • Automation & Optimization: Manage the platform effectively by implementing automation solutions. Optimize costs, performance, and system reliability through emerging capabilities in the marketplace.
  • Best Practices & Governance: Establish modern best practices for data governance , data architecture , and DataOps within the cloud data ecosystem. Ensure best practices are adhered to by all teams.
  • Performance Tuning & Reliability: Provide guidance on performance tuning, data pipeline optimization, and system reliability. Ensure systems are highly available and performant.
  • Collaboration & Leadership: Collaborate with cross-functional teams, including developers, analysts, and stakeholders, to ensure successful design, development, and deployment of data solutions.
  • Cloud Data Ecosystem Leadership: Act as the subject matter expert for the cloud data ecosystem, ensuring its evolution in line with the latest technologies and industry trends.

Key Skills & Experience:

  • Databricks & Azure Expertise: Proven experience with Databricks and Azure Data Platform in a production environment, including data integration, management, and optimization.
  • Data Pipeline & Analytics: Strong background in building and managing data pipelines, real-time analytics, and machine learning workflows.
  • Automation & Cloud Management: Experience implementing automation in cloud platforms, specifically Azure, for cost and performance optimization.
  • Data Governance & DataOps: Knowledge of data governance and DataOps best practices in cloud environments.
  • Performance & Cost Optimization: Experience with tuning cloud data systems for optimal performance and cost efficiency.
  • Leadership & Collaboration: Ability to lead teams and collaborate effectively with various stakeholders, including developers, data scientists, and business analysts.

Job Tags

Similar Jobs

Community College of Baltimore County

IT Support Technician (AV Support) | Community College of Baltimore County Job at Community College of Baltimore County

 ...certification may be acquired within 6 months of employment. One other technical certification required such as CompTIA (e.g. A+, Net+) Infocomm CTS, or Microsoft certifications (e.g. MCSA, MCSE) IT Support Technician I: # Receive, prioritize, schedule and fulfill... 

Children Unlimited, Inc.

Pediatric Speech-Language Pathologist Job at Children Unlimited, Inc.

 ...therapy, physical therapy, and speech therapy services; all in-...  ...and motivated Pediatric Speech Pathologist with at least 1-2 years of experience...  ...of expressive and receptive language disorders, provide...  ...Speech-Language Pathology (CCC-SLP) from the American Speech-Language... 

AdvisaCare

Caregiver or High Tech Aide position Job at AdvisaCare

 ...patients with mobility and physical therapies/exercises Provide companionship and basic emotional support Requirements High School Graduate or GED Reliable transportation Valid Drivers License Work in a team responsibly and independently... 

Harrow, Inc.

Associate Director, Patient Support Services Job at Harrow, Inc.

Associate Director, Patient Support Servicesat Harrow, Inc. (View all jobs)Nashville TN Before reading the job post, we encourage...  ...are data-driven and use our access to real-world clinical experience to lower the investment risks of our work. We concentrate on... 

Kairos Technologies

Requirement for AV Engineer Job at Kairos Technologies

 ...Parle Speakers and Mics QSC Qsys core processors and touch panels Qsys designer software Industry Certifications: Avixa CTS / CTS I, OSHA 10 / 30, Audinate Level 1,2,3, Various manufacture certs from Crestron, Extron, Biamp, QSC LaxmanAndoli |Lead...