Databricks & Azure Data Platform Principal Engineer - HYBRID Job at Kanshe Infotech, New Jersey

TGEzaEVLQU5rQ3lNbUUveklNRXdLRFdKZEE9PQ==
  • Kanshe Infotech
  • New Jersey

Job Description

Job Description: Databricks & Azure Data Platform Principal Engineer
Location: Warren, NJ (Hybrid - 3 days in-office required)

Overview:
We are seeking a highly skilled Databricks & Azure Data Platform Principal Engineer for a Re-Insurance client based in Warren, NJ . This is a senior-level role focused on designing, building, and optimizing data solutions using Databricks and Azure Data Platform technologies. The Principal Engineer will oversee the architecture, integration, development, and deployment of reusable data solutions, ensuring they are scalable, secure, and efficient.

Key Responsibilities:

  • Platform Architecture & Integration: Design and develop data solutions using Databricks and Azure Data Platform to meet business needs. Ensure the architecture is scalable, secure, and highly efficient.
  • Data Pipeline Development: Work closely with developers, analysts, and data scientists to implement data pipelines, real-time analytics, and machine learning models.
  • Automation & Optimization: Manage the platform effectively by implementing automation solutions. Optimize costs, performance, and system reliability through emerging capabilities in the marketplace.
  • Best Practices & Governance: Establish modern best practices for data governance , data architecture , and DataOps within the cloud data ecosystem. Ensure best practices are adhered to by all teams.
  • Performance Tuning & Reliability: Provide guidance on performance tuning, data pipeline optimization, and system reliability. Ensure systems are highly available and performant.
  • Collaboration & Leadership: Collaborate with cross-functional teams, including developers, analysts, and stakeholders, to ensure successful design, development, and deployment of data solutions.
  • Cloud Data Ecosystem Leadership: Act as the subject matter expert for the cloud data ecosystem, ensuring its evolution in line with the latest technologies and industry trends.

Key Skills & Experience:

  • Databricks & Azure Expertise: Proven experience with Databricks and Azure Data Platform in a production environment, including data integration, management, and optimization.
  • Data Pipeline & Analytics: Strong background in building and managing data pipelines, real-time analytics, and machine learning workflows.
  • Automation & Cloud Management: Experience implementing automation in cloud platforms, specifically Azure, for cost and performance optimization.
  • Data Governance & DataOps: Knowledge of data governance and DataOps best practices in cloud environments.
  • Performance & Cost Optimization: Experience with tuning cloud data systems for optimal performance and cost efficiency.
  • Leadership & Collaboration: Ability to lead teams and collaborate effectively with various stakeholders, including developers, data scientists, and business analysts.

Job Tags

Similar Jobs

Hyatt

Security Officer (PM Shift) Job at Hyatt

 ...Best Companies to Work For, for several years running! The Security Officer is responsible for the safety and security of the hotel...  ...Adoption Assistance Additional perks include: Free room nights after 90 days, discounted and friends & family room rates... 

Newport Associates

Work From Home- Executive Travel Assistant Job at Newport Associates

 ...Launch Your Dream Travel Business from Anywhere! Are you a travel enthusiast eager to...  ...and tools to get you started, including a personalized website. Whether you're looking for a...  ...you need to succeed as an Office Travel Assistant. Work on Your Terms Choose your schedule... 

5TH HQ

Warehouse Workers Job at 5TH HQ

 ...physical strength, attention to detail, and the ability to work in a fast-paced environment. Key Responsibilities: Load and unload freight from trucks, trailers, and containers. Move, stack, and organize products in designated warehouse areas. Inspect incoming and... 

Bill McCandless Ford

Automotive Technician Job at Bill McCandless Ford

 ...discrimination/harassment without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Eastridge

Forklift Operators Job at Eastridge

 ...rewarding career opportunities. We are currently hiring multiple Forklift Operators for a family-owned supplier specializing in industrial...  ...warehouse or construction)~6+ months of recent forklift experience (verifiable references required)~ Strong hand-eye coordination...