Azure

Azure Data Engineer

  • Location

    Manhattan

  • Sector:

    Data, ML & AI

  • Job type:

    Permanent

  • Salary:

    Negotiable

  • Contact:

    James Lesniak

  • Contact email:

    j.lesniak@ioassociates.com

  • Job ref:

    JH1_1666017411

  • Startdate:

    ASAP

This role will be responsible for developing, optimizing and standardizing data pipelines, creating robust data models for data publishing while complying with, and adding value to, the data architecture. Perform data model design, data formatting, and ETL development optimized for efficient storage, access, and computation to serve various use cases. This individual will work with both current ETL/Data Warehousing and provide direction for future development of data storage, streaming and pipeline architectures for a healthcare organization.

Required Qualifications:

  • Candidate must be located within commuting distance of Manhattan, NY or be willing to relocate to the area.
  • Bachelor's Degree or foreign equivalent
  • Experience securing Cloud based modern data platforms
  • Hands-on experience in developing, and successfully operationalizing complex/large scale data management projects
  • Experience in Python/Scala and Spark or Databricks to handle big data transformation and processing
  • Experience in SQL Development, specifically with complex queries
  • Interface with internal teams and vendors' IT to work through data quality issues and champion HIPAA compliant best practices in data handling and transfe
  • Collaborates with downstream consumers, understand their requirement of data engineering and do implementation

Preferred Qualifications:

  • MS SQL Data Base Packages, Stored Procedures, Functions, Procedures, Triggers, and Data Transformations using SQL with hands-on industry experience is a must
  • 3-5 years experience with Azure Data tools
  • Commutable to New York City, or open to relocation.
  • Prior working experience in healthcare a plus.