Azure

Sr Data Engineer - 12 Month Contract

  • Location

    New York

  • Sector:

    Data, ML & AI

  • Job type:

    Contract

  • Salary:

    Negotiable

  • Contact:

    Alyssa Hank

  • Contact email:

    a.hank@ioassociates.com

  • Job ref:

    0929AH_1665775504

  • Duration:

    12 Months

  • Consultant:

    Alyssa Hank

Our Customer, a Software Company in New York, is hiring a Data Engineer for a 12+ month contract on their new InfoSec team.

You Will:
* Work to enrich, stabilize and normalize datasets from an infosec data lake.
* Work within a private cloud environment that includes Java, Scala, Spark, Hadoop, Airflow, etc.
* Support data onboarding and migration.
* Collaborate with senior leadership to understand business needs and design a data ingestion pipeline.
* Support the creation of technical documentation.

Position Requirements:
* 5+ years of experience in software development.
* Experience building out data pipelines from scratch (Java and Scala).
* Experience working with streaming data and tools like Spark, Kafka.
* Experience working with tools like Hadoop in a big data environment (this role entails 15 TB/day).
* Experience with Flink is ideal.
* Ability to be onsite 2 times a week is ideal