Senior Data Engineer
-
Location
New York
-
Sector:
-
Job type:
-
Salary:
Negotiable
-
Contact:
Ellen Middleton
-
Contact email:
e.middleton@ioassociates.com
-
Job ref:
BBBH141562_1720808321
-
Duration:
6-months
We are currently looking for a Senior Data Engineer to join us on a contract basis, collaborating with teams within a dynamic technology organization. This role offers a hybrid work setup based at our Customer's office in New York City.
Responsibilities:
- Lead the complete development lifecycle of intricate data projects involving integrations and transformations, including analysis, design, development, and support of complex data pipelines within cloud environments.
- Contribute to the design and setup of data management tools for extracting and manipulating data from diverse sources, encompassing both internal and external databases.
Required Qualifications:
- Bachelor's degree in Computer Science, Information Systems, or a related field; a Master's degree is preferred.
- Over 7 years of experience as a Data Engineer.
- Proficiency in constructing scalable, secure data pipelines that facilitate the ingestion, transformation, and transfer of large volumes of structured and unstructured data from various databases and sources.
- Demonstrated expertise in developing sophisticated database logic and APIs to automate data retrieval and storage in various formats.
- Extensive familiarity with programming languages (e.g., Python), ETL tools, relational and non-relational databases, and their administration.
- Experience in architecting and building reusable modular components to support complex applications.
- Proven track record in implementing data quality, security, and governance standards across multiple cloud environments.
- Skilled in designing and implementing integrations between data management tools.
- Proficiency in designing, developing, and maintaining data solutions across major cloud platforms such as AWS or Google Cloud.
- Strong understanding of data structures, algorithms, software architecture, and the ability to design, test, and document complex systems comprehensively.
- Experience in securely handling PHI, PII, and PCI data, and optimizing application performance and resiliency.
- Ability to collaborate effectively with data analysts, data scientists, and IT operations to develop tools that transform data for use in advanced data and artificial intelligence applications.
- Demonstrated leadership in technical roles, providing guidance and consulting on development projects.
- Strong problem-solving skills, with the ability to innovate solutions for complex business and production challenges.
- Familiarity with modern DevSecOps practices and tools, as well as Agile methodologies and associated tools (e.g., Jira, Scrum, Kanban).
Preferred Qualifications:
- Experience leading teams of data engineers and analysts in developing complex software and data pipelines.
- Familiarity with data governance processes, data classification, and taxonomy tools.
