Contract Senior Data Engineer

  • Location

    Baltimore

  • Sector:

  • Job type:

    Temporary

  • Salary:

    Negotiable

  • Contact:

    Ellen Middleton

  • Contact email:

    e.middleton@ioassociates.com

  • Job ref:

    BBBH135773_1714145385

Overview: We are seeking a highly skilled and experienced Contract Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a critical role in designing, implementing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. You will collaborate closely with cross-functional teams to understand data requirements, architect robust solutions, and ensure the reliability and efficiency of our data ecosystem. This role offers an exciting opportunity to work with cutting-edge technologies and make a significant impact on our organization's data capabilities.

Responsibilities:

  1. Data Pipeline Development: Design, build, and optimize data pipelines to extract, transform, and load large volumes of structured and unstructured data from various sources into our data lake or warehouse.

  2. Data Modeling: Develop and maintain data models to support business analytics, reporting, and machine learning applications. Implement best practices for data modeling, ensuring scalability, performance, and data integrity.

  3. Infrastructure Management: Manage and enhance our data infrastructure, including cloud-based platforms (e.g., AWS, Azure, GCP) and distributed computing frameworks (e.g., Hadoop, Spark). Monitor system performance, troubleshoot issues, and implement optimizations for reliability and efficiency.

  4. Data Integration: Integrate data from disparate sources, including databases, APIs, streaming platforms, and external vendors. Develop custom connectors and APIs as needed to facilitate seamless data integration across systems.

  5. Data Quality and Governance: Establish data quality standards and implement data governance processes to ensure the accuracy, completeness, and consistency of our data assets. Develop and maintain data quality monitoring tools and frameworks.

  6. Collaboration and Leadership: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Provide technical leadership and mentorship to junior members of the team.

  7. Continuous Improvement: Stay abreast of industry trends and emerging technologies in data engineering and analytics. Identify opportunities for process improvements, automation, and innovation to enhance our data capabilities.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proven experience (5 years) working as a Data Engineer or a similar role, with a focus on building scalable data pipelines and infrastructure.
  • Proficiency in programming languages such as Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Apache Flink).
  • Strong SQL skills and experience working with relational and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
  • Hands-on experience with cloud platforms and services (e.g., AWS, Azure, GCP), including data storage, compute, and orchestration tools.
  • Solid understanding of data modeling concepts and techniques, with experience in designing dimensional and normalized data models.
  • Familiarity with data governance practices, data quality tools, and ETL/ELT processes.
  • Excellent problem-solving skills, with the ability to analyze complex data issues and implement effective solutions.
  • Strong communication skills and the ability to collaborate effectively with cross-functional teams.
  • Experience with agile development methodologies and version control systems (e.g., Git) is a plus.