Data Engineer

This is a hybrid contract role, please apply if you are local to the DC area.

Position Overview: We are seeking a talented Data Engineer to join our dynamic team in Washington DC. As an Data Engineer, you will play a crucial role in designing, implementing, and managing data solutions on the Azure cloud platform. You will work closely with cross-functional teams to understand data requirements, architect robust data pipelines, and ensure the integrity, reliability, and performance of our data infrastructure.

Key Responsibilities:

1. 
   Data Architecture and Design: Design scalable and efficient data architectures on Azure, including data lakes, data warehouses, and data pipelines, to support business objectives and analytical needs.
2. 
   Data Modeling: Develop data models and schemas to organize and structure data for optimal storage, retrieval, and analysis.
3. 
   ETL Development: Design, develop, and maintain Extract, Transform, Load (ETL) processes to efficiently move data from various sources into Azure data repositories.
4. 
   Data Integration: Integrate data from disparate sources, including relational databases, APIs, and streaming data sources, ensuring data consistency, quality, and accuracy.
5. 
   Data Transformation and Processing: Implement data transformation and processing logic using Azure services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
6. 
   Performance Optimization: Identify and implement performance optimizations to enhance the speed, scalability, and efficiency of data processing and analytics workloads.
7. 
   Data Security and Compliance: Implement robust data security measures and ensure compliance with relevant data privacy regulations, such as GDPR and CCPA.
8. 
   Monitoring and Troubleshooting: Monitor data pipelines and infrastructure components, proactively identify and resolve issues, and optimize system performance and reliability.
9. 
   Collaboration and Documentation: Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions. Document data architectures, designs, and processes for knowledge sharing and future reference.

Qualifications:

• Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree preferred.
• Proven experience as a Data Engineer, preferably with a focus on Azure cloud technologies.
• Strong proficiency in SQL and experience with relational database systems such as SQL Server, MySQL, or PostgreSQL.
• Hands-on experience with Azure data services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure SQL Database.
• Experience with data modeling, ETL development, and data integration techniques and best practices.
• Familiarity with programming languages such as Python, Java, or Scala for data processing and automation.
• Excellent analytical and problem-solving skills, with a keen attention to detail.
• Strong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment.
• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert) are a plus.