Data Engineer
-
Location
United States of America
-
Sector:
-
Job type:
-
Salary:
Negotiable
-
Contact:
Bryan Scott
-
Contact email:
b.scott@ioassociates.com
-
Job ref:
BBBH138377_1717170912
Job Title: Data Engineer
Location: Remote
Salary: $90,000 - $120,000 USD annually
We are in need of a Senior Data Engineer to join our client's team. This is an excellent opportunity to work with a great team and have the opportunity to make an immediate impact for the organization.
Responsibilities:
- Design, develop, and maintain data pipelines for ingesting, transforming, and loading data into the data warehouse.
- Implement data modeling and build out data warehousing solutions using Azure and PostgreSQL technologies.
- Ensure low-level security measures are implemented and maintained to safeguard sensitive data.
- Implement soft delete architecture for data deletion to ensure data integrity and compliance with regulatory requirements.
- Utilize Azure Data Factory for orchestrating data workflows and integrating with other Azure services.
- Embed Power BI for data visualization and reporting purposes, ensuring high-quality and scalable dashboards.
- Design and implement a robust architecture for the data platform, focusing on scalability, performance, and maintainability.
- Establish observability and monitoring practices to track data pipeline performance and detect anomalies.
- Monitor server health and performance, ensuring optimal operation and resource utilization.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Mentor junior team members and provide technical guidance and support as needed.
Requirements:
- Minimum of 5 years of experience in a Data Engineering or similar role.
- Strong expertise in Azure services, particularly Azure Data Factory and Power BI.
- Proficiency in PostgreSQL and SQL for data manipulation and querying.
- Experience with data warehousing techniques and methodologies.
- Familiarity with implementing security measures and data governance best practices.
- Excellent problem-solving skills and attention to detail.
- Experience with server monitoring and performance optimization.
- Ability to work effectively in a fast-paced and collaborative environment.