Data Engineer

We are seeking a skilled and detail-oriented Data Engineer to join our team. The ideal candidate will play a crucial role in building, optimizing, and maintaining the systems that enable effective data collection, storage, and analysis. You will collaborate with fellow team members, analysts, colleagues from other departments to ensure data infrastructure aligns with business goals and supports a variety of analytical and operational needs.

Key Responsibilities:

Data Pipeline Development:

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines to ensure data quality and availability.
• Optimize data workflows and integrate data from a variety of internal and external sources.

Database Management:

• Design and maintain data storage solutions such as relational databases, data warehouses, and data lakes.
• Ensure databases and data storage systems are optimized for performance, security, and reliability.

Data Integration and Transformation:

• Develop data integration solutions to merge data from various sources into unified formats.
• Implement data cleaning, validation, and transformation processes to prepare datasets for analysis.

System Monitoring and Maintenance:

• Monitor and troubleshoot data infrastructure to identify and resolve issues promptly.
• Implement and manage automation tools to enhance system efficiency and reduce downtime.

Collaboration:

• Work closely with the BI manager and business stakeholders to understand data requirements and deliver appropriate solutions.
• Document system architecture, workflows, and data models to facilitate knowledge sharing and system maintenance.

Data Security and Compliance:

• Ensure compliance with data governance standards and regulations.
• Implement robust security protocols to protect sensitive data and ensure privacy.