Data engineer
Fieldside
Расположение работы
Brussels
Статус занятости
на постоянной основе
Подробности вакансии
Voor een klant in Brussel ben ik op zoek naar een Data Engineer. De omgeving is volledig on prem, geen cloud kennis vereist. Het is een Engelstalige omgeving, kennis van Nederlands is een plus.
• ETL and Data Integration: Design, develop, and maintain ETL pipelines using Python, while integrating diverse data sources and ensuring data quality and consistency.
• Workflow Orchestration: Implement and manage data workflows with Apache Airflow, ensuring timely data flow and automation.
• Data Modeling and Transformation: Utilize dbt to transform raw data into usable models, create and maintain data models that support analytics, and manage databases for high performance and scalability.
• Database Management: Perform routine database administration tasks, including optimization, backups, and security, within the private data center.
• Collaboration and Support: Work closely with data teams on data-driven projects, providing technical support and troubleshooting data-related issues.
• Documentation and Reporting: Document data processes, workflows, and architecture, while generating and maintaining detailed operational reports.
• Continuous Improvement: Stay updated on the latest trends and tools in data engineering, innovating and implementing new techniques to enhance practices.
We need in-deep hands-on experience in Apache Airflow (+ Astro SDK and Cosmos), Kubernetes, Gitlab CI/CD pipelines, Python, PostgreSQL fine-tuning, familiar with Tableau is a plus
