Data Engineer - Security Insights and Automation
Skills
Ubicación
Debes residir (o estar dispuesto a desplazarte) en: Madrid, Spain
Idiomas
Avanzado Inglés
Descripción
We're looking for a skilled Data Engineer – Security Insights and Automation to lead, design, develop, and maintain scalable and robust data pipelines and infrastructure. This role focuses on building ETL/ELT processes, optimizing data storage solutions, ensuring data quality and system monitoring, with a strong collaboration alongside data scientists and analysts. You will implement decentralized Data Products following Data Mesh principles, leveraging expertise in Python, SQL, and big data technologies.
🎯 Responsibilities
- Design, build, and maintain scalable end-to-end data pipelines using Talend, dbt, and Python.
- Develop and optimize data architectures aligned with Data Mesh standards, ensuring scalability and security.
- Transform raw security telemetry and vulnerability data into high-quality feature sets for predictive modeling, anomaly detection, and automated risk scoring.
- Collaborate with business units and data scientists to fully understand and fulfill diverse data needs.
- Communicate effectively with both technical and non-technical stakeholders.
- Optimize and support data structures and schemas for executive dashboards and self-service analytics in Tableau and ThoughtSpot.
- Solve complex data ingestion challenges and lead Snowflake optimizations and schema design for large-scale data initiatives.
- Implement strategies and integrate diverse infrastructures for seamless organizational data flow.
🛠️ Requirements
- Demonstrated experience handling large-scale data engineering projects and managing complex systems.
- Proven expertise in independently building ETL/ELT processes and optimizing data warehouses and data lakes.
- Experience ensuring data quality, reliability, and effective system monitoring.
- Advanced skills in SQL and Snowflake, including data structure design, schema development, and performance optimization.
- Expert-level programming skills in Python or Scala for data engineering tasks.
- Hands-on experience with dbt for data transformation and Talend for data integration.
- Solid understanding of Data Mesh principles and experience supporting AI/ML initiatives (feature engineering).
- Technical ability to support visualizations using Tableau and ThoughtSpot.
- Expertise in consuming and exposing APIs to integrate security insights across systems.
- Strong communication and collaboration skills with technical and non-technical audiences.
Ubicación
Grenzacherstrasse, Basel, Switzerland