Descripción

I am a Data Engineer and AWS Certified Solutions Architect. I specialize in designing and implementing data solutions and in functional programming with Scala, Python, and particularly with Spark. I currently work for a company with its own platform, enabling clients to efficiently manage, analyze, and visualize large volumes of data. My daily tasks often include Data Acquisition, Data Orchestration, Data Development, Pipeline Automation, Data Cleaning, Data Migration, and Data Ingestion.

My extensive technical toolkit includes expertise in Scala, Python, Java, Spark, Flink, Kafka, Hive, Git, Docker, Kubernetes, AWS services (S3, EMR, ECS, DynamoDB, IAM), and SQL.

I take a meticulous and results-driven approach, focusing on delivering scalable, high-impact solutions that drive business growth and enhance decision-making capabilities.

Ámbito de especialización en el sector

Idiomas

Español
Bilingüe o nativo
Inglés
Competencia profesional completa

Preferencias de lugar de trabajo

Solo teletrabajo

Lleva a cabo sus proyectos principalmente en remoto

Big Data Company
Data Engineer
HIGH TECH
septiembre de 2022 - Hoy (3 años y 9 meses)
Kingdom of Spain, España
Design and Implementation of the Informational Layer of an MDM (Master Data Management) System Utilizing a three-tier architecture (Frontend, Backend, and Informational) and a Medallion Architecture in a Data Lakehouse. This includes defining the format, structure, partitioning, and modeling of data across the system's layers, as well as managing the data lifecycle. Agile methodology was applied throughout the project.
Data persistence was implemented using Delta tables with versioning based on the SCD Type 2 model. The infrastructure was containerized using Kubernetes.
Data pipeline orchestration was managed with Apache Airflow, encompassing monitoring, incident resolution, and continuous optimization for performance improvements.

Tools and Technologies:
PySpark, Spark SQL, HDFS, AWS Services (S3, IAM), Delta Lake, Kubernetes, Git, Jenkins, Nexus, Jira.
Spark Spark Sql PySpark Scala Airflow AWS S3 EMR
Banking Company
Big Data Developer
BANCA & SEGUROS
marzo de 2020 - septiembre de 2022 (2 años y 6 meses)
Madrid, España
Development and Optimization of Data Ingestion and Transformation Processes
Aligned with the bank's data model, including the modeling of tables with HQL structures. Conducted unit testing and ensured continuous integration across different layers with a code quality validator. Kanban methodology was applied.

Tools and Technologies:
Scala, Spark, Spark SQL, HDFS, Hive, ScalaTest, Git, Jenkins, Nexus, Jira, Sonar.

Real-Time Data Processing Developer in a Banking Sector Project
Focused on processing and transforming operations in real-time. Performed end-to-end (E2E) and unit testing, with continuous integration across different layers, including a code quality validator. Scrum methodology was utilized.

Tools and Technologies:
Java, Flink, Kafka, AWS S3, SQL, Mockito, Cucumber, Jenkins, Sonar, Git, Docker, NiFi, Jira.

Java Flink Kafka Scala Spark HDFS Hive
Banking Company
Big Data Engineer
BANCA & SEGUROS
junio de 2019 - marzo de 2020 (9 meses)
Madrid, España
Development of Data Ingestion, Transformation, and Quality Validation Processes
Aligned with the bank's architecture, including data structure modeling. Planned and monitored batch processes, ensuring continuous integration across the various layers.

Tools and Technologies:
Scala, Spark, HDFS, PowerDesigner, Kirby, Hammurabi, Control-M, Git, Jenkins, Docker, Artifactory, Jira.
Scala Spark HDFS Control-M Spark SQL