Over Joost
Senior data engineer met 8 jaar ervaring in het bouwen en schalen van data- en ML-systemen bij snelgroeiende techbedrijven. Ik neem graag end-to-end eigenaarschap over mijn werk, van design, naar implementatie, tot operatie/migratie. Sterke communicator, zowel met technische collega's als met stakeholders. Ik heb een kritische instelling, en mijn doel is het leveren van hoge kwaliteit oplossingen, altijd gecombineerd met een pragmatische blik op de huidige situatie en limitaties.
Tech: Python, Java, SQL, Kubernetes, Docker, GCP, BigQuery, Pub/Sub, dbt, Airflow, Redis, PostgreSQL, ElasticSearch, Hadoop, Spark, Feast, MLflow, Grafana, Git, GitLab
Nederlands
Tweetalig / moedertaal
Engels
Tweetalig / moedertaal
Kan op locatie werken
Amsterdam (tot 40km)
Werkervaring
- Dexter EnergySenior Data Engineermei 2022 - maart 2026 (3 jaren en 10 maanden)• • Part of the Market Data team, responsible for building and maintaining systems for ingesting,cleaning, storing, and serving energy market data – one of the three core data domains at Dexter Energy.• • Proposed, designed, and led the migration, from a legacy data ingestion system to a new platform with significantly improved performance: near-realtime processing (data ready within 10 seconds),easy extensibility to enable product development, consistent data cleaning and deduplication,better maintainability, documentation, and observability.• • Scaled the data platform from 3–4 sources and dozens of datasets, to 15+ sources and hundreds ofdatasets, while improving reliability and data quality.• • Shared in on-call responsibilities for operational issues including API downtime, malformed/missing data, and unannounced API changes from external providers.• • Owned the company-wide Airflow instances during the time when no infrastructure team existed.Migrated all workloads to Airflow 2, helped users with writing DAGs, troubleshot and optimisedperformance and execution issues. Handed Airflow over to infrastructure team when it was established.• • Took on de-facto tech lead responsibilities: driving planning meetings, writing design documents, creating and refining issues, and collaborating with downstream teams to understand their needsand prioritise work accordingly.• • Tech: Python, Kubernetes, GCP, Pub/Sub, BigQuery, dbt, Airflow, Redis, Grafana
- AdyenSoftware Developer, MLOpsjuni 2020 - mei 2022 (1 jaar en 11 maanden)• • Part of the MLOps team, working on Adyen's big data platform and machine learning tooling that enabled data scientists to launch fast and iterate.• • Designed and implemented a second-generation feature store, based on the open-source Feastproject, significantly improving performance and scaling up the number of features and users.• • Worked on tooling for model training, versioning, serving, lifecycle management, and observabil ity/monitoring.• • Collaborated with data infrastructure engineers, data scientists, cloud engineers, and other developers across the organisation. Python
- AdyenJava Developer, Monitoringmaart 2018 - juni 2020 (2 jaren en 3 maanden)• • Built internal systems for logging, monitoring, and alerting related to Adyen's payment serviceapplications, based on requirements and feedback from teams such as platform operations and tech support.• • Implemented a framework for event data logging, widely used across the company for dashboarding and transporting event data to Hadoop clusters for large-scale analysis.• • Tech: Java, Python, PostgreSQL, ElasticSearch, Grafana, Spark
Aanbevelingen
Wees de eerste die Joost aanbeveelt
Help deze freelancer om te schitteren door te vertellen hoe het is om met hem of haar te werken.
Deze freelancerprofielen matchen ook met zoekopdracht.
Agatha Frydrych
Backend Java Software Engineer
4.7
(3)
2
Baptiste Duhen
Fullstack developer
4.6
(4)
5
Amed Hamou
Senior Lead Developer
4
(2)
7
Audrey Champion
Web developer
4.3
(3)
4
Opleidingen
- MSc Aerospace EngineeringDelft University of Technology2017Specialised in control & simulation
- BSc Aerospace EngineeringDelft University of Technology2014