{"id":13455,"date":"2026-06-29T23:40:13","date_gmt":"2026-06-29T18:10:13","guid":{"rendered":"https:\/\/gapstars.net\/tech\/career-listings\/job-1541\/"},"modified":"2026-07-06T11:55:11","modified_gmt":"2026-07-06T06:25:11","slug":"job-1541","status":"publish","type":"career-listings","link":"https:\/\/gapstars.net\/tech\/career-listings\/job-1541\/","title":{"rendered":"ETL \/ Data Engineer"},"content":{"rendered":"<p dir=\"ltr\"><strong>About Gapstars<\/strong><\/p>\n<p dir=\"ltr\">Gapstars is a Netherlands-based software development services provider that builds remote, agile teams in Sri Lanka and Portugal for innovative tech companies. Today, we are home to 300+ TechStars and innovative minds, turning scalable software into performance products that shape the future. Our partners are highly ambitious tech companies that are looking to conquer their respective markets.\u00a0<strong>\u00a0<\/strong><\/p>\n<p dir=\"ltr\"><strong>About the Role<\/strong><\/p>\n<p>Our client is a fast-growing Dutch scale-up transforming the real-estate industry through a powerful data platform that leverages public real-estate and geospatial data to deliver actionable insights. As they continue expanding across international markets, they are looking for a Mid-Level ETL \/ Data Engineer to play a key role in building and scaling country-specific data pipelines, starting with Germany.<\/p>\n<p dir=\"ltr\">As part of a collaborative engineering team, you will design, develop and maintain robust ETL pipelines that ingest, transform and validate data from multiple public sources into an Azure-based platform. You&#8217;ll work with large-scale web scraping, API integrations and cloud technologies while taking ownership of end-to-end data pipelines. The ideal candidate is passionate about data engineering, enjoys solving complex data challenges and takes pride in delivering clean, reliable and scalable solutions that support business growth.<\/p>\n<p dir=\"ltr\"><strong>Responsibilities<\/strong><\/p>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Design, develop and maintain ETL pipelines for ingesting public real-estate and geo-data into Azure-based data platforms.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Build scalable web scraping solutions capable of handling anti-bot protection, proxies, and rate limiting.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Integrate structured data from APIs, official registries, and public datasets.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Transform, validate, deduplicate, and normalize source-specific data into clean and reliable datasets.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Develop incremental and idempotent data pipelines with robust validation before production deployment.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Ensure country-specific datasets remain physically separated and securely managed.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Extend existing pipeline architecture to onboard new countries using reusable components rather than duplicated implementations.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Write clean, maintainable, and well-tested Python code following engineering best practices.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Collaborate closely with engineering leads to implement technical designs within the provided architecture framework.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Participate in code reviews, pull requests, and automated quality assurance processes.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Troubleshoot, optimize, and maintain production data pipelines for reliability and scalability.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Work within an Agile environment, participating in daily stand-ups and cross-functional collaboration.<\/p>\n<\/ul>\n<h1 dir=\"ltr\"><span style=\"font-size: 16.0px;\"><strong>Technical Skills<\/strong><\/span><\/h1>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Strong proficiency in Python for ETL development and data engineering.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience building scalable web scraping solutions using tools such as BeautifulSoup, Scrapy, Selenium, or Playwright.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Knowledge of anti-bot mechanisms, proxy rotation, and rate-limiting strategies.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience integrating REST APIs and structured external data sources.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Strong SQL skills with experience designing and optimizing relational databases.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Familiarity with cloud-based data platforms, preferably Microsoft Azure.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience working with Databricks or similar distributed data processing platforms is highly desirable.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Understanding of ETL\/ELT concepts, data transformation, and data quality validation.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience with Git, Pull Requests, and collaborative software development workflows.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Familiarity with CI\/CD practices and automated testing.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Understanding of secure development practices, secrets management, and least-privilege access principles.<\/p>\n<\/ul>\n<h2 dir=\"ltr\"><span style=\"font-size: 16.0px;\"><strong>Experience &#038; Qualifications<\/strong><\/span><\/h2>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\">3+ years of professional experience in Data Engineering or ETL development.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Strong experience with Python, SQL, and data pipeline development.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Hands-on experience in both large-scale web scraping and structured API integrations.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience working with cloud platforms, preferably Azure.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Familiarity with Databricks is considered an advantage.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Experience working in Agile\/Scrum environments.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Bachelor&#8217;s degree in Computer Science, Software Engineering, Data Engineering, or a related field is preferred.<\/p>\n<\/ul>\n<h2 dir=\"ltr\"><strong><span style=\"font-size: 16.0px;\">Soft Skills<\/span><\/strong><\/h2>\n<ul>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Excellent analytical and problem-solving skills.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Strong ownership mindset with the ability to work independently.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Effective communication and collaboration skills in English.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Ability to adapt to evolving technical designs and business requirements.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Strong attention to detail and commitment to data quality.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Comfortable working in a fully remote, international engineering team.<\/p>\n<li dir=\"ltr\">\n<p dir=\"ltr\">Proactive attitude with the ability to identify edge cases and propose solutions.<br \/>\t\u00a0<\/p>\n<\/ul>\n<p dir=\"ltr\"><strong>&#8220;Gapstars is committed to a diverse and inclusive workplace. We are an equal-opportunity employer and do not discriminate based on race, national origin, gender, disability, or age. Your personal information collected during the application process is handled following our privacy policy and used exclusively for recruitment and hiring purposes only&#8221;<\/strong><\/p>\n","protected":false},"template":"","meta":{"_acf_changed":false,"content-type":"","role":"ETL \/ Data Engineer","location":"Portugal","about_gapstars":"<p dir=\"ltr\"><strong>About Gapstars<\/strong><\/p><p dir=\"ltr\">Gapstars is a Netherlands-based software development services provider that builds remote, agile teams in Sri Lanka and Portugal for innovative tech companies. Today, we are home to 300+ TechStars and innovative minds, turning scalable software into performance products that shape the future. Our partners are highly ambitious tech companies that are looking to conquer their respective markets.\u00a0<strong>\u00a0<\/strong><\/p><p dir=\"ltr\"><br><strong>About the Role<\/strong><br><br>Our client is a fast-growing Dutch scale-up transforming the real-estate industry through a powerful data platform that leverages public real-estate and geospatial data to deliver actionable insights. As they continue expanding across international markets, they are looking for a Mid-Level ETL \/ Data Engineer to play a key role in building and scaling country-specific data pipelines, starting with Germany.<\/p><p dir=\"ltr\">As part of a collaborative engineering team, you will design, develop and maintain robust ETL pipelines that ingest, transform and validate data from multiple public sources into an Azure-based platform. You'll work with large-scale web scraping, API integrations and cloud technologies while taking ownership of end-to-end data pipelines. The ideal candidate is passionate about data engineering, enjoys solving complex data challenges and takes pride in delivering clean, reliable and scalable solutions that support business growth.<\/p><p dir=\"ltr\"><strong>Responsibilities<\/strong><\/p><ul>\t<li dir=\"ltr\">\t<p dir=\"ltr\">Design, develop and maintain ETL pipelines for ingesting public real-estate and geo-data into Azure-based data platforms.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Build scalable web scraping solutions capable of handling anti-bot protection, proxies, and rate limiting.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Integrate structured data from APIs, official registries, and public datasets.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Transform, validate, deduplicate, and normalize source-specific data into clean and reliable datasets.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Develop incremental and idempotent data pipelines with robust validation before production deployment.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Ensure country-specific datasets remain physically separated and securely managed.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Extend existing pipeline architecture to onboard new countries using reusable components rather than duplicated implementations.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Write clean, maintainable, and well-tested Python code following engineering best practices.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Collaborate closely with engineering leads to implement technical designs within the provided architecture framework.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Participate in code reviews, pull requests, and automated quality assurance processes.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Troubleshoot, optimize, and maintain production data pipelines for reliability and scalability.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Work within an Agile environment, participating in daily stand-ups and cross-functional collaboration.<\/p>\t<\/ul>","requirements":"<h1 dir=\"ltr\"><span style=\"font-size: 16.0px;\"><strong>Technical Skills<\/strong><\/span><\/h1><ul>\t<li dir=\"ltr\">\t<p dir=\"ltr\">Strong proficiency in Python for ETL development and data engineering.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience building scalable web scraping solutions using tools such as BeautifulSoup, Scrapy, Selenium, or Playwright.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Knowledge of anti-bot mechanisms, proxy rotation, and rate-limiting strategies.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience integrating REST APIs and structured external data sources.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Strong SQL skills with experience designing and optimizing relational databases.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Familiarity with cloud-based data platforms, preferably Microsoft Azure.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience working with Databricks or similar distributed data processing platforms is highly desirable.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Understanding of ETL\/ELT concepts, data transformation, and data quality validation.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience with Git, Pull Requests, and collaborative software development workflows.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Familiarity with CI\/CD practices and automated testing.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Understanding of secure development practices, secrets management, and least-privilege access principles.<\/p>\t<\/ul><h2 dir=\"ltr\"><span style=\"font-size: 16.0px;\"><strong>Experience & Qualifications<\/strong><\/span><\/h2><ul>\t<li dir=\"ltr\">\t<p dir=\"ltr\">3+ years of professional experience in Data Engineering or ETL development.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Strong experience with Python, SQL, and data pipeline development.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Hands-on experience in both large-scale web scraping and structured API integrations.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience working with cloud platforms, preferably Azure.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Familiarity with Databricks is considered an advantage.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Experience working in Agile\/Scrum environments.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Bachelor's degree in Computer Science, Software Engineering, Data Engineering, or a related field is preferred.<\/p>\t<\/ul><h2 dir=\"ltr\"><strong><span style=\"font-size: 16.0px;\">Soft Skills<\/span><\/strong><\/h2><ul>\t<li dir=\"ltr\">\t<p dir=\"ltr\">Excellent analytical and problem-solving skills.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Strong ownership mindset with the ability to work independently.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Effective communication and collaboration skills in English.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Ability to adapt to evolving technical designs and business requirements.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Strong attention to detail and commitment to data quality.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Comfortable working in a fully remote, international engineering team.<\/p>\t\t<li dir=\"ltr\">\t<p dir=\"ltr\">Proactive attitude with the ability to identify edge cases and propose solutions.<br>\t\u00a0<\/p>\t<\/ul><p dir=\"ltr\"><strong>\"Gapstars is committed to a diverse and inclusive workplace. We are an equal-opportunity employer and do not discriminate based on race, national origin, gender, disability, or age. Your personal information collected during the application process is handled following our privacy policy and used exclusively for recruitment and hiring purposes only\"<\/strong><\/p>","recruitee_id":"1541"},"career-location":[56],"career-type":[30],"technologies":[173,192],"class_list":["post-13455","career-listings","type-career-listings","status-publish","hentry","career-location-lisbon","career-type-tech","technologies-azure","technologies-databricks"],"acf":[],"_links":{"self":[{"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/career-listings\/13455","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/career-listings"}],"about":[{"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/types\/career-listings"}],"wp:attachment":[{"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/media?parent=13455"}],"wp:term":[{"taxonomy":"career-location","embeddable":true,"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/career-location?post=13455"},{"taxonomy":"career-type","embeddable":true,"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/career-type?post=13455"},{"taxonomy":"technologies","embeddable":true,"href":"https:\/\/gapstars.net\/tech\/wp-json\/wp\/v2\/technologies?post=13455"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}