Mid Data Platform Engineer
RemotePortugalmidFull Time
- Posted
- today
- Source
- Himalayas
- Field
- Engineering
Skills
CommunicationSecurityAirflowPythonScalaCI/CDSparkSQLAWSdbtETL
Description
-
Fluent in written and spoken Portuguese and English.
-
30 days’ notice period for termination
-
The candidate can work remotely from any Portuguese region
What you will be doing:
-
We're looking for a Data Engineer to support and develop a data platform within a large-scale international energy provider.
-
Provide user support for the data platform, troubleshooting and fixing issues
-
Support data pipelines and ETL/ELT processes to enable reliable and scalable data flows
-
Collaborate with platform architects to ensure the data platform is efficient, secure, and highly available
-
Improve data processes, monitoring, performance and platform efficiency
-
Support data quality frameworks and monitoring to ensure accuracy, consistency, and completeness of data pipelines
-
Support for data lakes, data warehouses, and data streaming solutions
-
Work with stakeholders (data scientists, analysts, business users) to solve issues in the data platform
-
Automate repeatable tasks and improve the data ingestion, transformation, and delivery processes
-
Troubleshoot and optimize data workflows and SQL queries for performance and cost efficiency
-
Document data platform changes, processes, and best practices
-
Review, evaluate and approve data product releases to production.
What we are looking for:
-
Experience with data pipelines in a production environment
-
Strong hands-on knowledge of SQL and experience with distributed data processing (e.g., Apache Spark)
-
Proficiency and knowledge of troubleshooting dbt, Apache Kafka, Apache Ignite, Apache NiFi and Apache AirFlow
-
Proficiency in a programming language such as Python or Scala for data engineering tasks
-
Experience with cloud data services (AWS)
-
Familiarity with Grafana tools
-
Knowledge of data governance, security, and compliance in a cloud environment
-
Experience implementing CI/CD and testing frameworks for data workflows
-
Strong problem-solving skills, communication skills, and passion for collaboration.
What can you expect from us?
Mind-blowing workplace culture. You will be integrated in a professional, dynamic and collaborative team.
100% Remote opportunities
We want you to have the flexibility to work where you feel most comfortable and productive.
International Career
-
You can expect professional growth and to be connect with the world.
-
We are represented in Portugal, Belgium, Luxembourg, and Denmark.
-
And with projects in many other countries: Netherlands, Luxembourg, Singapore and in the United States of America (and a lot more is coming…)
Extra Benefits & Perks
If you wish to work with us and you are outside European Union (good news…) we are a Tech Visa Company, We will help!
As a plus, we provide Health and Life Insurance.
Originally posted on Himalayas
JobMatch aggregates public listings. Always apply through the original posting.