Data engineer
Andersen4 000 - 4 500 $ netto
-
Umowa o pracę Umowa
-
1001-5000 pracowników Rozmiar firmy
-
2007 Rok założenia firmy
Opis oferty
Responsibilities:
- Developing, testing, and maintaining daily pipeline ETL processes for collecting data in the cloud;
- Developing and ensuring ETL processes for data processing;
- Creating tools for operating and monitoring the data platform;
- Creating data models and building a data showcase for Data Analysts and ML Engineers;
- Creating services to handle real-time data via Kafka for subsequent analysis using Azure tools;
- Collaborating with all stakeholders to achieve a deep and clear understanding of requirements.
Must-haves:
- Experience as a Data Engineer for 3+ years;
- Understanding of data processing algorithms and principles;
- Experience with Azure cloud storage solutions;
- Experience with Python, Apache Airflow, and PySpark;
- Experience with Kafka;
- Knowledge of PL SQL or SQL;
- Experience with Azure Databricks and Azure Event Hub;
- Experience in building ETL processes;
- Experience with modern Agile software development and testing methodologies using modern ALM tools, such as GitHub/Azure DevOps;
- Level of English – from Intermediate.
Nice-to-haves:
- Experience with Apache Hive, Apache Impala, Amazon Redshift, Snowflake, PostgreSQL, Greenplum, and Vertica;
- Experience in creating cloud applications based on container platforms, such as Microsoft Azure Kubernetes Services or Lambda Azure Functions;
- Experience in building MLOps and data-driven applications.
Metodologia pracy
- System kontroli wersji
- System zarządzania projektem
- Metodologia Agile
- Komunikator firmowy
- Code review
- Continuous Integration
- Testy jednostkowe
- Testy integracyjne
- Testerzy w zespole
- System zarządzania wiedzą
- Statyczna analiza kodu
- Swoboda w wyborze oprogramowania
O Andersen
Andersen is a pre-IPO software development company providing a full cycle of services. For over 15 years, we have been helping enterprises and middle-sized firms worldwide transform their businesses by creating effective digital solutions using innovative technologies.
Andersen is a European IT company uniting over 3,100 top-class professionals: developers, architects, testers, analysts, and other specialists. Our employees are located all over the world, but we all are Andersen Family!
Andersen is a European IT company uniting over 3,100 top-class professionals: developers, architects, testers, analysts, and other specialists. Our employees are located all over the world, but we all are Andersen Family!