Data EngineerLocation:CMRE in La Spezia (Italy)Security Clearance:Valid NATO SecretReference No:CMRE-RFP-25-008Skills, Knowledge, Experience Required:3+ years of professional experience in software development and/or data engineering.Advanced knowledge of the Python programming language and its ecosystem, especially for data engineering.Proven experience in developing using cloud services (Azure).Professional experience in processing very large climatology datasets up to several terabytes per dataset, with cloud-based resources employing horizontal and vertical scalability HPC patterns and Python ecosystem.Very good command of the English language (oral/written).Experience On The Requirements Above Can Be Supported With:Experience with one or more industry standard distributed data systems: Databricks, Apache Kafka, Azure Event Hub, Azure Machine Learning.Experience with developing backend APIs using Python frameworks, especially for complex web applications.Experience using containers (Docker) and orchestration technologies (Kubernetes).Experience in developing workflows using tools (Apache Airflow).Experience in manipulating, storing and visualizing geospatial/satellite/climatology data.Duties/Role:Support the STO-CMRE Research Division and Engineering Division data-related projects based on NATO approved Cloud environments.Setup and management of data engineering pipelines, data processing, machine learning frameworks and tools, cloud-based HPC clusters and data cataloguing.Software Development in Python, configuration of pipelines and application of DevOps tools using Microsoft Azure, Docker, Kubernetes, GitLab.Deployment of dockerized applications with a focus on security.
#J-18808-Ljbffr