Senior Big Data Engineer, AI Engineer, Project Management, Team Leader
Aktualisiert am 05.09.2024
Profil
Mitarbeiter eines Dienstleisters
Remote-Arbeit
Verfügbar ab: 05.09.2024
Verfügbar zu: 100%
davon vor Ort: 50%
Skill-Profil eines fest angestellten Mitarbeiters des Dienstleisters
Englisch
Verhandlungssicher
Deutsch
Fortgeschritten
Persisch
Muttersprache

Einsatzorte

Einsatzorte

Heidelberg (+500km)
Deutschland, Schweiz
möglich

Projekte

Projekte

9 Monate
2023-10 - 2024-06

Project Management

Cloud and System Manager agiles Projektmanagement Azure Devops Internet of Things ...
Cloud and System Manager
  •  Providing IT consultancy across the full technology stack
  • Design and implementation of cloud-based solutions utilizing Azure with focus on scalability and operational efficiency
  • Collaborating with cross-functional teams to assess, select, and integrate advanced technologies, ensuring alignment with business goals
  • Guide discussions in platform meetings, demonstrating adept decision-making and leadership abilities
  • Resolving high-impact IT incidents with a focus on accountability and reliability
  • Facilitating global communications and engagement across dispersed sites, demonstrating interpersonal and coordination skills
  • Providing expert consultancy to the Enterprise Architecture department
  • Consultancy on two major initiatives: Data Management Platform and Digital Platform
  • Managing key operational projects, including the relocation of a data center and the initiation of operations at a new site, ensuring seamless transition and minimal operational disruption
Azure
agiles Projektmanagement Azure Devops Internet of Things Datenarchitektur
Georg Fischer Piping Systems Ltd
Schaffhausen, Switzerland
1 Jahr 8 Monate
2021-10 - 2023-05

Strategic Pricing Initiative

Senior Data Engineer Azure SQL Databricks ...
Senior Data Engineer
  • Work collaboratively with diverse business stakeholders to implement multiple pricing use cases
  • Provide expert consultation on data lake architecture and data infrastructure to ensure efficient data handling
  • Develop and manage cloud data lake engineering processes on Azure/Databricks to streamline data operations
  • Successfully led the migration of the pipeline from Data Factory to Databricks, ensuring a seamless transition with minimal downtime
  • Provided expert consultation for the development of a new data platform, advising on best practices and cutting-edge technologies
  • Enhanced the performance of the core pipeline by two-fold, leveraging the Delta Lake features of Databricks to optimize data processing and throughput
  • Create valuable data use cases employing Databricks and Azure Data Lake to extract meaningful insights from data
  • Participate in meetings with the Business team to comprehensively gather requirements for use cases, promoting effective communication
  • Establish robust CI/CD pipelines on Azure DevOps to automate and enhance the software development process
  • Design and implement continuous integration and deployment processes, increasing the efficiency and reliability of software updates
  • Provide custom solutions consultancy for data integration, accommodating unique business needs
  • Maintain and manage legacy data pipelines with Data Factory, ensuring data continuity and reliability
  • Automate data integration processes for data ingestion and data export to various external systems using interfaces such as REST, FTP, etc., improving the data interchange efficiency
  • Harmonize ingested data from various formats such as XML, JSON, CSV into unified Parquet data structures for streamlined processing by the data lake pipelines
  • Prepare data lake datasets for export in versatile formats such as XML, JSON, CSV, to be sent to external systems, ensuring compatibility and accessibility
  • Design and implement POCs for a low-latency data integration solution using PostgreSQL as a backend, enabling interactive use of certain data lake datasets by users in SAP C4C
Databricks Azure
Azure SQL Databricks Python Apache Spark
Henkel AG
Duesseldorf
1 Jahr 3 Monate
2020-06 - 2021-08

Reshaping DevOps Pipelines in an acquired BioTech Startup

Senior DevOps Engineer Ansible CI/CD
Senior DevOps Engineer

- DevOps Consultant working in a team of highly skilled developers and engineers creating cutting-edge digital products in the laboratory informatics space

-Tasks:

  • Configuring and operating the continuous integration and deployment (CI/CD) pipeline for solutions based on a scalable microservices architecture.
  • Responsible for maintaining, monitoring, and reporting systems both for the CI/CD pipeline and product Dev/QA/Prod deployments.
  • Handover to new internal staff
AWS GitLab CI/CD
Ansible CI/CD
Merck
Darmstadt
5 Monate
2020-08 - 2020-12

Data Workflow Orchestration and Monitoring

Data Engineer Kanban Pyhton CI/CD ...
Data Engineer

- Goal: Build up a comprehensive service for business and IT people by combining different Microsoft Azure Services and other tools to provide a data lake with data processing capabilities. Huge datasets from different platforms are managed on this data hub.

- Tasks:

  • Establish robust and performant pipelines using Python, Apache Spark within the Azure environment using Azure Databricks
  • Implement quality checks on incoming data and perform quality assurance tests on the datasets and code
  • Analyze business requirement in terms of data transformation in a qualitatively diverse data environment
  • Consult business on best practices and technical effort in relation to product development and project achievements

Azure Databricks Azure DevOps
Kanban Pyhton CI/CD REST API Azure
Henkel AG
Düsseldorf
3 Monate
2020-03 - 2020-05

Senior Consulting Engineer

Senior Consulting Engineer Microsoft Azure Databricks Data Factory ...
Senior Consulting Engineer

- Goal: Build up a comprehensive service for business and IT people by combining different Microsoft Azure Services and other tools to provide a data lake with data processing capabilities. Huge datasets from different platforms are managed on this data hub.

- Tasks:

  • Establish robust and performant pipelines using Python, Apache Spark within the Azure environment using Azure Databricks
  • Implement quality checks on incoming data and perform quality assurance tests on the datasets and code
  • Analyze business requirement in terms of data transformation in a qualitatively diverse data environment
  • Consult business on best practices and technical effort in relation to product development and project achievements

Microsoft Azure Databricks Data Factory Python Rest API Scrum Azure DevOps
Düsseldorf
5 Monate
2019-11 - 2020-03

DevOps Engineer

DevOps Kubernetes Docker Linux-Scripting ...
DevOps

- DevOps Consultant working in a team of highly skilled developers and engineers creating cutting-edge digital products in the laboratory informatics space

-Tasks:

  • Configuring and operating the continuous integration and deployment (CI/CD) pipeline for solutions based on a scalable microservices architecture.
  • Responsible for maintaining, monitoring, and reporting systems both for the CI/CD pipeline and product Dev/QA/Prod deployments.

Rancher Jenkins GitLab SonarQube
Kubernetes Docker Linux-Scripting Ansible Prometheus Grafana Continuous Integration Continuous Deployment AWS
Darmstadt
7 Monate
2019-06 - 2019-12

Team Leader

Teamleiter Openstack Scrum RedHat Enterprise Linux Administration ...
Teamleiter
  • Leading the cloud team
  • Participating in CAB
  • Reporting to higher managers
  • other organizational tasks
Openstack Scrum RedHat Enterprise Linux Administration SDN ELK Stack ITIL Grafana HAProxy Git JIRA Gitlab Administration von Linuxservern Troubleshooting VPN pfSense nginx
Heidelberg Universität
Heidelberg
2 Jahre 9 Monate
2016-10 - 2019-06

IAAS Cloud & Infrastructure

DevOps Openstack Scrum RedHat Enterprise Linux Administration ...
DevOps

Design, develop and administrate IaaS private cloud platform based on RED HAT OpenStack Platform for academical customers.

  • Provide appropriate cloud solutions for client requests
  • POC: object storage from different vendors
  • Logging, monitoring, and troubleshooting the cloud with different tools and frameworks such as ELK stack, Grafana, FluentD, and Sensu
  • Successful design and implementation of an OpenStack test cluster for testing cloud activities such as upgrade
  • Troubleshooting software-defined networking
Openstack Scrum RedHat Enterprise Linux Administration SDN ELK Stack ITIL Grafana HAProxy Git JIRA Gitlab Administration von Linuxservern Troubleshooting VPN pfSense nginx
Heidelberg University
Heidelberg
1 Jahr
2018-01 - 2018-12

Development of Billing & User Management System

Software Architect and Developer Python HTML5 JavaScript ...
Software Architect and Developer
  • Design and develop a billing and user management system for the heiCLOUD project using
  • Django, and Django Rest Framework.
  • Design and Develop a materialized billing frontend using REST API, Python, HTML5, Javascript.
Python HTML5 JavaScript Git PostgreSQL Django Django Rest Framework
Heidelberg University
Heidelberg
1 Jahr
2015-10 - 2016-09

heiDOCS - Zentrales Online-Portal der Universität Heidelberg

Software developer Scrum AngularJS Javascript ...
Software developer

Develop and configure a web application for handling
administrative processes of Ph.D. students.

  • Full-Stack Developer: develop backend (Node.js), frontend (AngularJS), and REST API.
  • Develop features requested by clients for heiDOCS processes.
  • Fixing bugs reported by clients.
  • Cooperation with a third-party company for further development of heiDOCS project.
Scrum AngularJS Javascript Node.js Administration von Linuxsystemen MongoDB Git
Heidelberg University
Heidelberg
2 Jahre 1 Monat
2013-10 - 2015-10

Research Assistant

Research Assistant Automated Debugging Research & Development
Research Assistant
Automated Debugging Research & Development
Heidelberg University
Heidelberg

Aus- und Weiterbildung

Aus- und Weiterbildung

6 Jahre 7 Monate
2013-01 - 2019-07

Ph.D. Computer Science

Dr. rer. nat., Heidelberg University
Dr. rer. nat.
Heidelberg University

Software debugging

Kompetenzen

Kompetenzen

Schwerpunkte

Project Management
Experte
Data Engineering
Experte
Software Development
Experte
DevOps
Experte
Machine Learning
Fortgeschritten
Generative AI
Fortgeschritten

Produkte / Standards / Erfahrungen / Methoden

Atlassian JIRA
Experte
AWS
Fortgeschritten
Azure
Experte
CI/CD
Experte
Container
Experte
Continuous Integration
Experte
Data Factory
Experte
Data visualization
Experte
Databricks
Experte
Django
Experte
Docker
Experte
FastAPI
Experte
Git
Experte
Gitlab
Experte
Grafana
Fortgeschritten
ITIL Foundation
Experte
Kanban
Experte
Machine Learning
Fortgeschritten
NLP
Fortgeschritten
Openstack
Fortgeschritten
Scrum
Experte
Kubernetes
Fortgeschritten

Betriebssysteme

Linux
Experte
Microsoft Windows
Fortgeschritten

Programmiersprachen

Linux-Scripting
Experte
Pyhton
Experte

Datenbanken

MongoDB
Basics
MySQL
Experte
PostgreSQL
Experte

Einsatzorte

Einsatzorte

Heidelberg (+500km)
Deutschland, Schweiz
möglich

Projekte

Projekte

9 Monate
2023-10 - 2024-06

Project Management

Cloud and System Manager agiles Projektmanagement Azure Devops Internet of Things ...
Cloud and System Manager
  •  Providing IT consultancy across the full technology stack
  • Design and implementation of cloud-based solutions utilizing Azure with focus on scalability and operational efficiency
  • Collaborating with cross-functional teams to assess, select, and integrate advanced technologies, ensuring alignment with business goals
  • Guide discussions in platform meetings, demonstrating adept decision-making and leadership abilities
  • Resolving high-impact IT incidents with a focus on accountability and reliability
  • Facilitating global communications and engagement across dispersed sites, demonstrating interpersonal and coordination skills
  • Providing expert consultancy to the Enterprise Architecture department
  • Consultancy on two major initiatives: Data Management Platform and Digital Platform
  • Managing key operational projects, including the relocation of a data center and the initiation of operations at a new site, ensuring seamless transition and minimal operational disruption
Azure
agiles Projektmanagement Azure Devops Internet of Things Datenarchitektur
Georg Fischer Piping Systems Ltd
Schaffhausen, Switzerland
1 Jahr 8 Monate
2021-10 - 2023-05

Strategic Pricing Initiative

Senior Data Engineer Azure SQL Databricks ...
Senior Data Engineer
  • Work collaboratively with diverse business stakeholders to implement multiple pricing use cases
  • Provide expert consultation on data lake architecture and data infrastructure to ensure efficient data handling
  • Develop and manage cloud data lake engineering processes on Azure/Databricks to streamline data operations
  • Successfully led the migration of the pipeline from Data Factory to Databricks, ensuring a seamless transition with minimal downtime
  • Provided expert consultation for the development of a new data platform, advising on best practices and cutting-edge technologies
  • Enhanced the performance of the core pipeline by two-fold, leveraging the Delta Lake features of Databricks to optimize data processing and throughput
  • Create valuable data use cases employing Databricks and Azure Data Lake to extract meaningful insights from data
  • Participate in meetings with the Business team to comprehensively gather requirements for use cases, promoting effective communication
  • Establish robust CI/CD pipelines on Azure DevOps to automate and enhance the software development process
  • Design and implement continuous integration and deployment processes, increasing the efficiency and reliability of software updates
  • Provide custom solutions consultancy for data integration, accommodating unique business needs
  • Maintain and manage legacy data pipelines with Data Factory, ensuring data continuity and reliability
  • Automate data integration processes for data ingestion and data export to various external systems using interfaces such as REST, FTP, etc., improving the data interchange efficiency
  • Harmonize ingested data from various formats such as XML, JSON, CSV into unified Parquet data structures for streamlined processing by the data lake pipelines
  • Prepare data lake datasets for export in versatile formats such as XML, JSON, CSV, to be sent to external systems, ensuring compatibility and accessibility
  • Design and implement POCs for a low-latency data integration solution using PostgreSQL as a backend, enabling interactive use of certain data lake datasets by users in SAP C4C
Databricks Azure
Azure SQL Databricks Python Apache Spark
Henkel AG
Duesseldorf
1 Jahr 3 Monate
2020-06 - 2021-08

Reshaping DevOps Pipelines in an acquired BioTech Startup

Senior DevOps Engineer Ansible CI/CD
Senior DevOps Engineer

- DevOps Consultant working in a team of highly skilled developers and engineers creating cutting-edge digital products in the laboratory informatics space

-Tasks:

  • Configuring and operating the continuous integration and deployment (CI/CD) pipeline for solutions based on a scalable microservices architecture.
  • Responsible for maintaining, monitoring, and reporting systems both for the CI/CD pipeline and product Dev/QA/Prod deployments.
  • Handover to new internal staff
AWS GitLab CI/CD
Ansible CI/CD
Merck
Darmstadt
5 Monate
2020-08 - 2020-12

Data Workflow Orchestration and Monitoring

Data Engineer Kanban Pyhton CI/CD ...
Data Engineer

- Goal: Build up a comprehensive service for business and IT people by combining different Microsoft Azure Services and other tools to provide a data lake with data processing capabilities. Huge datasets from different platforms are managed on this data hub.

- Tasks:

  • Establish robust and performant pipelines using Python, Apache Spark within the Azure environment using Azure Databricks
  • Implement quality checks on incoming data and perform quality assurance tests on the datasets and code
  • Analyze business requirement in terms of data transformation in a qualitatively diverse data environment
  • Consult business on best practices and technical effort in relation to product development and project achievements

Azure Databricks Azure DevOps
Kanban Pyhton CI/CD REST API Azure
Henkel AG
Düsseldorf
3 Monate
2020-03 - 2020-05

Senior Consulting Engineer

Senior Consulting Engineer Microsoft Azure Databricks Data Factory ...
Senior Consulting Engineer

- Goal: Build up a comprehensive service for business and IT people by combining different Microsoft Azure Services and other tools to provide a data lake with data processing capabilities. Huge datasets from different platforms are managed on this data hub.

- Tasks:

  • Establish robust and performant pipelines using Python, Apache Spark within the Azure environment using Azure Databricks
  • Implement quality checks on incoming data and perform quality assurance tests on the datasets and code
  • Analyze business requirement in terms of data transformation in a qualitatively diverse data environment
  • Consult business on best practices and technical effort in relation to product development and project achievements

Microsoft Azure Databricks Data Factory Python Rest API Scrum Azure DevOps
Düsseldorf
5 Monate
2019-11 - 2020-03

DevOps Engineer

DevOps Kubernetes Docker Linux-Scripting ...
DevOps

- DevOps Consultant working in a team of highly skilled developers and engineers creating cutting-edge digital products in the laboratory informatics space

-Tasks:

  • Configuring and operating the continuous integration and deployment (CI/CD) pipeline for solutions based on a scalable microservices architecture.
  • Responsible for maintaining, monitoring, and reporting systems both for the CI/CD pipeline and product Dev/QA/Prod deployments.

Rancher Jenkins GitLab SonarQube
Kubernetes Docker Linux-Scripting Ansible Prometheus Grafana Continuous Integration Continuous Deployment AWS
Darmstadt
7 Monate
2019-06 - 2019-12

Team Leader

Teamleiter Openstack Scrum RedHat Enterprise Linux Administration ...
Teamleiter
  • Leading the cloud team
  • Participating in CAB
  • Reporting to higher managers
  • other organizational tasks
Openstack Scrum RedHat Enterprise Linux Administration SDN ELK Stack ITIL Grafana HAProxy Git JIRA Gitlab Administration von Linuxservern Troubleshooting VPN pfSense nginx
Heidelberg Universität
Heidelberg
2 Jahre 9 Monate
2016-10 - 2019-06

IAAS Cloud & Infrastructure

DevOps Openstack Scrum RedHat Enterprise Linux Administration ...
DevOps

Design, develop and administrate IaaS private cloud platform based on RED HAT OpenStack Platform for academical customers.

  • Provide appropriate cloud solutions for client requests
  • POC: object storage from different vendors
  • Logging, monitoring, and troubleshooting the cloud with different tools and frameworks such as ELK stack, Grafana, FluentD, and Sensu
  • Successful design and implementation of an OpenStack test cluster for testing cloud activities such as upgrade
  • Troubleshooting software-defined networking
Openstack Scrum RedHat Enterprise Linux Administration SDN ELK Stack ITIL Grafana HAProxy Git JIRA Gitlab Administration von Linuxservern Troubleshooting VPN pfSense nginx
Heidelberg University
Heidelberg
1 Jahr
2018-01 - 2018-12

Development of Billing & User Management System

Software Architect and Developer Python HTML5 JavaScript ...
Software Architect and Developer
  • Design and develop a billing and user management system for the heiCLOUD project using
  • Django, and Django Rest Framework.
  • Design and Develop a materialized billing frontend using REST API, Python, HTML5, Javascript.
Python HTML5 JavaScript Git PostgreSQL Django Django Rest Framework
Heidelberg University
Heidelberg
1 Jahr
2015-10 - 2016-09

heiDOCS - Zentrales Online-Portal der Universität Heidelberg

Software developer Scrum AngularJS Javascript ...
Software developer

Develop and configure a web application for handling
administrative processes of Ph.D. students.

  • Full-Stack Developer: develop backend (Node.js), frontend (AngularJS), and REST API.
  • Develop features requested by clients for heiDOCS processes.
  • Fixing bugs reported by clients.
  • Cooperation with a third-party company for further development of heiDOCS project.
Scrum AngularJS Javascript Node.js Administration von Linuxsystemen MongoDB Git
Heidelberg University
Heidelberg
2 Jahre 1 Monat
2013-10 - 2015-10

Research Assistant

Research Assistant Automated Debugging Research & Development
Research Assistant
Automated Debugging Research & Development
Heidelberg University
Heidelberg

Aus- und Weiterbildung

Aus- und Weiterbildung

6 Jahre 7 Monate
2013-01 - 2019-07

Ph.D. Computer Science

Dr. rer. nat., Heidelberg University
Dr. rer. nat.
Heidelberg University

Software debugging

Kompetenzen

Kompetenzen

Schwerpunkte

Project Management
Experte
Data Engineering
Experte
Software Development
Experte
DevOps
Experte
Machine Learning
Fortgeschritten
Generative AI
Fortgeschritten

Produkte / Standards / Erfahrungen / Methoden

Atlassian JIRA
Experte
AWS
Fortgeschritten
Azure
Experte
CI/CD
Experte
Container
Experte
Continuous Integration
Experte
Data Factory
Experte
Data visualization
Experte
Databricks
Experte
Django
Experte
Docker
Experte
FastAPI
Experte
Git
Experte
Gitlab
Experte
Grafana
Fortgeschritten
ITIL Foundation
Experte
Kanban
Experte
Machine Learning
Fortgeschritten
NLP
Fortgeschritten
Openstack
Fortgeschritten
Scrum
Experte
Kubernetes
Fortgeschritten

Betriebssysteme

Linux
Experte
Microsoft Windows
Fortgeschritten

Programmiersprachen

Linux-Scripting
Experte
Pyhton
Experte

Datenbanken

MongoDB
Basics
MySQL
Experte
PostgreSQL
Experte

Vertrauen Sie auf Randstad

Im Bereich Freelancing
Im Bereich Arbeitnehmerüberlassung / Personalvermittlung

Fragen?

Rufen Sie uns an +49 89 500316-300 oder schreiben Sie uns:

Das Freelancer-Portal

Direktester geht's nicht! Ganz einfach Freelancer finden und direkt Kontakt aufnehmen.