Streamlink
Streamlink

Data engineer SCALA/ SPARK

Streamlink

Data engineer SCALA/ SPARK

Streamlink

115 Application(s)

This offer uses one way video interviews

If your application is selected, you will receive an invitation by email to take an automated video interview directly on Fabskill. All you have to do is answer the interview questions written by the recruiter on video. This type of interview replaces the physical interview in order to speed up the process and is often followed by a final interview in live video or face-to-face.

This offer requires a Pitch-Video interview

Following your application, the recruiters for this offer can send you an invitation by email to present yourself in a video pitch, please regularly check the email account associated with your Fabskill profile.
you can also anticipate this invitation and start your video pitch right now on this link.
The Pitch-Video is perceived by recruiters as proof of commitment, and allows your profile to appear at the top of the candidates list.

Data engineer  SCALA/ SPARK

Informations

Localisation:

France

Contract:

Mission

Requirements

Experience:
No experience
Diplomas:
Engineer degree
Languages:
English
This offer uses one way video interviews

If your application is selected, you will receive an invitation by email to take an automated video interview directly on Fabskill. All you have to do is answer the interview questions written by the recruiter on video. This type of interview replaces the physical interview in order to speed up the process and is often followed by a final interview in live video or face-to-face.

This offer requires a Pitch-Video interview

Following your application, the recruiters for this offer can send you an invitation by email to present yourself in a video pitch, please regularly check the email account associated with your Fabskill profile.
you can also anticipate this invitation and start your video pitch right now on this link.
The Pitch-Video is perceived by recruiters as proof of commitment, and allows your profile to appear at the top of the candidates list.

Description:

  • Développer et maintenir les pipelines de données en utilisant les technologies Spark/Scala, en mettant l'accent sur les API DataFrame, Dataset et RDD. 
  • La connaissance de la bibliothèque ScalaTest est également requise.
  • Expérience pratique avec les composants Azure tels que ADLS (Azure Data Lake Storage), DataBricks, Azure Data Factory, Azure Analysis Services (DAX), DevOps (Terraform, Docker, Kubernetes), Azure Functions et KeyVault.
  • Utilisation des IDE tels que Intellij, Visual Studio Code et Visual Studio pour le développement et le débogage.
  • Travailler avec des données de différents formats tels que Avro, Parquet, JSON, CSV/Excel et Delta. La connaissance de Python serait un plus.
  • Connaissance des technologies Kafka et Impala serait appréciée.
  • Maîtrise des requêtes SQL pour la manipulation et l'interrogation des données.
  • Connaissance en Python pour l'automatisation et les tâches de traitement des données.
  • Familiarité avec les technologies Kafka et Impala pour le streaming de données et l'analyse interactive.
  • Expérience avec les outils DevOps tels que Terraform, Docker et Kubernetes pour la gestion des infrastructures

Qualifications requises :

  •  Excellente communication, gestion autonome du travail, compétences ETL, travail d'équipe, partage des connaissances, orienté qualité et objectifs, bonne organisation.
  • Maîtrise de l'anglais, tant à l'écrit qu'à l'oral

Expérience exigée : entre 3 et 4 Ans.



Apply to offer
Streamlink

Streamlink

Website:
www.streamlink.fr
Localisation:
Tunisia, Ariana
Street:
Imm Golden Tower, centre urbain nord, Ariana
Postal code:
1082

Discover the salary expectations of the candidates for the offer Data engineer SCALA/ SPARK

Lowest salary
500 TND
1591 TND
Average salary
1781 TND
1970 TND
Highest salary
2900 TND
1591 - 1970 TND
1781 TND
500 TND
2900 TND
Estimations based on the salary expectations of the candidates for this offer

Useful trainings

event img Free training Online
Profile Picture

Opus Lab

Sat, 16 Sep 2023 11:00:00 +0000 - Sun, 15 Oct 2023 13:00:00 +0000
In progress

Introduction to the full stack web development (MongoDB, Express, ReactJS, NodeJS)

500

participants

Level: 1

Arabic

15 hours interactive sessions

View event
event img Free training Online
Profile Picture

Social Hackers Academy

Thu, 14 Sep 2023 10:00:00 +0000 - Sun, 01 Oct 2023 20:00:00 +0000

Web development starter kit

487

participants

Level: 1

English

15 hours interactive sessions

View event