Description:

תאריך עדכון

תיאור המשרה

Responsibilities 

• Design and implement the data pipeline from scratch

• Enable easy access to relevant data based on different projects needs

• Build monitoring tools to support data integrity and visualization 

• Work closely with our deep learning researchers and engineers

• Process huge image and video data sets of varying quality from various data sources

• Own data integrity and quality.

Requirements:

• Bachelor's degree in computer science or engineering

• At least 2 years of experience in software development (Python/Go)

• At least 2 years in designing and implementing data pipeline processes

• Developed data solutions such as building an enterprise data lake and data warehouse

• Developed complex ETL processes using tools such as Spark, Hive, Luigi, Hadoop

• Experience in distributed systems - microservices, containers, parallelism - advantage