Description:

Job Description:

We are seeking a highly motivated and experienced Data Engineer to join our team and be part of a new large-scale infrastructure for visual data processing and machine learning. This is a unique challenge, as you will be in charge or researching, designing and developing complex ETL processes, where multi-source, highly variable data is the name of the game.

Responsibilities
* Design and implement the data pipeline from scratch
* Enable easy access to relevant data based on different projects needs
* Build monitoring tools to support data integrity and visualization
* Work closely with our deep learning researchers and engineers
* Process huge image and video data sets of varying quality from various data sources
* Own data integrity and quality.

Additional Positions:

,

Category:

Software

Job Qualifications:

Bachelors degree in computer science or engineering

At least 2 years of experience in software development (Python/Go)

At least 2 years in designing and implementing data pipeline processes

Developed data solutions such as building an enterprise data lake and data warehouse

Developed complex ETL processes using tools such as Spark, Hive, Luigi, Hadoop

Experience in distributed systems - microservices, containers, parallelism - advantage

Company Occupation:

High Tech

Company Size:

StartUp