Data Engineer Tech Lead (BB-02295)
Found in: Neuvoo IL
Job Description:We're looking for a talented Data Engineer Tech Lead to join our exceptional team, help us continue our rapid growth, and create a better way forward for our customers. In this position on our Data Ops team, you will be responsible for designing, expanding and optimizing our data infrastructure architecture for cross-functional teams. The Data Engineer will work closely with our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. As a data engineer, you will provide creative solutions for data-related problems at scale by mixing in house and open source technology such as Kafka, Spark, Hadoop and more. You should be a Team player, quick learner, and have a "Can Do" approach.
In this role, you will
"Create, maintain and own the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
"Consistently evolve data model & data schema based on business and engineering needs
"Implement systems tracking data quality and consistency
"Develop tools supporting self-service data pipeline management (ETL)
"work with stakeholders including Product, Data analytics, R&D teams to assist with data-related technical issues and support their data infrastructure needs.
"Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Job Qualifications:5+ years of experience with server-side development
In-depth knowledge of at least one high-level programming language (Python, Java, Scala, etc.)
Strong communication skills
BSc. in Computer Science, Mathematics or related fields.
Experience with programming in Python
"Extensive experience with AWS - EMR, Lambda, CloudWatch, API Gateway, ECS, CloudFormation, etc.
Experience with big data and ETL tools: Spark, Kafka, Hadoop, etc.
Experience with maintaining Data Warehouse
Experience with relational SQL and NoSQL databases
Understanding of CI/CD concepts in production environment
Experience with Jenkins and cloud infrastructure deployments
Company Occupation:High Tech
calendar_today3 days ago
info full time
location_onTel Aviv-Yafo, Israel