Big Data Team Leader

This is an exciting opportunity to join a growing VC-backed startup in the Big Data tech space. We are looking for a Big Data Team Leader to join our team! Get ready to work with everything connected to data: Expanding and optimizing our data pipeline architecture as well as data flows, building and improving our data systems.

What’s the Job?

  • Lead and manage a team of Data Engineers, mentor and guide them to create meaningful and actionable data pipelines
  • Work with data and analytics experts, striving to improve our data systems functionality.
  • Work closely with Product team to define, measure and identify opportunities for product improvements.
  • Drive new initiatives to elevate the professional level and quality of data solutions and products.
  • Take an active part in our leadership team, consisting of Product, R&D, UX and Marketing leaders.
  • Lead the data strategy: be responsible for planning, prioritizing and building the right data solutions to support business needs.
  • Recruit and train new Data Engineers.
  • Create and maintain optimal data pipeline architecture.
  • Assemble large, complex data sets that meet both functional & non-functional business requirements
  • Identify, design, and implement improvements in internal processes: Manual processes automation, data delivery optimizations, infrastructure re-designs for greater scalability, etc.
  • Use SQL and big data cloud technologies to build the infrastructure required for optimal loading, extraction, and transformation of data from a wide variety of sources
  • Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics
  • Work with Fullstack team to assist with data-related technical issues and support their needs associated with data infrastructure 

Requirements

  • 3+ years of experience as a Data Engineer
  • 3+ years of experience with Python
  • Ability to take ownership and facilitate consensus among a diverse group of stakeholders
  • 3+ years of experience with data warehousing technologies such as Amazon Redshift, Snowflake, Redis, MongoDB and experience with BI solutions development (DWH, ETL)
  • 3+ years of experience in SQL and ETL pipelines
  • 3+ years of experience in open-source Big Data tools like Hadoop, Hive, Spark, Presto, Sqoop
  • Experience with data platforms architecture, in particular, Big Data architecture , Deep understanding of big data storage formats, especially Apache Parquet, Snappy
  • Experience with AWS cloud services like S3 , EMR , Athena, Lambda, Kinesis, Glue, etc.
  • Experience with Docker and Kubernetes, Fargate, ECS and CI/CD based on Jenkins
  • Experience with Cython, numpy, pandas, koalas, pyarrow, fastparquet, scipy, celery, async.io, django
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
  • Willing to collaborate and problem solve in an open team environment.
  • Flexible and adaptable in regard to learning and understanding new technologies.
  • B.Sc. or higher degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field

Advantages

  • Leading a team in a relevant or equivalent field
  • Experience with Linux administration
  • Experience with software architecture
  • Understanding of cloud security best practices
  • Experience with agile development (Scrum, Kanban)
  • Experience supporting and working with cross-functional teams in a dynamic environment

Seniority Level

Senior Level

Industry

Timeseries, Tabular Data, Online Media, Data AI, Marketing & Advertising

Employment

Full-time

How to Apply

Interested? Send us an email with your introduction and CV to careers@dealtale.com

What to Expect

We will review your application and contact you for a video call interview if selected.

Location

You will be working from our office in Herzliya and from home a few times per week.

Availability

This is a full time position, working 40 hours, spread over 5 days a week.