Data Engineer

Data Engineer Job Description Template

Our company is looking for a Data Engineer to join our team.

Responsibilities:

  • Work with big data developers to build scalable and supportable infrastructure;
  • Design, model, develop and maintain data sets to support reporting analytics and exploratory analysis;
  • Create parallelized and/or distributed versions of existing algorithms;
  • Develop and maintain enterprise business intelligence models;
  • Defines the requirements and oversees the development and build out of big data tool chains;
  • Design, develop, implement, and support data solutions;
  • Architects data pipes and technology stacks related to data manipulations;
  • Mentors and coaches junior members of the team and helps them develop their technical expertise;
  • Gather and determine requirements for new features from internal colleagues;
  • Acts as the lead for any high complexity functional data requirements and transformation needs;
  • Maintaining integrations to external APIs such as Google, Facebook, Cloudtrax, Yelp, and others;
  • Design and implement reliably distributed data pipelines;
  • Work with the SW architects to understand downstream development activities and to increase upstream SW capabilities;
  • Help build a machine learning platform for data scientists to develop, train and execute models;
  • Recommend ways to improve data reliability, efficiency and quality.

Requirements:

  • Solid scripting capability for analysis and reporting (Strong PL/SQL);
  • Strong analytical skills to support BAs;
  • MS in Computer Science, Computer Engineering or related fields;
  • Expert in the ELK stack (elastic search, logstash, Kibana) or equivalent;
  • 2+ years of experience working with data lake and data warehouse;
  • Expert Knowledge of Engineering risk and decision making process;
  • Strong interpersonal skills, self-motivated, and enjoys working on a wide range of projects;
  • Over 5 years of relevant working experience;
  • A passion for software development;
  • 3+ years and a proven record of success in building data pipelines and ETL workflows;
  • Design high performing data schemas to support dashboard reports;
  • Experience writing software in Python, Scala and/or Java. Experience working with data structures, algorithms and software design;
  • Bachelor’s degree in computer science, software engineering or related technical field;
  • Bachelor’s or Master’s degree in computer science or software engineering;
  • Design and build marketing databases and reporting/BI datamarts.