Data Engineer Job Description

Data Engineer Job Description Template

Our company is looking for a Data Engineer to join our team.

Work with big data developers to build scalable and supportable infrastructure;
Design, model, develop and maintain data sets to support reporting analytics and exploratory analysis;
Create parallelized and/or distributed versions of existing algorithms;
Develop and maintain enterprise business intelligence models;
Defines the requirements and oversees the development and build out of big data tool chains;
Design, develop, implement, and support data solutions;
Architects data pipes and technology stacks related to data manipulations;
Mentors and coaches junior members of the team and helps them develop their technical expertise;
Gather and determine requirements for new features from internal colleagues;
Acts as the lead for any high complexity functional data requirements and transformation needs;
Maintaining integrations to external APIs such as Google, Facebook, Cloudtrax, Yelp, and others;
Design and implement reliably distributed data pipelines;
Work with the SW architects to understand downstream development activities and to increase upstream SW capabilities;
Help build a machine learning platform for data scientists to develop, train and execute models;
Recommend ways to improve data reliability, efficiency and quality.

Solid scripting capability for analysis and reporting (Strong PL/SQL);
Strong analytical skills to support BAs;
MS in Computer Science, Computer Engineering or related fields;
Expert in the ELK stack (elastic search, logstash, Kibana) or equivalent;
2+ years of experience working with data lake and data warehouse;
Expert Knowledge of Engineering risk and decision making process;
Strong interpersonal skills, self-motivated, and enjoys working on a wide range of projects;
Over 5 years of relevant working experience;
A passion for software development;
3+ years and a proven record of success in building data pipelines and ETL workflows;
Design high performing data schemas to support dashboard reports;
Experience writing software in Python, Scala and/or Java. Experience working with data structures, algorithms and software design;
Bachelor’s degree in computer science, software engineering or related technical field;
Bachelor’s or Master’s degree in computer science or software engineering;
Design and build marketing databases and reporting/BI datamarts.