Senior data engineer Job Description

Senior data engineer Job Description Template

Senior data engineers are skilled professionals who oversee the entire data engineering process. Their responsibilities include organizing and analyzing large datasets, creating and maintaining reliable data pipelines, optimizing data storage and retrieval, and implementing data security measures. They perform tasks such as data modeling, building and maintaining APIs, and collaborating with cross-functional teams to improve data infrastructure and decision-making systems.

Responsibilities:

  • Design, build and maintain data pipelines and ETL workflows
  • Develop and maintain databases and data warehouses
  • Ensure data quality and integrity through testing and validation
  • Collaborate with data scientists and analysts to support their data needs
  • Mentor and guide junior data engineers and other team members
  • Stay up-to-date with emerging technologies and industry trends to continuously improve data infrastructure
  • Develop and implement data security and privacy protocols
  • Work with cross-functional teams to identify and prioritize data engineering needs and projects

Requirements:

  • Minimum of 5 years experience in data engineering
  • Expertise in at least one programming language commonly used in data engineering (e.g. Python, Java, Scala)
  • Strong understanding of distributed systems and experience with big data technologies such as Hadoop, Spark, and Kafka
  • Experience with data warehousing and ETL (extract, transform, load) processes
  • Ability to design and implement scalable data pipelines
  • Excellent problem-solving skills and ability to troubleshoot complex data issues
  • Experience with cloud-based data engineering platforms such as AWS, Azure or Google Cloud
  • Strong collaboration and communication skills to work effectively with cross-functional teams