Lead Data Engineer

Who we are

We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Grow their audiences and grow their revenues - both direct to consumer and business to business revenues. Our platforms and services are trusted by over 900 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike and Amazon. We are almost 1000 people, based out of 14 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.

Responsibilities

*Redshift Experience is essential for this role

*Experience working with Big Data Essential

• Create and maintain data warehouses and associated ETL processes using DBT models in Redshift
• Implement and maintain DBT projects, including creating macros, tests, and documentation for data pipelines.
• Conduct performance tuning for Redshift queries and DBT models to optimize resource utilization.
• Develop and enforce best practices for data modelling with big data sets, version control, and CI/CD pipelines.
• Ensure high quality development by building robust tests into each model developed.

Requirements

The ideal background and skills we are looking for include:

• Hands-on experience designing and implementing DBT models, tests, and documentation in a data warehousing environment.
• Strong knowledge of Amazon Redshift architecture, SQL, and performance optimization techniques.
• Familiarity with version control systems like Git and CI/CD workflows
• Excellent communication skills with an ability to clearly articulate both end user value and technical implementation..
• Passion for technology and an eagerness to learn
• Ability to work in a fast-paced, constantly-changing environment while maintaining a strong eye for detail

Experience with the following would also be beneficial:

• AWS technologies such as Step function, AWS Glue jobs & Data Catalogues, Lambda Functions (Python based) and Athena.
• Experience in development using Python and Pyspark
• Experience of, or a keen interest in, the business of sport

Why Join Us?

• Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.
• Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.
• Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.
• Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.