Big Data Developer
Cogency
Job Title: Big Data Developer ( Spark, AWS, Airflow, Snowflake, Big Data & ETL)
Company: Cogency Inc.
Location: Greater Toronto Area (Hybrid - 4 days office)
Job Summary
We are seeking a skilled and detail-oriented Data Engineer with strong expertise in Snowflake, Big Data technologies, and ETL processes . The ideal candidate will be responsible for designing, building, and optimizing scalable data pipelines and ensuring high data quality, performance, and security across the platform.You will work in an Agile environment, collaborating with cross-functional teams to deliver robust data solutions that support analytics, reporting, and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain data ingestion pipelines and ETL workflows
- Build and optimize data pipelines, frameworks, and transformation processes
- Ensure data quality, integrity, security, and performance across systems
- Develop and optimize SQL queries, stored procedures, and data models
- Integrate Snowflake with various data sources and BI/reporting tools
- Monitor, troubleshoot, and resolve data pipeline and platform issues
- Collaborate with cross-functional teams in an Agile delivery environment
- Maintain comprehensive documentation for pipelines, transformations, and data models
- Implement best practices in DevSecOps, CI/CD, and data engineering standards
Required Skills & Experience
- 5+ years of experience in Data Engineering / ETL development
- Strong hands-on experience with Big Data technologies :
- Hadoop
- Spark
- Hive
- Solid experience working with Snowflake data platform
- Strong expertise in SQL and data modeling concepts
- Programming experience in Scala or Java , including API development
- Experience with ETL tools such as:
- Informatica
- Talend
- Apache Airflow
- Familiarity with cloud platforms (preferably AWS)
- Understanding of DevSecOps practices, CI/CD pipelines, and Infrastructure-as-Code
- Knowledge of GenAI tools for code generation and developer productivity enhancement
- Excellent problem-solving, analytical, and communication skills
Preferred / Nice-to-Have Skills
- Experience with AWS services (e.g., Glue, S3, Lambda)
- Hands-on experience with Apache Airflow or similar workflow orchestration tools
- Experience with CI/CD tools (GitHub Actions, Git, automated testing tools)
- Exposure to containerization technologies (Docker, Kubernetes, OpenShift)
- Knowledge of Python or scripting languages
- Experience with shell scripting
Education
- Bachelor’s or Master’s degree in Computer Science, Data Engineering , or a related field
Key Competencies
- Strong analytical and problem-solving mindset
- Ability to work independently and in team environments
- Excellent communication and stakeholder collaboration skills
- Attention to detail and commitment to data quality
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Big Data Developer in Toronto, ON vacancy
- ...organizations unlock the value of technology and build a more sustainable, more inclusive world. Job Description We are seeking a Big Data Developer to build and enhance realtime and batch fraud analytics AML platforms that process highvolume financial transactions The role...Big dataPermanent employmentFull timeLocal area
$95k - $145k per year
Big Data Developer (Java / Scala) - AML Tech Position Description We are Canada's largest independent information technology services firm, and after 45 years, we're still growing! Join Canada's largest IT Company as a "Big Data Developer (Java / Scala) - AML Tech" in...Big dataWork at office- ...Series D funding round, bringing our total funding to $254 million and valuing the company at $2.5 billion. We are seeking a Senior Data Developer to join our growing team. You will help build and maintain the data platform that directly powers the MaintainX product and...SuggestedWorldwide
- ...100 private cloud companies in the world. We're growing fast and hiring the engineering talent to match. We are seeking a Senior Data Developer with a strong background in event streaming to join our growing team. You will help build and maintain the data streaming platform...SuggestedImmediate startWorldwide
- ...companies in the world. We're growing fast and hiring the engineering talent to match. The Opportunity: We are seeking a Senior Data Developer with a strong background in data governance to join our growing team. You will own the governance foundation that underpins the...SuggestedImmediate startWorldwide
$80k - $100k per year
...Kensington, visit kensingtontours.com . Are you passionate about data and analytics that solve real business problems ? Do you... ...trust to make critical decisions? We’re looking for a BI Developer / Data Analyst to join our analytics team and play a key role in...InternshipLocal areaWorldwide$87.58 - $97.58 per hour
...infrastructure. Design curated, business centric data models that provide a single source of... ...-structured, and unstructured datasets. Develop modeling guidelines for facts, dimensions,... ...design, and solution architecture in Big Data environments. ~ Proven expertise in...Big dataWork at officeLocal area- ...truly matters. Your New Role You are a senior, detail-oriented data professional with strong technical expertise in data quality,... ...enterprise data quality rules, thresholds, scorecards, and controls Develop exception handling, remediation workflows, root-cause analysis...Long term contractPermanent employmentWorldwide
- ...Role: Data Engineers Developers Qty: 3 Location: Toronto Office Hybrid: 2 days a week... ...pipelines. Key Responsibilities Develop ETLELT pipelines using Databricks Work... ...Top 3 Preferred Skills Spark Big Data experience Data warehousing knowledge...Big dataContract workWork at office2 days per week
- ...Experience ~ Strong hands-on experience with SQL for backend data manipulation, query optimization, and troubleshooting ~ Proven... ...extraction, transformation, and reporting support) ~ Experience developing and maintaining reporting solutions using SSRS ~2+ years of experience...Contract work
- ...engineering talent to match. We are looking for Full-Stack Developers to join our Connected Data team in the Engineering Organization. This role has... ...Build and evolve our integrations platform — Design, develop, and maintain the connectors and data pipelines that bring...Long term contractImmediate start
- ...platforms across Generative AI, AI Agents, RAG, Knowledge Bases, Data Mining, Anomaly Detection, and LLM fine-tuning — powering flagship... ...Familiarity with NoSQL and document databases Track record of handling big data, optimising workflows, and improving system performance...Big dataShift work
$62 - $65 per hour
...Job Title: OBIEE Developer Location: Toronto, ON Work Arrangement: Hybrid (3 days/week WFO) Employment Type: Contract Duration: 12... ...BMM, Presentation layers) Experience in integrating OBIEE with data sources (Oracle DB, SQL Server, flat files, etc.) Experience working...Contract work3 days per week$48 - $52 per hour
...Job Title: Talend Developer Location: Toronto, ON Work Arrangement: Hybrid (3 days WFO) Employment Type: Contract Duration: 12... ...Design and develop Talend ETL/ELT jobs using Talend Studio. Build data pipelines for batch and real‑time processing. Develop...Contract work$30 per hour
...Overview Join our expert annotation team to create training data for the world's most advanced AI models. No previous AI experience... ...AI/LLM space today. We're primarily seeking JavaScript/React developers with 3+ years of experience to train large AI language models, helping...Hourly payWeekly payLong term contractContract workInternshipRemote workFlexible hours- ...Iris's Fortune 100 direct client is looking to hire BA - Data Analyst for one of our banking clients. Please find below the job description... ..., outlining features and enhancements. Analyze data sets and develop detailed requirements around Sourcing, Infosec classification,...
- ...Job Title: ETL Lead Developer Location: Toronto, ON Work Style: Hybrid (2 days per week in-person at Toronto office preferred) Skills: Data Warehouse~Digital : PySpark~Digital : IBM Cloud Experience Required: 6-8 Role and Responsibilities: Resource have strong...Work at office2 days per week
- ...Managers, Business Analysts, Quality Engineers, and Operations teams to develop innovative solutions that meet functional and non-functional... ...Thorough understanding in computer science fundamentals, data structures and algorithms and extensive experience in building highly...Long term contract
- ...Strong hands-on experience of 5-8 years with Salesforce Data Cloud and core Salesforce platform and Designing experience Architect... ...customization of Salesforce Data Cloud to meet client needs. Develop and maintain custom features, components, and integrations to enhance...Contract workWork at office3 days per week
- ...workplace that rewards your contribution. #LI-Hybrid Job Description Our Data & Analytics team in MUFG Investor Services (“MUFG”) is looking for a skilled Business Intelligence Developer to join us. The successful candidate will be a key part of the Analytics team...Long term contractFull timeFor contractorsInternshipWork at office
- ...Description: The role focuses on designing, developing, and optimizing Power BI dashboards and... .... It requires strong analytical skills, data modeling expertise, and the ability to... ...Roles & Responsibilities: · Design and develop Power BI reports and dashboards to meet business...Contract work
- ...Job Title: Test Data Management (Delphix) Developer We are looking for a skilled Developer with expertise in Test Data Management (TDM) using Delphix , responsible for supporting data provisioning, masking, and virtualization activities. Key Responsibilities...Full time
- .... Job Description The Senior Associate Director, IT, Data Modelling and Reporting will report to IT Head of Reporting & Analytics... ...attribution, and investor reporting. SQL Optimization: Develop complex SQL queries and support ETL processes, ensuring high-performance...Full timeInternshipWork at office
$90k - $125k per year
...Creative Developer Toronto, remote DEPT® is a Growth Invention company built to help the... ...Experience, Commerce, CRM, and Technology & Data. We’re 50|50 tech and marketing, partner-... ...Awards. ~ Awesome clients. Whether big or small, local or global — at DEPT® you’ll...Permanent employmentFixed term contractWork at officeLocal areaRemote workFlexible hoursShift work- ...We are looking for a Corporate Tax Technology Partner for a Big 4 Firm in Canada. If you have Tax Technology consulting experience gained in a Big 4 or major consulting firm, this may be the role for you. Please message me if you would like a discrete conversation on...
- ...Senior Python Developer/Data Analyst - Capital Markets Role Description · We are seeking a Capital Market Analyst and Developer with strong hands-on experience in Python and SQL development to support data-driven applications and services. This role involves designing...Contract work
- ...We are looking for a highly skilled Senior Data Engineer to become part of our core Data &... ...ideal candidate has a strong background in big data processing, pipeline orchestration, and... ...powered systems What you’ll do: Design, develop, and maintain high-performance, product-...Big dataLong term contractRemote workWorldwide
$95k - $145k per year
Senior Data Engineer Position Description This role is hybrid... ...play a key role in designing, developing, and optimizing large-scale... ...responsibilities • Design, develop, and maintain scalable data pipelines... ...of distributed computing and big data architectures. •...Big dataWork at office$115k - $130k per year
...to keep reading. About the Role: Senior Data Engineer We’re growing — and we’re... ...’t just react — you anticipate. You think big, challenge the status quo, and push the work... ...Skills: A proven track record of mentoring and developing engineers or analysts, with a focus on...Remote work$90k - $125k per year
...working people who are lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing, building, and... ...programming skills in SQL, Python, or related languages. Experience with big data technologies and concepts (Spark, Hadoop, Kafka)....Big dataFull timeWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Developer. Be the first to apply!
Related searches
- data centre engineer Toronto, ON
- data engineering intern summer Toronto, ON
- big data developer Toronto, ON
- data integration developer Toronto, ON
- python data engineer Toronto, ON
- data engineer Toronto, ON
- big data engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON