Ab Initio Developer (Big Data & Hadoop)
Capgemini
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Job Location : Toronto, CA (Onsite/Hybrid from Day 1)
Job Description
We are seeking a highly skilled Ab Initio Developer (Big Data & Hadoop) to join our Agile Scrum team and support the development of enterprise-scale Big Data and Data Lake solutions. This role will be responsible for designing, developing, and supporting data integration applications leveraging Ab Initio, Hadoop, and modern Big Data technologies . The ideal candidate will combine strong technical expertise with the ability to collaborate across business and technology teams to deliver high-quality data solutions.
Key Responsibilities
- Participate in Agile/Scrum ceremonies, sprint planning, design discussions, and development activities.
- Analyze business requirements and translate them into functional and technical specifications.
- Design, develop, test, and support scalable data integration and ETL solutions using Ab Initio.
- Build and maintain enterprise data pipelines supporting the organization's Data Lake and analytics platforms.
- Ensure application quality, performance, scalability, and adherence to development standards.
- Collaborate with architects, data engineers, business analysts, and stakeholders to deliver data-driven solutions.
- Create project estimates and contribute to project planning and delivery discussions.
- Participate in code reviews and promote development best practices.
- Develop reusable and modular components to improve development efficiency and maintainability.
- Troubleshoot production issues and perform performance tuning of ETL and Big Data applications.
- Mentor junior developers and provide technical guidance to team members.
- Support continuous improvement initiatives and adoption of emerging technologies.
Mandatory Skills
- Bachelor's degree in Computer Science, Engineering, Statistics, Econometrics, Information Systems, or a related quantitative field.
- 10+ years of overall IT experience with at least 5+ years of hands-on experience in Big Data and Data Integration solutions.
- Expert knowledge of Ab Initio technologies, including Graphical Development Environment (GDE), Co-Operating System, Control Center, Metadata Hub, Enterprise Meta Environment (EME) , EME Portal, Acquire> It, Express> It, Conduct> It, Data Quality Environment, and Query> It.
- Strong experience in designing, developing, and supporting complex ETL and enterprise data integration solutions.
- Hands-on experience with shell scripting, complex SQL development, Hadoop commands, and Git version control .
- Strong programming skills in at least two of the following languages: Python, Java, and Scala .
- Proven experience developing reusable, scalable, and maintainable code components.
- Experience working with Hadoop ecosystem technologies such as Hive, Spark, Kafka, HBase, and Sqoop .
- Strong understanding of Big Data architectures, Data Lake technologies, and large-scale data processing frameworks.
- Experience in performance tuning, optimization, and troubleshooting of ETL and Big Data applications .
- Familiarity with Hortonworks, ZooKeeper, Oozie, and NoSQL technologies is preferred.
Good to Have
- Hands-on experience with Big Data technologies including:
- Hadoop, Hive, Spark, Kafka, HBase and Sqoop etc
- Experience working with Data Lake architectures and large-scale analytics platforms.
- Knowledge of Hortonworks, ZooKeeper, Oozie, and NoSQL databases .
- Experience with data modeling, data quality, and performance optimization.
- Familiarity with cloud-based data platforms and modern data engineering practices.
- Understanding of CI/CD processes and DevOps methodologies .
The base compensation range for this role in the posted location is: 88786- 95298
Capgemini provides compensation range information in accordance with applicable national, state, provincial, and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini, in good faith, believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law.
The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction.
These may include, but are not limited to: Geographic location, Education and qualifications, Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal pay equity.
It is not typical for candidates to be hired at or near the top of the posted compensation range.
In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.
Capgemini offers a comprehensive, non-negotiable benefits package to all regular, full-time employees. In the U.S. and Canada, available benefits are determined by local policy and eligibility and may include:
- Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
- Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
- Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
- Life and disability insurance
- Employee assistance programs
- Other benefits as provided by local policy and eligibility
Important Notice: Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini’s discretion, consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time, within the limits of applicable legislation.
Disclaimers
Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodation does not pose an undue hardship. Capgemini is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.
Click the following link for more information on your rights as an Applicant in the United States.
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.
- ...Role: Big Data Developer Location: Toronto(Hybrid) Required Skills ~10+ years of experience in Big Data technologies, Java. ~ Strong programming... ...(OCP) certification is highly desirable. ~ Experience with Hadoop ecosystem, Hive, and other distributed systems is a plus. ~...Big dataFor contractors
- ...Big Data Developer – Snowflake, Spark & AWS Location: Toronto Hybrid 4 days WFO Position Overview We are seeking an experienced... ...and develop robust ETL/ELT pipelines using Spark| Hive| and Hadoop for large-scale data processing Architect and maintain Snowflake...Big dataContract work
- ...experienced professional with over 5 years in capital markets, focusing on Market Risk or Back Office. Candidates must have strong skills in Big Data tools like PySpark and HDFS, alongside quantitative abilities. This role requires effective communication with stakeholders and a...Big data
$95k - $145k per year
Big Data Developer (Java / Scala) - AML Tech Position Description We are Canada's largest independent information technology services firm... ...years of Experience with Big Data technologies used for ETL: Hadoop, Spark, Hive • Well versed with Snowflake Platform. • Strong...Big dataWork at office- ...professionally and personally. Overview As a Big Data Architect, you are passionate about data... ...architects, data architects, ETL developers & engineers, data scientists, and... ...Fortune, Forbes and Glassdoor, we attract and develop world-class talent. Join us on our mission...Big dataFull time
- Advance your career as a Senior Big Data Engineer with Restaurant Brands International, located in the vibrant city of Toronto. Engage with large-scale data systems using AWS and Snowflake. Restaurant Brands is seeking a skilled engineer to focus on building and maintaining...Big data
- A leading data solutions provider is seeking a Sr. Business Systems Analyst in Toronto, ON. The ideal candidate will have over... ...systems, and optimizing data pipelines. Experience with big data tools like Hadoop and databases such as Cassandra is required. This role supports...Big data2 days per week
- ...Job Title: Senior Platform Engineer (AWS, Big Data, Data Warehouse, Netezza) Location:... .... Key Responsibilities Design, develop, and support scalable data pipelines.... ...plus). Unix/Linux. Preferred Hadoop, Data Warehousing, ETL design, DevOps/CI-...Big dataContract work
- We are seeking a highly accomplished Senior Data Science Developer to spearhead the technical design, architectural optimization, and migration of... ...Solidify your engineering footprint using premium cloud-native big data utilities, including Databricks Unity Catalog and advanced...Big dataContract workHome officeFlexible hours3 days per week
- ...#TeamBell. At Bell, software developers like you are empowered and enabled to... ...We’re looking for a Software Developer to join our Data Platform Operations team and help shape... ...processing frameworks such as Spark, Hadoop, Kafka, or cloud-native data processing...Full timeWork at office3 days per week
$160k - $180k per year
...cloud infrastructure. A key aspect of this mission is our scalable data service, which supports the growth of BlueCat's data-driven... ...driven products. High-Level Design and Architecture • Design, develop, and operate highly reliable large-scale data lake • Partner closely...Full time$90k - $125k per year
...people who are lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing, building, and... ...SQL, Python, or related languages. Experience with big data technologies and concepts (Spark, Hadoop, Kafka). Excellent analytical, troubleshooting, and...Big dataFull timeWork from homeFlexible hours- ...000 accounting and audit professionals list Caseware as a skill on their LinkedIn profiles! We are seeking a Principal Software Developer – Data Architect to drive the technical vision and architectural strategy of Caseware’s enterprise data platform, including the AI-...Long term contractPermanent employmentFull timeWork at office3 days per week
- A leading tech company in Toronto is seeking a Senior Software Developer specializing in ETL to lead data migration projects. You will be responsible for developing migration strategies, analyzing legacy data systems, and ensuring successful data conversion. The ideal candidate...Full time
- ...Analytics & Modeling team, the Senior Data Scientist is responsible for... ...and use of ML algorithms to develop innovative solutions and solve... ...distributed computing tools (e.g. Spark, Hadoop) for analysis, data mining and... ...). Experience working with Big Data and distributed processing...Big dataFlexible hours
- A leading tech firm in Toronto is seeking a Senior Software Developer specialized in ETL processes to join their team. You will be responsible for designing and implementing data pipelines using Azure services, optimizing existing ETL workflows, and collaborating with IT professionals...Work at office3 days per week
- ...Who We Are BIG HUG Hospitality is the team behind some of Toronto’s most celebrated restaurants, including Mimi Chinese, Sunnys Chinese... ...for each Front-of-House position. Work with stakeholders to develop and enforce established policies and procedures. Implement policies...Full timeShift workWeekend workAfternoon shift
- ...truly matters. Your New Role You are a senior, detail-oriented data professional with strong technical expertise in data quality,... ...enterprise data quality rules, thresholds, scorecards, and controls Develop exception handling, remediation workflows, root-cause analysis...Long term contractPermanent employmentWorldwide
- ...Job Title: Data Engineer Location: Toronto, ON Work Model:... ...& Development Design and develop software solutions for retrieving... ...languages. Strong experience with Big Data and Cloud Technologies , including: Spark, Hadoop, Hive, Kafka Snowflake,...Big dataWork at office
$84k - $175k per year
...BC; Brossard, QC; Burlington, ON; Calgary, AB; Edmonton, AB; Fredericton, NB; Halifax, NS... ...typical day look like? • Architect end to end data platforms on Azure and align designs to... ...people who want to learn, gain experience, and develop skills. Wherever you are in your career, we...Permanent employmentFlexible hours$120k - $150k per year
...experiment with the infrastructure and data of one of the world's largest... ...you. As a Senior Software Developer, your role will be to help... ...Experience with experimentation (i.e AB, multivariate) ~ Basic... ...Puns - this one is kind of a big dill if you haven’t already noticed...Casual workManual laborWork at officeRemote workFlexible hours2 days per week3 days per week- ...Role: ETL DataStage Developer Location: Toronto, ON - Hybrid; 2-3 days a week... ...implementation, and production support of AML data solutions within the Enterprise Data Lake... ...platforms. • Familiarity with Hadoop/Hive ecosystems. • Knowledge of Data...Permanent employmentContract work2 days per week3 days per week
- ...We are looking for a Corporate Tax Technology Partner for a Big 4 Firm in Canada. If you have Tax Technology consulting experience gained in a Big 4 or major consulting firm, this may be the role for you. Please message me if you would like a discrete conversation on...
$108k - $135k per year
...promotions, cost models, and more. As a Data Engineer on the Pricing team, you will... ...tracking data quality and consistency Develop tools supporting self-service data pipeline... ...experience with Spark ~ Experience with Hadoop (or similar) Ecosystem, S3, DynamoDB, MapReduce...Hourly payWork at officeFlexible hours3 days per week- ...Key Responsibilities Design, develop, and deploy machine learning and deep learning... ...datasets. Architect and optimize big data pipelines and data modeling processes to... ...background in big data technologies (e.g., Hadoop, Spark, Databricks). Deep understanding...Big data
- ...Data Engineer – Google Cloud Platform (GCP), BigQuery, Python & Data... ..., ETL/ELT development, big data technologies, and GCP services... ...Responsibilities • Design, develop, and maintain scalable batch... ...Experience with Apache Spark, Hadoop, Kafka, and Airflow • Exposure...Big dataContract work3 days per week
- ...source, e.g. mainframe, SQL server, Oracle. Experience in Sqoop / Hadoop. Microsoft Excel for metadata files with requirements for ingestion. Any other certificate in Azure/AWS/GCP and data engineering hands‑on experience in cloud. Strong programming...Full time
- ...Sr. Software Developer - ETL - (Microsoft D365, Azure Data Lake Storage, Azure Synapse Analytics and Azure Data Factory, SQL Server, Azure SQL) - RQ09449 Job Openings Sr. Software Developer - ETL Sr. Software Developer - ETL - (Microsoft D365, Azure Data Lake Storage,...Contract workWork at office
- ...the most important work of your career. About the team Our Data Science team partners deeply with teams across Stripe to ensure that... ...wisdom Experience with distributed tools such as Spark, Hadoop, etc. A PhD or MS in a quantitative field (e.g., Statistics, Engineering...
- ...Senior Data Engineer – Dataiku & Full Stack Integration Role Description... ...Workday, SAP, ServiceNow Experience developing Tableau Dashboard and reusable Work Books... ...Python Language. Competencies: Big Data and Hadoop Ecosystems, Python, ReactJS, PL/SQL...Big dataFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ab Initio Developer (Big Data & Hadoop). Be the first to apply!
- data centre engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON
- data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data cabling engineer Toronto, ON
- data engineering intern summer Toronto, ON
