RQ11713 - Software Developer - ETL - Senior

Responsibilities:

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
  
• Required to translate technical systems specifications into working, tested applications.
  
• This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
  
• Resolves and troubleshoots technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
  

General Skills:

• Experience in programming and analysis; specialized software package support at the specified experience level
  
• Ability to collaborate with IT Professionals throughout the Software Development Life Cycle
  
• Experience in structured methodologies for the development, design, implementation and maintenance of applications
  
• Experience in design, code, test, debug and document applications
  
• Experience in the use of object and/or third generation language development tools
  
• Experience in one or more programming languages
  
• Experience in application design, latest design patters, deployment and troubleshooting
  
• Experience with relational and hierarchical database technologies
  
• Experience in the use of information retrieval packages using query languages
  
• Experience with one or more communications protocols
  
• Experience in structured methodologies for the design, development, implementation and maintenance of applications
  
• Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts
  
• Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills
  
• A team player with a track record for meeting deadlines
  

ETL Skills:

• Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users Knowledge and experience maintaining and improving already existing processes.
  
• Knowledge and experience ensuring that the data architecture is scalable and maintainable
  
• Knowledge and experience working with the business in designing and delivering correct, high quality data
  
• Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions Experience preparing detailed documentation for further reference.
  

Desirable Skills:

• Knowledge and experience with programming Internet-ready applications
  
• Knowledge and experience in rapid application development (RAD) methodologies
  
• Knowledge and understanding of Information Management principles, concepts, policies and practices
  
• Experience with middleware and gateways
  
• Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging
  
• Ability to provide post-implementation support and resolve any post-implementation technical issues
  
• Experience conducting design walkthrough sessions with project team
  
• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Ability to provide user and system documentation as required
  

Requirements

Experience and Skill Set Requirements:

Must Haves:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
  
• Experience with Databricks Platform
  
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
  
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
  
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
  
• Experience with data integration, data cleansing, and data analytics
  
• Experience with data modeling and design principles for data marts and data warehouses
  
• Experience in database management and administration
  
• Experience in constructing complex SQL queries and performance tuning
  
• Experience with Git and knowledge of source control strategies
  
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
  
• Experience in eliciting, documenting, and validating business requirements
  
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
  
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.
  

Nice to have skills:

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
  
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
  
• Experience writing scripts with PowerShell and other scripting languages 
  

Skill Set Requirements:

Deliverables –  Senior ETL Developer :

• Designs, develops, and maintains database backend and ETL applications for Data Warehouse and Business Intelligence solutions. 
  
• Uses knowledge of ETL languages and development techniques to build and expand application functionality 
  
• by writing high quality code using appropriate patterns. Ensures applications remain scalable while complying to standards and following best practices. 
  
• Tests and debugs applications and ensures that software is properly documented. Collaborates clearly and professionally as part of a development team and communicates with clients.
  

Mandatory Skills:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
  
• Experience with Databricks Platform
  
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
  
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
  
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
  
• Experience with data integration, data cleansing, and data analytics
  
• Experience with data modeling and design principles for data marts and data warehouses
  
• Experience in database management and administration
  
• Experience in constructing complex SQL queries and performance tuning
  
• Experience with Git and knowledge of source control strategies
  
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
  
• Experience in eliciting, documenting, and validating business requirements
  
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
  
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.
  

Nice to have skills:

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards
  
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
  
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
  
• Experience writing scripts with PowerShell and other scripting languages 
  

Core Technical Skills:

• Experience with the Microsoft suite of technology including: Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
  
• Experience with the Amazon Web Services (AWS) suite of technology including: Amazon Aurora, Amazon Relational Database Search, Glue, OpenSearch, etc.
  
• Experience with developing data extraction, transformation, and load programs (daily and initial load) functionality on a wide range of data repositories (structured and semi-structured files, relational and multi-dimensional data stores)
  
• Experience with developing, implementing, and maintaining schedule/dependency logic for Extract Transform Load (ETL) scripts
  
• Experience with data integration, data cleansing, and data analytics
  
• Experience with data modeling and design principles for data marts and data warehouses
  
• Experience in database management and administration
  
• Experience in constructing complex SQL queries and performance tuning
  
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, detailed design documents, etc.
  

Other Technical Skills:

• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing canned reports (scheduled and ad-hoc)
  
• Experience with programming languages such as C#, developing application code such as APIs, Functions, etc.
  
• Experience writing scripts with PowerShell and other scripting languages
  
• Experience with Git and knowledge of source control strategies
  
• Experience in software development lifecycle from Development, to Testing and Quality Assurance, to Delivery
  

Communications Skills:

• Experience in eliciting, documenting, and validating business requirements
  
• Solid communications skills: the ability to understand, comprehend, and follow instructions and requirements to communicate clearly and effectively both verbally and in writing.
  

Standards and Best Practices:

• Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards