Data Engineer
$55 per hourFull-time
University of Toronto
-About 2+ years of professional experience in Data Engineering, Data modeling, Data mining, and Statistical Data Analysis
-Data Engineer with demonstrated ability in designing and building scalable Data Pipelines with proficient knowledge in Python programming, Exploratory Data Analysis, Structured Machine Learning algorithms, and Power BI Visualization
-Good at setting up Data Lake in Azure and setup Kafka messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on Oracle DB
-Well-versed in migrating data and databases from on-prem infrastructure to the Azure data lake. Raw data is transferred to Azure Storage containers and processed by Azure functions and then stored in Cosmos DB
-Demonstrated expertise and hands-on experience in building scalable and optimized data pipelines along with optimizing the performance of database queries
-Excellent in Ingestion of large Datasets using Python, writing Python codes to automate the interaction, and downloading data as per the data frequency from REST API, Azure Storage, FTP servers, or any client-side application which acts as a data source
-Proficient in SQL, Python, and Azure cloud technologies and very comfortable with working with large data sets can perform a variety of data analyses, cleaning and ingestion, and curation using Python and visualize them using Tableau and Power BI for analysis
-Experience in statistical and predictive modeling using R. Conducted Exploratory data analysis and different statistical analyses including hypothesis testing, regression analysis, chi-squared test, t-test, z- test, and ANOVA test.
-Experienced in retrieving various data from different Data servers and validating it, cleaning it, and manipulating and transforming the data using, Python scripts, Excel Macros, and Advanced Excel
-Expertise in tackling complex business problems using Data Analytics and Business Intelligence tools, analyzing business problems, and finding creative solutions using a data-driven approach
-Superior skill in Advanced Excel on conditional formatting, count, data validation, index, match, sum, pivot table, VLOOKUP, and data table
-Savvy in using Advanced Tableau user to analyze the data, develop Dashboards, and generate sophisticated reports to exhibit data visualization results
-Experienced in developing, maintaining, and processing large databases with complex relationships between tables. Written several advanced SQL queries for extracting relevant data for predictive analytics
-Worked in an Agile environment and exhibited strong communication skills and a keen understanding of project timelines and dependencies. Team player with excellent interpersonal skills, self-motivated, dedicated, and understanding.
Employment Type: Full-Time
Salary: $ 55.00 Per Hour
-Data Engineer with demonstrated ability in designing and building scalable Data Pipelines with proficient knowledge in Python programming, Exploratory Data Analysis, Structured Machine Learning algorithms, and Power BI Visualization
-Good at setting up Data Lake in Azure and setup Kafka messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on Oracle DB
-Well-versed in migrating data and databases from on-prem infrastructure to the Azure data lake. Raw data is transferred to Azure Storage containers and processed by Azure functions and then stored in Cosmos DB
-Demonstrated expertise and hands-on experience in building scalable and optimized data pipelines along with optimizing the performance of database queries
-Excellent in Ingestion of large Datasets using Python, writing Python codes to automate the interaction, and downloading data as per the data frequency from REST API, Azure Storage, FTP servers, or any client-side application which acts as a data source
-Proficient in SQL, Python, and Azure cloud technologies and very comfortable with working with large data sets can perform a variety of data analyses, cleaning and ingestion, and curation using Python and visualize them using Tableau and Power BI for analysis
-Experience in statistical and predictive modeling using R. Conducted Exploratory data analysis and different statistical analyses including hypothesis testing, regression analysis, chi-squared test, t-test, z- test, and ANOVA test.
-Experienced in retrieving various data from different Data servers and validating it, cleaning it, and manipulating and transforming the data using, Python scripts, Excel Macros, and Advanced Excel
-Expertise in tackling complex business problems using Data Analytics and Business Intelligence tools, analyzing business problems, and finding creative solutions using a data-driven approach
-Superior skill in Advanced Excel on conditional formatting, count, data validation, index, match, sum, pivot table, VLOOKUP, and data table
-Savvy in using Advanced Tableau user to analyze the data, develop Dashboards, and generate sophisticated reports to exhibit data visualization results
-Experienced in developing, maintaining, and processing large databases with complex relationships between tables. Written several advanced SQL queries for extracting relevant data for predictive analytics
-Worked in an Agile environment and exhibited strong communication skills and a keen understanding of project timelines and dependencies. Team player with excellent interpersonal skills, self-motivated, dedicated, and understanding.
Employment Type: Full-Time
Salary: $ 55.00 Per Hour
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Engineer in Toronto, ON vacancy
- ...Reference No. R2796167 Position Title: Data Engineer Department: Data Engineering Location: Toronto, ON About The Job Our Hubs are a crucial part of how we innovate, improving performance across every Sanofi department and providing a springboard for the amazing...SuggestedWork from homeFlexible hours
- ...Compass digital is comprised of user experience designers, developers, data scientists, project managers, business analysts, marketers and... .... Job Summary We are looking for a passionate Senior Data Engineer to join our team at Compass Digital. You will design, develop,...SuggestedRemote job
$55 per hour
-About 2+ years of professional experience in Data Engineering, Data modeling, Data mining, and Statistical Data Analysis -Data Engineer with demonstrated ability in designing and building scalable Data Pipelines with proficient knowledge in Python programming, Exploratory...SuggestedHourly payFull time- ...optimize ETL/ELT pipelines (Snowflake, BigQuery, Redshift) Stream data via Kafka/Kinesis/Spark Structured Streaming Automate... ..., and security best practices Must-Haves ~3–5 yrs data engineering in AWS/GCP/Azure ~ Advanced SQL + Python or Scala ~ IaC (Terraform...SuggestedRemote job
- ...build an exceptional experience for yourself, and a better working world for all. The opportunity We are looking for a Data Engineer. Our AI & Data practice works collaboratively with our clients to enhance their ability to use and interpret data and develop their...Suggested
- ...traditional and emerging technologies while delivering innovative solutions for our business applications and platforms. Scotiabank’s Data Engineering, under CBT, is responsible for delivering data integration solutions for a variety of business lines. Our current applications...Holiday workWork experience placementFlexible hours
- ...creativity and innovation every day We give back to the communities in which we operate Job Description MISSION The Data Engineer is responsible for the continuous development and improvement of data engineering initiatives that support critical business...Full timeWork experience placementHome office
$50k - $60k per year
...We are seeking a skilled and detail-oriented Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, reporting, and data science initiatives....Full time$76.8k - $115.2k per year
...dialogue with your recruiter who can provide you more specific details for this role. Job Description: Provide a broad range of data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, extract transform load (ETL),...Work from home- ...or connect with us on LinkedIn, X (formerly Twitter), Facebook, and Instagram. Position Description We are seeking a Senior Data Engineer to join our team and help us build the next generation of data tools for our retail and commerce loyalty platform. The ideal candidate...Remote jobWorldwide
- ...Analytics team. In this role, you will handle billions of rows of data from numerous sources, organizing, visualizing, and analyzing... ...The Home Depot Canada. As the Manager, Data Analytics & Data Engineering, you will support the development and delivery of data products,...Temporary workWork experience placementWork from home
- ...Contract/Perm (Open) Primary Location: Toronto or Montreal - 2 days onsite per week We currently have an opportunity for a Data Engineer , supporting a partner in Insurance sector. Client is expanding the team, and the successful resource will help with supporting team...Permanent employmentContract work2 days per week
- ...Risk Technology (GFRT) partners within Scotiabank catering to various business lines and enterprise finance functions The Senior Data Engineer leads cost-efficient, effective, and timely development (i.e. systems enhancements), user testing, implementation, administration,...Holiday workInternshipFlexible hours
- ...: 73 Strings is an innovative platform providing comprehensive data extraction, monitoring, and valuation solutions for the private capital... ...Broadhaven Ventures. About the role We are seeking a Data Engineer with hands-on experience in Azure, Databricks, and API...
- ...Client - Banking Title - Senior Data Engineer Location - Toronto, ON (Hybrid) Type - Contract Day-to-Day Responsibilities Develop ingestion pipelines using Azure Data Factory, Synapse, and SQL DB Transform structured and unstructured financial data for LLM...Contract work
- ...The Company SimplyAnalytics is a powerful spatial analytics and data visualization application used by thousands of business,... ...rest of the team. The Role We're looking for a Senior Data Engineer to process datasets, manage our existing data workflows, develop...Full timeRemote jobWork experience placementFlexible hours
- ...Overview We are seeking a skilled Data Engineer to support a comprehensive Data Modernization Assessment for our client. This role will play a critical part in evaluating and optimizing the data architecture, pipelines, and observability infrastructure. The ideal candidate...2 days per week
$76.8k - $115.2k per year
...the DE will support the core capabilities and features of Fraud's data lake platform. Responsibilities will include assisting front line... ...and business rules. The DE works closely with the other data engineers and the data analysts (DA), business analysts (BA), product owners...Work from home- ...This is a remote position. In this role, you will collaborate with cross-functional teams—including Cloud Engineering, Data Engineering, and Product Management—to architect and implement end-to-end cloud solutions primarily on AWS. You'll play a key role in designing complex...Contract workRemote job
- Data Architecture and Engineering Leader Location Hybrid remote in Toronto, ON : A career in Information Technology, within Business Enablement, will provide you with the opportunity to support our core business functions by deploying applications that enable our people to...Full timeRemote job
- ...the role Do you have a passion for being at the forefront of Data Science innovation and building cutting edge, scalable analytical... ...’s or advanced degree in a quantitative discipline such as Engineering, Economics, Mathematics, Statistics, or Physics is essential....
$94.6k - $176k per year
...Technology This is an individual contributor role and also HYBRID We are looking for a candidate who brings 10-15 years of data engineering experience having worked with multiple data warehouses, databases, interconnected and interdependent systems, can work independently...Full timeContract workPart time- ...solutions into a strategic asset that can drive new revenue and improve business operations. Website Job Description Data Engineer and Data scientist Hybrid role – 2 to 4 days in Toronto downtown / week. Combination role of AI data scientist + Data...Contract work2 days per week
- ...powered by 200,000+ volunteer contributors. The Wikimedia Foundation's Data Platform team enables this global knowledge ecosystem through... ...artificial intelligence responsibly. As a Senior Data Engineer for our Data Platform, you will shape the future of how Wikimedia...Remote jobFor contractorsLocal area
- Data Systems and Support Engineer Location Toronto, ON : We are a leading financial services provider committed to making decisions easier and lives better for our customers and colleagues around the world. From our environmental initiatives to our community investments, we...Holiday workFull timeTemporary workInternshipLocal areaFlexible hours
- ...Requisition ID: 227260 Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. The Data Engineer will focus on application development and support in a Talend-based development environment. In a team-oriented atmosphere, the...Holiday workFlexible hoursNight shiftWeekend work
- ...individual contributions, and a variety of benefit options for you to choose from. Position Overview: As a Lead Security Data Platform Engineer specializing in solving complex data challenges across multiple hyper-scaler clouds, you will be responsible for designing,...Permanent employmentFull timeWorldwideFlexible hours
- ...containers, how they work, how to deploy ~ Docker and Kubernetes ~ Application and Service Intergration ~ Oracle, MS SQL, Databrick experience ~ Java Intergration and troubleshooting ~ Data Elemental code protection experience ~ Service intergration on third party...
- ...advertisers and publishers to achieve a common objective, elevating relevancy in E-commerce for everyday shoppers. As a Senior Data Engineer, you will leverage your Databricks and Spark expertise to execute on building enterprise-grade data products that power Fluent’s business...Full timeRemote jobGangs
- ...ID: 225099 Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team in meeting the operational data needs of the various stake...Holiday workWork experience placementFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!