Senior Data Engineer
E-IT
Must have : SQL+ Datawarehouse+ Banking domainJob DescriptionThis position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Winnipeg, MB vacancy
$110k per year
...with experience. About the Team: The Data & Analytics team is moving from a legacy... ...data quality standards, and creating engineering patterns that let analytics, product, engineering... ...confidence. About the Role: The Senior Data Engineer will design, build, and...SeniorFull time- ...feel valued and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling...SeniorWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...within our AI organization. While a Senior Data Scientist excels at building and deploying... ...& Scalability: Partner with Engineering and DevOps to design robust ML platforms....Senior3 days per week- ...Databricks, and Kimball modeling in hybrid Toronto work. The Senior Data Architect will turn complex telephony and quality requirements... ...pagination, rate limits, and asynchronous jobs Explain trade-offs to engineers and business stakeholders Requirements: Deep Kimball...Senior
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...Permanent employmentFull time
- ...Senior Automation Engineer (Project Manager) Saguenay-Lac-Saint-Jean, QC, Canada Type of position: Regular To pursue project and client... ...specifications, and calls for tenders Prepare technical data sheets and select instruments (flow, pressure, levels) and control...SeniorLong term contractTemporary workWork at officeLocal area
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
- ...and rescue, military, utility, and commercial operations. With engineering and manufacturing operations across Canada, the United States,... ...innovative aerospace products. We are looking for an experienced Senior New Product Introduction (NPI) Engineer to lead the...SeniorPermanent employmentFull time
- ...not reach. Falcon is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a... ...are ultimately made by humans. If you would like more information about how your data is processed, please contact us....SeniorRemote workWorldwideFlexible hours
- ...• Our convenient Price Café offers free Tea and Coffee. Senior Manufacturing Engineering Specialist - Critical Environments Reporting To: Manufacturing... ...layouts, production line configurations, machine capacity data, and labor cost standards. • Ensure drawing packages...Senior
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing... ...Develop scalable enterprise REST APIs and solutions Build data analytics and self-service platforms Optimize performance of...Senior
- ...required work and prepare proposals. • Select appropriate team for a project and inform that team of an assignment. • Lead electrical engineering work on all electrical systems for a project. • Present designs to clients and obtain acceptance. • Coordinate development of...SeniorFor contractorsFor subcontractorInternshipWork at office
- ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business-facing products. You will apply quantitative... ...modeling, experimentation and algorithms to solve complex engineering challenges at scale, collaborating with Product, Engineering,...Senior
- ...Affirm, Inc. is seeking an experienced Capacity Modeling Engineer to own quarterly goals for the team and lead engineers through ambiguity while delivering capacity plans for peak sales events. You will translate demand forecasts into resource settings across regions and environments...Senior
- A growing adtech startup is seeking experienced developers to design and build scalable web applications. Responsibilities include deploying cloud-native applications and driving architecture decisions in a remote-first setting. Ideal candidates will master both front-end and...SeniorRemote work
- ...This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform... ...learning needs into reusable platform capabilities Build data and machine learning pipelines Maintain MLOps tooling,...Senior
- ...Senior Back End Software Engineer Canada, United Kingdom, United States 1 gün 9 saat 9 dakika önce yayınlandı. Full Time Himalayas - Our software engineers... .... Traditional analytical techniques built on historical data were not built for this. Epistemix was. We build...SeniorFull time
- ...full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise...SeniorFull timeInternshipRemote workRelocation
$18 - $22 per hour
...commentary, forecast and trend review, change‑impact assessment, and data validation; verify outputs against source data. Support... ...Qualifications / Requirements Bachelor’s degree or diploma in Engineering, Construction Management, Quantity Surveying, Finance, Business,...SeniorHourly payPermanent employmentFull timeContract workTemporary workPart timeFor contractorsWork at officeFlexible hours3 days per week- ...We are looking for a Senior Routing Engine Developer to design and build the next generation interaction routing platform powering enterprise-scale... ...with PostgreSQL or comparable relational databases, data modeling, integration data flows, and transactional design....SeniorInternshipRemote workRelocation
- ...team that’s naturally committed to the environment. Your Opportunity We have an exciting opportunity for a motivated senior Water Resources Engineer / Environmental Engineer with experience in water resource. You will be part of the Water Resources Technical Team within...SeniorWork at officeWorldwide
- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure...SeniorContract workInternshipRemote work
- ...with P.Eng. accountability, complex heat-load calculations, and multidisciplinary execution from Mississauga, Ontario. This senior engineering role covers HVAC and mechanical systems for Nuclear Power Plants. You will lead detailed design, supervise junior and intermediate...Senior
$130k - $160k per year
...Senior Substation Engineer (P.Eng.) Toronto, ON | Calgary, AB | Vancouver / Winnipeg, MB | Hybrid Do you thrive taking technical ownership... ...industries like semiconductor manufacturing, municipal entities, data center mega campuses, and pioneers in renewable energy. With...SeniorLong term contractFull timeLocal areaFlexible hours- ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally distributed development team. As a Senior SDN Network Software Engineer, you will help develop open-source software for Equinix’s AI Inference...Senior
- ...power-supply development at SCIEX in Concord, Ontario, using analog electronics expertise in an on-site R&D environment. As Senior Electrical Engineer/Designer, you will guide analog and high-voltage module development for SCIEX instruments. Apply power-supply architecture,...Senior
- ...Hire Resolve is partnering with established and growing organisations across Canada to recruit experienced mid-senior to senior-level engineering professionals . These opportunities are ideal for engineers with strong technical expertise, proven project delivery experience...SeniorFull timeFor contractors
- ...opportunities to reach your full potential in an environment that’s engineered for people. At CIMA+, we care about our people and make sure... ...organization. Elevate your engineering career by joining us as a Senior Overhead Transmission Lines Engineer . In this pivotal role,...SeniorPermanent employmentInternshipWork at officeFlexible hours2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- junior data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB