Lead Software Engineer (Python | Databricks)
Scotiabank
Requisition ID: 258694
Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.
The Team
Global Banking and Markets Engineering (GBME) is the fast-moving, award-winning technology engine that powers Scotiabank’s Corporate, Investment Banking and Capital Markets businesses.
The Role
GBME is searching for Software Engineers who are continuous learners and are eager to boost capabilities of capital markets products and analytics platforms.
The successful candidate will have a strong technical and engineering mindset. You will work closely with business teams and cross functional engineering leaders to develop and implement market leading solutions for the various projects within GBME.
Is this role right for you? In this role you will:
- Work closely with end users, and business teams to understand business needs, conduct gap analysis and requirements assessments as needed
- Partner with Architecture on the design and integration
- Deliver and enhance new and current solutions and applications
- Be involved in the full life cycle of a project, responsible for the design, producing actionable and complete specifications, writing production quality code, and implementation
- Design, deliver and implement data models, database schema and data pipelines
- Design test sets and automate where possible, including functional and non functional testing, regression testing as well as performance testing
- Write deployment scripts and leverage tools such as the Accelerator pipeline to promote code
- Support the solution in production (as needed)
- Improve the end user experience by finding scalable solutions and addressing complex ad hoc queries.
- Effectively communicate with technical and non-technical audiences
- Able to work with and refactor legacy code (as needed).
- Coach and train end users (as needed).
- Participate and run SCRUM Meetings (as needed).
Skills
Do you have the skills that will enable you to succeed in this role? We’d love to work with you if you have:
- 4+ years’ experience with Python (PySpark, Pandas),
- 4+ years’ experience with designing scalable ETL pipelines & data modeling
- 4+ years’ experience developing, deploying, and maintaining large scale applications with complex integration
- 4 + years’ experience reading, writing, and running SQL scripts.
- Working experience with data technologies and databases, preferably in one or more of: Postgres, MSSQL, Oracle DB, Apache Spark, Apache Kafka, Apache ElasticSearch, comfortable working with large datasets
- Working experience with data platforms: DataBricks or Snowflake
- Working experience with cloud platforms (Azure/GCP)
- Working experience with workflow orchestration tool such as Airflow or Data Factory
- Working experience with Web Services & API
- Hands-on experience with DevOps: CI/CD (Jenkins, Git)
- Experience working in an Agile environment, with experience and understanding of Test-Driven Development methodology.
- Bachelor’s degree in computer science, Engineering or relevant experience.
Preferred Qualifications (Nice To Have)
- Understanding of networking protocols and security principles
- Capital Markets product knowledge
- Dockers, Kubernetes experience
- Experience working with real-time, high availability and low latency systems
- Experience in multi-threaded applications
What's in it for you?
- Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank. We embrace diversity and provide opportunities for all employee to learn, grow & participate through our various Employee Resource Groups (ERGs) that span across diverse gender identities, ethnicity, race, age, ability & veterans.
- Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
- Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
- Community Engagement - no matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs.
Location(s): Canada : Ontario : Toronto
Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.
At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone.
#J-18808-Ljbffr$86.1k - $136.1k per year
...Manulife is a leading international financial services provider, helping... ...you want to go. Full Stack Engineer The Opportunity We’re... ...services and APIs using Python, FastAPI/async frameworks, and... ...with large datasets using Azure Databricks and Delta Tables. Develop cloud...DatabricksLong term contractFull timeTemporary workLocal area- ...Databricks Lead – Python, PySpark, SQL & Supply Chain Analytics Experience Required: 6-8 Years Location: Toronto / Edmonton / Calgary Work Model: Hybrid (3 days per week in office) Role Summary Seeking a Databricks Lead with strong expertise...DatabricksPermanent employmentWork at office3 days per week
$180k - $275k per year
...employees, and communities. The Role As Principal Software Engineer for a new product within Veeva, you will be a... ...software development expertise (Production level Python development required) Enterprise SaaS Leader: Extensive experience developing high-scale enterprise...SuggestedInternshipWork at officeLocal areaRemote workWork from homeFlexible hours$117k - $130k per year
...applying new technologies to complex problems. As a Senior Software Engineer, you will be responsible for designing, developing, and maintaining... ...software solutions that meet business requirements, using Python and/or Golang programming languages. You are capable of...SuggestedFull timeRemote workShift work- ...Markets, and external vendor partners. We are looking for a lead senior software engineer, a seasoned technologist to build cutting-edge, products... ...Understanding of Launch Darkly Experience with C/C++/C#, Golang, Python, DB2 Experience with/Understanding of Sybase, Postgres...Suggested
- ...is the Opportunity? We are seeking a Lead Financial Engineer to bridge the gap between our investment strategy business units and our software engineering teams. In this role, you will... ...Design and execute prototype models in Python or R to validate algorithmic accuracy before...Full timeFlexible hours
- ...and a leader in their space is looking for an Intermediate Software Engineer - Python or Go, Data, Hybrid to join their growing team. The successful... ...with cutting-edge technology on innovative products at a leading SaaS company. Our client offers a competitive salary and benefits...Permanent employmentFull time2 days per week
$40 - $50 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Software Engineer Type: Contract Compensation... ...Build MCP servers in Python using FastMCP . Integrate web or...Remote jobContract workSummer workLocal area$140k - $175k per year
...products spanning Engagement Manager and Guided Assurance. As a Lead Software Engineer AI (Staff Engineer AI), you will own core backend and AI... ...to-end architecture and design of backend services (C#/.NET, Python, FastAPI, PostgreSQL, AWS, Vercel) that integrate and orchestrate...Long term contractFull timeWork at officeLocal areaFlexible hoursShift work2 days per week3 days per week$127k - $203k per year
...of products and services that help people, businesses and governments realize their greatest potential. Title and Summary Lead Software Engineer (SDET) Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and power...Full timeWorldwide$140k - $175k per year
...Lead Software Engineer, AI What if the AI agents you architect today are empowering legal professionals at firms large and small to act more decisively, with sharper judgment and greater leverage, and the tools you use to build them are themselves AI-native, multiplying what...Full timeInternshipWork at officeLocal areaFlexible hoursShift work2 days per week3 days per week$140k - $175k per year
...current openings or future vacancies within our organization. Lead Software Engineer - AI (Materia AI) Are you excited about building AI-driven... ...advisory, and audit. Develop and maintain backend services using Python, FastAPI, and PostgreSQL. Implement AI orchestration...Full timeWork at officeLocal areaFlexible hours2 days per week3 days per weekusd168k - usd210k per year
...people. The company has been leading an industry transformation through... ...About the role Our Engineering team helps Nubank to create and... ...We strive for state-of-the-art software development practices that currently... ...Demonstrated ability to lead technical initiatives across multiple...Full timeFlexible hours$150k - $180k per year
...Arrangement: Onsite / 4 Days in Office Salary: $150K–$180K Experience: 12–18 Years We are looking for a Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives, with a strong focus on Cloudera-to-Databricks migration, Lakehouse...DatabricksTemporary workWork at office$123.9k - $203.6k per year
...security. Key Responsibilities Platform Software Development: Set group-wide guardrails... ...- Design, Testing, and Optimization: Leads project initiatives to design software solutions... ...software development lifecycle; coaches engineers across teams or units to drive...Long term contractTemporary workShift work$85k - $95k per year
...dental benefits plan - Market-leading pension plan - Competitive... ...and implement innovative software solutions, working closely with... ...such as D&O Copilot, built with Python and FastAPI, so this role... ...based LLM services. Agentic engineering, using AI coding agents,...Permanent employmentFull timeTemporary workRemote workFlexible hours$130k - $170k per year
...DataVisor DataVisor is the world’s leading AI-powered Fraud and Risk... ..., powerful decision engine, and investigation tools work... ...the globe. Our award-winning software platform is powered by a team... ...along with working proficiency in Python and Shell scripting. Experience...Full time$130k - $155k per year
...hiring its first dedicated AI Engineer. Over the past year, AI at Fluent... ...you will build them on the Databricks lakehouse that is Fluent's data... ...who ships. You are strong in Python and SQL, you have put at least... ...comfortable sitting with a support lead or an account manager,...DatabricksFull timeWork at officeRemote work- ...large and small players, we stay at the leading edge of technology, remain nimble even... ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US... ...platforms. ~ Strong knowledge of software engineering best practices, testing,...Full timeInternshipRemote workRelocation
- ...and Silicon Valley. Our talented team of software engineers, hardware engineers, and operators have... ...Google. We're currently looking for a Lead Software Engineer to join our core team,... ...Bonus Experience with Python and C Experience building scalable, available...Full time
- ...position is between C$ 135.000 to C$ 150,000. The Job: Lead Software Engineer, Backend & Cloud Platform We’re hiring a Lead Software Engineer... ...file ingestion pipelines using S3, Lambda, schedulers, and Python/Node.js components. Maintain and improve data sync...Temporary workWork at officeRemote work
- ...Developer you are responsible for leading the planning, technical design... ...5+ years’ experience in Databricks, Azure Data Factory, Informatica... ..., Cloud technologies (Azure), Python, SQL, CI/CD, GITHUB, Batch Job... ...Oriented Design and structured Software Delivery Life Cycle (SDLC) is...DatabricksRemote workFlexible hours
$92.92 - $107.21 per hour
...an experienced, high-performing Senior Python Engineer to join their core technology and platform... ...Docker, Kubernetes, Redis, Kafka, Azure Databricks, PySpark, and Delta Lake. Operating... ...closely with platform architects, security leads, and business stakeholders to establish...DatabricksContract workWork at office$86.1k - $136.1k per year
...As a Back-end Software Engineer within Group Functions Technology, you will be a key member building... ...and engineering excellence. Lead the design and review of software systems... ...development, designing, implementing solutions in Databricks, Pyspark (Python API), Azure Data...DatabricksLong term contractTemporary workLocal areaFlexible hours$87.4k - $137.4k per year
...Job Description As a Software Engineer on the Litigation Drafting team you will be building the next... ...and build backend services using Python, FastAPI, and PostgreSQL to support real... ...you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future....Full timeWork at officeLocal areaFlexible hours$100k - $150k per year
...conversational AI Agents for leading healthcare organizations to automate... ...experiences. As Founding Engineer, you will work closely with... ...React, Next.js, NestJS, shadcn, Python AWS Supabase, PostgreSQL... ...for 2+ years of hands-on software engineering and system design...$130k - $160k per year
...Senior Software Engineer, Full-Stack Applications – Python Fitch Ratings is seeking a Senior Software Engineer to join our global Ratings Technology team... ...critical full-stack applications that power how a world-leading credit ratings agency delivers insights to analysts,...Long term contractWork at officeImmediate startWorldwideFlexible hours$125.5k - $154k per year
...an open dialogue with your recruiter who can provide you more specific details for this role. Job Description: As a Software Engineer III Tech Lead, you will be responsible for designing, developing, and maintaining high-performance applications using Java and the...Temporary workWork from home$200k per year
...role We are looking for a Principal Software Engineer to help architect and scale the core systems... ...capable of supporting global scale Lead complex technical initiatives Own the... ...in modern backend languages (such as Python, TypeScript, Go, or similar) ~ Experience...Long term contractWork at officeRelocation$134.5k - $195.1k per year
...our values: invest in every relationship, lead with curiosity, champion diverse... ...10+ years of progressive experience in software engineering, including experience leading large-scale... ...design Strong proficiency in C++ and Python; additionally, experience with GPU-accelerated...Full timeInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Software Engineer (Python | Databricks). Be the first to apply!
- lead software engineer Toronto, ON
- lead structural engineer Toronto, ON
- lead process engineer Toronto, ON
- développeur python Toronto, ON
- python developer Toronto, ON
- python data engineer Toronto, ON
- python developer remote Toronto, ON
- python developer no experience Toronto, ON
- junior python developer Toronto, ON
- junior software developer .net Toronto, ON
