Python Data Engineer - Remote Working
ipvisibility
Specific Duties
- Reviewing, designing, developing ETL jobs to ingest data into Data Lake, load data to data marts;
- extract data to integrate with various business applications.
- Parse unstructured data, semi structured data such XML etc.
- Design and develop efficient Mapping and workflows to load data to Data Marts
- Map XML DTD schema in Python (customized table definitions)
- Write efficient queries and reports in Hive or Impala to extract data on ad hoc basis for data analysis.
- Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.
- Responsible for performance tuning of ETL mappings and queries.
- import tables and all necessary lookup tables to facilitate the ETL process required to process daily XML files in addition to processing the very large (multi-terabytes) historical XML data files
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Python Data Engineer - Remote Working in Ottawa, ON vacancy
$128k - $170k per year
...share, manage and work with Ouster lidar data. We develop a web and desktop application that... ...driven, dynamic and passionate software engineer who will be a key player in improving our... ...distributed system at scale Develop robust Python code to support product functionalities...SuggestedFull time- ...Noda to attract top talent for Senior Data Engineer. Noda is a data and analytics company... ...-end. You will join a close-knit team of developers using data technologies such as Snowflake... ...technologies, ensuring efficient data pipelines, ETL processes, and database performance...Remote workLong term contractWork at officeFlexible hoursShift work
- ...rate, and profit. Our search engine is entirely invented in-house... ...Integration Engineer on our Customer Developer Experience team, you’ll own... ..., and validating data quality - while proactively monitoring... ...integrations. How we work Remote-first: work from anywhere Cross...Remote workFull timeWork from homeHome office
$105k - $130k per year
...talented professionals to join our team in developing and optimizing advanced machine learning and AI systems. As an ML Data Engineer , you will contribute across the full machine... ...systems at scale ~ Proficiency in Python (pandas, NumPy, scikit-learn) and SQL for data...SuggestedLong term contractTemporary work$130k - $225k per year
...communicate technical findings to both engineering and product management... ...your flexibility to work remotely or in the office within Canada... ...integrity and coverage of test data sets to reflect real-world usage... ...Automation of Evaluation Pipelines: Develop, implement, and maintain...Remote workWork at officeLocal areaWork from home$125.2k - $132.5k per year
...collection of unmatched reverse engineering, teardown, and market... ...the observability, Internal Developer Platform (IDP), and service catalog... ...differentiator. This role is a remote role for candidates based in... ...preferred) ~ Proficiency in Python and/or Bash; experience...Remote jobPermanent employmentFull timeInternshipFlexible hours- ...We are a reputable provider of legitimate work-from-home data entry positions. We value skillsets relevant to the roles we offer and provide... ...individuals from various fields, including but not limited to remote data entry clerks, administrative assistants, receptionists,...Remote workExtra incomeFull timePart timeCasual workStart todayWork from homeFlexible hours
- ...To ensure success as a data entry specialist, you should display impeccable organizational skills and experience working with a variety of databases. Ultimately, a top-notch data entry specialist should have a razor-sharp eye for detail and excellent knowledge of data management...Remote workLong term contractFull timeWork at officeFlexible hours
- ...Senior Data Platform Engineer – Cloud & GenAI Enablement Location: US / Canada (Remote/Hybrid) Type: Contract / Full-Time Overview: We are seeking a Senior Data... ...Nice to Have: ~ Experience with Python, PyTorch, and ML frameworks ~ Familiarity...Remote workFull timeContract work
$74.8k per year
...role We are seeking a technical Data Analyst II with expertise in data engineering and BI development. In this role,... ...What you'll do here: Design and develop reporting to test, track and improve... ...of data warehouse architecture, ETL/ELT processes, and dimensional modelling...Long term contractFlexible hours- ...Marketing Data Analyst MacDonald Search Group has been asked... ...will do in this role includes: Develop and maintain marketing... ...~ Strong proficiency with SQL, Python, Excel, and business intelligence... ...environment with flexibility between remote and in-office collaboration...Remote workLong term contractWork at office
- ...Title – . Java Back End Developer (3 Openings Sr/Mid/Jr) Position – Fulltime With our client Location – 100% Remote Work Salary - $Open (Best Possible) -----------... ...cycle. Leading and mentoring other engineers as well as liaising with other parts of...Remote workFull timeInternship
- ...Job Responsibility: The SOAR Developer will be accountable for implementing key elements within... ...and oversight from the CanSSOC Engineering team, the SOAR Developer will also work to... ...knowledge of the following: Language: Python, PowerShell, JavaScript/TypeScript, bash,...Permanent employmentFull timeWork at office
- ...started out as a team of three engineers. Today, we have grown to... ...passionate Machine Learning Staff Developer to join our cutting-edge research... ...Experience with cloud-based data processing, machine learning services... ...systems. Proficiency in Python with at least 5 years of...Long term contractFull timeWorldwideFlexible hours
- ...mission, such as overseeing field data collection and AI model... ...Master Physical Layer software developer whoever have big passion/belief... ...~ Strong competence in C/C++, Python is a must. ~ Quick learner with... ...~ MSc degree in Electrical engineering or Computer Science or equivalent...Full timeWork at office
$100k - $120k per year
...enterprises and public sector agencies develop purpose-built GenAI applications on their private data. With a focus on Sovereign AI—... ...Full Stack & Systems Software Engineer to join our H2OGPTe generative... ...robust systems software using Python, Go, and React. Implement and...Remote workFull timeWorldwideFlexible hours- A federal financial institution is seeking a highly skilled Data Analyst / Developer to support advanced data and analytics initiatives within a cybersecurity-focused environment. The successful candidate will act as a Data & Analytics Architect, delivering end-to-end solutions...
$81k - $107.5k per year
...Our platform protects email, data, applications, and networks with... ...hardworking midlevel Software Developer in Test who can join our cross... ..., AWS, Docker, Java, React, Python What you will be working... ...frameworks ~Collaborate with software engineers, product owners, and other...Worldwide- ...Location: Remote, Canada Employment Type: Full-Time or Part-Time Schedule: Flexible About Zonda Home Zonda Home works with housing data, market research, and digital tools used by builders, developers, and real estate teams. The work we do helps companies stay...Remote workFull timePart timeWork from homeFlexible hours
- ...next chapter starts here. As a Embedded Developer, you’ll build core system functionality... ...consistency matter. You’ll work with protocols, data models, and validation tools, turning... ...or similar platforms • Familiarity with Python for bindings, automation, or developer...Permanent employmentFull time
$92.35k - $108.64k per year
...Job Responsibility: Senior Financial Data Analyst Take a central role The Bank of... ...emerging data challenges and requests. You will develop and maintain deep subject-matter knowledge... ...one programming language (e.g., PySpark, Python, SQL, DAX) Sound judgment for decision-...Remote workPermanent employmentFull timeInternshipLive InWork at officeRelocationFlexible hours$94.5k - $138.6k per year
...seamless integration between GIS data and BIM models to improve all... ...workflows that help owners, engineers, planners, and stakeholders collaborate... ...Communicate with industry developers on best practices for... ...experience with C++, .NET and/or Python ~ Knowledge of Agile software...$84.7k per year
...Canada’s mortgage sector. As a Specialist, Data Analysis, you will support the Manager,... ...internal partners to ensure data is available to develop, validate and implement models using state... ..., and develop code in languages such as Python, R, SAS, or SQL. Demonstrated...Full timeContract workTemporary workWork at office$84.9k - $110k per year
...Day in the Life of a Senior GIS Developer at Esri Canada: * Produce... ...geomatics, computer science, engineering, or equivalent education and experience... ...framework * Experience with Python and the ArcGIS API for Python... ...* Working knowledge of UML, data modeling, process modeling, workflows...Remote workFull timeSummer workInternshipLive InWork at officeWork from home$106k - $141.5k per year
...Our platform protects email, data, applications, and networks with... ...hardworking Senior Software Developer in Test to join our cross-functional... ...: JavaScript (TypeScript) / Python / Java / Kotlin ~Cloud: AWS (... ...~Collaborate with engineers, product owners, and stakeholders...Worldwide$106.25k - $143.75k per year
...We’re seeking an experienced Zuora Developer to join our team in a hands-on role supporting... ...functionally with Sales, Finance, RevOps, and Engineering to support and optimize the SaaS... ...workflows, notifications, custom fields, data mappings, and Salesforce integrations, including...Full timeFlexible hours- ...seeking a detail-oriented and creative Web Developer to design, build, and maintain our web... ...with back-end technologies such as Node.js, Python, PHP, or Ruby (depending on role).... ...Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience. By...
- ...We're hiring a precise and dependable Data Entry Specialist to manage and maintain our medical records and patient data systems. If... ...Specialist Department: Administrative & Health Records Location: Remote / On-Site Type: Full-Time / Part-Time Requirements...Remote workFull timePart timeFlexible hours
$75.7 - $96.35 per hour
...respected federal organization, is seeking two fully remote Senior Microsoft Dynamics 365 CRM Developers to support the development and enhancement of a core... ...Visual Studio. •Minimum of 5 years of experience as a Developer, including recent experience with Microsoft .NET...Remote workFlexible hours- ...consecutive year . Senior Embedded Application Developer Lumentum is looking for a senior embedded... ...'s degree in Computer Science, Computer Engineering, Software Engineering, Electrical... ...dual port RAM, RS-232. Cross compiling/remote debugging/JTAG debugging. Ability to use...Remote workFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Data Engineer - Remote Working. Be the first to apply!
Related searches
- python developer remote Ottawa, ON
- python data engineer Ottawa, ON
- python developer no experience Ottawa, ON
- junior python developer Ottawa, ON
- python developer Ottawa, ON
- data cabling engineer Ottawa, ON
- data integration developer Ottawa, ON
- data centre engineer Ottawa, ON
- big data developer Ottawa, ON
- junior data engineer Ottawa, ON