Python Data Engineer - Remote Working
ipvisibility
Specific Duties
- Reviewing, designing, developing ETL jobs to ingest data into Data Lake, load data to data marts;
- extract data to integrate with various business applications.
- Parse unstructured data, semi structured data such XML etc.
- Design and develop efficient Mapping and workflows to load data to Data Marts
- Map XML DTD schema in Python (customized table definitions)
- Write efficient queries and reports in Hive or Impala to extract data on ad hoc basis for data analysis.
- Identify the performance bottlenecks in ETL Jobs and tune their performance by enhancing or redesigning them.
- Responsible for performance tuning of ETL mappings and queries.
- import tables and all necessary lookup tables to facilitate the ETL process required to process daily XML files in addition to processing the very large (multi-terabytes) historical XML data files
Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Python Data Engineer - Remote Working in Ottawa, ON vacancy
$82.59k - $97.16k per year
...About The Role As a member of our multidisciplinary Data Operations team, you will collaborate with developers, data engineers, analysts, and architects to create reliable and scalable data pipelines using Databricks, Python, SQL, and cloud data technologies. You will...Remote workPermanent employmentInternshipLive InWork at officeRelocation packageFlexible hours- ...enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...profitable and growing. We are hiring Python and Kubernetes Specialist Engineers focused... ..., DVC, and Feast. You may also work on ETL, data governance and visualization...SuggestedLocal areaWork from homeWorldwide
$85k - $225k per year
...communicate technical findings to both engineering and product management... ...your flexibility to work remotely or in the office within Canada... ...integrity and coverage of test data sets to reflect real-world usage... ...Automation of Evaluation Pipelines: Develop, implement, and maintain...Remote workWork at officeLocal areaWork from home$146.5k per year
...individual needs and preferences. About The Team The ML Data Engineering team powers metadata extraction, enrichment, and content understanding... ...building event-driven, distributed, and scalable systems in Python. In this role, you’ll design and optimize large-scale data and...SuggestedLong term contractTemporary workLocal areaWorldwideHome officeFlexible hours$95.62k - $152.99k per year
...16390 Software Development Engineer Level III What will you do... ...software architecture/design, data model & implementation. Responsibilities... ..., programming skills Develop the SDN applications software... ...Information Location: Remote, Canada Travel: 10% As we...Remote workTemporary workFlexible hours- ...Principal Data Engineer _ A bit about the role… _ The data team at Solink builds and manages a growing list of over 350 integrations... ...Pipeline Background: You have a strong background in developing and managing ETL and ELT pipelines. Observability Solutions: You have...Long term contractImmediate start
- .... Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the... ...~8+ years of experience in a Data Engineer role ~ Experience with relational SQL... ...oriented/object function scripting languages: Python, Java, Scala, etc. ~ Experience extracting...Full time
- ...immediate permanent opening for a Software Engineer. About the team: The YunShan... ...points, complex issues, and challenges in data communication device software. This lab is... ...Proficiency in other programming languages (Java/Go/Python/Lua/Shell/etc…) is an asset. Strong...Permanent employmentFull timeInternshipImmediate start
- ...Senior Back-End Developer (This role is open to hybrid candidates in... ...sensors, combined with third-party data, to help industrial emitters... ...Computer Science or Software Engineering with a minimum of 5 years’... ...Proven capability with: Linux, Python, Docker Experience with Cloud...Remote workFull timeLocal areaFlexible hours
- ...The Imapct You'll Make As Data Scientist, Pricing you will be... ...Sales and Services leaders to develop and implement the governance,... ...problem formulation, features engineering, algorithmic selection and evaluation... ...an asset ~ Proficiency in Python, R, SQL and experience with ML...Remote workInternship
- ...2016, has been innovating the data analytics market in ways no-one... ...Collaborating and constantly engineering better and better solutions. We... ...for clients, partners and developers. And you’ll articulate technical... ...Proficiency in Scala, java, python, or a programming language associated...Full timeWork from home
$57.51k - $71.89k per year
...throughout the Business Intelligence and data science lifecycle. Develop Business Intelligence and data... ...brings: A post-secondary degree in Engineering, Computer Science, Mathematics,... ...more of the following (Power BI, R, Python) Proficient with the use of data...Permanent employmentInternship$82.18k - $90.83k per year
Developer (Entry Level) Location Ottawa, ON : Join our Team About this... ...Develop test plans, perform data analysis, review test results,... ...or M.Sc. degree in Electrical Engineering or a related field. Up to 2... ...programming languages such as Python, Matlab, or Java Strong problem...Permanent employmentFull timeInternship- ...years. Backed by a legacy of engineering excellence, reliability and industry... ...visit The Senior Software Developer will play a pivotal role in... ...languages such as C++, Python Understanding of satellite... ...more information about how your data is processed, please contact us...InternshipWork at officeWorldwideMonday to friday
- ...breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the... ..., and growing. We are hiring a Junior developer with a proven track record in Python and/or Go. As part of the Observability team, you...Remote workWork at officeLocal areaWork from homeWorldwide
- Sales Developer Location Ottawa, ON : Are you a rockstar Sales Developer looking to make your mark in the world of engineering manufacturing? Look no further! We are seeking a dynamic and results... ...g., headquarters, regional office]. Remote work options may be available based...Remote workFull timeContract workWork at office
- ...Job Description Design, develop, and maintain modern web applications... ...Core) and LINQ for efficient data access and manipulation.... ...in Computer Science, Software Engineering, or a related field. ~3–5 years... ...: Ottawa, ON (Hybrid – Remote flexibility) Reports To: Manager...Remote workFull timeTemporary workPart timeFlexible hours
- ...in Research and Development, Engineering, Information Technology Services... ...Title: Software Engineering Developer Location: Ottawa, Canada... ...: 40 hours/week, Day Shift Remote Work Policy: Hybrid – 3 days/... ...libraries, gRPC/REST APIs, and data formats (JSON, YAML, XML, Protobuf...Remote workLocal areaDay shift3 days per week
- ...Automation Development & Scripting Design, develop, and implement automation solutions for... ...using programming languages such as Python, Java, or JavaScript. Develop custom automation... ...coverage. Performance & Reliability Engineering Implement performance testing...
- ...to attract top talent for a Java Backend Developer position. This job posting is a new... ...support in pre-sales stage, requirement engineering, refinements and other scrum events We... ...initial screening of resumes, ensuring your data remains safe while helping us efficiently...Internship
$82k per year
SW Developer (Entry Level) Location Ottawa, ON : Join our Team At this time, Ericsson Canada... ...degree in Computer Science or Electrical Engineering with strong background in C++ programming... ...spinnaker Familiarity with Linux OS, Python, MATLAB, Bash, JSON, YAML, XML, protobuf...Full time- ...) software from the Microsoft Dynamics 365 (D365) software line. Role Overview Our client is looking for a talented Data Engineer who will assist in designing and implementing Business Intelligence (BI) and large-scale Data Analytics solutions for their customers...Permanent employmentFull timeRelocationRelocation package
- ...functional teams, architects, engineers to translate requirements in robust... ...GCP) ~2+ years of experience developing AI/ML solutions, including at... .... ~ Proficiency in Python and frameworks such as Tensorflow... ...capital markets. Enabled by data, AI and advanced technology,...Live InRelocationWeekend work
- ...To ensure success as a data entry specialist, you should display impeccable organizational skills and experience working with a variety of databases. Ultimately, a top-notch data entry specialist should have a razor-sharp eye for detail and excellent knowledge of data management...Remote workLong term contractFull timeWork at officeFlexible hours
- ...years. Backed by a legacy of engineering excellence, reliability and industry... ...systems, and hypervisors. Develop and operate a highly secure... ...out on-premise, secure data centre based hardware clusters... ...build infrastructure (i.e. Bash, Python, Terraform). Familiarity with...InternshipLocal areaWorldwide
$69.2k - $111k per year
...ID: 76444 Description RF Applications Engineer: The RF and Mixed-Signal Intelligence Solutions (RMI) team in Ottawa is developing wireless integrated circuit components and... ...introduction and ramp to high volume production • Python coding and LabView test automation #LI...- ...for over 50 years. Backed by a legacy of engineering excellence, reliability and industry-leading... ...and Debian), and Kubernetes to join our data platform team. This is a hands-on... ...K8s ). ~ Proficiency in scripting (Bash, Python) and automation tools (Ansible, Terraform...InternshipWorldwide
- ...breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's... ...This is a technical management role to lead a team that develops Python and Golang micro-services that power our global software...Remote workInternshipWork at officeWork from home
$85k - $120k per year
...ice caps, capturing essential data on water temperature, salinity... ...talented R&D team as a Firmware Engineer and help shape the future of... ...What you'll do Design and develop embedded firmware applications... ...Some knowledge of Bash and Python scripting Familiarity with...Permanent employmentFull timeInternshipWork at officeWorldwideShift work- ...We are a reputable provider of legitimate work-from-home data entry positions. We value skillsets relevant to the roles we offer and provide... ...individuals from various fields, including but not limited to remote data entry clerks, administrative assistants, receptionists,...Remote workExtra incomeFull timePart timeCasual workStart todayWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Data Engineer - Remote Working. Be the first to apply!
Related searches
- python developer remote Ottawa, ON
- junior python developer Ottawa, ON
- python developer Ottawa, ON
- python data engineer Ottawa, ON
- python developer no experience Ottawa, ON
- junior data engineer Ottawa, ON
- remote data engineer Ottawa, ON
- data engineering intern summer Ottawa, ON
- data centre engineer Ottawa, ON
- data cabling engineer Ottawa, ON