Google Cloud Platform/Databricks Data Engineer (Accepts C2C)
Job Details
Over 7 years experience , 2 years in Python, Airflow, Google Cloud Platform Biq query, Databricks with AWS and Google Cloud Platform background Designing and implementing highly performant data ingestion pipelines from multiple sources using Databricks, Python, Airflow , Apache Spark on Google Cloud Platform Platform
Expert in designing pipelines on various source system. Converting pipelines from shared service to indiual servers
Delivering and presenting proofs of concept to of key technology components to project stakeholders.
Developing scalable and re-usable frameworks for ingesting of geospatial data sets
Integrating the end to end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times
Working with event based / streaming technologies to ingest and process data
Working with other members of the project team to support delivery of additional project components (API interfaces, Search) Evaluating the performance and applicability of multiple tools against customer requirements
Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
Solution:Jump to solution
Google Cloud Platform/Databricks Data Engineer - Amzur Technologies...
12-20-2023 - Over 7 years experience , 2 years in Python, Airflow, Google Cloud Platform Biq query, Databricks with AWS and Google Cloud Platform ba...
1 Reply
Solution
automatic-azure•9mo ago
Google Cloud Platform/Databricks Data Engineer - Amzur Technologies...
12-20-2023 - Over 7 years experience , 2 years in Python, Airflow, Google Cloud Platform Biq query, Databricks with AWS and Google Cloud Platform ba...