Pyspark Developer
Experienced in designing and implementing data ingestion pipelines from multiple sources using Azure Databricks.
Design and develop scalable and reusable frameworks for ingesting data sets to Azure Data Lake storage.
Integrating end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.
Working with event-based/streaming technologies to ingest and process data.
Technically able to articulate solutions for projects involving on-prem to Cloud transformations.
As part of the team support has to be provided for any business queries, acknowledge, analyze, and provide necessary details.
The requirement from the business has to be taken based on the business priority for the development, perform initial analysis, and provide estimation to the business.
Experienced with Agile project methodology and ceremonies (creating and assigning user stories, assigning story points, creating epics, backlog refinements, release planning, project retrospectives, etc).
Must have strong communication skills.
Pyspark Developer Recommended Skills Communication Data Pipeline Data Streaming Databricks Microsoft Azure User Stories Estimated Salary: $20 to $28 per hour based on qualifications.
Design and develop scalable and reusable frameworks for ingesting data sets to Azure Data Lake storage.
Integrating end-to-end data pipeline - to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times.
Working with event-based/streaming technologies to ingest and process data.
Technically able to articulate solutions for projects involving on-prem to Cloud transformations.
As part of the team support has to be provided for any business queries, acknowledge, analyze, and provide necessary details.
The requirement from the business has to be taken based on the business priority for the development, perform initial analysis, and provide estimation to the business.
Experienced with Agile project methodology and ceremonies (creating and assigning user stories, assigning story points, creating epics, backlog refinements, release planning, project retrospectives, etc).
Must have strong communication skills.
Pyspark Developer Recommended Skills Communication Data Pipeline Data Streaming Databricks Microsoft Azure User Stories Estimated Salary: $20 to $28 per hour based on qualifications.
|
|
 | |
