- Job Search
- IT Jobs
- Lead Consultant - Databricks Developer - AWS
Similar Jobs
Lead Consultant - Databricks Developer - AWS
Responsibilities
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functionalrequirements.
Demonstrated knowledge of relevant industry trends andstandards.
Demonstratestrong analytical and technical problem-solvingskills.
Must have excellent coding skills either Python or Scala, preferably Python.
Qualifications we seek in you!
Minimum qualifications
Bachelor&rsquos Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent workexperience.
Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.
Work with architect and lead engineers for solutions to meet functional and non-functionalrequirements.
Demonstrated knowledge of relevant industry trends andstandards.
Demonstratestrong analytical and technical problem-solvingskills.
Must have excellent coding skills either Python or Scala, preferably Python.
Must have experience in Data Engineering domain
Must have implemented at least 2 project end-to-end in Databricks.
Must have experience on databricks which consists of various components as below
Delta lake
dbConnect
db API 2.0
Databricks workflows orchestration
Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.
Must have good understanding to create complex data pipeline
Must have good knowledge of Data structure & algorithms.
Must be strong in SQL and sprak-sql.
Must have strong performance optimization skills to improve efficiency and reduce cost.
Must have worked on both Batch and streaming data pipeline.
Must have extensive knowledge of Spark and Hive data processing framework.
Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.
Must be strong in writing unit test case and integration test
Must have strong communication skills and have worked on the team of size 5 plus
Must have great attitude towards learning new skills and upskilling the existing skills.
Good to have Unity catalog and basic governance knowledge.
Good to have Databricks SQL Endpoint understanding.
Good To have CI/CD experience to build the pipeline for Databricks jobs.
Good to have if worked on migration project to build Unified data platform.
Good to have knowledge of DBT.
Good to have knowledge of docker and Kubernetes.
for more details, contact us at
hr.helpdeskexit@genpact.com
   Your application has been submitted successfully
Thanks for submitting the application, Please check your email and Goodluck!
You have already been applied on this job.
Email Me Job
Delete Office
Are you sure, you wish to delete?
Job Application
Are you sure, you wish to delete?
Job Portal
Quickest way to apply and increase your chances of getting shortlisted! Please make sure your profile is up to date before your apply.
Apply for - Upload/Choose documents
Resume
Upload your Resume
Cover letter
You Can Upload Image Files (.png, .jpeg or .gif), .pdf and .docx Files.
You Need To Provide At Least Your Resume(.pdf,.docx and .doc) To Submit An Application.
Apply for - Create an Account
Already have an account?SignIn
New to careerz360.com?SignUp