Similar Jobs
Data Engineer
Responsibilities
This role is to build very large, scalable platforms using cutting edge data technologies, from the ground up and plan to leverage the most recent Big Data technologies, working closely with product engineering teams and data scientists.
Responsibilities:
- Design and implement data infrastructure and processing workflows required to support data science, machine learning, BI and reporting
- Build robust, efficient and reliable data pipelines consisting of diverse data sources
- Design and develop real time streaming and batch processing pipeline solutions
- Own the data expertise and data quality for the pipelines
- Drive the collection of new data and refinement of existing data sources
Requirements:
- A minimum of 2 years of experience in data engineering, ETL or work in SQL
- Bachelor's degree in Computer Engineering or a related field
- Proficiency in Python, Java, Scala, or any two.
- Strong command of SQL
- Proficient understanding of distributed computing principles
- Experience with schema design and dimensional data modeling
- Experience working with either a Map Reduce or a MPP system on any size/scale
- Knowledge of NoSQL databases will be a plus
- Knowledge of Talend
- Good understanding of Lambda / Kappa Architecture, along with its advantages and drawbacks.
- Familiarity or experience in Cloudera/Hortonworks
- Experience with multiple data technologies and concepts such as Airflow, Kafka, Hadoop, Hive, Spark, MapReduce, SQL, NoSQL, and Columnar databases.
   Your application has been submitted successfully
Thanks for submitting the application, Please check your email and Goodluck!
You have already been applied on this job.
Email Me Job
Delete Office
Are you sure, you wish to delete?
Job Application
Are you sure, you wish to delete?
Job Portal
Quickest way to apply and increase your chances of getting shortlisted! Please make sure your profile is up to date before your apply.
Apply for - Upload/Choose documents
Resume
Upload your Resume
Cover letter
You Can Upload Image Files (.png, .jpeg or .gif), .pdf and .docx Files.
You Need To Provide At Least Your Resume(.pdf,.docx and .doc) To Submit An Application.
Apply for - Create an Account
Already have an account?SignIn
New to careerz360.com?SignUp