Your Role and Responsibilities
Who you are
- As Data Scientist, you will develop, maintain, evaluate and test big data solutions. You will be involved in the design of data solutions using Artificial Intelligence based technologies like H2O, Tensorflow.
Skills in designing algorithms, implementing pipelines, validating model performance, and developing interfaces such as APIs. Expertise in working with IBM Watson services using Python Also experience with Spark, Hadoop, SQL (HANA)
What you will do
- You are responsible for designing algorithms and implementation including loading from disparate data sets, pre-processing using Hive and Pig.
- Scope and deliver solutions with the ability to design solutions independently based on high-level architecture.
- Maintain the production systems like Kafka, Hadoop, Cassandra, Elasticsearch
How we’ll help you grow:
- You’ll have access to all the technical and management training courses that will help you
- You’ll learn directly from guide developers in the field; our team leads love to mentor
- You have the opportunity to work in many different areas to identify what really excites you
Required Technical and Professional Expertise
- 4 to 6 years of experience in IT Industry
- Technology expertise of solutioning in Hadoop, Hive, Spark / PySpark, SQL, Oozie along Data Modelling in Hive
- Experience in programming Languages- Java / Python / Scala and ability to demonstrate micro / macro designing and familiar with Unix Commands and basic work experience in Unix Shell Scripting
- Working knowledge in one NoSQL database like MongoDB/Cassandra/HBase/Couchbase
- Hands-on experience of various Big data architectures like Lambda / kappa with usage of automation / scheduling tool like Oozie or Cronacle or any other technology
- Proven ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers
Preferred Technical and Professional Expertise
- Hands-on 2 years’ experience in real time Big Data projects is preferred
- Working knowledge with one cluster manager like Cloudera Manager or Ambari
- Ambitious individual who can work under their own direction towards agreed targets/goals.
- Ability to manage change and be open to it good time management and an ability to work under stress
- Proven interpersonal skills while contributing to team effort by accomplishing related results as needed
- Maintain technical knowledge by attending educational workshops, reviewing publications