Jobs Home » Full Time Opportunities » Big Data Engineer




CluztersOps1`s Listings

Big Data Engineer

Job Details

  • Job Posting Type Managed on

Company Details

Full Time Job Requirement Details

  • Designation Big Data Engineer
  • Required Skills Python Programming, Big Data, Cloud-Data Science, Others
  • Position Level Mid Senior Level
  • Years of Experience 2-5 years
  • Indicative Package Range Not Disclosed
  • Domain Expertise Health Care
  • Highest Qualification M.B.A, B.E / B.Tech, Any Post Graduation


Job Responsibilities

  • Work in a cross-functional environment to architect, design and develop new functions in HiLabs product line.

  • Conduct feasibility analysis, produce functional and design specifications of proposed new features.

  • Troubleshoot complex issues discovered in-house as well as in customer environments.

  • Improve codebase, bring in latest technologies, re-architect modules to increase the throughput and performance.

  • Develop the software or program in accordance with the High Level and Low Level design to fulfill the project delivery

  • Adhere to enterprise standards guidelines, best practices and processes while the program or code being developed

  • Work with SME/Business Analyst / Technical Manager / Architect and create required test data for Testing the code developed

  • Create and Execute the Unit Test Cases, Integration Tests, follow coding best practices and proactively work towards resolving all the issues before handing over the code for code review

  • Conduct initial peer code reviews before handing over the code to Solutions Architect for code review

  • Proactively communicate all the risks/issues and any road blockers to Technical Lead / Project Manager

  • Create the required project artifacts like data flow diagrams / work flow diagrams, use case diagram, detail design covering enterprise features like Monitoring, logging, security, test automation, deployment automation (CI/CD) during development

  • Create the required artifacts for migration of code to QA and Production environment

  • Work with Technical leads and architects during production deployment

  • Work closely with the Application Support Team during the transition of the application

  • Provide L2 / L3 / L4 support to the Application Support team during warranty period and facilitate in resolving the production issues within defined SLA

  • Mentor junior engineers in software development, technology and processes.



Desired Profile

  • BE / B.Tech / ME / M.Tech in CS or other branches of engineering

  • Solid CS fundamentals including data structure and algorithm design, and creation of architecture and design specifications.

  • Working knowledge and experience of Big Data / Hadoop tools and technologies like Hive, UDF, HDFS, Spark, SparkML, SparkSQL, data ingestions and visualization.

  • Database development experience with a solid understanding of core database concepts, relational database design (nice to have knowledge on one of the NoSQL DBs like Mongo/Cassandra/HBase etc) .

  • Expert level knowledge of SQL and scripting preferably UNIX shell scripting, Perl scripting

  • Good understanding of Cloudera platform administration, Apache hadoop/spark ecosystem, distributed computing, and integration, etc.

  • R&D contributions and production deployments of large backend systems, supporting big data use cases.

  • Knowledge of designing and implementing data processing pipelines with a combination of the following technologies: Hadoop, Map Reduce, YARN, Spark, Hive, Kafka, Avro, Parquet, SQL and NoSQL data warehouses.

  • Experience in implementation of professional software engineering best practices for the full software development life cycle, including coding standards, code reviews, source control management, documentation, build processes, automated testing, and operations.

  • Experience in defining big data solution architectures and component designs, exploring technical feasibility trade-offs, creating POCs using new technologies, and productizing the best solutions in line with business requirements.

  • Passion for developing and maintaining a high quality code and test base, and enabling contributions from engineers across the team.

  • Ability to handle multiple competing priorities with good time management and a dedication to doing what it takes to get the work done right.

  • Ability to achieve stretch goals in a very innovative and fast paced environment.

  • Ability to learn new technologies quickly and independently.

  • Excellent verbal and written communication skills, especially in technical communications.

  • Strong inter-personal skills and a desire to work collaboratively.

  • Excellent understanding of all aspects of the Software Development Lifecycle.

  • Experience in Java will be an added advantage

  • Knowledge of object oriented programming concepts is a must


Our mission is to put healthcare organizations in the driver seat for data-driven healthcare decision making. We believe that the no one knows healthcare data better than the healthcare organizations that create it. However, healthcare organizations often lack the tools to generate insights from this data. Statisticians, data scientists and technology gurus can create tools, but these tools have no value until merged with the valuable domain knowledge that only healthcare organizations possess. We empower healthcare organizations with data science tools to leverage their deep domain knowledge and generate novel insights from their data.


Location Information

  • Location: Pune, Maharashtra, India - Get Directions
  • Formatted Address: Pune, Maharashtra, India
  • Street Address: Pune
  • City: Pune
  • State: Maharashtra
  • Country: India