ROLES & RESPONSIBILITIES

• "Major accountabilities:


• Responsible for Data Engineering, Foundry Data Pipeline Creation, Foundry Analysis & Reporting, Slate Application development, re-usable code development & management and Integrating Internal or External System with Foundry for data ingestion with high quality.


• Have good understanding on Foundry Platform landscape and its capabilities


• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.


• Defines company data assets (data models), Pyspark, spark SQL, jobs to populate data models.


• Designs data integrations and data quality framework.


• Design & Implement integration with Internal, External Systems, F1 AWS platform using Foundry Data Connector or Magritte Agent


• Collaboration with data scientists, data analyst and technology teams to document and leverage their understanding of the Foundry integration with different data sources - Actively participate in agile work practices


• Coordinating with Quality Engineer to ensure the all quality controls, naming convention & best practices have been followed


• Desired Candidate Profile :


• Strong data engineering background


• Experience with Clinical Data Model is preferred


• Experience in


• o SQL Server ,Postgres, Cassandra, Hadoop, and Spark for distributed data storage and parallel computing


• o Java and Groovy for our back-end applications and data integration tools


• o Python for data processing and analysis


• o Cloud infrastructure based on AWS EC2 and S3


• 7+ years IT experience, 2+ years experience in Palantir Foundry Platform, 4+ years experience in Big Data platform


• 5+ years of Python and Pyspark development experience


• Strong troubleshooting and problem solving skills


• BTech or master's degree in computer science or a related technical field


• Experience designing, building, and maintaining big data pipelines systems


• Hands-on experience on Palantir Foundry Platform and Foundry custom Apps development"

EXPERIENCE

• 11 - 12 Years

SKILLS

• Skill Category: BI/Analytics


• Primary Skill: Big Data


• Additional Skill(s): Python