Job Responsibilities
- Design, develop and enhance the Marcus Data Platform
- Develop data flows and pipelines in python and spark to support business needs
- Create data tools for analytics and data scientist team members that can assist them in building and optimizing our product into an innovative industry leader
- Work with data and analytics experts to strive for greater functionality in our data systems
- Conduct POC to help define the components for the Big Data platform
Qualifications for Data Engineer
- 3+ years academic or industry experience
- Strong data warehousing concepts, especially in the ETL space
- Experience with any one ETL tool
- Strong in data structures and algorithms
- Programming experience in either python or java.
- Advanced SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets