SmartNews is a leading mobile app of news aggregation services. It analyzes millions of articles to deliver most engaging information with high quality in near-real time fashion to millions of users around the world. The data platform team plays a key role of accelerating the products/business developments by building a highly efficient and flexible data platform for analytical, operational and machine learning purposes. The team mission is to create high-level, easy-to-use data services for simplifying access, integration and consolidation of various data sets, and also to build efficient platforms for executing data pipelines of massive scales of TB per day..
Responsibilities - Design and build highly efficient, scalable and secured data platforms as the foundation that can power data driven applications in the domains of data-analytics and AI across the company
- Design and build consolidated and integrated high-level data services to help application-developers and data scientists to leverage data for innovations and decision making
- Drive architectural decisions and implementation of Data Platform team
- Lead cross team/cross functional discussions and drive alignment on technology strategy
- Able to effectively resolve conflict while navigating complex decisions
- Define the bar for data quality and processing efficiency of data platform/services while balancing business impact, operational overhead and cost benefits of design and architectural choices
- Lead by example to build a culture of engineering excellence and innovation
Requirements
Minimum Qualifications
- Over 4 years of experience in highly scalable backend development with 2 years of relevant experiences in data platform/services
- Able to distill complex problems and drive toward creative solutions. Able to have deep end-to-end understanding of sophisticated distributed systems/data pipelines and can proactively detect problems and make/implement improvement suggestions
- Can solve challenging engineering problems systematically across different services/platforms
- Capable of designing high quality frameworks/toolings to reduce redundancy and ineffectiveness across components/services
- Able to demonstrate strong leadership and set as an example at team level for engineering excellence
- Able to thrive in a dynamic environment where goals and requirements may be changing
- Strong coding skills in Java, C++ or Python
- Experience with open source data platforms including Hive/Flink/Spark, etc
- Experience with highly scalable data platform/service (gt;TB/day level)
Preferred Qualifications
- Experience with open source data platforms including Hive/Flink/Spark, etc
- Experience with highly scalable data platform/service (gt;TB/day level)
- Experience with building data lineage/data discovery engine
- Experience in building data warehouse ETL
- Experience in building data modeling in data warehouse