Job Description
The Data Platform Development Engineer will be responsible for designing, developing, and maintaining the company's internal big data platform. This role involves working on various components such as data synchronization, data lineage calculation, cost optimization, computational logic workflows, and data access control. The engineer will collaborate with cross-functional teams to integrate common business requirements into the platform, transforming them into scalable solutions. Additionally, the role requires participation in the full product development lifecycle, from requirement gathering to system deployment and maintenance.
Key Responsibilities
- Develop and enhance the company's big data platform, including data synchronization components, lineage tracking, cost optimization, and access control systems.
- Identify and consolidate common business needs, translating them into unified platform capabilities.
- Collaborate with frontend/backend engineers and product managers throughout the entire development process (requirement analysis, PRD review, technical design, implementation, testing, and deployment).
- Conduct secondary development of open-source systems or integrate cloud-based solutions (e.g., AWS, Alibaba Cloud) with internal platforms to support business needs.
- Address systemic platform issues to create reusable solutions benefiting multiple business units.
- Leverage AI tools to enhance development efficiency and integrate AI capabilities into big data workflows.
Job Requirements
- Bachelor's degree or higher in Computer Science, Statistics, Mathematics, or related fields, with 3+ years of data-related work experience.
- Proven experience in large-scale system development, multi-tenant architectures, and PB-level big data processing.
- Deep understanding of cloud services (e.g., Alibaba DataWorks, AWS, Flink) and open-source ecosystems (Spark, Flink, data lakes, Kafka, KV stores).
- Ability to customize open-source components and integrate them with internal systems to meet business demands.
- Strong product sense with knowledge of big data workflows and platform product development.
- Experience in both startups and established companies is preferred, with adaptability to multi-role responsibilities and proactive communication skills.
- Proficiency in Python and familiarity with BI tools (Tableau, Power BI) is a plus.
- Candidates with AI implementation experience in big data scenarios will be prioritized.
Benefits
Please contact our HR team via Telegram for details. Thank you!
