Job Description
Key Responsibilities
- Design and develop scalable, high-performance data processing systems using Hadoop, Flink, Doris, and data lake-related technologies
- Develop and maintain data pipelines for data collection, processing, and analysis
- Design and implement efficient data models to support data storage and retrieval
- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications
- Troubleshoot and resolve issues related to data processing and data quality
- Stay updated with the latest big data technologies and industry trends
Job Requirements
- Bachelor's degree or higher in Computer Science, Information Technology, or a related field
- Minimum of 3 years of experience in big data development and data processing
- Proficiency in Hadoop, Flink, Kafka, Doris, Iceberg, Redshift, and other big data technologies
- Experience in data modeling and database design
- Strong knowledge of data security and compliance, with excellent problem-solving skills
- Good communication skills and a team-oriented mindset
- Experience in data lake construction and maintenance is preferred