Job Description
We are seeking an experienced Big Data Development Engineer to join our team. The ideal candidate should have a solid background in data processing, data warehousing, and data modeling. This position will be responsible for designing and developing scalable, high-performance data processing systems while implementing data security and compliance measures.
Key Responsibilities
- Design and develop scalable, high-performance data processing systems using Hadoop, Flink, Doris, and data lake-related technologies
- Develop and maintain data pipelines for data collection, processing, and analysis
- Design and implement efficient data models to support data storage and retrieval
- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications
- Troubleshoot and resolve issues related to data processing and data quality
- Stay updated with the latest big data technologies and industry trends
Job Requirements
- Bachelor's degree or higher in Computer Science, Information Technology, or a related field
- Minimum of 3 years of experience in big data development and data processing
- Proficiency in Hadoop, Flink, Kafka, Doris, Iceberg, Redshift, and other big data technologies
- Experience in data modeling and database design
- Strong knowledge of data security and compliance, with excellent problem-solving skills
- Good communication skills and a team-oriented mindset
- Experience in data lake construction and maintenance is preferred
Benefits
Paid leave, performance bonuses