Data Engineer at Yuga Labs

Job Description

Key Responsibilities

• Develop robust database architectures and data storage solutions for handling large-scale datasets (millions of records) encompassing diverse data types such as text, images, videos, and structured data. This involves designing scalable, secure, and efficient data retrieval mechanisms to ensure seamless access for analytical and operational purposes.
• Oversee the entire data lifecycle, ensuring data quality, integrity, and consistency across all stages. This includes establishing and maintaining clean, sustainable data pipelines that deliver actionable insights critical to the product's growth and development.
• Manage and scale data processing tools and technologies on our cloud infrastructure (AWS and GCP), ensuring optimal performance, cost efficiency, and reliability. This includes monitoring system health, implementing automation, and optimizing resource allocation to support high-availability and scalability.
• Collaborate with cross-functional teams including game developers, web engineers, DevOps specialists, and service engineers to design, develop, and instrument telemetry libraries and frameworks. This involves integrating data collection mechanisms into existing systems and ensuring real-time data monitoring capabilities.
• Provide code reviews for team members to maintain code quality and consistency across projects. This includes identifying technical risks, suggesting improvements, and ensuring adherence to best practices in data engineering and software development.
• Mentor and provide technical guidance to junior engineers, fostering a culture of knowledge sharing and professional growth. This includes conducting training sessions, reviewing junior team members' work, and supporting their development in complex data systems.

Job Requirements

• Proven experience in designing data models for blockchain, cross-game analytics, and AI applications with a focus on scalability and performance optimization.
• Expertise in database management systems (e.g., SQL, NoSQL) and data storage technologies for handling large datasets (millions of records) across text, image, video, and structured data formats.
• Strong proficiency in cloud platforms (AWS and GCP) for deploying, managing, and scaling data infrastructure solutions that ensure reliability and cost efficiency.
• Ability to collaborate with game, web, DevOps, and service engineering teams to develop telemetry systems, requiring excellent communication and cross-functional project management skills.
• Experience with machine learning and AI frameworks for analyzing data patterns and building predictive models to support product innovation and decision-making.
• Excellent problem-solving skills with a focus on data pipeline optimization, system scalability, and ensuring data quality across all stages of development.
• Strong leadership and mentorship abilities to guide junior engineers in complex data systems, with a track record of fostering team growth and knowledge sharing.