Job Description
The position is for a Data Engineering Intern responsible for developing and maintaining automated data collection systems. The intern will work on gathering historical trading data from centralized exchanges (CEX), as well as on-chain trading data, liquidity pool data, and price information from decentralized exchanges (DEX). Additionally, the role involves collecting trading data, odds fluctuations, and settlement details from prediction market platforms. The intern will also clean, validate, and store collected data to ensure quality and integrity, while maintaining proper documentation and data dictionaries.
Key Responsibilities
- Develop and maintain automated data collection systems
- Scrape historical trading data from centralized exchanges (CEX)
- Collect on-chain trading data, liquidity pool data, and price information from decentralized exchanges (DEX)
- Gather trading data, odds fluctuations, and settlement details from prediction market platforms
- Clean, validate, and store collected data to ensure quality and integrity
- Document data collection processes and maintain data dictionaries
Job Requirements
- Proficiency in Python and experience with common scraping frameworks (e.g., Scrapy, BeautifulSoup) and API integration
- Basic understanding of blockchain technology; familiarity with Ethereum, BSC, or other major public chains is a plus
- Experience with relational/non-relational databases (MySQL, MongoDB, PostgreSQL, etc.)
- Knowledge of blockchain development tools like Web3.py or ethers.js is advantageous
- Understanding of RESTful APIs, WebSocket, and other data interfaces
- Prior experience in cryptocurrency trading or DeFi usage is preferred
- Strong sense of responsibility and ability to solve problems independently
Preferred Qualifications
- Experience in data scraping or web crawling projects
- Familiarity with on-chain data tools like The Graph or Dune Analytics
- Knowledge of prediction market protocols (e.g., Polymarket, Augur)
Benefits
Internship Duration: 6-12 months, with potential for full-time conversion Competitive salary (negotiable) Supportive and stable team environment
