Senior Data Extraction Engineer

Joining Razer will place you on a global mission to revolutionize the way the world games. Razer is a place to do great work, offering you the opportunity to make an impact globally while working across a global team located across 5 continents. Razer is also a great place to work, providing you the unique, gamer-centric #LifeAtRazer experience that will put you in an accelerated growth, both personally and professionally. Job Responsibilities/ 工作职责 : Job Description Responsibilities: - Design, develop, and deploy web scraping solutions to collect specific datasets for AI training purposes. - Build robust and scalable web crawlers to extract structured and unstructured data from various online sources. - Ensure data accuracy, integrity, and compliance with relevant laws and regulations. - Clean, preprocess, and organize scraped data for use in machine learning models. - Monitor and optimize crawling performance to ensure efficiency and reliability. - Collaborate with AI teams to define data requirements and ensure the relevance of collected data. - Document crawling workflows, tools, and results for future reference. Requirements: - Bachelor's or master’s degree in computer science, Software Engineering, or a related field. - Strong experience with web scraping tools and frameworks (e.g., Scrapy, Selenium, BeautifulSoup). - Proficiency in programming languages like Python, Java, or Node.js. - Familiarity with HTTP protocols, HTML parsing, and JSON data formats. - Knowledge of database systems (SQL, NoSQL) for data storage and management. - Experience with cloud platforms (e.g., AWS, GCP) and containerization tools (e.g., Docker). - Strong understanding of web crawling ethics, regulations, and best practices. - Excellent analytical skills and attention to detail. Preferred Qualifications: - Experience with large-scale data scraping and handling distributed crawlers. - Familiarity with AI and machine learning concepts, especially data preprocessing for AI models. - Knowledge of browser automation and tools for rendering dynamic content. - Ability to handle multilingual data and diverse data formats. 岗位职责： - 设计、开发并部署网页爬虫解决方案，收集特定数据用于AI模型训练。 - 构建稳健且可扩展的爬虫，提取结构化与非结构化数据。 - 确保数据的准确性、完整性，并符合相关法律法规。 - 对爬取的数据进行清理、预处理和组织，以便应用于机器学习模型。 - 监控并优化爬虫性能，确保其高效可靠运行。 - 与AI团队合作，明确数据需求，确保采集数据的相关性和价值。 - 记录爬虫工作流、工具和结果，以便未来参考和改进。 岗位要求： - 计算机科学、软件工程或相关领域的学士或硕士学位。 - 熟练掌握网页爬取工具与框架（如Scrapy、Selenium、BeautifulSoup）。 - 熟悉Python、Java或Node.js等编程语言。 - 熟悉HTTP协议、HTML解析和JSON数据格式。 - 了解数据库系统（SQL、NoSQL）用于数据存储与管理。 - 有云平台（如AWS、GCP）及容器化工具（如Docker）使用经验。 - 深刻理解爬虫的伦理、法规及最佳实践。 - 具备优秀的分析能力与细节关注度。 优先条件： - 有大规模数据爬取及分布式爬虫经验者优先。 - 熟悉AI与机器学习概念，尤其是AI模型的数据预处理者优先。 - 了解浏览器自动化及动态内容渲染工具者优先。 - 能处理多语言数据及多样化数据格式者优先。 Pre-Requisites/ 任职要求 : Are you game?