Data Scraping Engineer

Pasay, National Capital Region

Posted 8 days ago

Company:: John Clements Recruitment Inc.
Company Description:: John Clements Consultants, the pioneer in Executive Search since 1974, has played a significant role in transforming thousands of Filipino and other Southeast Asian professionals into extraordinary leaders. Forty-seven years later, John Clements continues to offer superior services that included recruitment (from non-managerial to C-level positions), large scale staffing, RPO, outsourced staffing, overseas recruitment, leadership development training with digital learning platforms, 360-degree assessment and coaching all specially designed for our partners’ needs. Keeping ahead of the game in digitalization, we also invested in AI and Data Science. Working with CrossKnowledge, a global leader in digital learning solutions, and Zenger Folkman, enables John Clements to offer world-class talent development programs that elevate the leadership capabilities of professionals, transforming them into extraordinary leaders of change. Our “deep purpose” as a company is to build our country, uplift the lives of Filipinos, and develop successful leaders.
Contract Type:: Full Time
Experience Required:: 2 years
Education Level:: Bachelor’s Degree
Number of vacancies:: 1

Job Description

Job Description
• Design, develop, and operate data scraping systems targeting financial and other websites for data collection and analysis purposes
• Build accurate and efficient scraping tools tailored to meet the needs of our company and clients
• Analyze complex site structures, including dynamic content, to achieve efficient data extraction
• Utilize relevant APIs and implement custom data pipelines for optimal data collection
• Ensure the quality and reliability of collected data
• Independently tackle challenges and execute all tasks, including programming and development, from start to finish

Qualifications
• Experience: 5+ years of hands-on experience in data scraping and web data extraction, including projects involving financial sites

• Technical Skills:
◦ Proficiency in scraping technologies using languages such as Python, Node.js, or Ruby
◦ Deep knowledge of scraping frameworks like BeautifulSoup, Scrapy, and Selenium
◦ Experience with web proxies and CAPTCHA bypass methods
◦ Strong understanding of JavaScript, HTML, and CSS (including handling dynamic content)
◦ Knowledge of API analysis and implementation (REST API, GraphQL, etc.)
◦ Experience with monitoring and logging tools

• Data Analysis Skills: Understanding of data analysis and processing, with knowledge of databases and ETL processes preferred
• Legal Knowledge: Understanding of legal regulations and compliance related to web scraping and data collection
• Security Knowledge: Familiarity with security considerations and risk management for scraping and reverse engineering
• Problem-Solving Skills: Ability to independently solve problems and complete all development and operational tasks

Work Setup
• Hybrid

Employment Conditions
• Salary: Based on previous salary, adjusted according to skills and experience

Start Date: As soon as possible