Data Scraping Engineer

Job Description
• Design, develop, and operate data scraping systems targeting financial and other websites for data collection and analysis purposes
• Build accurate and efficient scraping tools tailored to meet the needs of our company and clients
• Analyze complex site structures, including dynamic content, to achieve efficient data extraction
• Utilize relevant APIs and implement custom data pipelines for optimal data collection
• Ensure the quality and reliability of collected data
• Independently tackle challenges and execute all tasks, including programming and development, from start to finish

Qualifications
• Experience: 5+ years of hands-on experience in data scraping and web data extraction, including projects involving financial sites

• Technical Skills:
◦ Proficiency in scraping technologies using languages such as Python, Node.js, or Ruby
◦ Deep knowledge of scraping frameworks like BeautifulSoup, Scrapy, and Selenium
◦ Experience with web proxies and CAPTCHA bypass methods
◦ Strong understanding of JavaScript, HTML, and CSS (including handling dynamic content)
◦ Knowledge of API analysis and implementation (REST API, GraphQL, etc.)
◦ Experience with monitoring and logging tools

• Data Analysis Skills: Understanding of data analysis and processing, with knowledge of databases and ETL processes preferred
• Legal Knowledge: Understanding of legal regulations and compliance related to web scraping and data collection
• Security Knowledge: Familiarity with security considerations and risk management for scraping and reverse engineering
• Problem-Solving Skills: Ability to independently solve problems and complete all development and operational tasks

Work Setup
• Hybrid 

Employment Conditions
• Salary: Based on previous salary, adjusted according to skills and experience

Start Date: As soon as possible