Freelance AI & Web Scraping Developer

This is a remote position. Solstice Analytics is hiring a Web Crawling & AI Lead Qualification Engineer to develop a smart tool that identifies and evaluates potential business leads. In this role, you will build a web crawling and AI-powered lead qualification application that takes a list of company websites, extracts relevant content, and uses AI to determine whether those companies are strong marketing targets for specific industry sectors (such as utilities or telecom). The final deliverable should be a clean, maintainable, and handover-ready product that the end client can easily operate and expand. Key Responsibilities Develop a web crawling and scraping system to collect relevant data from a list of websites. Extract and process meaningful content from crawled pages. Integrate AI/LLM capabilities to analyze website content and evaluate whether the company fits a target industry vertical. Design a scoring or ranking mechanism that qualifies and prioritizes leads. Produce a structured output containing qualified leads with clear reasoning or scoring. Deliver a standalone, well-structured application ready for handover to the client. Requirements Technical Requirements Experience with web scraping and crawling tools such as BeautifulSoup, Scrapy, Playwright, Puppeteer, or similar frameworks. Strong knowledge of content extraction and text analysis . Hands-on experience integrating AI / LLM APIs (e.g., OpenAI, Anthropic, or open-source models). Ability to design and build clean, maintainable software products , not just quick prototypes. Familiarity with modern development stacks and best practices. Nice to Have Experience in lead generation, marketing technology, or sales intelligence tools . Knowledge of prompt engineering , particularly for multilingual or non-English content. Experience building end-to-end AI-powered tools or automation solutions . German language skills are a plus but not required (language support will be provided by the client). Benefits Flexible working hours to support a healthy work-life balance. Remote-friendly work environment . Collaborative and supportive team culture . Originally posted on Himalayas