Description
We are looking for a skilled and motivated AI and Data Crawling Programmer with 1–2 years of hands-on experience in building data-driven solutions. The ideal candidate will have practical exposure to AI/ML concepts, data crawling, and web scraping, with the ability to design efficient crawlers and contribute to AI model development. Prior experience in website development or data integration will be a strong advantage.
Key Responsibilities:
Design, develop, and maintain scalable web crawlers and scraping tools.
Collect, clean, and preprocess large datasets to support AI/ML pipelines.
Work with data scientists and engineers to integrate crawled data into AI models.
Research and implement techniques to improve data accuracy, efficiency, and automation.
Monitor and troubleshoot crawling processes, ensuring robust data extraction from complex websites.
Document processes, maintain code quality, and contribute to knowledge sharing across the team.
Required Skills & Qualifications:
Bachelor’s degree in AI, IT, Computer Science, or a related field.
1–2 years of professional experience in web scraping, data crawling, or related roles.
Proficiency in Python with experience in libraries such as BeautifulSoup, Scrapy, Pandas, NumPy.
Strong understanding of web technologies (HTML, CSS, JavaScript) and site structures.
Hands-on experience working with RESTful APIs, JSON, and XML.
Good problem-solving, analytical, and debugging skills.
Strong communication skills and ability to work in a collaborative environment.
Preferred Qualifications:
Prior experience in website development or front-end/back-end integration.
Exposure to AI/ML frameworks (TensorFlow, PyTorch, Scikit-learn).
Familiarity with cloud platforms (AWS, GCP, Azure) or data storage solutions.
Ability to optimize crawlers for scalability and performance.
Similer jobs
