Web scraper

Web scraper

Multi Recruit
20 - 22 Years
2000000 - 2200000 INR

Job Description

Job Responsibilities:

  • As a Lead Web Scraper, your role is to understand requirement and apply your knowledge set to fetch data from multiple online sources.
  • Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store.
  • Basis the nature of data and the business logic, define appropriate NoSQL datastores and the underlying data model.
  • Develop frameworks for automating and maintaining constant flow of data from multiple sources
  • Work independently to research and test innovative solutions

  • Skills and Qualifications:

  • Strong coding experience in Python (knowledge of java script is a plus)
  • Experience with NoSQL databases like MongoDB etc.
  • Experience with multi-processing, multi-threading and AWS/Azure
  • Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web-harvest, Scrapy and others.

One of the most comprehensive digital due diligence platforms to enable screening of counter parties through 700+ credible publicly available government information sources through a singular gateway.

About Recruiter




Active jobs

Functions : IT

Industries : IT/Computers - Software

Skills/Roles I hire for: Java, UI Developers, Php, Full stack etc

level Hiring For: High Level

Career Advice to Find Better