Send me more jobs like this

Lead Web Scraper

Keywords / Skills : Lead Web Scraper, Web Scraper, Data Processing, NoSQL, Data Storage, Python, Multithreading, AWS, AZURE

3 - 6 years
Posted: 2019-05-16

Industry
Consulting/Advisory Services
Function
IT
Role
Other Software/Hardware/EDP
Posted On
16th May 2019
Job Description
Lead Web Scraper

Experience Required: 3 - 6 years

Employment Type: Full Time

CTC Offered: 10 LPA –20 LPA

Location: Mumbai

Job Responsibilities:

• As a Lead Web Scraper, your role is to understand requirement and apply your knowledge set to fetch data from multiple online sources.

• Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store.

• Basis the nature of data and the business logic, define appropriate NoSQL datastores and the underlying data model.

• Develop frameworks for automating and maintaining constant flow of data from multiple sources

• Work independently to research and test innovative solutions


Skills and Qualifications:

• Strong coding experience in Python (knowledge of java script is a plus)

• Experience with NoSQL databases like MongoDB etc.

• Experience with multi-processing, multi-threading and AWS/Azure

• Strong knowledge of scraping frameworks such as Python (Request, Beautiful Soup), Web-harvest, Scrapy and others.



About Company

Crossword Placement
Similar Jobs
View All Similar Jobs
Walkin for you