Tuesday, July 10, 2018

I will do web crawling, web scraping, data gathering, web bots

I will do web crawling, web scraping, data gathering, web bots












About:

I will crawl and extract data from any site. Data would be collected in the desired format. I will ensure that data is clean and there is least/no garbage in the data. Data will be stored in required format i.e excel, word, pdf or MySql db.

1. Web Crawling - Will go through the whole web site to crawl data.
2. Web Scrapping - Will open the required pages through custom requests(to save network over head) and will use strong libraries and regular expressions to get data.
3. Web automation - Will write bot scripts to automate your daily repetitive tasks. 
4. Complete database design - To store crawled data (MySql). Fully customized schema will be implemented according to structure of data.
5. Export of MySql can be provided which you can just execute.
6. HTA'a for premium buyers to control the crawlers through graphical user interface.

Reviews


:

:

:

:

:


No comments:

Post a Comment