masterscraper/scrape_all.py

#!/usr/bin/python3


import masterscraper as ms


scrapelist = ms.macrotrends.scrapelist()
for url in scrapelist:
    scrape = ms.scrape(url)
    scrape.get_meta()
    scrape.clean()
    scrape.save()
Initial commit 2023-03-05 04:56:10 +01:00			`#!/usr/bin/python3`


			`import masterscraper as ms`


Added macrotrend scraping 2023-03-05 08:33:51 +01:00			`scrapelist = ms.macrotrends.scrapelist()`
Initial commit 2023-03-05 04:56:10 +01:00			`for url in scrapelist:`
			`scrape = ms.scrape(url)`
			`scrape.get_meta()`
			`scrape.clean()`
			`scrape.save()`