Skip to content Skip to sidebar Skip to footer
Home / Javascript / Php

How To Get The Link To All The Pages Of A Website For Data Scraping

Post a Comment
I have been working on a program that scrapes data from a particular page of a website using regular expression in PHP.

Solution 1: 

import bs4
for link in bs4.BeautifulSoup(urllib2.urlopen(target_url).read()).find_all("a"):
    print link

Post a Comment for "How To Get The Link To All The Pages Of A Website For Data Scraping"