Hmm I think I have already tried that, which returned "None". Response method raise_for_status() checks response status to make sure it is 200 code and not an error response. "//div[@class='quote']//span[@class='text']//text()", "//div[@class='quote']//small[text()='Albert Einstein']/../../span[@class='text']//text()", './/div[@class="tags"]//a[@class="tag"]//text()', How to put scraped website data into Google Sheets, Scrape Amazon products' price with no code, Extract job listings, details and salaries, A guide to Web Scraping without getting blocked. After executing the program you can also check your Python script directory and look for the newly created The Selector class allows you to extract data from HTML or XML documents using CSS and XPath by taking a required argument called text.After creating the selector object, the HTML document is parsed in such a way that then you can query it using the CSS and . anchor (a), paragraph (p), header tags (h1, h2, h3, etc.) Step 2 Create a Map () object using the Map constructor. Lean how to scrape the web with Selenium and Python with this step by step tutorial.