Web Scraping Using Python
Web Scraping Using Python – Learn to extract web information with Python
This video covers numerous methods for extracting information from web pages using Python. There are 12 videos in this series:
About the Course. This first video in the series is an introductory video and discusses topics that will be covered in this course.
About Web Scraping. This second video in the series lays the foundation for web scraping by defining it, and differentiating it with other terms such as web crawling and internet bots. It also discusses the website’s terms of use, as well as robots.txt files – in order to scratch the web legally and ethically.
Web Page Structure. This third video in the series explains the layout of HTML pages. It starts with learning more about websites’ ownership details and the technology stack. It talks about the Document Object Model, the parent and child elements of the HTML, and the CSS classes. The video also covers the use of XPaths and CSS Selectors, to find the elements in an HTML file.
About Beautiful Soup. This fourth video in the series discusses two major Python libraries for web scraping – Requests and Beautiful Soup. The video provides a detailed understanding of the fetching of HTML pages using the above-mentioned libraries, and then cleaning and slicing them to scrape the data. The video also discusses the installation of Python as well as the Anaconda Notebook.
Scraping Blog Posts. This fifth video in the series shows how to scrape blog posts and product review sites. It covers scraping data from a list of posts, analyzing it as a table, and then exporting it as a CSV file. The video also discusses the use of regular expression in web scraping, and introduces several Python libraries such as Pandas, CSV, and RE.
Scraping Ecommerce Sites. This sixth video in the series shows how to scrape a web page of an ecommerce website. The code reads all of the products on a webpage, extracts the relevant information, and then exports it to a CSV file.
Recursive Web Scraping. This seventh video in the series covers the recursive web scraping, where we have to scrape several pages of a website. It discusses the use of Time and Random Libraries, to time the web scraping. The video further talks about using a while loop to scrape websites, where we do not know the number of pages to scrape.
Web Scraping with Selenium. This eighth video in the series focuses on automating the browser-controlled web scrapping, using the web browser automation tool, Selenium. The video talks about controlling web browser behavior, filling forms, and extracting data using Selenium.
Scraping XML Files. This ninth video in the series covers reading and scraping content from XML files. The video talks about how to scrape sitemaps, as well as other XML files, run queries on the same, and export their data.
Scraping Map Data. This tenth video in the series covers reading data from a map, exported as an XML file. The video talks about reading the map data, and then exploring it further to extract and analyze various amenities in the area.
Scraping Data through APIs. This eleventh video in the series covers fetching data through APIs. The video discusses two different APIs to fetch data and analyze data. It also covers scraping and analyzing data using RSS feeds.
Fetching Emails via Python. This twelfth video in the series covers fetching email from Gmail using Python. The video discusses using the Google’s Gmail API to access the inbox, receive message details, and read the messages. It also covers modifying messages from unread to read by changing their label Ids.
Screenshot Tutorials/Courses
https://drive.google.com/open?id=1xtDKRb80RUNXJ5mzO23Qp6Rnw4JW5cg0
https://mshare.io/file/O0Ugrxw
https://freeshadow-my.sharepoint.com/:u:/g/personal/hoquangdai_abcda_tech/EYJ8q4LamVJBuqWU4hLJe4QB4KAyKkrw-CyNquzb6H34Qg
