Professional Web Scraping with Java

We start with an overview of what web scraping is and what you can do with it.

Then we explain the difference in scraping static pages vs. dynamic / AJAX pages. You learn how to classify a website in one of the two categories and then apply the right concept to scrape the data you want.

Now you will learn how to export scraped data either as CSV or JSON. These are some popular formats that can be used for further processing.

Unfortunately, many websites try to block scrapers or sometimes you just do not want to be detected. In the section going undercover you will learn how to stay undetected and avoid getting blocked.

At the end of the course, you can download the full source code of all the lectures, and we discuss the Outlook to some advanced topics (private proxies, cloud deployment, multi threading …). These advanced topics are covered in a follow up course I’m going to teach.