Website Scraping with ChatGPT API (Python and Beautiful Soup 4)

September 15, 2023 6103 Views

Support Silicon Dojo at: https://donorbox.org/etcg
RSVP for Classes at: http://www.silicondojo.com
LinkedIn at: https://www.linkedin.com/in/eli-etherton-a15362211/

00:00 Intro
06:23 Legal Comments on Copyright and Fair Use with AI
11:18 ChatGPT Pricing and Web Scraping
15:10 Getting the ChatGPT API Key
18:00 Why can’t you “just” submit an entire website to ChatGPT
27:36 Using Beautiful Soup 4 to Extract Text from a web page
35:44 Combining Beautiful Soup and ChatGPT API to Summarize a web page
45:00 Using ChatGPT to create tags for a web page
50:20 Final Thoughts

Leave a comment