Web-Scraping (with BeautifulSoup4?) on ESP32

All ESP32 boards running MicroPython.
Target audience: MicroPython users with an ESP32 board.
Post Reply
Posts: 1
Joined: Sun Nov 03, 2019 6:34 pm

Web-Scraping (with BeautifulSoup4?) on ESP32

Post by jcambefort » Sun Nov 03, 2019 6:40 pm


I would like to be able to web scrape from my esp32 huzzah featherboard. I've just installed mycropython onto the board. My idea is to install a web-scraping library like BS4, but my guess is it will be too large for the board / take up too much space. Any ideas on how I could achieve this? Perhaps there's a lite version of BS4? Are there alternative ways I could get some data (such as the time, local weather, etc.) from the internet?

I'm new to the embedded systems in general / the ESP32 board, just trynna have fun with the board. Thanks for the help.

Posts: 82
Joined: Sat Oct 27, 2018 5:17 pm

Re: Web-Scraping (with BeautifulSoup4?) on ESP32

Post by rpr » Sun Nov 03, 2019 7:30 pm

Not sure about bs4 but a quick Google search shows that there are available APIs for weather data, for example, openweathermap Haven't used them but using requests module they should return json that should be figurable with the micropython json module.

Post Reply