WebScraping on Micropython

All ESP8266 boards running MicroPython.
Official boards are the Adafruit Huzzah and Feather boards.
Target audience: MicroPython users with an ESP8266 board.
Post Reply
blckpstv
Posts: 28
Joined: Thu Dec 15, 2016 9:11 pm
Location: Belgium

WebScraping on Micropython

Post by blckpstv » Thu Jan 19, 2017 6:38 pm

Anybody heard from a webscraping micropython wrapper?
Or would this be to heavy on the Wemos D1 Mini (Pro) (ESP8266) boards?

Beginning to extremely like the micropython platform :)

User avatar
deshipu
Posts: 1388
Joined: Thu May 28, 2015 5:54 pm

Re: WebScraping on Micropython

Post by deshipu » Fri Jan 20, 2017 9:05 am

Parsing HTML (especially not-quite correct HTML that you can find on websites) can be a very memory hungry task, and as such probably much better done on a device with much more memory, like a Raspberry Pi Zero. Of course, given enough time and budget everything is possible, and I'm sure you could handle this using streaming SOX parsers and other tricks -- but I doubt it would be very useful and efficient. The microcontrollers are really great, but sometimes it's just better to use a normal computer for certain tasks.

Post Reply