Microdot: A Web Framework for Microcontrollers

by jandeboevrie • 2 years ago

55 44 2 years ago

synergy202• 2 years ago

Micropython is using python 3.4 and it does take more storage space than compiled language when you pull in its modules etc.

I would think Lua or even C based web framework for MCU and restricted embedded boards will be a lot more resource efficient.

Typically you can just run a few cgi scripts with bootstrap as the UI and jquery as the javascript, but a simple MVC will be really cool.

kaycebasques3• 2 years ago

So the entire Microdot web framework is also intended to run on-device? I didn't grok that on my first readthrough

synergy202• 2 years ago

I think so, otherwise what's the point to call it Microdot.

kaycebasques3• 2 years ago

Looks great. Not sure how apples-to-apples this comparison is [1] but my team has a similar product, pw_web, a Node.js lib that lets you communicate with embedded devices over RPC: https://pigweed.dev/pw_web/

I'm curious to hear what other similar products are out there that others are using?

Edit: Sounds like Microdot runs the entire web framework completely on-device? My initial understanding was wrong in that case; it's an apples-to-oranges comparison

[1] It seems like Microdot handles more of the stack and is probably more hobbyist-friendly based on the fact that it targets MicroPython. Or maybe it's just better all-around; I haven't tried MicroPython so I can't compare.

thomasqbrady• 2 years ago

Looked in several places, but I can’t figure out exactly what sort of microcontroller they aim to support… are we talking ATmega? ESP32? ARM Cortex M? All of those?

eichin• 2 years ago

Presumably "anything that micropython (or circuitpython) does" which is vast range. https://github.com/miguelgrinberg/microdot/tree/main/src/mic... is just python code...

chrsw• 2 years ago

Interesting. Is there a similar micro- or nano- web framework like this but in C?

voakbasda• 2 years ago

I hate to be that guy, but I've been writing embedded systems using microcontrollers for decades. The movement to put Python on them makes me cringe.

I understand making them more approachable for developers at a higher level, but the resulting solutions need an order of magnitude more resources to accomplish the same tasks when compared to writing an equivalent system in C.

Assuming these kinds of tools are being used temporarily for proof-of-concept, I think that it is a great fit; however, we all know that there's nothing more permanent than a temporary solution.

jstanley• 2 years ago

I'm personally not interested in MicroPython either, but...

the resulting solutions need an order of magnitude more resources to accomplish the same tasks when compared to writing an equivalent system in C.

I mean, yeah... but that's true when you're writing Python code on a normal computer as well. It's not really an argument against writing Python except in cases where you're actually running into resource constraints.

If you can get the resources you need in a microcontroller you can afford, and you prefer programming in Python... why not?

bemusedthrow754• 2 years ago

If you can get the resources you need in a microcontroller you can afford, and you prefer programming in Python... why not?

Particularly when you consider that the "bloat" here has no secondary side-effects: it doesn't waste resources that other software could be using, because no other software is running.

I am a long-time web developer who has always intellectually understood the interest in microcontrollers but never had much of the need. I do now.

I'm not even a fan of Python but MicroPython is a surprisingly productive development experience and I've learned a lot in a very short time with a Pico W.

I will probably use TinyGo at some point in the future, particularly as I try to use smaller devices, and I'm not averse to porting to C, but I really rate the MicroPython ecosystem highly in terms of actual coverage, though mainly just the intent of it, which is unimpeachable IMO.

e63f67dd-065b• 2 years ago

Doesn't this depend highly on whether that resource usage is worth the tradeoff of developer productivity? Python devs are much more plentiful and easier to hire, and if you now need a $1 microcontroller instead of a $0.5, and you're selling 100k units, that's a $50k cost.

It really depends here. The lower the volume, tighter the iteration time, etc the more sense it makes. I know oil rigs, for example, have a bunch of rpis running on them, because the manufacturer is selling a $100k box and any amount of time spent shaving $10 off the BOM is really not worth it at all.

seabird• 2 years ago

You can't just make a firmware developer out of anybody by slapping a more widely used language on a microcontroller, because the language isn't the issue.

"Embedded" development on a highly specced SBC running Linux (like a Raspberry Pi) is a long ways away from what MicroPython is targeting.

the__alchemist• 2 years ago

Do you think using Python make programmers more productive? I find it's the opposite, due to finding bugs one-by-one as they show up at run time.

robomartin2• 2 years ago

As someone with embedded development experience going back to the 1980’s and across more platforms than I can remember, I agree with your perspective.

Still, even so, I decided to give MicroPython a go for a new design; an industrial product we would ship in the tens of thousands of units.

This will count as one of the many choices I will regret making in my business history. I won’t bore you with details. We shipped 250 units. We are busy porting the code to C as fast as humanly possible.

At least I can say we tried. I have coded embedded systems with assembler, Forth, C and C++. Any one of these would be better than Python.

Yes, I use Python extensively for desktop, data science and web work. It simply isn’t a good fit for embedded work.

rowanG077• 2 years ago

I'm curious what made you backpedal after shipping 250 units. I imagine you at least very least made it work at that point.

bityard• 2 years ago

REAL programmers etch the ROM with a laser and an extremely steady hand

daemonologist• 2 years ago

As a non-embedded dev, the tooling for embedded stuff has a problematically steep learning curve. I appreciate that sometimes there's a good reason for that, but it drives people to micropython and similar simply because getting them working is so much less painful.

I had an nrf52(840) microcontroller and it took me hours to get "hello world" out of that thing with nRF Connect/Zephyr. Granted, I had no idea what I was doing, but accomplishing the same with equally-foreign-to-me Circuitpython took five minutes - just plug it in to a USB port and drop the bootloader and then your .py into file explorer. I _want_ to do things "properly" and efficiently, but for a small project I can't justify the time investment to get there and so the -pythons provide a tradeoff I'm willing to make.

pknopf• 2 years ago

Platform.io makes things very approachable.

crote2• 2 years ago

the resulting solutions need an order of magnitude more resources to accomplish the same tasks

Okay, and? It's 2024, even a $2.50 toy devboard had multi-megabit flash & ram. I really don't care if my code takes up 10k or 100k. If Python makes it easier to develop and eliminates entire categories of vulnerabilities in the process, it doesn't make any sense to use bare C instead. I paid for the entire chip, why shouldn't I use the entire chip?

C is fine if you have to do high-speed bitbanging or have to squeeze every last byte out of a chip, but for most applications that's simply not the case anymore. A decent fraction of embedded systems is absolutely trivial on today's hardware. It's time we start treating them like the mini-computers they are, because remaining in a 2000s mindset is going to result in a lot of compromised network-connected devices due to some developer fat-fingering a buffer size.

dmitrygr2• 2 years ago

$2.50 toy devboard had multi-megabit flash & ram

"multi" is "2 or more"

So that's 256KB+ or RAM and 256KB+ of flash. Please send me a link to a $2.50 board with those specs. I could use one at that price point.

conductr• 2 years ago

Isn’t this an extension of what occurred everywhere in tech, programming becoming bloated/inefficient as a trade off for developer UX via frameworks/abstractions/higher level programming languages. It’s all driven by the low cost of hardware performance.

I’m coming at it from opposite direction. I’ve been learning C to program ESP32 devices and it’s such a frustrating experience how much that language is lacking or has to be DIYed. I could easily use python and move 10x faster, but I’m trying to force myself to learn C in the process, otherwise I have no idea what the benefit would be.

nateglims• 2 years ago

There's a pretty direct tradeoff between BOM cost of an ARM microcontroller and ROM/RAM. ESP is a little different with external spi flash, but the tradeoff is mostly there still. So there's a lot of pressure in product development to keep technical costing down by using C/Assembly and choose technologies like UDP vs TCP or CBOR/Binary protocols vs JSON.

rramadass• 2 years ago

I’ve been learning C to program ESP32 devices and it’s such a frustrating experience ... but I’m trying to force myself to learn C in the process, otherwise I have no idea what the benefit would be.

Keep at it; the benefits to learning C/C++ are immense. They have become the underlying "lingua franca" of the software industry allowing you to study/program applications/libraries/system tools/OS kernels/bare-metal MCUs etc.

For lots of C code to study for MCU programming, see the books (some are available for free) by Michael Pont of SafeTTy Systems here - https://www.safetty.net/publications Though they are for 8051 and not for ESP32 you should be able to understand the techniques involved and use them with your choice of MCU family.

dekhn2• 2 years ago

When I use python on my microcontroller, it's really just configuring and driving peripherals like the ESP32 RMT. But I have implemented interrupt handlers that handle microsecond-level timing events in python (closed loop camera/light flash/stepper motors). The only reason this works is modern microcontrollers have tons of CPU and memory.

I had a python-based game of life that drove a 16x16 LED panel but the frame rate wasn't very good so I rewrote it in C++.

bemusedthrow754• 2 years ago

I think the balance will shift here a little, now that the RP2040 has made PIO a rather more mainstream concept. Access to really very high-speed, narrowly-focussed reliable IO timing in the context of an interpreted language seems to me to be a good plan.

I gather other microcontrollers have had programmable I/O state machine cores in the past but I'd expect to see a lot more of them (or more documentation and coverage of the ones that exist)

Liftyee2• 2 years ago

I agree. Sadly, it seems like C/C++ isn't popular for teaching the next generation to program microcontrollers (from my limited perspective, at least).

At high school I was taught Arduino and C++ but younger students have rPi Pico's and CircuitPython (Adafruit version of MicroPython), to use the same language as the CS syllabus. I guess the "easy" features of Python (many traps once programs get complex) make it attractive as a first programming language.

One project I've worked on for 3 years with a C++ codebase is going to be passed on to mostly Python programmers... I'll just have to make sure the hardware documentation is good.

miki1232112• 2 years ago

Why are people teaching kids to program on tiny microcontrollers instead of the beefy laptops they already have?

Very few people are doing microcontroller programming these days, and so beginner-friendly microcontroller resources are far less plentiful than those for mainstream languages. Just teach kids Python on a normal laptop (or in the cloud if you're in the US and give them Chromebooks).

I guess the ability to interact with the physical world (with servos and such) might make the subject more attractive to some, but I'm sure there are ways to plug those into a real computer, or at least a Pi.

iknowstuff• 2 years ago

https://lib.rs/crates/picoserve

This should make you happy :)

dragontamer2• 2 years ago

As opposed to the movement to put interpreted BASIC into PIC or Intel 8052 microcontrollers?

1980s embedded engineers please stand up.

-------

But BasicStamp was a thing even decades ago (but after 1980s). There are plenty of advantages to interpreted languages, and they were a bigger deal back when 8052 or whatever we're EPROM and harder to program. I mean, physically harder, with UV to erase the flash.

Having a portion of the code execute out of dataspace thanks to an embedded interpreter was worthwhile, even with all the extra CPU cycles and RAM wasted.

I see Micropython as just an extension of that. Python displaced BASIC a long time ago for good reasons.

miki1232112• 2 years ago

Basic can fit into a few kbytes of ROM on an 8-bit CPU, Python definitely cannot.

Even lua needs ~100K IIRC, and that's more than the entire address space (including RAM, ROM and IO) of a 6502.

cdaringe• 2 years ago

I feel like all sane people are with you here mate. Its insane.

Been using esp32-rs recently (esp32 is an admittedly beefy platform/soc) and its been real pleasant.

bemusedthrow754• 2 years ago

Quick honourable mention for Pimoroni's similar tiny framework, phew:

https://github.com/pimoroni/phew

and this rather clever start-as-access-point-to-join-network scheme implemented on it:

https://github.com/simonprickett/phewap

which works a treat!

dang• 2 years ago

Microdot: A web framework for microcontrollers - https://news.ycombinator.com/item?id=39111276 - Jan 2024 (1 comment)

Microdot: Yet another Python web framework - https://news.ycombinator.com/item?id=38834156 - Jan 2024 (26 comments)

Microdot - https://news.ycombinator.com/item?id=38156060 - Nov 2023 (26 comments)

Microdot: A Web Framework for Microcontrollers

Related Stories