A Mental Model for C++ Coroutine

https://uvdn7.github.io/cpp-coro/

by uvdn7 • 1 year ago

30 19 1 year ago

uvdn7.github.io

mog_dev• 1 year ago

Interesting article, but you should use a spell checker. Typos are distracting.

uvdn73• 1 year ago

I am not a native speaker and I joke about my typos and grammar mistakes being the evidence that none of my code or post is AI generated. Sorry about the typos. I just fixed all the ones I can find. Hope it's better now.

valorzard3• 1 year ago

i appreciate that you don't use AI. I like real human stuff

valorzard3• 1 year ago

Note that with std::execution, c++26 will have a default async runtime (similar to how C# has a default async runtime).

This means that c++26 is getting a default coroutine task type [1] AND a default executor [2]. You can even spawn the tasks like in Tokio/async Rust. [3]

I’m not totally sure if this is a GOOD idea to add to the c++ standard but oh well.

[1] https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2025/p35...

[2] http://wg21.link/P2079R5

[3] https://www.open-std.org/jtc1/sc22/wg21/docs/papers/2025/p31...

uvdn73• 1 year ago

I’m not totally sure if this is a GOOD idea to add to the c++ standard

What are the downsides? Naively, it seems like a good idea to both provide a coroutine spec (for power users) and a default task type & default executor.

valorzard3• 1 year ago

well, Rust didn't do the same thing for a reason. Rust lets you pick and choose what async runtime to use (even though everyone has decided to use Tokio anyways). This is good because it allows for alternative async runtimes like Embassy (https://embassy.dev/) and it also doesn't freeze the API into something that can't change. It could totally be possible that people find a new style of async that works better than std::execution.

a_t482• 1 year ago

I’m excited to actually getting around to trying coroutines - they should be a good replacement for simple state machines. Rather than an storing an object with a state enum, I can write simple declarative code.

spacechild1• 1 year ago

In my latest personal project I have switched my asio networking code from callback functions to coroutines. It is such a big improvement! Repeated actions can be written as simple loops, error handling is done with exceptions and the code is generally much easier to follow. And here's the icing on the cake: most data can actually stay in local variables, which means I don't have to care about the lifetime!

a_t482• 1 year ago

Yeah, I have in mind handling network messages, mainly. Thinking about it, I have this problem at two layers:

- At the transport layer, I read in a header on a message (which may come in one byte at a time!), get a size for the serialized message, then read N bytes for the message. The simple way to do things is to use a thread per socket, but that results in a lot of wasted memory, depending on how many sockets there are. Instead I use epoll, but now I can't make the simple for loop reading in bytes for the message - I have to have a buffer + allocated size + current size + state enum, wrapped in a struct, then run a switch statement every time I get an epoll event for the socket.

- At half a level higher, there might be multiple messages or other negotiations that need to happen before we can start to stream messages to the owner of the connection. Once again - need to either use a thread or a state enum to keep track of where we are.

Even if you want the enum to be able to report state, you can still set it somewhere for debug purposes.

nickelpro2• 1 year ago

Random switching between "Awaitor" and "awaiter" makes it seem like these are distinct concepts instead that the reader is supposed to understand.

In general this moves way too fast for the density of the grammar it's trying to introduce, lines like:

We have seen Awaitors already - suspend_always is an empty awaiter type that has await_ready returns false always.

But we haven't "seen" suspend_always, it's mentioned in half a sentence in an earlier paragraph, with no further context or examples.

There's a reason Lewis Baker's writings about C++ coroutines are 5000 word monsters, the body of grammar which needs to be covered demands that level of careful and precise definition and exploration.

michaelg7x• 1 year ago

Amen. Even with those 5k word monsters it's brutally hard. Andreas Fertig's cpp-insights is really helpful, when is able to complete the coroutine transform.

FWIW, I think a useful addition would be for compilers to output the intermediate source code, so you can reason more easily about behaviour and debug into readable code.

JonChesterfield2• 1 year ago

That's pretty damning too though.

A stackful coroutine is "write the live registers to your stack, swap the stack pointer to a suspended coroutine, load the old live registers from your new stack". It's a short and boring sequence of assembly.

A C++ coroutine is a CFG transform with a bunch of logic around heap allocation elision to construct something less capable than the above, with a bunch of keywords and semantics that you can kind of derive from the work the compiler needs to do to wire things together.

nickelpro2• 1 year ago

If you want fibers there are ample mechanisms already available to implement them, they don't really benefit from specialized language machinery

gpderetta3• 1 year ago

I recently decided that it was time to properly learn C++ coroutines. I looked at a few tutorials, but by far the best was Raymond Chen coroutine series[1]. It is a long series, but every article is just the right size. Strongly recommended.

[1] https://devblogs.microsoft.com/oldnewthing/20210504-01/?p=10...

A Mental Model for C++ Coroutine

Related Stories