FreeBSD Scheduling on Hybrid CPUs

https://wiki.freebsd.org/Scheduler/Hybrid

by fntlnz • 12 months ago

119 33 12 months ago

wiki.freebsd.org

themafia• 11 months ago

Apart from some models of Alder Lake, it is now impossible to buy an Intel chip that does not have at least P (Performance) and E (Efficiency) cores.

Really? I just bought one:

https://www.intel.com/content/www/us/en/products/sku/236786/...

pixl97• 11 months ago

How about change that to "Anything with more than 6 cores". Anything with 4 cores only has one speed of core. At 6 cores it more of a mixed bag, some have all the same cores, some have a split of performance and efficient cores. Anything over an i5 will have E cores.

swills• 11 months ago

Hmm, I think Granite Rapids is all P-Cores and goes up to 86 cores (172 threads):

https://en.wikipedia.org/wiki/Granite_Rapids

dehrmann2• 11 months ago

There are also Xeons, but it limits an OS to use in data centers.

dijit• 11 months ago

There are workstation Xeons. Though it seems that mobile Xeons are defunct now.

wtallis3• 11 months ago

Apart from some models of Alder Lake

That bit actually still applies. Intel may have branded the 14100F as Raptor Lake, but it is almost certainly Alder Lake silicon, just a higher speed bin of the 12100F.

See https://www.intel.com/content/www/us/en/products/compare.htm... and note how none of them get the higher DRAM frequency support or larger L2 caches characteristic of Raptor Lake silicon.

ethan_smith• 11 months ago

The i3-14100F is just one example - Intel still sells numerous non-hybrid models across their lineup including most i3s, Pentiums, Celerons, and many server/workstation Xeons. The documentation's claim about availability is overstated.

dehrmann2• 11 months ago

The high-level pitch of P cores and E cores seems so elegant, but when it actually comes to scheduling, it gets messy fast. Even in a laptop running off a battery, you can't simply switch to E cores because some short-lived work might be latency-sensitive. You also can't assume long-running work should be on an E core because maybe you're anxious to get that video encoded. Even for lots of small work, different core can have different performance characteristics, and a P core might be more efficient for certain workloads.

jcelerier2• 11 months ago

As a user with a laptop, the last thing I want is the OS to decide for me. I want to tell it myself "this is sensitive, put all your energy into it because I'm five minutes away from pushing that important work and I have seven minutes of battery left" or "this won't work at all if run at less than 2 GHz" vs "I must drag what I'm doing along for as long as I can, save every bit of battery possible. The computer can't know about these cases.

twoodfin• 11 months ago

FWIW, Apple leaves it up to the app developer to specify a quality-of-service for a particular execution context:

https://developer.apple.com/library/archive/documentation/Pe...

01HNNWZ0MV43FF• 11 months ago

I feel like cases 1, 2, and 3 broadly fit into "Battery Saver", "Performance", and "Battery Saver" modes?

bluGill• 11 months ago

The problem is you don't really think about those cases early enough to matter. 7 minutes of battery isn't even a knowable thing - that is current average (though often not calculated that well) and could be 10 minutes if nothing happens (no emails arrive, no web pages rendering in the background, don't touch anything on it....), but if you try to run that 5 minute task in reality you have 2 minutes of CPU using the P cores, or 5 minutes using the E cores - but on the E cores you need 7 minutes. The above times are all made up of course, but they give the idea.

If when the battery is full you make the right decisions your battery can last longer. However this isn't something you can do. You don't want a pop-up when your email program spawns a thread to check for new email - programs do this all the time and the system doesn't know if the thread itself will run for a few ms or for hours. In most cases the battery consumed by the popup will be more than the thread itself uses. You want the system to make the right decisions - but the right decision depends on your system and someone else with a difference CPU may need different decisions.

nine_k2• 11 months ago

Funny enough, Unix already has user-settable priorities, aka "nice level". ACPI gives us an idea how plentiful the power is.

So, when powered by AC power, schedule everything on P cores when possible, schedule processes that eat a lot of CPU on P cores, same for any process with a negative nice value.

When powered by a battery, schedule anything with non-negative nice value on E cores, keep one P core up for real-time tasks, and for nice-below-zero tasks.

These are two extremes, but I suppose that the idea is understandable.

mrheosuper• 11 months ago

when powered by AC power, schedule everything on P cores when possible

Sometime I feel like that is undesirable. It may make system consume more power, thus more heat output and louder.

wtallis3• 11 months ago

So, when powered by AC power, schedule everything on P cores when possible, schedule processes that eat a lot of CPU on P cores, same for any process with a negative nice value.

Even when plugged in, you may have thermal limitations. P cores will chew through your power budget more aggressively than E cores. For latency-sensitive workloads you do want to emphasize the P cores, but when throughput is the goal you'll usually be better off not ignoring the E cores, and not trying to run the P cores at high frequency where they're much less efficient. Intel started adding E cores to consumer chips in large part so they could score better on throughput-oriented multithreaded benchmarks like Cinebench; they're decent at compiling code, too, but you'll still want the P core for the linker.

arp242• 11 months ago

That's not really how nice levels have worked traditionally, and would disallow specifying "run on Performance cores, but yield to other processes quickly".

casenmgreen2• 11 months ago

I may be completely wrong, but I read that E cores are not power efficient, rather they are die space efficient.

dietr1ch• 11 months ago

I think that here is where things are lacking. There's not enough information that can be conveyed to the OS with just a number, and the number seems fixed and not tied to user input (active application, user just clicked, action blocking presentation).

It'd be cool if tasks told you about their workload in terms of latency throughput, and cadence required (hello skipping audio when you compile hard).

irusensei• 11 months ago

Thats one of the reasons I switched back to Linux. I've bought Alder Lake and a couple of RockPro64s that have heterogenous CPU sets.

Dead_Lemon• 11 months ago

Maybe its just me, but this P&E arch is underwhelming and screams similar issues AMD bulldozer again. Claims of massive core counts with mediocre performance, and little control over how things are assigned to the cores. Maybe that will improve over time with improved schedulers, but I doubt it. Its looks like an architectural issue. The experience feels so inconstant, even ending up worse than the prior generations with all normal P cores with lower core counts. I'm avoiding Intel P&E CPUs with anything that needs consistent performance, as my limited experience with the new Intel chips leaves me with a bitter taste in my mouth, and a frustrating computing experience.

DevelopingElk• 11 months ago

I see the heterogeneous architectures as mostly a plus. If you want the most throughput for a highly parallel workload given a power and silicon budget 100% E cores would be best. If you have some workloads that don't parallelize well then a few P cores are best. Heterogeneous gives possibilities to optimize for both cases. There is another knob to turn, and mistakes can be made, but this should be an overall positive.

My bigger concern with the newer Intel CPUs are the crashes and reliability issues that were reported.

ksec• 11 months ago

You do realise every single Smartphone has had P&E core for the past 6 - 7 years? The problem is more with Intel.

monster_truck• 11 months ago

Intel is quietly having their bulldozer moment

johnklos• 11 months ago

That's not really fair to Bulldozer CPUs.

The AMD Bulldozers put a lot of new, untested ideas in to practice. Some of them paid off, while many did not, at least not in the short term. There were, however, many good ideas, and many of those lived on and helped make Ryzen what it is.

Over time, Bulldozer performance has matched and exceeded contemporary Intel performance, both because compiler optimizations have made better use of the CPU and because of the slowdowns from Spectre / Meltdown affecting Intel much more than AMD. I still run an FX-8150 server and have compared it with an Intel 2600K system in many tasks.

Do we think that Intel is going to use their current shitshow to make a golden age of Intel CPUs, like how Bulldozer led to Ryzen? I personally don't think so. They've put all their cheap tricks in to their CPUs, tricks which require huge slowdowns when flaws are found, and unless / until they start caring about actually doing things correctly rather than playing fast and loose with hundreds of watts, they'll keep trying to game the benchmarks, will keep having flaws and problems, and will keep losing market share.

FreeBSD Scheduling on Hybrid CPUs

Related Stories