HN user

EricLeer

58 karma

https://twitter.com/LeerEric

Posts4
Comments42
View on HN

Yes there are many attempts in applying a transformers to timeseries forecasting. For instance (but there are many more): - Timegpt https://arxiv.org/abs/2310.03589 - Chronos https://github.com/amazon-science/chronos-forecasting

These kind of papers often talk the world, but often lack a proper baseline model. They only compare against very simple (naive forecast), or non tuned models. In my experience a gradient boosting model will probably solve 95% of your forecasting problems, and trying to get fancy with a transformer (or even just a simple neural net) is more trouble then it is worth.

Funnily enough next to wind also solar is one of the major renewable sources in the Netherlands. So also day-night storage would be important.

The Netherlands actually is second place in terms of solar generation per capita in the world (only Australia has more).

I am in the power forecasting domain, where weather forecasts are one of the most important inputs. What I find surprising is that with all the papers and publications from google in the past years, there seems to be no way to get access to these forecasts! We've now evaluated numerous of the ai weather forecasting startups that are popping up everywhere and so far for all of them their claims fall flat on their face when you actually start comparing their quality in a production setting next to the HRES model from ECMWF.

I wonder if it would be possible to probe what a model is trained on by usage of prompts the reply to which can only be answered well with certain training data.

For instance if I have some body of text that can't be found elsewhere on the internet, if the reply of the model references the information in that text in some way you may be fairly certain it was used in training.

The hard part is probably finding such a body of text.

As a European I am a bit surprised by this comment. Resistant based light bulbs have been banned already for some years, and all the LED lighting you can get in stores just work? Don't really have to think about it. Also would not assume that a 220V grid would make this easier.

Pandas 2.0 3 years ago

As someone who mainly uses pandas, what is the benefit of using DuckDB to write your queries over using pandas (or polars) to operate on the data. Is it that you can already subset the data without loading it into memory?

Next to being easier to run, I also have the feeling that images by them selves are also more interesting then generating text. It is much easier for us to look past the defaults, whereas for a text it has to be of a really high quality to be of notice (and even more if you want it to be interesting).

Have the feeling this is definitely more of an American problem. I'm from a European country and the last time I have had any sort of power outage is more then 10 years ago (can't even remember it to be honest). Even with the current surge in prices the production and transmission system is still reliable as ever.

True, but this entire loop happens within the model, if you would return an output at every intermediate step the model would be extremely slow.

My take on why they have build the output layer like it is, is that next to feeling more human, it also forces you to be a bit more thoughtfull with your requests, and thus spam the system less. In the end it is still really expensive to run these models..

From how I understand the description these glasses can only record video/take photos, play audio and be used with a voice command.

Seems pretty gimmicky for the price tag.

Last Flight Out 3 years ago

Unfortunatly wind turbines are also not really a big fan of the cold. When ice grows on the blades they can become unstable.

Do you have some recommendations on good books on trading systems? I work in the energy trading world, and in general the systems there are behind the financial world by ~10 years.

I hope to learn more about this topic!

Bunny AI 4 years ago

Check out the climate change ai[0] community! There are many people working on the interesting interface between ai and relevant problems.

I think the main thing to take into account that many of these problems and organisations still live in an age of 200X tech, so already implementing current age practices can result in great improvements (although this does not result in flashy press announcments or papers).

[0] https://www.climatechange.ai/