Generating Music Tracks with Unified Representation and Diffusion Framework

https://ai-muzic.github.io/getmusic/

by laurieg • 3 years ago

96 41 3 years ago

ai-muzic.github.io

satellite2• 3 years ago

So it's basically a midi predicting LLM? I don't understand how it solves the issue of representing music, i.e. actual sound waves and not simply the notes that make it up?

theage• 3 years ago

It's the best note mixing LLM I've seen. Someone just needs to train a sound diffusion model on the midi notes to orchestral mp3s. Give it a few weeks. "Unified" seems to mean all the notes in one place which you can edit/build on/mix so that you can put another layer on top, human or ai performs it with words & flare.

cjohnson3182• 3 years ago

Uh, yeah. I've been looking at programmatically writing guide tone lines and motifs in jazz for my personal piano practice, and this... looks very sophisticated.

downWidOutaFite• 3 years ago

I can't help but mourn a little for humanity everytime I see a demo like this one that leave little doubt that the machines will be taking away another one of our creative passions.

arvinsim• 3 years ago

If you talk about monetizing these creative pursuits, then yes, there is a reason to be worried.

But if you are talking about pursuing these creative passions as an end by itself, it's much less relevant.

ablation• 3 years ago

Quite so. Much in the same way ChatGPT or other LLMs won’t stop me writing for pleasure, entertainment or otherwise, no model will likely ever make me not want to pick up my guitar or fire up my DAW.

soulofmischief2• 3 years ago

Being creative, or mastering new skills, after a suffocating 9-5 isn't the easiest task.

code51• 3 years ago

Did you watch Rick Beato's take on AI effect on music? Monetizing music is a totally different thing that requires fan interaction and that takes both time, a live avatar (human or not). I'm thinking when a group comes up with a live avatar that can do concerts for AI songs and interact with fans, then monetization is doomed. Not for now though...

tgv3• 3 years ago

It is relevant.

When the incentives (money, fame, sex) are taken away from producing music, the infrastructure for teaching music will erode rapidly. If AI takes over the music industry, music teaching and production of affordable musical instruments will be gone within a generation. There will be no resources left for "pursuing these creative passions", and aspiring pop musicians will only be able to produce bad and old-fashioned sounding tripe, and be ignored.

Classical music might be an exception, since the audience cares a lot about performance, and is much less impressed by fashions and fads (sometimes to the detriment of modern composers, but that's another story).

nxpnsv• 3 years ago

There millions of musicians way more accomplished than me. But in no way do they stop me from enjoying noodling around with sound. Meanwhile, a lot of our most famous artists employ massive teams to helping them make tracks. Yet, still there are passionate creatives doing amazing stuff. I don't think creativity is over quite yet.

feoren• 3 years ago

Yes, all this AI generated content is only more, and only adds to the total body of creative works that humans can enjoy (if you're rich). Humans are still free to pursue their own creative passions, and can get the same fulfillment from them as before (if you're rich). We can all look forward to a future where even more of our needs are met even more cheaply and easily (if you're rich).

Sure, of all of the pathways previously available for humans to make a decent living and actually put a roof over their heads and food on their tables, most of them will no longer an option in a decade or two -- it was already extremely hard to make a living as a creative, and now it will be completely impossible. Nor will anyone be able to make a living driving a truck, doing landscape design, writing ad copy, writing basic code, working in a factory, optimizing a factory, designing a factory, or building a factory. Only owning things will make you money; everyone else will be competing tooth-and-nail for the few remaining ways to serve you that still require a human. Obviously those poorsies won't be able to pursue their creative passions anymore, since they're working 80 hours per week in the vain hope that their children will be able to escape the cycle of poverty. But fuck those guys: you're rich! You can play guitar all fuckin' day if you want.

You are rich, right? Right?

cjohnson3182• 3 years ago

Creativity isn't over, but being able to support a family with creative work is going to get a lot harder.

jjallen• 3 years ago

And give us myriad new forms of media. Sort of like the advent of cars eliminating the lives of horses opening up journeys that we couldn’t even imagine before cars

josephg3• 3 years ago

Judging from the output, we have at least a couple generations of these algorithms before humans have anything to worry about. The music it generates is .. musical. But it sounds bland and soulless. I struggled to get through any of the examples.

I can imagine it being used to "autofill" parts of an arrangement when musicians are feeling uninspired, but I doubt it will be writing new pop songs for at least a few more years. (Though a few years is an utter drop in the bucket for humanity.)

zirgs3• 3 years ago

Bland and soulless - so just like Spotify top 50? When I listen to it - it all sounds so samey and generic that it might as well be procedurally generated.

williamcotton• 3 years ago

Now you know how every musician within a 5 mile radius of you feels when Taylor Swift rolls into town with 40 trucks full of blinking lights and speaker arrays!

rbflx1• 3 years ago

What method are they using to check to what extent generations are reproducing training examples? Because at least the "Bach Style Generation" on the website seems to just be a sped-up version of the "Befiehl du deine Wege" choral from St. Matthews Passion.

tudorw• 3 years ago

that a next level Rik roll right there ;)

bandika• 3 years ago

Musically, those examples are really bland, and the rendering is of poor quality.

Besides, I'm not sure what's the point of this. I can see how ChatGPT can be useful for devs/writers/researchers etc. I can't imagine how this could be useful for a musician.

AlecSchueler• 3 years ago

To be fair some people have already listed examples of how they could use the technology elsewhere in the thread, and it will only improve from this point.

laratied• 3 years ago

I can't wait for better music AI but these examples are absolutely pathetic.

It is shameful to mention Bach's name in that one example.

ad8e• 3 years ago

Contrast this parent comment's opinion, that it is "shameful to mention Bach's name" with the Bach example, with this comment https://news.ycombinator.com/item?id=36043384, pointing out that the Bach example is plagiarized from Bach: https://www.youtube.com/watch?v=Fpqd1gCzLN4&t=178s

frankling_• 3 years ago

That "Bach style generation" is on point. In fact, it's "O Haupt voll Blut und Wunden": https://www.youtube.com/watch?v=Fpqd1gCzLN4

rerdavies• 3 years ago

Why would anyone play the output on a awful FM synth dating to the early 80s? Somebody buy those guys a CASIO! Please!

midenginedcoupe• 3 years ago

Why on earth are most of these transposed? The written parts are a semitone out!? The first video is played at the same pitch as what's written, but the next two are a semitone out and Hey Jude is a whole tone away.

Bizarre.

Generating Music Tracks with Unified Representation and Diffusion Framework

Related Stories