Stable Audio 2.0

https://stability.ai/news/stable-audio-2-0

by meetpateltech • 2 years ago

59 34 2 years ago

aurareturn2• 2 years ago

It's very impressive. Some of the same tracks are very nice to listen to.

However, I can't help but feel like it's missing something. Perhaps the reason we listen to human made music is to feel what the artist wants us to feel. There are intentions behind every beat and every tone in a human created track.

Maybe it's just getting used to listening to AI music.

Jeff_Brown• 2 years ago

intentions behind every tone

Or at least an interesting process. I didn't appreciate this until I started making tracks myself. Music that's simple to notate, once interpreted by a human, gains more information than could possibly fit in the score.

I don't have reason to think AI can't accomplish the same thing eventually, but I haven't seen it happen yet.

emadm• 2 years ago

This with audio to audio, style transfer & all the elements to come likely put into a comfyUI style format is just the beginning as a inspiration and augmentation tech.

Team aren't that interested in Taylor Swift by Drake or whatever but steadily building up tools to customise to musicians own libraries (the open version of this, it tunes super well), plus then have control and composition over it all.

Plus making sure the licensing is all good versus other audio tools where they are asking for permission later (which is a very bad idea imo)

MrSkyNet3• 2 years ago

I don't think your reason is valid at all.

I have bsaically 0 background knowledge of music and still enjoy it.

Do you know the story of the writer and his son? He wrote a book and this book was used at his sons school. The son wrote an analysis of the book and he got a bad grade because the teacher disagreed with the authors sons interpretation of his fathers book.

If an artist doesn't exactly tell us what they want us to feel, its nothing we can feel through magic.

I liked the cinemactic syncwave, but you know its a demo page. Its not included in a game, movie or something else.

aurareturn2• 2 years ago

I don't think you're getting my point.

The point is that human created songs have some sort of "soul" to it. I don't know what the reason was that the human artist chose this lyric or this beat. But some thought was put into it.

It's why I appreciate human art over AI generated art.

t8882• 2 years ago

What is that story supposed to mean?

I liked the cinematic synthwave track too - much better than what a lot of human creators do.

But… the fact that it can generate a pleasant electronica tune is essentially meaningless. This is no Miles Davis.

An LLM generated narrative cannot convey the emotions and experiences of the author. Nor can AI generated music.

fnordpiglet• 2 years ago

There’s a better version of that story written by Asimov where a physicist is talking at a party to an English professor about a Time Machine they created that can bring famous people from the past to the present. He used it to bring William Shakespeare to the present. And Shakespeare took the English professors class on Shakespeares plays. He had to send Shakespeare back tho because he was angry that he failed the class on his own plays.

knighthack• 2 years ago

You sound like someone who's not a musician.

There are ways to 'humanize' music, by use of messing around with rhythms/syncopation, velocity, distortion, etc. Not all of it is intentioned - quite a number of stuff is automated. Yet it feels no less 'human' - you would be a fool to think that human-created music must have "intentions behind every beat and every tone". That's not how it works - as any musician, arranger or composer can attest to.

I suspect that AI music can write music far better than even humans, and more consistently than with AI (visual art), given how music tends to be repetitive and more mathematically consistent in that regard.

coldcode• 2 years ago

It seems to have issues for me (Safari), at least this morning, complaining about being unable to get a user. Maybe too many people are trying it. Looks like a 500 error.

incrudible• 2 years ago

space elevator music

joshstrange• 2 years ago

Not sure if you mean "space-elevator music" (music to listen to on a space elevator) or "space elevator-music" (an elevator in space) but I spent too long thinking about it and decided I'm fine with answer being either. Also I kind of hope I live to see a "space elevator" but I'll also settle for an elevator in space.

peddling-brink• 2 years ago

I think they meant music that elevates space. Like the auditory equivalent to helium.

porkbeer• 2 years ago

I am picturing a toejam and earl type situation, but that music was way better.

CharlesW• 2 years ago

"Stable Audio 2.0 was exclusively trained on a licensed dataset from the AudioSparx music library, honoring opt-out requests and ensuring fair compensation for creators."

This is how you do it. Well done, Stability AI!

jjice• 2 years ago

This is really neat. I didn't see mention of copyright on the output audio. They talk a good bit about how they handle the input audio's copyright (which is great they mention that), but I didn't see anything about the output. Do you own it? Do they own it? I may have just missed it, but that's an important piece here IMO.

zerocrates• 2 years ago

That's very much up in the air with generative AI output. The US Copyright Office has claimed so far that there's just no copyright in model output, though that's far from settled one way or the other. If there is copyright, who owns it would be yet another question.

Sound is even a little trickier than other domains: the composition of a song and its embodiment in a specific recording have separate copyrights. Do both necessarily get treated the same?

livrem• 2 years ago

"Subject to the remainder of these Terms, we encourage Basic Tier Users to employ the Services to make creative, non-commercial use of Content ... Unlike Basic Tier Users, paid tiers of users may use the Services to generate Content for some (but not all) commercial uses".

impostervt• 2 years ago

I tend to listen to synthwave while coding, as for me it has the right mix of energy + being able to ignore. I have felt my playlists have become a bit stale, and have been looking to add new stuff. Now it feels like this could just generate an infinite "good enough" play list.

xnx• 2 years ago

Stability made a 24/7 stream for this: https://www.youtube.com/watch?v=k04RGJBHTv8

drcongo• 2 years ago

Anyone know if there's a ComfyUI style interface or similar for the audio models?

999900000999• 2 years ago

What a neat prototype.

I gave it a beat I made 10 years ago, the original source files are long go. Set it to 90%, sounded like someone played put a stereo in a washing machine.

I can't help but think this can't really work without a larger dataset. Still, I'll probably buy a subscription.

I might see if I can automate using Chat GPT to summarize the morning news, generate a beat reflecting it, and then upload a visualization of the music to YouTube( or another service, don't want to piss off the Google gods.)

Edit: After playing around with it for 30 minutes, nothing sounds particularly great. I can make something better than this in an hour or so. Let's see where we're at next year.

jenny91• 2 years ago

The sound samples are cool but I'm failing to generate anything very interesting using their site.

_lvbh• 2 years ago

Unfortunately not open source. I really hope StabilityAI doesn't go the OpenAI route but I don't want them to fail either.

Jackson__• 2 years ago

The irony of this tweet is growing ever rapidly I see.

Emad (Ex-Stability CEO, 2023/11/21)
Not your models not your mind
#decentralizeAI
https://twitter.com/EMostaque/status/1727091529440022641

bashZorina_09• 2 years ago

The Audio-to-Audio samples sound more like the model trying to construct a similar enough instrumental and vocoding the difference using the original sample rather than drums and strums being generated identically to match the intent. Still interesting though, and I certainly imagine we're not far off from improved versions.

dwb2• 2 years ago

Again, technically impressive, but extremely mediocre outputs. I listened to all the samples and they're just nothing. A competent modern electronic musician would do a better job, or at the very least get a vastly more interesting result trying, for all of them. The actual artistic potential in this is in how it breaks, not how it works. I'm sure future versions will come with higher fidelity, but clearly still zero artistry.

sgu999• 2 years ago

As someone who doesn't know much about music, I found the samples interesting. Sadly for the actual competent musicians, I'm not an outlier... We won't notice the difference when videos, ads, movies and elevators are padded with these instead of human-made ones.

dwb2• 2 years ago

They're interesting, as far as that goes. I'm sure the technology will improve and will start to be used by musicians and yes, if used well, people won't notice. If the result is fine, it will be acceptable by most. I'm absolutely sure that anyone listening to something lesser, though, say something generated by a non-musician and not worked at all, will at the very least notice something off or lower-quality, even if they can't explain it better.

Stable Audio 2.0

Related Stories