New music generation works fine, but I couldn't make cover/repaint work properly

[aliok]

Awesome model for generating new music.

However, I couldn't find a good setup to do repaint/cover existing music.

Original melody is lost or corrupted. Anybody has a good working setup, possibly with ComfyUI?

I played for hours with many parameters (using different model variations, denoise values, cfg values, ModelSamplingAuraFlow values, etc.). Couldn't make it work properly.

[aidanodr]

@aliok I have been using the gradio UI. Tried the REMIX ( Cover?? ) and REPAINT Generation modes. Using these on an existing track created with the CUSTOM Generation mode. TBH, no matter what settings I tried tweaking I did not get that much different. Most of the times the recreated tracks sound very similar or the same.

I have tried, through likes of prompts to change the vocalist sound, no go, same voice all the time pretty much. like yourself, spent hours at it with not much by the way of different results. The resultant sounds regardless of prompts etc sound sort of countryish, country rock genre, vaguely pop perhaps

I wonder would COMFYUI make a difference, however thats again just a GUI front end using the same ACE STEP "Engine"??

regards - AIDAN

[aliok]

I wonder would COMFYUI make a difference, however thats again just a GUI front end using the same ACE STEP "Engine"??

I guess so. In the end, ComfyUI would just use the underlying model. I don't know if there is stuff not hooked in properly (between ComfyUI and AceStep). Or, if there's something I misunderstand.

[aidanodr]

@aliok Lots of complaints on Reddit about this AND alternative methods like here:

https://www.reddit.com/r/StableDiffusion/comments/1rwb0de/acestep_15_getting_results/

Have not tried these yet.

[aidanodr]

One disadvantage with the COMFYUI I/F is it ONLY has MP3 to save to. No options for WAV etc.

I decided to delete the ACE STEP 1.5 folder ( kept the models ) and reinstalled it, see if that makes a dif, using the official github Ace step page ( install instructions further down )

https://github.com/ace-step/ACE-Step-1.5

[aidanodr]

Also seeing some saying the acestep-v15-base model better than the turbo ..

[aliok]

One disadvantage with the COMFYUI I/F is it ONLY has MP3 to save to. No options for WAV etc.

I know it can save FLAC. Not sure about WAV though.

Also seeing some saying the acestep-v15-base model better than the turbo ..

Yeah, base model is generally better in my experience, but it takes 2-3x longer to generate music. In the end, 3-4 songs I generated I loved was done with turbo model. Base is better, but IMO not worth the waiting time.

In the end, I found AceStep music generation working good, except the repaint and cover.

[aidanodr]

"In the end, I found AceStep music generation working good, except the repaint and cover."

Hi @aliok .. agree 100%.

Re the Repaint / Cover. I think the cover is now called REMIX in the Gradio UI.

Last evening I was experimenting with both, mainly the remix. I wanted to change the whole lyric on a track previously recorded using the Ace Step CUSTOM Generation Mode. I wanted to keep the music and the arrangement but change the lyric as i had revised that lyric substantially.

To a large extent the following worked. I added the original track ( done previously using CUSTOM Generation Mode ) as the SOURCE AUDIO. I then set the following settings to:

LM CFG Scale: 3

LM Temp: 0.4

Qual Score Sensitivity: 1

Target Peak: -4.5 ( I always set this down this low to deal with potential clipping, give it alot of headroom vs the default -1 )

Remix Strength: 0.9

Cover strength: 1

NO MUSIC CAPTION ( dont want any other things that might change the original music )

Add new changed LYRIC

THINK - off

Then press GENERATE MUSIC.

Another tip I got on REDDIT was to take note of the original tracks SEED number and use that in the seed field when doing the remix / repaint. I could not do this this time as i had not taken note of the seed number in the original:

"It is advisable to use the same seed. if a random seed "-1" is used in Advanced Settings, change it to the one that generated the original track"

The results were pretty much 90% in most cases. It did however stumble over a few lyrics. I did a few generations and will stem out the vocal line of each take .. make one good take inside REAPER ( the DAW I use ) - the rest of the music in the REAPER project I rerecord myself.

Another thing I have not been able to figure out is to change the vocal voice. It seems to be the same "Guy :D" all the time, no matter what i add to the Music Caption prompt wise.

Aidan