NUO-STEMS 3.1 beta with improved Traktor support and new algorithm

Harald Walker · 2024-10-18T13:01:41+00:00

There was an error rendering this rich post.

Harald Walker

NUO-STEMS v3.1 beta has been released with many improvements and new features.

What's new in 3.1

“mel_band_roformer” – new algorithm with insane quality of vocals and improved drums, bass & other stems
“sum of stems = original” – now mix of 4 stems (drums, bass, other, vocals) equal the original track
Revamped Traktor Utilities show which originals in the collection have STEMS versions created; Experimental feature to automatically add STEMS to collection after conversion.
Much more accurate beatgrid & hotcues transfer between originals & STEMS
much more – see the changelog

https://youtu.be/KTAMIDx9YWw?si=a_U0lBGggqN53i9w

Find more posts tagged with

Traktor Pro 3

Comments

Owner

Nice! Does this mean that the "mel_band_reformer" can now spit out the "sum of stems = original" without any lost?

Harald Walker

@Owner I haven't tried it yet. From what I understand it should mean that when you play all stems at the same time you should not hear a difference from the original (wasn't the case before). Does not seem to depend on the algorithm.

Nico_Tf

I have yet to test it but the sound comparison looks awesome.

Please NI, open your API so that this developer can integrate fully his product with Traktor. And also I’m tired of hunting and replacing files in the Stems folder by hand. Thanks!

DJ NUO

https://community.native-instruments.com/discussion/comment/185165#Comment_185165

This is correct. New "sum of stems = original" feature works for all the algorithms (mel_band_roformer, htdemucs_ft, htdemucs). And obviously, the most clean results will be with "mel_band_roformer" 🙂

Owner

https://community.native-instruments.com/discussion/comment/185207#Comment_185207

wow, that's great - thanks for your work!

TurnedTables

NI should really consider hiring Nuo. Let him focus on the stem algorithms and the rest of the team work on features.

We could keep the Nuo-stems UI for standalone use/config and Traktor call out to it to process in-app.

leesinthemix

https://community.native-instruments.com/discussion/comment/185438#Comment_185438

I don't think you understand and judging by the likes, no one else does either.

It isn't his algorithm being used, he merely uses open source software that's available to everyone and packages it up into his stem splitter to be compatible with Traktor Pro 4.

Here is the vocal algo he uses for version 3.1: https://github.com/KimberleyJensen/Mel-Band-Roformer-Vocal-Model

Hiring him to focus on stems would undermine the work of an entire company in iZotope.

DJ NUO

https://community.native-instruments.com/discussion/comment/185595#Comment_185595

Let me elaborate on the answer 🙂

You are partially correct 🙃

What you're correct about:

I'm using open-source mel_band_roformer algorithm & weights by Kimberley Jensen (which I publicly mention within the app - )
I'm also using open-source demucs algorithm, just like almost every other STEMS separation software on the market
I'm using NI SDK to package the results into .stem.m4a for Traktor Pro

What you might have missed that is also done by NUO-STEMS, which is proprietary code:

"sum of stems = original". Especially "AI distribute between drums & other stem". It's "in-house" development.
Making things run on every possible Windows 7+ & MacOS 10.14+, and accelerating conversion using NVIDIA & Apple Silicon GPUs.
Packaging it all in a single distributable, which requires users to have zero programming background
And then a ton of different stuff related to UX for Traktor users (e.g. Traktor Utilities & syncing of beatgrids, hotcues & metadata between originals & STEMS, accounting for different codec offsets) & other users preferences

That is to say, nobody is undermining the work of guys at NI 🙂. I'm just a single developer, who part-time for 4 years has been supporting Traktor enthusiasts that wanted to use highest quality available for STEMS. Especially since Traktor's implementation & UI for STEMS is the best on the market IMO.

Best regards 🙂

TurnedTables

https://community.native-instruments.com/discussion/comment/185595#Comment_185595

I've always been fully aware of where the algorithms come from for Nuo's app and I think you do him a disservice saying he 'merely' uses open source algos. My point is that Nuo has single handedly developed a stem separation app that produces results objectively better than all other implementations in almost all metrics and releases on a more frequent cadence than NI can dream about. Just think, with a separate 'stem engine' like we have here , Nuo can keep iterating , improving and innovating (sum of parts - wow) whilst the rest of the Traktor team crank out the features.

I don't think hiring Nuo would undermine Izotope - hire him in that team if it matters so much, and I'm sure they'd love to have someone as talented as Nuo to work with.

BMAC16

DJ Nuo,

Do the beat grids remain from the original song when exporting to Instrumental and Acapella? If so, that would be a game changer specifically for Acapellas.

leesinthemix

https://community.native-instruments.com/discussion/comment/185679#Comment_185679

My argument was hypothetical, not once did I say you are undermining NI.

Quick links

Unanswered questions