Convert Voice into Music with this New AI Tool!. Today we use this new AI to turn our VOCALS into MUSIC!
https://translate.google.com/
Расшифровка видео
0:00
hello everybody and welcome back to the
0:02
Matt vidpro AI YouTube channel I have a
0:04
pretty exciting one for you guys today
0:06
we’re going to be trying out speech to
0:09
music so essentially I’m going to take
0:12
my voice here and make some vocal notes
0:15
with it and that will actually be
0:16
converted into an instrument that you
0:19
can hear and it sounds like it’s really
0:21
playing now I spoke about this
0:23
technology in a recent AI news video and
0:26
you guys seriously wanted to see the
0:28
full thing in action first of all let’s
0:30
take a peek at that demo that drove
0:33
everyone so crazy in my original AI news
0:36
video so here is that original Twitter
0:38
post voice to music we launched a
0:41
feature that allows you to sing and turn
0:43
your notes into any instrument you want
0:46
pretty cool to see AI giving humans the
0:48
ability to do things they could just
0:50
never do before and I mean that really
0:52
is kind of what AI is all
0:58
about
1:02
[Music]
1:14
[Music]
1:17
it’s pretty Flawless right off the bat I
1:19
think we can all agree again we’re
1:21
testing it out today so we’ll have to
1:23
see how good it truly is but man right
1:25
off the bat really impressive so that’s
1:28
guitar right there the next one
1:34
[Music]
1:48
electric guitar again just as impressive
1:51
as the regular guitar next
1:55
up this was seriously impressive to
1:57
[Music]
1:58
me
2:01
[Music]
2:13
so you can see that was a duduk we have
2:15
some percussion
2:28
here
2:32
next up we take an instrument and turn
2:34
it into another
2:37
[Music]
2:55
one impressive stuff man some more at
3:00
the end
3:10
here so yeah I think you guys can get
3:12
the idea here why everyone wanted me to
3:15
test this thing out so bad I mean it’s
3:17
just really darn exciting a lot of
3:19
people were also wondering you know the
3:21
video that we just saw makes it look
3:23
like it works in real time unfortunately
3:25
no the AI doesn’t actually run in real
3:28
time although one day it probably will
3:30
let’s check out the website that
3:32
actually is able to do all of this this
3:34
right here is musicy meet your AI music
3:38
assistant is their tagline here on the
3:40
website use AI to create music with your
3:43
voice and leverage the latest in AI
3:45
technology to supercharge your music
3:47
this is an AI site that I just hadn’t
3:49
heard of before I don’t know they have a
3:51
lot more than just what we are going to
3:53
be focusing on today so I might have to
3:56
come back to this one at some point so
3:57
when you log in with an account you can
3:59
can get access to this instrumentals
4:02
section but I’m really focused on this
4:04
speech to music type deal upload your
4:06
vocals or an instrument track and
4:08
convert it to one of our AI instruments
4:11
you can actually record right in browser
4:13
which is obviously what I’m going to be
4:14
doing today but you can upload audio
4:17
files with a 20 megabyte file limit
4:20
which really isn’t too big but that
4:22
could be a full song they actually have
4:24
more instruments than I originally
4:26
thought obviously you know the guitars
4:27
that we saw but we also have violin
4:30
break beats saxophone cinematic music
4:33
some good options in here really solid
4:36
let’s just start off with the basic
4:37
acoustic guitar I think we can all agree
4:39
and we will record some basic vocal
4:43
instrument like noises from my
4:51
[Music]
4:58
mouth
4:59
[Music]
5:06
listen I never said I had a musical ear
5:08
for some reason the vocals is set to the
5:10
instrument that I picked so let’s listen
5:12
to
5:14
[Music]
5:28
that
5:34
so obviously that’s not as good as the
5:36
demo that we listened to earlier but
5:38
it’s probably because I’ve never used
5:39
this tool before it still wasn’t half
5:42
bad honestly it was still very
5:43
mindblowing it’s clear that the way I
5:46
was extenuating my voice doesn’t really
5:49
match well with the acoustic
5:54
[Music]
5:58
guitar
6:00
[Music]
6:07
all right so for that one I’m going to
6:08
do the duduk from the video that we saw
6:10
I hope that this converts a little bit
6:12
[Music]
6:28
better
6:32
you it seems like one of those things
6:34
you kind of have to tweak we’re also
6:35
only on the standard quality here we’re
6:37
not in the master quality all right guys
6:40
just for this video I upgraded to a more
6:42
Premium plan let’s take a listen to the
6:44
master
6:46
[Music]
6:56
quality trying the electric guitar out
7:00
[Music]
7:11
that was definitely a lot better than
7:13
the previous ones and I think I have to
7:14
up my pitch a little bit just because of
7:17
the pitch of my voice that could be what
7:19
this setting really is for all right we
7:20
got a banjo got to try that one
7:28
out
7:34
[Music]
7:47
that’s pretty crazy that one worked well
7:50
I got to say it definitely sounds like a
7:52
banjo although it’s got like a weird
7:53
twang to it because of the way that I’m
7:56
speaking into this I really want to try
7:58
this cinematic like what could that even
8:05
[Music]
8:08
be got to say the generation time with
8:11
the paid plan is a lot
8:13
[Music]
8:21
faster I have no idea what instrument
8:23
that is supposed to be but that one
8:24
didn’t work at all let’s apply that one
8:27
to uh this instrument sure a
8:36
[Music]
8:48
Shai that one worked honestly better
8:50
than the Cinematic let’s go ahead and
8:52
try the
8:58
violin
9:01
[Music]
9:04
I knew that would kind of work I’m I’m
9:06
happy with that I’m pleasantly surprised
9:08
actually okay let’s actually try some of
9:10
the percussion out so this one I’m going
9:12
to point the mic at my desk I’m going to
9:13
do tapping and just
9:28
Beats
9:32
that one actually works really well like
9:34
you could do some real like Bongo beats
9:36
with that
9:58
thing
10:15
this little piece of plastic worked
10:17
pretty good though I’m I’m happy with
10:19
that
10:20
[Music]
10:28
result
10:32
I’m putting this on the uh perk by the
10:35
[Music]
10:41
way not good let’s try to convert an
10:45
acoustic guitar into an electric
10:51
[Music]
10:56
one I have a feeling this is going to
10:58
work out pretty
11:00
[Music]
11:08
well definitely not perfect but a lot
11:12
better than me using my voice again that
11:14
could just be the fault of my voice not
11:16
really being well suited for this
11:19
specific application and also me just
11:21
not knowing how to reproduce instruments
11:23
with my voice let’s convert that to
11:25
banjo
11:26
[Music]
11:27
now
11:30
[Music]
11:35
yeah that one sounds a little bit AI you
11:37
know what I’m saying can we convert it
11:38
to
11:43
[Music]
11:53
saxophone came through a little bit
11:55
there not too bad got a little bit JBL
11:57
at the end they have General brass
11:59
instruments as
12:08
[Music]
12:15
well what was that at the end overall
12:18
this is definitely something that’s
12:20
going to take a little bit of
12:21
fine-tuning to get perfect some people’s
12:24
voices might be better attenuated for
12:26
this than others and likely I could see
12:28
a future where this is huge and this is
12:30
used often but I suspect that the model
12:33
might have to be fine-tuned on your
12:35
specific voice to work super well it
12:38
might be the thing we’re struggling with
12:39
here it is pretty impressive though and
12:42
for instrument conversion I have no
12:44
doubt in my mind that this could
12:45
actually work really well again they
12:47
have a few other things here that I will
12:49
have to check out apparently they have
12:51
straight text to music generation let’s
12:53
take a listen to their text to
12:57
music
13:00
[Music]
13:06
[Music]
13:20
okay it didn’t really follow my prompt
13:22
too well but the generation itself was
13:25
not half bad I got to say I don’t know
13:27
if this is a model that they have
13:29
developed in house or if they’re using
13:31
some open source stuff I’d have to look
13:33
into it a little bit more but if you
13:34
want a full video exploring the rest of
13:36
Music F’s AI capabilities please let me
13:39
know down in the comments below we got
13:41
parody vocals as well which is pretty
13:43
crazy I mean we got Eric Cartman
13:45
SpongeBob Plankton I’m sure you’ve heard
13:48
some of these before but this is all
13:49
pretty interesting is it only singing or
13:52
can it just do like a straight SpongeBob
13:54
for me voice conversion thanks for
13:56
watching And subscribe to Matt VI Pro
13:59
okay as far as AI SpongeBobs go that
14:02
ain’t half bad again this could be
14:04
another video checking out the rest of
14:05
this stuff thank you so much for tuning
14:07
in and diving into this stuff with me I
14:10
hope you enjoyed it as much as I did
14:12
this is definitely very interesting I
14:13
don’t think it works great on my voice
14:15
or I’m just really bad at making
14:17
instrument sounds with my voice this is
14:19
one you’ll have to test out for yourself
14:21
and let me know down in the comments if
14:23
it works well for you their plans are
14:25
reasonably priced I’d say and you do get
14:27
five generation for completely free so
14:30
if you make anything cool please post it
14:32
to my Discord server we would love to
14:34
see it on there thanks so much for
14:35
watching I’m at vidpro Ai and see you in
14:37
the next one goodbye