LYRICS

badmozart · Post by **badmozart** » 05-15-23 2:09 am

Hello.

I've been using Synthesia for more than a year and it is great.

However, I really wish it had support for lyrics. I believe it's possible for MIDI files to have lyrics embedded in them as text events. It would be cool if Synthesia would pick a format for text events in midi files such that when I play those files it displays the lyrics along with the notes.

I think the best interface would put the lyrics in white text just above the keyboard at the bottom of the screen (i.e. the same place where you look to see which note to play next).

Where to get midi files with lyrics embedded in them? I think the best approach would be to build a tool that automates this where you pair a midi up with an mp3 file, rip out the voice track with spleeter (or other), audio to text it with another AI tool, match the notes up with spectral analysis to place the individual words in the right place in the file.

Pretty interested in this, might start poking around to build an open source solution if nothing already exists.

jimhenry · Post by **jimhenry** » 05-15-23 10:03 am

Interesting ideas. There are a lot of MIDI karaoke file available. They have a .kar extension. This article about MIDI karaoke formats might be of interest: https://www.mixagesoftware.com/en/midik ... rmats.html

It would be nice if the karaoke syllables fell in time with the notes but that might be tricky given that their width is variable.

Gaf · Post by **Gaf** » 05-06-24 5:48 am

Synthesia can view .mxl files

and .mxl files can have the lyrics stored in them…
a word is linked to a note, so timing should not be a problem

would be nice to display the words in the ‘Sheet Music’ strip
would be nice if it looked something like this...
or just the words and falling notes

Post by **Nicholas** » 05-08-24 2:23 pm

I agree that the lyrics in MusicXML are probably the easiest to read and get lined up with the correct notes (vs. say, lyric meta events in MIDI files), even if there are a couple particulars like "elision" or "laughing" that keep it from being as straightforward as I'd like.

Synthesia 11 already needs to add relatively arbitrary text rendering to the sheet music area (for all sorts of other things like tempo names), so lyrics should fit into that system easily enough. They're in the Synthesia 11 plan.