Music-Image Matching Case Show

image 2 music:
Case: Misearch

MiSearch offers users a new way to search music with image query. User can drop an image below to the above search box. The system will retrun five music segments which have the highest matching scores with the input image. The matching scores are estimated by the proposed kernel based cross modal analysis.

music 2 image:
Case: Music video generation

We also apply the image-music matching techniques for automatic music video generation. For an input song, we divide the song into segments according to its rhythm or lyric lines (if exist). Then for each segment, we determine its matched images by evaluating the music-image matching degree. The candidate images can be obtained by Internet searching or user uploading. Two examples of MV generated are shown as follows.

song 1
song 2