Movie Trailer Scene Classification Based on Audio VGGish Features

In a movie trailer, sound carries important information about the background music or sound effects thus, using these data to classify the genre of a movie can help post-production teams in the movie industry. Since deep learning has shown great potential and usefulness in many machine learning applications, this paper studied deep learning methods and building suitable neural networks for this movie trailer genre classification task. To train and evaluate the performance of our neural networks, we used MovieLens20M dataset. Instead of providing original audio files, AudioSet offers 128-dimensional embeddings outputted by a VGG model for audio with a frame length of 960ms, approximately 1s. Thus, each audio from is represented as a series of 128-dimensional features. Then we finetuned the VGG model that AudioSet used as a feature extractor. Afterward, we compared Convolutional Neural Networks (CNN) and Long Short Term Memory (LSTM) models with same hyper-parameters.