论文标题
MIDI仪器的实时错误校正和性能辅助
Real-time error correction and performance aid for MIDI instruments
论文作者
论文摘要
即使表演是即兴演奏或不熟悉的作品,也可以很容易地发现在现场音乐表演中犯一个轻微的错误。一个例子可能是在古典奏鸣曲中错误地演奏的高度不和谐的和弦,或者在反复出现的主题中突然的偏离音符。可以使用人工智能来识别和纠正此类错误的问题 - 如果训练有素的人可以轻松地做到这一点,也许可以对计算机进行训练以迅速且准确地发现错误。实时识别和自动纠正错误的能力不仅对表演音乐家非常有用,而且对生产商来说也是宝贵的资产,由于小小的缺陷,因此较少的覆盖物和重新录制的收入。本文研究了有关相关问题的最新解决方案,并探讨了音乐错误检测和纠正的新颖解决方案,重点是他们的实时适用性。探索方法考虑通过音乐上下文和理论来考虑错误检测,以及没有预定义的音乐信息或规则的监督学习模型,该模型在适当的数据集上培训。提出的解决方案纯粹专注于纠正音乐错误,以高级代表(MIDI)而不是原始音频域来运行,从电子乐器(MIDI键盘/钢琴)中获取输入,并在需要时将其更改为采样器。这项工作提出了多种一般性复发性神经网络设计,用于实时错误校正和MIDI仪器的性能辅助,讨论结果,局限性以及可能的未来改进。它还强调,通过使用最新的人工智能平台和工具,最终用户,音乐爱好者,制作人和表演者可以轻松访问研究结果。
Making a slight mistake during live music performance can easily be spotted by an astute listener, even if the performance is an improvisation or an unfamiliar piece. An example might be a highly dissonant chord played by mistake in a classical-era sonata, or a sudden off-key note in a recurring motif. The problem of identifying and correcting such errors can be approached with artificial intelligence -- if a trained human can easily do it, maybe a computer can be trained to spot the errors quickly and just as accurately. The ability to identify and auto-correct errors in real-time would be not only extremely useful to performing musicians, but also a valuable asset for producers, allowing much fewer overdubs and re-recording of takes due to small imperfections. This paper examines state-of-the-art solutions to related problems and explores novel solutions for music error detection and correction, focusing on their real-time applicability. The explored approaches consider error detection through music context and theory, as well as supervised learning models with no predefined musical information or rules, trained on appropriate datasets. Focusing purely on correcting musical errors, the presented solutions operate on a high-level representation of the audio (MIDI) instead of the raw audio domain, taking input from an electronic instrument (MIDI keyboard/piano) and altering it when needed before it is sent to the sampler. This work proposes multiple general recurrent neural network designs for real-time error correction and performance aid for MIDI instruments, discusses the results, limitations, and possible future improvements. It also emphasizes on making the research results easily accessible to the end user - music enthusiasts, producers and performers -- by using the latest artificial intelligence platforms and tools.