Transformer Based Adaptive Music Generation for Video Games
摘要
This research proposes a novel approach that leverages the transformer architecture to create a dynamic MIDI composition that responds to events in near real-time. The model leverages Rotary Positional Embeddings (RoPE) to allow infinite generation for background music applications. Custom rule-based logit filters are also provided to improve generation quality. Byte-Pair Encoding is used to improve the attention context strength. This approach has been implemented and tested with Unreal Engine integration, allowing for the synthesis and mixing of sounds within Metasound.