Musical structure
Finding the phrase
Separate a predicted group of bars from a melodic entrance, a drop, or a DJ cue.
When a VJ asks for the next phrase, they might want the next eight-bar mixing point, the start of a vocal line, or the instant the arrangement changes into a drop. Those targets can coincide. They also diverge on pickups, extended builds, and drops that last several phrases. A useful event carries a timestamp and identifies the musical level that produced it. 17 · 18 · 20
Count bars, with an anchor
A simple predictor accepts an operator cue at a known group start, counts downbeats, and projects every fourth, eighth, or sixteenth bar. The length is configurable. This gives advance notice and stays stable through a quiet passage. It will keep counting across an extra two-bar fill, and a mistaken starting bar displaces every later cue. In an unchanging eight-bar loop, several possible starting bars can explain every sample equally well.
Raveform’s EDM annotators used four- and eight-measure organization as a soft prior and followed audible changes elsewhere. Some long drops remained a single labeled section. For an engineering baseline, keep several candidate lengths and offsets, favor recurring agreement, and allow a strong musical event or operator cue to re-anchor the count. Present the countdown as a forecast. 17
Listen for a change at more than one scale
Average features over beats or bars. Band energies and mel-frequency cepstral coefficients (MFCCs) capture changes in loudness and timbre. Chroma describes pitch-class content and can expose harmonic change. Drum or vocal activity helps identify an entrance. A simple online change detector compares a new bar with a trailing baseline, smooths the score, and requires enough separation between accepted boundaries. A sudden filter sweep can then score highly even while the same phrase continues. 13 · 31
In Foote-style novelty analysis, build a self-similarity matrix whose cells compare musical frames. At each candidate boundary, a checkerboard kernel rewards similarity within the preceding and following neighborhoods and contrast across them. Vary the kernel width to change the musical scale. A symmetric comparison must hear what comes next. In a drum-and-bass system, combining MFCC and RMS novelty used four measures on either side. At 124 BPM in 4/4, that right-hand window alone takes 7.74 seconds. This is practical for prepared files and useful for retrospective confirmation. 13 · 12
Recurrence asks whether a passage sounded like something earlier. McFee and Ellis combined repeating material with local continuity and used spectral clustering to recover groups at several levels. This can connect two choruses separated by a verse. A local novelty peak alone supplies little evidence that the new passage is a returning chorus. MSAF provides a common interface for comparing structural algorithms on recordings. 14 · 15
Learn the intended level
Jiang and colleagues modeled nested metrical groupings. Their earlier work used symbolic scores. The later implementation accepts audio and needs a reliable beat grid. For conditional random field (CRF) decoding of the larger group hierarchy it also needs accurate downbeats. An erroneous bar grid therefore propagates into the larger group prediction. 16
All-In-One predicts functional segments such as verse and chorus along with beat and downbeat positions. For explicitly annotated local phrases, the FaiSonic MMD preprint supplies a different target. Its 500 Chinese- and English-language pop tracks have separate phrase and section references. Its joint model reports phrase F1 of 62.90% within ±0.5 seconds and 79.18% within ±3 seconds. That larger window spans over six beats at 124 BPM. These are offline results for that pop corpus. 19 · 18
Give the performer three distinct controls
Show the predicted group start as a countdown. Show observed arrangement changes as evidence with a time and confidence. Make manual phrase start an immediate authoritative anchor. For an automatic hard cut, require agreement between the bar phase and the selected cue type, or allow the operator to arm the next downbeat. While confidence is weak, gradual palette or density changes cost less than an unwanted scene cut. This is a proposed performance policy. Beat Link Trigger illustrates another approach on compatible setups, using prepared rekordbox phrase information to place performance cues. 34 · 17
Chapter sources (11)
- [17]Raveform
- [18]FaiSonic MMD
- [20]Cue point estimation using object detection
- [13]Novelty-based segmentation
- [31]Low cost algorithm for online segmentation of Electronic Dance Music
- [12]From raw audio to a seamless mix
- [14]Analyzing song structure with spectral clustering
- [15]Music Structure Analysis Framework
- [16]Deep self-supervised hierarchical metrical structure modeling
- [19]All-In-One metrical and functional structure analysis
- [34]Beat Link Trigger phrase triggers