Smashcima

  Authors

Mayer, Jiří ; Pecina, Pavel and Hajič jr., Jan

  Item identifier

http://hdl.handle.net/11234/1-5835

 Project URL

https://github.com/OMR-Research/Smashcima

 Demo URL

https://huggingface.co/spaces/Jirka-Mayer/Smashcima

 Date issued

2024-12-30

 Type

toolService

 Description

Smashcima is a library and framework for synthesizing images containing handwritten music for creating synthetic training data for OMR models. It is primarily intended to be used as part of optical music recognition workflows, esp. with domain adaptation in mind. The target user is therefore a machine-learning, document processing, library sciences, or computational musicology researcher with minimal skills in python programming. Smashcima is the only tool that simultaneously: - synthesizes handwritten music notation, - produces not only raster images but also segmentation masks, classification labels, bounding boxes, and more, - synthesizes entire pages as well as individual symbols, - synthesizes background paper textures, - synthesizes also polyphonic and pianoform music images, - accepts just MusicXML as input, - is written in Python, which simplifies its adoption and extensibility. Therefore, Smashcima brings a unique new capability for optical music recognition (OMR): synthesizing a near-realistic image of handwritten sheet music from just a MusicXML file. As opposed to notation editors, which work with a fixed set of fonts and a set of layout rules, it can adapt handwriting styles from existing OMR datasets to arbitrary music (beyond the music encoded in existing OMR datasets), and randomize layout to simulate the imprecisions of handwriting, while guaranteeing the semantic correctness of the output rendering. Crucially, the rendered image is provided also with the positions of all the visual elements of music notation, so that both object detection-based and sequence-to-sequence OMR pipelines can utilize Smashcima as a synthesizer of training data. (In combination with the LMX canonical linearization of MusicXML, one can imagine the endless possibilities of running Smashcima on inputs from a MusicXML generator.)

 Publisher

Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)

 Acknowledgement

Ministry of Culture

Project code: DH23P03OVV008

Project name: OmniOMR – rozpoznávání hudebního záznamu pomocí strojového učení pro digitální knihovny

 Subject(s)

Optical music recognition synthetic data handwritten notation

 Collection(s)

LINDAT / CLARIAH-CZ Data & Tools

Show full item record