<<  Introduction to Music Digital Music Survey  >>
Music image processing
Music image processing
With
With
Overview
Overview
The vision
The vision
Barlow and Morgenstern 1949
Barlow and Morgenstern 1949
Barlow and Morgenstern 1949
Barlow and Morgenstern 1949
Barlow and Morgenstern 1949
Barlow and Morgenstern 1949
Activities with music
Activities with music
Digital music problems
Digital music problems
Problems with paper
Problems with paper
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
D (lick #1) Dmin#5 Look at me now, will I ever learn
D (lick #1) Dmin#5 Look at me now, will I ever learn
Live performance
Live performance
Live performance
Live performance
Live performance
Live performance
Transcription
Transcription
Transcription
Transcription
Transcription
Transcription
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Operations on music
Operations on music
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Visual display
Optical Music Recognition
Optical Music Recognition
Music image processing
Music image processing
Music image processing
Music image processing
Wabot-2
Wabot-2
Music image processing
Music image processing
Staff line removal/identification
Staff line removal/identification
Music image processing
Music image processing
Horizontal projection
Horizontal projection
Piece at an angle
Piece at an angle
Vertical slices
Vertical slices
Vertical slices
Vertical slices
Wobble/track
Wobble/track
Object location
Object location
Identifying objects
Identifying objects
Constructing musical features
Constructing musical features
Musical semantics
Musical semantics
Commercial systems
Commercial systems
Is 96% recognition good enough
Is 96% recognition good enough
Not just notes
Not just notes
Music image processing
Music image processing
Visual display
Visual display
The gulf of interpretation
The gulf of interpretation
Interpretation
Interpretation
Interpretation
Interpretation
Visual display
Visual display
Music image processing
Music image processing
Music image processing
Music image processing
Coloured staveline removal
Coloured staveline removal
Music image processing
Music image processing
Music image processing
Music image processing
Mis-classified images
Mis-classified images
Discussion
Discussion

: Music image processing. : Tim Bell. : Music image processing.ppt. zip-: 6793 .

Music image processing

Music image processing.ppt
1 Music image processing

Music image processing

Tim Bell Department of Computer Science and Software Engineering University of Canterbury, Christchurch, New Zealand

2 With

With

David Bainbridge (Waikato) Richard Lobb Dave Blizzard (Portland, OR) Richard Green John McPherson Karen Lin Annabel Church Simon Glass

3 Overview

Overview

OMR Digital music stand Page turning and image size Fast capture of music Music classification

4 The vision

The vision

..

All music available on the web as score, recording and MIDI search by name, composer, lyrics, phrase, similarity, genre, novelty remunerate those responsible culturally sensitive access

5 Barlow and Morgenstern 1949

Barlow and Morgenstern 1949

6 Barlow and Morgenstern 1949

Barlow and Morgenstern 1949

7 Barlow and Morgenstern 1949

Barlow and Morgenstern 1949

8 Activities with music

Activities with music

Composing Arranging Performance Teaching Musicology Recording Accompanying Transcribing...

9 Digital music problems

Digital music problems

Cost of hardware and software Viewing music on small screen Loss of inspiration and creativity Loss of efficiency Learning curve Software compatibility

10 Problems with paper

Problems with paper

Pen or pencil? Indexed retrieval

11 Visual display

Visual display

Digital image

Human memory

Digital semantic

Audio

12 Visual display

Visual display

Digital image

memorised oral tradition original ideas

Human memory

Digital semantic

Audio

13 Visual display

Visual display

Digital image

Human memory

live performance mp3, wav, cd video?

Digital semantic

Audio

14 Visual display

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

15 Visual display

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

16 Visual display

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

17 Visual display

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

18 Visual display

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

19 D (lick #1) Dmin#5 Look at me now, will I ever learn

D (lick #1) Dmin#5 Look at me now, will I ever learn

D (lick #2) Dmin#5 G I dont know how but I suddenly lose control.

Visual display

Digital image

sheet music screen

Human memory

Digital semantic

Audio

20 Live performance

Live performance

Visual display

Digital image

Human memory

Digital semantic

Audio

21 Live performance

Live performance

Visual display

read

Digital image

Human memory

Digital semantic

Audio

22 Live performance

Live performance

Visual display

Digital image

Human memory

play (interpret)

Digital semantic

Audio

23 Transcription

Transcription

Visual display

Digital image

Human memory

Digital semantic

Audio

24 Transcription

Transcription

Visual display

Digital image

Human memory

listen

Digital semantic

Audio

25 Transcription

Transcription

Visual display

Digital image

write

Human memory

Digital semantic

Audio

26 Visual display

Visual display

Digital image

BMP, GIF, JPEG

Human memory

Digital semantic

Audio

27 Visual display

Visual display

Digital image

scanner, camera

Human memory

Digital semantic

Audio

28 Visual display

Visual display

Digital image

print, display

Human memory

Digital semantic

Audio

29 Visual display

Visual display

Digital image

Human memory

MIDI NIFF MUSICXML GUIDO

Digital semantic

Audio

30 Visual display

Visual display

Digital image

Render (Sibelius, Lime, Guido, Tex etc.)

Human memory

Digital semantic

Audio

31 Visual display

Visual display

Digital image

OMR

Human memory

Digital semantic

Audio

32 Visual display

Visual display

Digital image

Human memory

Synthesis (audio rendering)

Digital semantic

Audio

33 Visual display

Visual display

Digital image

Human memory

Audio analysis (monophonic, polyphonic)

Digital semantic

Audio

34 Visual display

Visual display

Data entry

Digital image

Human memory

Digital semantic

Audio

35 Visual display

Visual display

Digital image

Weak links

Human memory

Digital semantic

Audio

36 Visual display

Visual display

Digital image

Labour intensive links

Human memory

Digital semantic

Audio

37 Visual display

Visual display

Digital image

Human memory

Digital semantic

Audio

38 Visual display

Visual display

Digital image

QBH

Human memory

Digital semantic

Audio

39 Operations on music

Operations on music

40 Visual display

Visual display

Digital image

Compose Arrange/orchestrate Rehearse React

Human memory

Digital semantic

Audio

41 Visual display

Visual display

Digital image

Library (personal, shared) Music stand (rehearse, perform)

Human memory

Digital semantic

Audio

42 Visual display

Visual display

Digital image

Intermediate form Archive

Human memory

Digital semantic

Audio

43 Visual display

Visual display

Suitable for: transposition part splitting reduction searching theme detection accompaniment performance following

Digital image

Human memory

Digital semantic

Audio

44 Visual display

Visual display

Digital image

listening recording studio analysis thumbnail backing

Human memory

Digital semantic

Audio

45 Optical Music Recognition

Optical Music Recognition

46 Music image processing
47 Music image processing
48 Wabot-2

Wabot-2

1980-1984 Read simple score Heavy processing requirements

49 Music image processing
50 Staff line removal/identification

Staff line removal/identification

Horizontal projection Vertical slices Wobble/track Chords Template

51 Music image processing
52 Horizontal projection

Horizontal projection

53 Piece at an angle

Piece at an angle

Rotate until correct

54 Vertical slices

Vertical slices

55 Vertical slices

Vertical slices

56 Wobble/track

Wobble/track

57 Object location

Object location

Fragmentation Superimposed Touching objects

58 Identifying objects

Identifying objects

Flood fill Template matching Hough transform

59 Constructing musical features

Constructing musical features

Grammars Decision tree Rules

60 Musical semantics

Musical semantics

Treble clef determines pitches Accidentals change pitch Time signature changes note lengths

61 Commercial systems

Commercial systems

Sharpeye Vivaldi Neuratron PhotoScore and more

62 Is 96% recognition good enough

Is 96% recognition good enough

One mistake in 24 notes No interpretation if playing music Time to set up, train and correct greater than typing?

63 Not just notes

Not just notes

64 Music image processing
65 Visual display

Visual display

Digital image

Optical music recognition in practice!

Human memory

Digital semantic

Audio

66 The gulf of interpretation

The gulf of interpretation

Classical tempo and dynamics Jazz improvisation Rock style (e.g. syncopation, articulation) Figured bass Cadenzas MIDI vs. Orchestra

67 Interpretation

Interpretation

68 Interpretation

Interpretation

69 Visual display

Visual display

Digital image

Pen-based music data entry

Human memory

Digital semantic

Audio

70 Music image processing
71 Music image processing
72 Coloured staveline removal

Coloured staveline removal

Scanned as RGB Convert to HSV and CMYK V indicates colour K indicates pencil, black pen

73 Music image processing
74 Music image processing
75 Mis-classified images

Mis-classified images

76 Discussion

Discussion

Music image processing
http://900igr.net/prezentacija/anglijskij-jazyk/music-image-processing-207132.html
c

29
900igr.net > > > Music image processing