JP2005037751A - Multi-functional type electronic music stand - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide convenience to a player himself or herself or a person going to learn performance by allowing a device to perform the operation to turn over sheets of musical scores in the form of electronic files without the operation to hardware by the hands and feet of a player or an assistant and by recording the performance tones by the player in synchronization with turning over of the sheets of the musical scores, and also to provide a metronome function and a function of measuring the lapse time so as to provide the reference for the performance speed of the player. <P>SOLUTION: The body sign, such as the face expression, of the player is automatically detected by the image processing from an image by a television camera and the page feed or page return of the musical scores is performed by the signal thereof. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention electronically displays a musical score when playing a musical instrument, and has a function of automatically turning a musical score, and at the same time, a stopwatch and a tempo for recording a performance and checking a performance time. The present invention relates to a technology for realizing a multifunctional electronic musical score having a metronome function for matching.

  Conventionally, when playing a musical instrument, apart from relying on memorization, it is necessary to turn the musical score as the performance progresses. Especially for recitals, it is necessary to prepare a “music-turning person” for piano players. However, it is a burden for the performers to find a person who has a certain skill in playing musical instruments.

  Among devices already put into practical use, there is a device that feeds a musical score in an electronic file by a key operation of a personal computer or a push button switch (see, for example, Patent Document 1). This proposal captures the timing of turning the musical score by capturing any motion or body sign performed by the performer with a camera and identifying the image by image processing (see Patent Document 2 for application in the image monitoring field). It was devised to set.

  In addition, the performer often records the performance of the recital, and the recording function enables recording with a simple operation.

  In addition to the recording function, a time measurement function (a stopwatch function or a metronome function) can be provided to make the device more convenient for daily practice.

  Using the identification signal obtained by the above image processing, it is possible to turn on / off the recording function and the measurement function and to measure the performance time for each page of the musical score.

Japanese Patent Application Laid-Open No. 2003-177745 “Electronic score providing device”

JP 2002-262282 “Image monitoring method and image monitoring apparatus” None.

  It is intended to cause the machine to perform an operation of turning a musical score in an electronic file without operating the hardware by the performers or assistants. At the same time, the performance sound by the performer is recorded in synchronism with the turning of the musical score, which is convenient for the performer himself and those who want to learn this performance. In addition, a metronome function and a function that can measure elapsed time are provided so that the performance speed of the performer can be used as a reference.

  An operation to turn a musical score in an electronic file is to be performed by a machine by a body sign emitted by a performer. The principle described in Japanese Patent Laid-Open No. 2002-262282 is used for the detection of the body sign from the video image. In other words, a small area called an observation window is set in a part of the video screen where the change is to be detected, and image changes within the observation window are compared with means such as comparing average brightness values or normalized correlation function values. Is detected by The television camera that faces the performer is fixed so that the body part of the performer who wants to give a body sign, that is, the movement of the performer's face and limbs can be imaged. The observation window is set in the portion of the video screen imaged in this way where the body signature is to be read.

Depending on the setting of the observation window, for example, the screen centered on the performer's face is imaged, and even if the face moves on the screen, the observation window follows the face portion, and the performer's mouth is It can detect whether it opens.

  The music turning function according to the present invention eliminates the need for the performer to turn a paper music or an assistant for turning the music. It is not necessary, and the digitized musical score display can be freely paged and paged back simply by performing a predetermined body action. Therefore, if the body action to be detected is a slight extension of the movement of the limbs during performance, for example, if you decide to detect that the head and limbs shake a little extra, you can switch this with the limbs during the performance. The troublesome operation of performing the operation becomes unnecessary, and the burden of turning the music score of the performer during the performance is greatly reduced.

  An electronic display device (a flat panel display is suitable for current practical equipment) is provided at the position where the music score is originally placed, such as a music stand, and a control unit, a microphone and a video camera are placed on the back of the electronic display device. And integrated with it.

  FIG. 1 shows an example of a system configuration according to the present proposal. The control unit 101 has a function for controlling each output by each input, the microphone 102 captures a performance sound, and the TV camera 103 has a function of imaging a part of the performer's body. An example of capturing an image of the face will be described. The liquid crystal display 104 displays the electronic musical score itself and displays setting information and status for operating the entire apparatus. The manual operation unit 105 gives a signal for setting or operation to the apparatus, and a signal having the same effect as the signal by the body sign given via the TV camera 103 is given by manual input as necessary. The movable memory 106 is a memory element that can be attached to and detached from the control unit 101. A broken-line box 107 indicates that the entire apparatus is integrated.

  FIG. 2 conceptually describes the inside of the control unit 101 shown in FIG. The control unit 201 has the same function as that of the control unit 101, but is described here with a built-in movable memory 211. In FIG. 2, the microphone 202, the TV camera 203, the liquid crystal display 204, and the manual operation unit 205 are the same as those shown in FIG. The voice capturing I / F 206 is an interface for capturing the output of the microphone into the microcomputer 213. The image capture I / F 207 is an interface for capturing the output of the TV camera 203 into the microcomputer 212. If the output method of the TV camera is a USB method, the image capture I / F 207 referred to here is a USB interface, and the camera Is the LAN interface, the image capture I / F 207 is a LAN interface. A display I / F 208 is an interface for displaying the output of the microcomputer 213 on the liquid crystal display 204. A control signal I / F 209 is an interface for taking the output of the manual operation unit 205 into the microcomputer 213. The memory 212 stores programming and data that control the functions of the apparatus. A power supply 210 supplies necessary power for the entire apparatus.

  FIG. 3 shows an example of a player's face imaged from the position of the electronic music stand and its change. An example of a normal performance scene is a normal screen 301, and an example of a performance scene in which the performer has opened his / her mouth as one of body signs is a body sign transmission screen 302. A face 303 indicating the status of the normal performer and a face 304 indicating the status of transmitting an example of the body sign are displayed on the normal screen 301 and the body sign transmitting screen 302, respectively.

  FIG. 4 shows a pattern in which an observation window is set in the screen group shown in FIG. The observation window group 410 is a 3 × 3 observation window, and observation windows 411 to 419 are arranged as shown in the figure. The observation window group 410 and the observation window group 406 are obtained by setting the observation window group 410 on the normal screen 401 and the body sign transmission screen 402. A face 403 indicating the status of a normal performer and a face 404 indicating a status of transmitting an example of a body sign are displayed on a normal screen 401 and a body sign transmission screen 402, respectively.

  Depending on the nature of the performer, the face may be swung up and down or left and right during performance. In order to compare the brightness of the dark background with the bright face, the average brightness of each observation window such as the observation windows 411, 412, 413, 414, and 416 in this example, particularly the observation window corresponding to the contour portion of the face. The position of the observation window group on the screen is automatically moved up, down, left and right so that the values fall within a certain range.

  The body sign is detected by reading the change of the average brightness value of the observation window 415 with respect to the time axis and transmitting the body sign when the change width exceeds a predetermined value. As for the change of the average brightness value with respect to the time axis, the accuracy of body sign detection can be improved by subjecting the average brightness value to differentiation processing with respect to the time axis.

  Depending on the situation of the performer's face image, chromaticity information is used instead of the average brightness value.

  Using the electronic music stand according to the present invention, not only soloists who have to rely on the turning of music by others, but also performers who are learning to learn the performance style using the performances of advanced performers as examples. Effective equipment can be supplied. Considering these demands, the development of new equipment fields can be expected.

The block diagram which shows schematic structure of one implementation of this invention, Block diagram for explaining the function of the control unit, The figure which shows an example of the difference in the expression of the performer Figure showing the setting of the observation window that detects the difference in the expression of the performer

Explanation of symbols

101, control unit 102, microphone 103, television camera 104, liquid crystal display 105, manual operation unit 106, movable memory 201, control unit 202, microphone 203, television camera 204, liquid crystal display 205, manual operation unit 206, audio capture I / F
207, Image capture I / F
208, Display I / F
209, control signal I / F
210, power supply 211, movable memory 212, memory 213, microcomputer 301, normal screen 302, body sign transmission screen 303, face 304 indicating the status of a normal performer, and an example of a body sign , A normal screen 402, a body sign sending screen 403, a face 404 showing the status of a normal performer, a face 405 showing an example of sending a body sign, an observation window group 406, an observation window Group 410, observation window group 411, observation window 412, observation window 413, observation window 414, observation window 415, observation window 416, observation window 417, observation window 418, observation window 419, observation window

Claims (4)

An apparatus for displaying a musical score converted into an electronic file when playing a musical instrument, comprising a television camera for imaging a performer, and detecting a body sign emitted by the performer from an image signal photographed by the television camera, thereby providing a musical score An electronic music stand characterized by automatically causing the operation to change to the previous page or the next page. 2. The electronic music stand according to claim 1, further comprising a microphone, wherein when a performance is performed while turning the music, a performance sound synchronized with the timing of turning the music is recorded. 2. The electronic music stand according to claim 1, further comprising a metronome function for giving a performer an index of performance tempo. 2. The electronic music stand according to claim 1, further comprising a function capable of measuring between two arbitrary time points (in a stopwatch manner) while sequentially displaying the music score during performance based on the music score.

Images