WO2018221038A1 - Output device, output system, method for controlling output device, and control program - Google Patents

Output device, output system, method for controlling output device, and control program Download PDF

Info

Publication number
WO2018221038A1
WO2018221038A1 PCT/JP2018/015600 JP2018015600W WO2018221038A1 WO 2018221038 A1 WO2018221038 A1 WO 2018221038A1 JP 2018015600 W JP2018015600 W JP 2018015600W WO 2018221038 A1 WO2018221038 A1 WO 2018221038A1
Authority
WO
WIPO (PCT)
Prior art keywords
output
metronome
unit
player
parent
Prior art date
Application number
PCT/JP2018/015600
Other languages
French (fr)
Japanese (ja)
Inventor
敏久 秋山
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2018221038A1 publication Critical patent/WO2018221038A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G04—HOROLOGY
    • G04F—TIME-INTERVAL MEASURING
    • G04F5/00—Apparatus for producing preselected time intervals for use as timing standards
    • G04F5/02—Metronomes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10G—REPRESENTATION OF MUSIC; RECORDING MUSIC IN NOTATION FORM; ACCESSORIES FOR MUSIC OR MUSICAL INSTRUMENTS NOT OTHERWISE PROVIDED FOR, e.g. SUPPORTS
    • G10G7/00—Other auxiliary devices or accessories, e.g. conductors' batons or separate holders for resin or strings
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/18—Selecting circuits
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/40—Rhythm

Definitions

  • the present invention relates to an output device, an output system, an output device control method, and a control program.
  • the present invention relates to a metronome device, a metronome system, a method for controlling the metronome device, and a control program.
  • Patent Document 1 discloses a program for causing an information terminal including a touch panel to execute a metronome sound generation process.
  • the program displays a control group (operation screen for setting the metronome) for setting and displaying the tempo and time signature as the foreground of the touch panel and displaying an arbitrarily selected wallpaper as the background of the touch panel.
  • the program further causes the information terminal to execute a process of changing the brightness of the wallpaper according to the beat timing and the passage of time thereafter during the metronome sound generation process.
  • the conventional technology as described above requires a user to perform a metronome output operation (for example, ON / OFF of the metronome output), which is troublesome.
  • An object of one embodiment of the present invention is to provide an output device capable of operating an output regardless of a user's operation.
  • an output device uses an image acquisition unit that acquires an image of a player including a musical instrument, and a positional relationship between the player and the musical instrument recognized from the image. And an output control unit for controlling the output.
  • the output device control method provides an output using an image acquisition step of acquiring an image of a player including a musical instrument, and a positional relationship between the player and the musical instrument recognized from the image. And an output control step for controlling.
  • an output device capable of operating an output regardless of a user operation.
  • the metronome device 1 may be a humanoid robot terminal, and is provided with an imaging device 11 on the forehead portion and an output portion 12 on the eye portion. Then, the metronome output is performed by controlling the output timing such as blinking the light output from the output unit 12 based on the positional relationship between the player and the instrument imaged by the imaging device 11. Thereby, the metronome output control can be performed only from the photographed image of the player, and the trouble of the player (user) can be saved.
  • FIG. 1 is a block diagram showing a main configuration of the metronome device 1.
  • the metronome device 1 includes an imaging device 11, an output unit 12, a control unit 200, and a storage unit 30.
  • the metronome device 1 can be, for example, a (human type) robot terminal, a general-purpose information terminal, a sound reproduction device, or the like.
  • a (human type) robot terminal for example, a robot terminal, a general-purpose information terminal, a sound reproduction device, or the like.
  • embodiments of the present invention may be described based on these specific examples, but the scope of the present invention is not limited to the above specific examples.
  • the imaging device 11 captures an image including a player and a musical instrument.
  • the image may be a still image or a moving image.
  • the image is sent to the image acquisition unit 201 included in the control unit 200.
  • the imaging device 11 is a digital camera.
  • the output unit 12 performs metronome output (output of time signature, accompaniment, etc.). Whether the output unit 12 performs metronome output (that is, whether the metronome output is turned on or off) is controlled by the output control unit 204.
  • the output unit 12 is a light emitting unit (such as an LED), a display unit (such as a display), an audio output unit (such as a speaker), or a driving unit.
  • the metronome output in the above-described example may be light emission, image, sound, and movement of the metronome device 1 (such as a gesture).
  • the control unit 200 comprehensively controls the operation and processing of the metronome device 1.
  • the control unit 200 includes an image acquisition unit 201, an image recognition unit 202, an image determination unit 203, and an output control unit 204.
  • the control unit 200 is a CPU (Central Processing Unit).
  • the image acquisition unit 201 acquires an image including a player and a musical instrument imaged by the imaging device 11.
  • the acquired image is sent to the image recognition unit 202.
  • the image recognition unit 202 receives an image from the image acquisition unit 201 and recognizes the position of the player and the position of the instrument in the image.
  • the image in which the position of the player and the position of the instrument are recognized is sent to the image determination unit 203.
  • the image determination unit 203 determines whether or not the positional relationship between the player and the instrument is a predetermined positional relationship in the image received from the image recognition unit 202 (an image in which the position of the player and the position of the instrument is recognized). .
  • the determination result of the determination is sent to the output control unit 204.
  • the determination as to whether or not the positional relationship between the player and the instrument is a predetermined positional relationship is performed, for example, by comparing the image received from the image recognition unit 202 with the reference image 31 read from the storage unit 30. .
  • FIG. 16 is an image showing a state in which the player's finger is close to the keyboard. Such a state can be regarded as a state where the player is about to start playing, and is appropriate as the predetermined positional relationship.
  • the output control unit 204 controls the metronome output of the output unit 12 based on the determination result received from the image determination unit 203. That is, when the determination result that “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203, the output control unit 204 causes the output unit 12 to output a metronome (ie, metronome output). To ON). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203 during the metronome output, the output control unit 204 does not cause the output unit 12 to output the metronome. (That is, turn off the metronome output).
  • the storage unit 30 stores information and includes a nonvolatile storage device (flash memory, ROM (Read Only Memory), etc.) and a volatile existing device (RAM (Random Access Memory, etc.)).
  • the nonvolatile storage device stores various programs, various operation setting values, various data, and the like.
  • the volatile storage device stores work files, temporary files, and the like.
  • the storage unit 30 includes a reference image 31 and time / accompaniment data 32.
  • the reference image 31 is data that provides a determination reference when the image determination unit 203 makes a determination. For example, an image as shown in FIG. 16 can be used as the reference image.
  • the time signature / accompaniment data 32 is data constituting a metronome output performed by the output unit 12. The time signature / accompaniment data 32 is sent from the output control unit 204 to the output unit 12.
  • FIG. 2 is a flowchart showing a process flow of the metronome device according to the first embodiment.
  • the image acquisition unit 201 acquires an image including a player and a musical instrument.
  • the image is taken by the imaging device 11.
  • the image recognition unit 202 recognizes the position of the player and the position of the instrument in the image received from the image acquisition unit 201.
  • the image determination unit 203 determines whether or not the positional relationship between the player and the musical instrument is a predetermined positional relationship in the image received from the image recognition unit 202 (an image in which the position of the player and the position of the musical instrument is recognized). Determine whether.
  • the determination as to whether or not the positional relationship between the player and the musical instrument is a predetermined positional relationship may be made, for example, by comparing the image received from the image recognition unit 202 with the reference image 31.
  • the positional relationship between the player and the musical instrument is a positional relationship between the musical instrument and at least one of the player's hands, feet, and mouth. This is because a general musical instrument is played by at least one of a player's hand, foot, and mouth.
  • the predetermined positional relationship may also be a positional relationship between at least one of the player's hands, feet, and mouth and the musical instrument.
  • the reference image 31 may also be an image representing the positional relationship between the instrument and at least one of the player's hands, feet, or mouth.
  • the process proceeds to S14. Conversely, if the image determination unit 203 determines that the positional relationship between the player and the instrument is not the predetermined positional relationship, the process proceeds to S15.
  • step S14 the output control unit 204 causes the output unit 12 to output a metronome.
  • step S15 the output control unit 204 prevents the output unit 12 from outputting a metronome. After the step of S14 or S15 is completed, the process of the metronome device 1 returns to S11 again.
  • the metronome device 1 can have the following functions. That is, the metronome device 1 can control the metronome output based on the image acquired by the metronome device 1 rather than based on the user's operation.
  • the metronome device 1 can output a metronome when the positional relationship between the player and the musical instrument is a predetermined positional relationship. Conversely, if the positional relationship between the player and the musical instrument is not a predetermined positional relationship, the metronome can be output.
  • the metronome device 1 can detect a player's movement such as “put a hand on the keyboard”, “put a mouth on the mouthpiece”, and turn on the metronome output. Further, the metronome device 1 can detect a player's movement such as “release the hand from the keyboard”, “release the mouth from the mouthpiece”, and turn off the metronome output.
  • the metronome device according to the second embodiment includes a drive unit 13 in addition to the configuration of the metronome device according to the first embodiment.
  • the control unit of the metronome device according to the second embodiment includes a face recognition unit 205, a face determination unit 206, and a drive control unit 207.
  • the storage unit of the metronome device according to the second embodiment includes a face reference image 33 in addition to the storage unit of the metronome device according to the first embodiment.
  • members having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.
  • the metronome output performed by the output unit 12 is a metronome output recognized visually. Examples of such a metronome output include light emission, image, and gesture.
  • the driving unit 13 drives each part of the metronome device 1.
  • the drive unit 13 moves the position of the output unit 12 relative to the player by changing or moving the metronome device 1. Such movement may be achieved by moving the entire metronome device 1 or may be achieved by moving a part of the metronome device 1 including the output unit 12.
  • the drive unit 13 can be appropriately configured by known means.
  • the drive unit 13 deforms the metronome device 1 from the standing state to the sitting state so that the height of the output unit 12 corresponds to the height of the player's eyes. (See FIG. 17).
  • the face recognition unit 205 receives an image from the image acquisition unit 201 and recognizes the position of the player's eyes from the player's image included in the image.
  • the face determination unit 206 determines whether or not the output unit 12 and the player's eye position are in a predetermined positional relationship in the image received from the face recognition unit 205 (an image in which the player's eye position is recognized). , Is determined. The determination result of the determination is sent to the drive control unit 207. Whether the output unit 12 and the player's eye position are in a predetermined positional relationship is determined by, for example, comparing an image received from the face recognition unit 205 with a face reference image read from the storage unit 30. Is done by.
  • the above determination can be made by determining whether the left and right eyes are included in the face outline included in the image received from the face recognition unit 205.
  • the face determination unit 206 determines whether or not the output unit is in a position that is easily visible to the player.
  • the face reference image 33 is data that provides a determination reference when the face determination unit 206 makes a determination.
  • FIG. 4 is a flowchart showing a process flow of the metronome device according to the second embodiment.
  • the image acquisition unit 201 acquires the player's image. This step is the same as S11.
  • the face recognition unit 205 recognizes the position of the player's eyes included in the image received from the image acquisition unit 201.
  • the recognition is performed by recognizing the player's face included in the image. Such recognition can be performed by a known face recognition technique.
  • step S ⁇ b> 23 the face determination unit 206 determines whether the output unit 12 is easily visible to the player in the image received from the face recognition unit 205 (an image in which the player's eye position is recognized). To do.
  • the determination as to whether or not the output unit 12 is in a position that is easily visible to the player may be performed by comparing the image received from the face recognition unit 205 with the face reference image 33, for example.
  • the determination as to whether or not the output unit 12 is easily visible to the player is made based on whether or not the player's eyes recognized in S22 include both eyes of the player. The When both eyes of the player are included, it can be determined that “the output unit 12 is in a position where the player can easily see”. Conversely, when at least one eye of the player is not included, it can be determined that “the output unit 12 is not in a position where the player can easily recognize”.
  • the process proceeds to S24. Conversely, if the face determination unit 206 determines that the output unit 12 is not in a position that is easily visible to the player, the process proceeds to S25.
  • the drive control unit 207 controls the drive unit 13 so that the position of the output unit 12 is maintained.
  • the drive control unit 207 drives the metronome device 1 so that the player can easily recognize the position of the output unit 12. This driving is performed, for example, by moving all or part of the metronome device 1.
  • the position of the output unit 12 is driven so that the position of the output unit 12 moves until the player's eyes are included in the image acquired by the image acquisition unit 201.
  • the imaging device 11 is preferably configured to be able to capture an image of a player viewed from the position of the output unit 12. According to such a configuration, it can be more accurately determined whether or not the output unit 12 is in a position that is easily visible to the player.
  • step S24 or S25 ends, the process of the metronome device 1 returns to S21 again.
  • the metronome device 1 can have the following functions. That is, the metronome device 1 can move the metronome output to a position where the player can easily recognize it based on the image acquired by the metronome device 1, not based on the user's operation.
  • FIG. 5 is a block diagram showing the entire metronome system according to the third embodiment.
  • the metronome system 1000 includes a parent metronome device 1a and a child metronome device 1b.
  • the parent metronome device 1a and the child metronome device 1b perform wired communication or wireless communication via the communication unit 14a and the communication unit 14b.
  • the communication requires a predetermined communication time.
  • FIG. 5 shows only one child metronome device, but two or more child metronome devices may be included.
  • FIG. 6 is a block diagram showing a main configuration of the parent metronome device 1a included in the metronome system 1000.
  • the parent metronome device 1a includes an imaging device 11a, an output unit 12a, a communication unit 14a, a control unit 200a, and a storage unit 30a.
  • the control unit 200a includes an image acquisition unit 201a, an image recognition unit 202a, an image determination unit 203a, an output control unit 204a, and a communication control unit 208a.
  • the storage unit 30a includes a reference image 31a, time signature / accompaniment data 32a, and communication time data 34a.
  • the image determination unit 203a also sends a determination result “whether or not the positional relationship between the player and the instrument is a predetermined positional relationship” to the communication control unit 208a.
  • the output control unit 204a is modified in the function described in the first embodiment. That is, the output control unit 204a reflects the time required for communication between the parent metronome device 1a and the child metronome device 1b (hereinafter also simply referred to as “communication time”) based on the determination result received from the image determination unit 203a. After that, the metronome output of the output unit 12a is controlled. More specifically, when the determination result “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203a, the output control unit 204a has transmitted the output instruction from the communication unit 14a.
  • the output unit 12a After the communication time has elapsed from the time, the output unit 12a outputs a metronome (that is, turns on the metronome output). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203a during the metronome output, the output control unit 204a causes the communication unit 14a to issue an output instruction. After the communication time has elapsed from the time of transmission, the output unit 12a is prevented from outputting the metronome (that is, the metronome output is turned off).
  • the communication unit 14a communicates with the child metronome device.
  • the communication unit 14a includes a transmission unit that transmits data to the child metronome device and a reception unit that receives data from the child metronome device.
  • the specific configuration of the communication unit can be appropriately set depending on the type of communication employed.
  • the communication control unit 208a sends data to be transmitted to the communication unit 14a (transmission unit) and acquires data received by the communication unit 14a (reception unit).
  • the communication control unit 208a When the communication control unit 208a receives the determination result from the image determination unit 203a, the communication control unit 208a causes the communication unit to transmit an instruction based on the determination result. That is, when the determination result that “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203a, the communication control unit 208a causes the communication unit 14a to transmit an output instruction.
  • the output instruction is an instruction of contents to be output to the metronome device 1b by the metronome apparatus 1b.
  • the communication control unit 208a includes the communication unit 14a.
  • the stop instruction is an instruction to prevent the child metronome device 1b from outputting the metronome.
  • the communication control unit 208a receives the information and records it in the storage unit 30 as communication time data 34a.
  • the parent metronome device 1a is configured to measure the communication time, the function of the communication control unit 208a is not always necessary.
  • the communication time data 34a is data relating to the time required for communication between the parent metronome device 1a and the child metronome device 1b.
  • the communication time data 34a is referred to when the output control unit 204a controls the metronome output.
  • FIG. 7 is a block diagram showing a main configuration of a child metronome device 1b included in the metronome system 1000.
  • the child metronome device 1b includes an output unit 12b, a communication unit 14b, a control unit 200b, and a storage unit 30b.
  • the control unit 200b includes an output control unit 204b, a communication control unit 208b, a communication time measurement unit 209b, and a command determination unit 210b.
  • the storage unit 30b includes time signature / accompaniment data 32b and an instruction table 35b.
  • the output control unit 204b controls the output unit 12b based on the determination result of the instruction determination unit 210b. That is, when the command determination unit 210b determines that “an output instruction has been received”, the output control unit 204b causes the output unit 12b to output a metronome. Conversely, when the command determination unit 210b determines that “a stop instruction has been received”, the output control unit 204b prevents the output unit 12b from outputting a metronome.
  • the communication control unit 208b sends data to be transmitted to the communication unit 14b (transmission unit), and acquires data received by the communication unit 14b (reception unit).
  • the communication control unit 208b When the communication control unit 208b receives an output instruction or a stop instruction from the communication unit 14b, the communication control unit 208b sends the instruction to the instruction determination unit 210b.
  • the communication control unit 208b receives information on the communication time from the communication time measuring unit 209b and causes the communication unit 14b to transmit the information.
  • the function of the communication control unit 208b is not always necessary.
  • the communication time measuring unit 209b measures the communication time.
  • the communication time is measured by the following procedure, for example. (1) First, the parent metronome device 1a transmits a communication time measurement signal. The communication time measurement signal includes the instant at which the signal is transmitted. (2) Next, the child metronome device 1b compares “the time at which the signal included in the communication time measurement signal is transmitted” with “the time when the communication time measurement signal is received”. . (3) Measure the communication time based on the comparison result. After measuring the communication time, the communication time measuring unit 209b generates information about the communication time and sends it to the communication control unit 208b.
  • the communication time measuring unit may be provided in the parent metronome device 1a.
  • the communication time measurement signal is transmitted from the child metronome device 1b to the parent metronome device 1a
  • the parent metronome device 1a measures the communication time
  • the parent metronome device 1a transmits the communication time.
  • the command determination unit 210b determines whether the command received from the communication control unit 208b is an output instruction or a stop instruction. The determination is performed, for example, by comparing a command received from the communication control unit with a command table.
  • the instruction table 35b is data that provides a determination criterion when the instruction determination unit 210b determines whether the instruction received from the communication control unit 208b is an output instruction or a stop instruction.
  • FIG. 8 is a flowchart showing the processing flow of the parent metronome device 1a included in the metronome system 1000.
  • the parent metronome device 1a acquires information related to the communication time required for communication with the child metronome device 1b. More specifically, acquisition of information related to communication time is performed by the following sub-steps. (1) The communication time measuring unit 209b measures the communication time and generates information related to the communication time. (2) The communication control unit 208b receives information related to the communication time and causes the communication unit 14b to transmit the information. (3) The communication control unit 208a acquires information related to the communication time received by the communication unit 14a. (4) The communication control unit 208a records information related to the communication time as communication time data 34a.
  • the step of S31 can be performed by the following two substeps. (1) The communication time measuring unit measures communication time. (2) The communication time measuring unit generates information related to the communication time from the communication time and records it as communication time data 34a.
  • Steps S32, S33, and S34 correspond to steps S11, S12, and S13 in FIG. 2, respectively.
  • the parent metronome device 1a determines whether or not the player and the musical instrument are in a predetermined positional relationship. If the image determination unit 203a determines that “the player and the instrument are in a predetermined positional relationship”, the process proceeds to S35, and if it is determined that “the player and the instrument are not in a predetermined positional relationship”, the process proceeds to S37.
  • the communication control unit 208a that has received the determination result that “the player and the musical instrument are in a predetermined positional relationship” causes the communication unit 14a (transmission unit) to transmit an output instruction.
  • the output instruction is an instruction of contents to be output to the metronome device 1b by the metronome apparatus 1b.
  • the output control unit 204a that has received the determination result that “the player and the musical instrument are in a predetermined positional relationship” causes the output unit 12a to output a metronome after reflecting the communication time. More specifically, the output unit 12a is controlled so that the metronome is output at the “time when the communication unit 14a (transmission unit) further transmits a communication time after the output instruction is transmitted”. It should be noted that “when the communication unit 14a (transmission unit) transmits an output instruction” in the parent metronome device 1a is “when the positional relationship between the player and the instrument becomes a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1a returns to S32.
  • the communication control unit 208a that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” causes the communication unit 14a (transmission unit) to transmit a stop instruction.
  • the stop instruction is an instruction to prevent the child metronome device 1b from outputting the metronome output.
  • the output control unit 204a that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” reflects the communication time and prevents the output unit 12a from outputting the metronome. More specifically, the output unit 12a is controlled so that the metronome is not output when “the communication unit 14a (transmission unit) transmits the stop instruction and when the communication time further elapses”. It should be noted that “when the communication unit 14a (transmission unit) transmits a stop instruction” in the parent metronome device 1a is “when the positional relationship between the player and the instrument is no longer a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1a returns to S32.
  • FIG. 9 is a flowchart showing a process flow of the child metronome device 1b included in the metronome system 1000.
  • the communication time measuring unit 209b measures the communication time.
  • the communication time is measured by, for example, the method exemplified in the description of the communication time measurement unit 209b. Thereafter, the communication time measurement unit 209b generates information related to the communication time.
  • the communication control unit 208b receives information on the communication time from the communication time measurement unit 209b and causes the communication unit 14b to transmit the information.
  • the steps S41 and S42 can be omitted.
  • the communication unit 14b receives the command transmitted from the parent metronome device 1a.
  • the received command is acquired by the communication control unit 208b.
  • the command received in S43 is the command (output instruction or stop instruction) transmitted in S35 or S37.
  • the instruction determination unit 210b receives an instruction from the communication control unit 208b, and determines whether the instruction is an output instruction or a stop instruction. The determination is performed, for example, by comparing the command received from the communication control unit 208b with the command table 35b read from the storage unit 30b. If it is determined that the command is an output instruction, the process proceeds to S45. If it is determined that the instruction is a stop instruction, the process proceeds to S46.
  • the output control unit 204b causes the output unit 12b to output a metronome.
  • the output control unit 204b prevents the output unit 12b from outputting the metronome.
  • the metronome system 1000 can have the following functions. That is, the parent metronome device 1a and the child metronome device 1b can control the metronome output at the same time. More specifically, the parent metronome device 1a and the child metronome device 1b can turn on / off the metronome output at the same timing. Thereby, a synchronized metronome output can be obtained among a plurality of metronome devices.
  • the player who uses the parent metronome device 1a recognizes that the metronome output is turned on after the communication time has elapsed after taking a predetermined positional relationship with the musical instrument. For this reason, it is preferable that the communication time is as short as possible so that the player who uses the parent metronome device 1a does not feel inconvenience (for example, about 0.01 seconds).
  • FIG. 10 is a block diagram showing the entire metronome system according to the fourth embodiment.
  • the metronome system 2000 includes a parent metronome device 1c and child metronome devices 1d and 1e. Although only two child metronome devices are illustrated in FIG. 5, three or more child metronome devices may be included.
  • the parent metronome device 1c and the child metronome device 1d perform wired communication or wireless communication via the communication unit 14c and the communication unit 14d.
  • a first communication time is required for communication between the parent metronome device 1c and the child metronome device 1d.
  • the parent metronome device 1c and the child metronome device 1e perform wired communication or wireless communication via the communication unit 14c and the communication unit 14e. Communication between the parent metronome device 1c and the child metronome device 1e requires a second communication time.
  • FIG. 11 is a block diagram showing a main configuration of the parent metronome device 1c included in the metronome system 2000.
  • the parent metronome device 1c includes an imaging device 11c, an output unit 12c, a communication unit 14c, a control unit 200c, and a storage unit 30c.
  • the control unit 200c includes an image acquisition unit 201c, an image recognition unit 202c, an image determination unit 203c, an output control unit 204c, a communication control unit 208c, and a maximum communication time extraction unit 211c.
  • the storage unit 30c includes a reference image 31c, time signature / accompaniment data 32c, and communication time data 34c.
  • the output control unit 204c is modified in the function described in the third embodiment. That is, based on the determination result received from the image determination unit 203c, the output control unit 204c determines the maximum time (hereinafter simply referred to as “maximum communication time”) required for communication between the parent metronome device 1c and the child metronome devices 1d and 1e. And the metronome output of the output unit 12c is controlled.
  • the “maximum communication time” in FIG. 10 is a longer communication time out of the first communication time and the second communication time.
  • the output control unit 204c is the maximum from the time when the communication unit 14c transmits the output instruction. After the communication time elapses, the output unit 12c outputs the metronome (that is, turns the metronome output ON). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203c during the metronome output, the output control unit 204c causes the communication unit 14c to issue an output instruction. After the maximum communication time has elapsed from the time of transmission, the output unit 12c is prevented from outputting a metronome (that is, the metronome output is turned off).
  • the communication control unit 208c sends data to be transmitted to the communication unit 14c (transmission unit) and acquires data received by the communication unit 14c (reception unit).
  • the communication control unit 208c receives information on the maximum communication time from the maximum communication time extraction unit 211c, and transmits the information to the child metronome devices 1d and 1e via the communication unit 14c.
  • the communication control unit 208c receives the information and records it in the storage unit 30 as communication time data 34c. Therefore, the communication time data 34c includes the same number of information about communication time as the number of child metronome devices. Note that, when the parent metronome device 1c is configured to measure the communication time, the function of the communication control unit 208c is not necessarily required.
  • the function when the communication control unit 208a receives the determination result from the image determination unit 203a is the same as that of the third embodiment.
  • the maximum communication time extraction unit 211c reads the communication time data 34c from the storage unit 30c, and extracts information related to the maximum communication time included in the communication time data 34c. Information regarding the extracted maximum communication time is sent to the output control unit 204c and the communication control unit 208c.
  • the communication time data 34c information on communication time between the parent metronome device 1c and each child metronome device is recorded. Therefore, in the case of the configuration of the metronome system 2000 shown in FIG. 10, the communication time data 34c includes information related to the first communication time and information related to the second communication time.
  • FIG. 12 is a block diagram showing the main configuration of the child metronome device 1d included in the metronome system 1000.
  • the child metronome device 1d includes an output unit 12d, a communication unit 14d, a control unit 200d, and a storage unit 30d.
  • the control unit 200d includes an output control unit 204d, a communication control unit 208d, a communication time measurement unit 209d, a command determination unit 210d, and a difference time calculation unit 212d.
  • the storage unit 30d includes time signature / accompaniment data 32d, communication time data 34d, and a command table 35d.
  • the output control unit 204d controls the output unit 12d by reflecting the difference time based on the determination result of the instruction determination unit 210d. That is, when the command determination unit 210d determines that “the output instruction has been received”, the output control unit 204d causes the output unit 12d to output a metronome at “a time when the difference time has elapsed from the time when the output instruction is received”. . On the other hand, when the command determination unit 210d determines that “stop instruction has been received”, the output control unit 204d does not cause the output unit 12d to output the metronome when the difference time has elapsed from the time when the stop instruction is received. To. Information regarding the difference time necessary for the output control unit 204d to control the output unit 12d is received from the difference time calculation unit 212d.
  • the communication control unit 208d sends data to be transmitted to the communication unit 14d (transmission unit) and acquires data received by the communication unit 14d (reception unit).
  • the communication control unit 208d when the communication control unit 208d receives information on the maximum communication time from the communication unit 14d, the communication control unit 208d writes the information on the maximum communication time in the storage unit 30d as communication time data 34d.
  • the function when the communication control unit 208d receives an output instruction or a stop instruction from the communication unit 14b is the same as that of the third embodiment.
  • the function of the communication control unit 208d when the communication time measuring unit 209b measures the communication time is the same as that of the third embodiment.
  • the communication time measuring unit 209d measures the communication time. Further, after measuring the communication time, the communication time measuring unit 209d generates information related to the communication time, sends the information to the communication control unit 208b, and writes the communication time data 34d in the storage unit 30d.
  • the difference time calculation unit 212d reads the communication time data 34d from the storage unit 30d and calculates the difference time. Thereafter, the difference time calculation unit 212d generates information on the difference time and sends it to the output control unit 204d.
  • the difference time is a time obtained by subtracting the communication time between the child metronome device 1d and the parent metronome device 1c from the maximum communication time. That is, the difference time is a difference between (1) the maximum communication time and (2) the communication time between the own device and the parent metronome device. Therefore, when the communication time between the own device and the parent metronome device is the maximum communication time, the difference time is zero.
  • the communication time data 34d (1) information related to the maximum communication time written from the communication control unit 208d, and (2) information related to communication time between the own device and the parent metronome device 1c written from the communication time measurement unit 209d. , Is included.
  • the communication time measuring unit is provided in the parent metronome device 1c, information related to the communication time between the own device and the parent metronome device 1c is also written by the communication control unit 208d.
  • the communication time data 34d is read by the difference time calculation unit and provided as information for calculating the difference time.
  • FIG. 13 is a flowchart showing a process flow of the parent metronome device 1c included in the metronome system 1000.
  • the parent metronome device 1c acquires information related to the communication time required for communication with the child metronome devices 1d and 1e.
  • a method for acquiring information related to communication time with each child metronome device is as described in the third embodiment. Further, the description when the communication time measuring unit is provided in the parent metronome device 1c is also as described in the third embodiment.
  • the acquired communication time is written in the storage unit 30c as communication time data 34c.
  • the maximum communication time extraction unit 211c reads the communication time data 34c, and extracts information related to the maximum communication time from information related to each communication time.
  • the information on the maximum communication time is information on the communication time indicating the longest communication time among the information on the respective communication times.
  • the extracted information related to the maximum communication time is sent to the communication control unit 208c and transmitted to the child metronome devices 1d and 1e via the communication unit 14c.
  • Steps S53, S54 and S55 correspond to the steps S11, S12 and S13 in FIG. 2, respectively.
  • the parent metronome device 1c determines whether or not the player and the musical instrument are in a predetermined positional relationship. If the image determination unit 203c determines that “the player and the instrument are in a predetermined positional relationship”, the process proceeds to S56, and if it is determined that “the player and the instrument are not in a predetermined positional relationship”, the process proceeds to S58.
  • S56 and S58 correspond to S35 and S37 in FIG. 8, respectively.
  • the communication control unit 208c transmits an output instruction or a stop instruction to the child metronome devices 1d and 1e via the communication unit 14c.
  • the output control unit 204c that has received the determination result that “the player and the instrument are in a predetermined positional relationship” causes the output unit 12c to output a metronome after reflecting the maximum communication time. More specifically, the output unit 12c is controlled so that the metronome output is performed “at the time when the maximum communication time has elapsed from when the communication unit 14c (transmission unit) transmits the output instruction”. It should be noted that “when the communication unit 14c (transmission unit) transmits an output instruction” in the parent metronome device 1c is “when the positional relationship between the player and the instrument becomes a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1c returns to S53.
  • the output control unit 204c that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” reflects the maximum communication time and prevents the output unit 12c from outputting the metronome. More specifically, the output unit 12c is controlled so that the metronome is not output when “the maximum communication time has elapsed after the communication unit 14c (transmission unit) transmits the stop instruction”. Note that “the point in time when the communication unit 14c (transmission unit) transmits a stop instruction” in the parent metronome device 1c is “the point in time when the positional relationship between the player and the instrument is no longer a predetermined positional relationship” for the player. After S59, the process of the parent metronome device 1c returns to S53.
  • FIG. 14 is a flowchart showing a process flow of the child metronome device 1d included in the metronome system 2000.
  • the sub-metronome device 1e also performs the same processing as described below.
  • the communication time measuring unit 209d measures the communication time.
  • the communication time is measured by the method exemplified in the third embodiment, for example. Thereafter, the communication time measuring unit 209d generates information related to the communication time (communication time between the own device and the parent metronome device 1c). In addition, the communication time measurement unit 209d writes information related to the communication time in the storage unit 30d as communication time data.
  • the communication control unit 208d receives information related to the communication time from the communication time measurement unit 209d and causes the communication unit 14d to transmit the information.
  • the step of S61 can be replaced with the following steps. That is, (1) The communication unit 14d receives information on the communication time (communication time between the own device and the parent metronome device 1c) generated by the communication time measurement unit of the parent metronome device. (2) The communication control unit 208d acquires information related to the communication time and writes the information as communication time data 34d in the storage unit 30d. In the above case, S62 can be omitted.
  • the communication unit 14d receives information on the maximum communication time transmitted from the parent metronome device 1c.
  • the communication control unit 208d acquires information on the maximum communication time from the communication unit 14d, and writes the information as communication time data 34d in the storage unit 30d.
  • the difference time calculation unit 212d reads the communication time data 34d from the storage unit 30d and calculates the difference time. More specifically, the difference time calculation unit 212d calculates the difference time based on “information about maximum communication time” and “information about communication time” included in the communication time data 34d. Thereafter, the difference time calculation unit 212d generates information about the difference time.
  • S65 and S66 correspond to S43 and S44 of FIG. 9, respectively.
  • the child metronome device 1d determines whether the received command is an output instruction or a stop instruction, and sends a determination result to the output control unit 204d.
  • the output control unit 204d reflects the difference time and causes the output unit 12d to output a metronome. More specifically, the output control unit 204d causes the output unit 12d to output a metronome at a “time when a difference time has elapsed from the time when the output instruction is received”. After the step of S67 is completed, the process of the child metronome device 1d returns to S65 again.
  • the output control unit 204d reflects the difference time and prevents the output unit 12d from outputting the metronome. More specifically, the output control unit 204d prevents the output unit 12d from outputting the metronome at the “time when the difference time has elapsed from the time when the output instruction is received”. After the step of S68 is completed, the process of the child metronome device 1d returns to S65 again.
  • the metronome system 2000 can have the following functions. That is, the parent metronome device 1c and the child metronome devices 1d and 1e can control the metronome output at the same time. More specifically, the parent metronome device 1c and the child metronome devices 1d and 1e can turn on / off the metronome output at the same timing. Thereby, a synchronized metronome output can be obtained between three or more metronome devices.
  • the player using the parent metronome device 1c recognizes that the metronome output is turned on after the maximum communication time has elapsed since the predetermined positional relationship with the musical instrument has been established. .
  • the maximum communication time is as short as possible (for example, about 0.01 seconds) so that the player who uses the parent metronome device 1c does not feel inconvenience.
  • the configuration of the parent metronome device in the third and fourth embodiments can be the configuration of the metronome device described in the second embodiment. According to such a configuration, the parent metronome device can move the metronome output to a position where the player can easily view the image based on the image acquired by the parent metronome device, not based on the user's operation.
  • the configurations of the parent metronome device and the child metronome device can be the same. That is, a member provided only in one metronome device can be provided in the other metronome device. With this configuration, the same metronome device can be used as a parent metronome device in some cases and as a child metronome device in other cases.
  • control unit 200 of the metronome device 1, the control units 200a and 200c of the parent metronome devices 1a and 1c, and the control units 200b, 200d and 200e of the child metronome devices 1b, 1d and 1e are formed in an integrated circuit (IC chip) or the like. Alternatively, it may be realized by a logic circuit (hardware) or by software using a CPU (Central Processing Unit).
  • IC chip integrated circuit
  • CPU Central Processing Unit
  • the metronome device 1, the parent metronome devices 1a, 1c, and the child metronome devices 1b, 1d, 1e are a CPU that executes instructions of a program that is software for realizing each function, and the program and various data are stored in a computer ( Alternatively, a ROM (Read Only Memory) or a storage device (these are referred to as “recording media”) and a RAM (Random Access Memory) that expands the program are recorded. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it.
  • a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used.
  • the program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program.
  • an arbitrary transmission medium such as a communication network or a broadcast wave
  • one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.
  • the embodiment of the present invention has been described by taking the metronome device as an example.
  • the scope of the present invention is not limited to metronome devices.
  • an output device that outputs music instead of the metronome output may be used.
  • the output device (metronome device 1) according to aspect 1 of the present invention outputs an image using an image acquisition unit 201 that acquires an image of a player including a musical instrument, and the positional relationship between the player and the musical instrument recognized from the image ( And an output control unit 204 for controlling (metronome output).
  • output (metronome output) can be controlled based on an image acquired by the output device (metronome device 1), not based on a user operation.
  • the output control unit 204 may perform output (metronome output) when the positional relationship becomes a predetermined positional relationship. Good.
  • the output device can perform output (metronome output) when the positional relationship between the player and the musical instrument is a predetermined positional relationship.
  • the output device detects the player's movements such as “put your hand on the keyboard” or “put your mouth on the mouthpiece” and turn on the output (metronome output). Can do.
  • the output device (metronome device 1) is the output device 12 that performs the above-mentioned output (metronome output) recognized visually, the player recognized from the image, and the above-described player.
  • a drive unit 13 for moving the position of the output unit 12 relative to the player may be further provided so that the output (metronome output) is easily visible to the player using the positional relationship with the output unit 12. .
  • the output device (metronome device 1) is not based on the user's operation, but the player visually recognizes the output (metronome output) based on the image acquired by the output device (metronome device 1). It can be moved to an easy position.
  • the output device (metronome device 1) according to aspect 4 of the present invention, in the above-described aspects 1 to 3, the output is at least one of metronome output and music.
  • an output device (metronome device 1) that can output at least one of metronome output and music is obtained.
  • the output system (metronome system 1000) is an output system (metronome system 1000) including a parent output device (parent metronome device 1a) and one or more child devices (child metronome device 1b).
  • the parent output device (parent metronome device 1a) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome)
  • an output instruction is transmitted to the device 1b) and a predetermined time elapses from when the output instruction is transmitted, an output (metronome output) is performed, and the child device (child metronome device 1b)
  • the output instruction is received from the parent metronome apparatus 1a), and when the output instruction is received, output (metronome output) is performed.
  • the child device when the parent output device (parent metronome device 1a) performs output (metronome output), the child device (child metronome device 1b) can also perform output (metronome output).
  • the output (metronome output) of the child device (child metronome device 1b) can be turned on / off in accordance with the ON / OFF of the output (metronome output) of the parent output device (parent metronome device 1a).
  • the output system (metronome system 1000) is an output system (metronome system 1000) including a parent output device (parent metronome device 1a) and one or more child devices (child metronome device 1b).
  • the parent output device (parent metronome device 1a) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome) Since the output instruction is transmitted to the apparatus 1b), the time required for communication between the own apparatus (parent output apparatus (parent metronome apparatus 1a)) and the child apparatus (child metronome apparatus 1b) has elapsed since the output instruction is transmitted.
  • Output (metronome output) the child device (child metronome device 1b) is connected to the parent output device (parent metronome device). Receiving the output instruction from a) a, it performs output (metronome output) when it receives the output instruction.
  • the parent output device (parent metronome device 1a) and the child device (child metronome device 1b) can control the output (metronome output) at the same time.
  • the parent output device (parent metronome device 1a) and the child device (child metronome device 1b) can turn ON / OFF the output (metronome output) at the same timing.
  • a synchronized output (metronome output) can be obtained among a plurality of output devices (metronome devices).
  • the output system (metronome system 2000) is an output system (metronome system 2000) including a parent device (parent metronome device 1c) and a plurality of child devices (child metronome devices 1d and 1e).
  • the parent device (parent metronome device 1c) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome device 1d).
  • an output instruction for output (metronome output) is transmitted, and when the output instruction is transmitted, the own apparatus (parent apparatus (parent metronome apparatus 1c)) and the plurality of child apparatuses (child metronome apparatuses 1d, 1e) )
  • the maximum communication time which is the maximum time, has elapsed (metronome output)
  • (Child metronome device 1d) receives the output instruction from the parent device (parent metronome device 1c), and when receiving the output instruction, the own device (child device (child metronome device 1d)) and the parent device
  • output (metronome output) is performed.
  • the parent device (parent metronome device 1c) and the child devices (child metronome devices 1d, 1e) can control the output (metronome output) at the same time.
  • the parent device (parent metronome device 1c) and the child devices (child metronome devices 1d, 1e) can turn ON / OFF the output (metronome output) at the same timing. Thereby, a synchronized output (metronome output) can be obtained between three or more output devices (metronome devices).
  • the control method of the output device (metronome device) according to the aspect 8 of the present invention includes an image acquisition step (S11) for acquiring an image of a player including a musical instrument, and a positional relationship between the player recognized from the image and the musical instrument. And an output control process (S13, S14, S15) for controlling the output (metronome output). According to said structure, there exists an effect similar to the said aspect 1.
  • FIG. 1 An image acquisition step (S11) for acquiring an image of a player including a musical instrument, and a positional relationship between the player recognized from the image and the musical instrument.
  • an output control process S13, S14, S15
  • the output device (metronome device) (including the parent device (parent metronome device) and the child device (child metronome device)) according to each aspect of the present invention may be realized by a computer.
  • a control program of the output device (metronome device) that realizes the output device (metronome device) by a computer by operating as each unit (software element) included in the output device (metronome device), and a computer readable recording thereof Recording media also fall within the scope of the present invention.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

Provided is an output device with which it is possible to manipulate the output irrespective of manipulation by a user. An output device (metronome device (1)) according to one embodiment of the present invention comprises an image acquisition unit (201) that acquires an image of a musician including an instrument, and an output control unit (204) that controls the output using the positional relationship between the musician and the instrument as recognized from the image.

Description

出力装置、出力システム、出力装置の制御方法および制御プログラムOUTPUT DEVICE, OUTPUT SYSTEM, OUTPUT DEVICE CONTROL METHOD, AND CONTROL PROGRAM
　本発明は、出力装置、出力システム、出力装置の制御方法および制御プログラムに関する。一例においては、メトロノーム装置、メトロノームシステム、メトロノーム装置の制御方法および制御プログラムに関する。 The present invention relates to an output device, an output system, an output device control method, and a control program. In one example, the present invention relates to a metronome device, a metronome system, a method for controlling the metronome device, and a control program.
　発光や発音などの手段により、拍子・伴奏などを出力する電子メトロノーム装置が、従来技術として知られている。例えば特許文献１は、タッチパネルを備えた情報端末に、メトロノームの発音処理を実行させるプログラムを開示している。上記プログラムは、テンポ、拍子を設定し表示するコントロール群（メトロノームの設定のための操作画面）を上記タッチパネルの前景として表示するとともに、任意に選択した壁紙を上記タッチパネルの背景として表示する。上記プログラムはさらに、上記メトロノーム発音処理中において、拍のタイミングおよびその後の時間経過に応じて前記壁紙の明度を変化させる処理を、上記情報端末に実行させる。 2. Description of the Related Art An electronic metronome device that outputs time signatures and accompaniment by means such as light emission and sound generation is known as a prior art. For example, Patent Document 1 discloses a program for causing an information terminal including a touch panel to execute a metronome sound generation process. The program displays a control group (operation screen for setting the metronome) for setting and displaying the tempo and time signature as the foreground of the touch panel and displaying an arbitrarily selected wallpaper as the background of the touch panel. The program further causes the information terminal to execute a process of changing the brightness of the wallpaper according to the beat timing and the passage of time thereafter during the metronome sound generation process.
日本国公開特許公報「特開２０１５－０６８７４４号公報（２０１５年４月１３日公開）」Japanese Patent Publication “Japanese Patent Laid-Open No. 2015-068744 (published on April 13, 2015)”
　しかしながら、上述のような従来技術は、メトロノーム出力の操作（例えば、メトロノーム出力のＯＮ／ＯＦＦ）を、ユーザ自身が行う必要があり、手間を要した。 However, the conventional technology as described above requires a user to perform a metronome output operation (for example, ON / OFF of the metronome output), which is troublesome.
　本発明の一態様は、ユーザの操作によらずに、出力を操作することができる出力装置を提供することを目的とする。 An object of one embodiment of the present invention is to provide an output device capable of operating an output regardless of a user's operation.
　上記の課題を解決するために、本発明の一態様に係る出力装置は、楽器を含む奏者の画像を取得する画像取得部と、上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力を制御する出力制御部と、を備えている。 In order to solve the above problems, an output device according to an aspect of the present invention uses an image acquisition unit that acquires an image of a player including a musical instrument, and a positional relationship between the player and the musical instrument recognized from the image. And an output control unit for controlling the output.
　また、本発明の他の態様に係る出力装置の制御方法は、楽器を含む奏者の画像を取得する画像取得工程と、上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力を制御する出力制御工程と、を備えている。 The output device control method according to another aspect of the present invention provides an output using an image acquisition step of acquiring an image of a player including a musical instrument, and a positional relationship between the player and the musical instrument recognized from the image. And an output control step for controlling.
　本発明の一態様によれば、ユーザの操作によらずに、出力を操作することができる出力装置が提供される。 According to one aspect of the present invention, there is provided an output device capable of operating an output regardless of a user operation.
本発明の実施形態１に係るメトロノーム装置の、要部を表すブロック図である。It is a block diagram showing the principal part of the metronome apparatus which concerns on Embodiment 1 of this invention. 本発明の実施形態１に係るメトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the metronome apparatus which concerns on Embodiment 1 of this invention. 本発明の実施形態２に係るメトロノーム装置の、要部を表すブロック図である。It is a block diagram showing the principal part of the metronome apparatus which concerns on Embodiment 2 of this invention. 本発明の実施形態２に係るメトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the metronome apparatus which concerns on Embodiment 2 of this invention. 本発明の実施形態３に係るメトロノームシステムの、全体を表すブロック図である。It is a block diagram showing the whole metronome system which concerns on Embodiment 3 of this invention. 本発明の実施形態３に係るメトロノームシステムを構成する、親メトロノーム装置の要部を表すブロック図である。It is a block diagram showing the principal part of the parent metronome apparatus which comprises the metronome system which concerns on Embodiment 3 of this invention. 本発明の実施形態３に係るメトロノームシステムを構成する、子メトロノーム装置の要部を表すブロック図である。It is a block diagram showing the principal part of the child metronome apparatus which comprises the metronome system which concerns on Embodiment 3 of this invention. 本発明の実施形態３に係るメトロノームシステムを構成する親メトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the parent metronome apparatus which comprises the metronome system which concerns on Embodiment 3 of this invention. 本発明の実施形態３に係るメトロノームシステムを構成する子メトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the child metronome apparatus which comprises the metronome system which concerns on Embodiment 3 of this invention. 本発明の実施形態４に係るメトロノームシステムの、全体を表すブロック図である。It is a block diagram showing the whole metronome system which concerns on Embodiment 4 of this invention. 本発明の実施形態４に係るメトロノームシステムを構成する、親メトロノーム装置の要部を表すブロック図である。It is a block diagram showing the principal part of the parent metronome apparatus which comprises the metronome system which concerns on Embodiment 4 of this invention. 本発明の実施形態４に係るメトロノームシステムを構成する、子メトロノーム装置の要部を表すブロック図である。It is a block diagram showing the principal part of the child metronome apparatus which comprises the metronome system which concerns on Embodiment 4 of this invention. 本発明の実施形態４に係るメトロノームシステムを構成する親メトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the parent metronome apparatus which comprises the metronome system which concerns on Embodiment 4 of this invention. 本発明の実施形態４に係るメトロノームシステムを構成する子メトロノーム装置の、処理の流れを表すフローチャートである。It is a flowchart showing the flow of a process of the child metronome apparatus which comprises the metronome system which concerns on Embodiment 4 of this invention. 本発明の実施形態１に係るメトロノーム装置の、概要を表す模式図である。It is a schematic diagram showing the outline | summary of the metronome apparatus which concerns on Embodiment 1 of this invention. 本発明の実施形態１における、所定の位置関係の一例を表す図である。It is a figure showing an example of the predetermined positional relationship in Embodiment 1 of this invention. 本発明の実施形態２に係るメトロノーム装置おける奏者に対する出力部の位置の移動の一例を表す模式図である。It is a schematic diagram showing an example of the movement of the position of the output part with respect to the player in the metronome apparatus which concerns on Embodiment 2 of this invention.
　〔実施形態１〕
　［概要］
　まず、図１５を参照して、実施形態１に係るメトロノーム装置１の概要について説明する。図１５に示すように、メトロノーム装置１は、人型ロボット端末でよく、額部分に撮像装置１１が備えられているとともに、眼の部分が出力部１２となっている。そして、撮像装置１１で撮像した奏者と楽器との位置関係に基づいて、出力部１２から出力する光を点滅させるなどの出力タイミングを制御することにより、メトロノーム出力を行う。これにより、奏者の撮影画像のみからメトロノーム出力制御することができ、奏者（ユーザ）の手間を省くことができる。 Embodiment 1
[Overview]
First, an outline of the metronome device 1 according to the first embodiment will be described with reference to FIG. As shown in FIG. 15, the metronome device 1 may be a humanoid robot terminal, and is provided with an imaging device 11 on the forehead portion and an output portion 12 on the eye portion. Then, the metronome output is performed by controlling the output timing such as blinking the light output from the output unit 12 based on the positional relationship between the player and the instrument imaged by the imaging device 11. Thereby, the metronome output control can be performed only from the photographed image of the player, and the trouble of the player (user) can be saved.
　［メトロノーム装置の構成］
　次に、実施形態１に係るメトロノーム装置の要部構成について、図１に基づいて説明する。図１は、メトロノーム装置１の要部構成を表すブロック図である。図１に表されているように、メトロノーム装置１は、撮像装置１１、出力部１２、制御部２００、記憶部３０を備えている。 [Configuration of metronome device]
Next, the configuration of the main part of the metronome device according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the metronome device 1. As shown in FIG. 1, the metronome device 1 includes an imaging device 11, an output unit 12, a control unit 200, and a storage unit 30.
　メトロノーム装置１は、例えば、（人型）ロボット端末、汎用情報端末、音響再生装置などでありうる。以下、これらの具体例に基づいて本発明の実施形態を説明する場合があるが、本発明の範囲は上記具体例には限定されない。 The metronome device 1 can be, for example, a (human type) robot terminal, a general-purpose information terminal, a sound reproduction device, or the like. Hereinafter, embodiments of the present invention may be described based on these specific examples, but the scope of the present invention is not limited to the above specific examples.
　撮像装置１１は、奏者および楽器が含まれている画像を撮像する。上記画像は、静止画像でも動画像でも構わない。上記画像は、制御部２００に含まれる画像取得部２０１に送られる。一例において、撮像装置１１は、デジタルカメラである。 The imaging device 11 captures an image including a player and a musical instrument. The image may be a still image or a moving image. The image is sent to the image acquisition unit 201 included in the control unit 200. In one example, the imaging device 11 is a digital camera.
　出力部１２は、メトロノーム出力（拍子・伴奏などの出力）を行う。出力部１２がメトロノーム出力を行うか否か（すなわち、メトロノーム出力をＯＮとするかＯＦＦとするか）は、出力制御部２０４によって制御される。一例において、出力部１２は、発光部（ＬＥＤなど）、表示部（ディスプレイなど）、音声出力部（スピーカなど）、駆動部である。上述した例におけるメトロノーム出力は、それぞれ、発光、画像、音声、メトロノーム装置１の動き（ジェスチャなど）でありうる。 The output unit 12 performs metronome output (output of time signature, accompaniment, etc.). Whether the output unit 12 performs metronome output (that is, whether the metronome output is turned on or off) is controlled by the output control unit 204. In one example, the output unit 12 is a light emitting unit (such as an LED), a display unit (such as a display), an audio output unit (such as a speaker), or a driving unit. The metronome output in the above-described example may be light emission, image, sound, and movement of the metronome device 1 (such as a gesture).
　制御部２００は、メトロノーム装置１の動作および処理を、統括的に制御する。制御部２００は、画像取得部２０１、画像認識部２０２、画像判定部２０３および出力制御部２０４を備えている。一例において、制御部２００は、ＣＰＵ（Central Processing Unit）である。 The control unit 200 comprehensively controls the operation and processing of the metronome device 1. The control unit 200 includes an image acquisition unit 201, an image recognition unit 202, an image determination unit 203, and an output control unit 204. In one example, the control unit 200 is a CPU (Central Processing Unit).
　画像取得部２０１は、撮像装置１１が撮像した、奏者および楽器を含む画像を取得する。取得された画像は、画像認識部２０２に送られる。 The image acquisition unit 201 acquires an image including a player and a musical instrument imaged by the imaging device 11. The acquired image is sent to the image recognition unit 202.
　画像認識部２０２は、画像取得部２０１から画像を受け取り、当該画像における奏者の位置および楽器の位置を認識する。奏者の位置および楽器の位置を認識された画像は、画像判定部２０３に送られる。 The image recognition unit 202 receives an image from the image acquisition unit 201 and recognizes the position of the player and the position of the instrument in the image. The image in which the position of the player and the position of the instrument are recognized is sent to the image determination unit 203.
　画像判定部２０３は、画像認識部２０２から受け取った画像（奏者の位置および楽器の位置を認識された画像）において、奏者と楽器との位置関係が所定の位置関係であるか否かを判定する。上記判定の判定結果は、出力制御部２０４に送られる。奏者と楽器との位置関係が所定の位置関係であるか否かの判定は、例えば、画像認識部２０２から受け取った画像と、記憶部３０から読み出した基準画像３１とを比較することによって行われる。 The image determination unit 203 determines whether or not the positional relationship between the player and the instrument is a predetermined positional relationship in the image received from the image recognition unit 202 (an image in which the position of the player and the position of the instrument is recognized). . The determination result of the determination is sent to the output control unit 204. The determination as to whether or not the positional relationship between the player and the instrument is a predetermined positional relationship is performed, for example, by comparing the image received from the image recognition unit 202 with the reference image 31 read from the storage unit 30. .
　ここで、上記所定の位置関係の一例を、図１６に示す。図１６は、奏者の指が鍵盤に近づけられている状態を示す画像である。このような状態は、奏者が演奏を始めようとしている状態と見做すことができ、上記所定の位置関係として適切である。 Here, an example of the predetermined positional relationship is shown in FIG. FIG. 16 is an image showing a state in which the player's finger is close to the keyboard. Such a state can be regarded as a state where the player is about to start playing, and is appropriate as the predetermined positional relationship.
　出力制御部２０４は、画像判定部２０３から受け取る判定結果に基づいて、出力部１２のメトロノーム出力を制御する。すなわち、「奏者と楽器との位置関係が所定の位置関係である」との判定結果を画像判定部２０３から受け取った場合、出力制御部２０４は、出力部１２にメトロノーム出力させる（すなわち、メトロノーム出力をＯＮにする）。逆に、メトロノーム出力中に、「奏者と楽器との位置関係が所定の位置関係でない」との判定結果を画像判定部２０３から受け取った場合、出力制御部２０４は、出力部１２にメトロノーム出力させないようにする（すなわち、メトロノーム出力をＯＦＦにする）。 The output control unit 204 controls the metronome output of the output unit 12 based on the determination result received from the image determination unit 203. That is, when the determination result that “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203, the output control unit 204 causes the output unit 12 to output a metronome (ie, metronome output). To ON). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203 during the metronome output, the output control unit 204 does not cause the output unit 12 to output the metronome. (That is, turn off the metronome output).
　記憶部３０は、情報を記憶するものであり、不揮発性の記憶装置（フラッシュメモリ、ＲＯＭ（Read Only Memory）など）および揮発性の既往装置（ＲＡＭ（Random Access Memory）など）から構成される。上記不揮発性の記憶装置には、各種プログラム、各種動作設定値、各種データなどが記憶される。上記揮発性の記憶装置には、作業用ファイル、テンポラリファイルなどが記憶される。 The storage unit 30 stores information and includes a nonvolatile storage device (flash memory, ROM (Read Only Memory), etc.) and a volatile existing device (RAM (Random Access Memory, etc.)). The nonvolatile storage device stores various programs, various operation setting values, various data, and the like. The volatile storage device stores work files, temporary files, and the like.
　記憶部３０は、基準画像３１および拍子・伴奏データ３２を含んでいる。基準画像３１は、画像判定部２０３が判定を行う際に、判定基準を提供するデータである。例えば、図１６のような画像を、基準画像として用いることができる。拍子・伴奏データ３２は、出力部１２が行うメトロノーム出力を構成するデータである。拍子・伴奏データ３２は、出力制御部２０４から出力部１２に送られる。 The storage unit 30 includes a reference image 31 and time / accompaniment data 32. The reference image 31 is data that provides a determination reference when the image determination unit 203 makes a determination. For example, an image as shown in FIG. 16 can be used as the reference image. The time signature / accompaniment data 32 is data constituting a metronome output performed by the output unit 12. The time signature / accompaniment data 32 is sent from the output control unit 204 to the output unit 12.
　［メトロノーム装置における処理の流れ］
　次に、実施形態１に係るメトロノーム装置の処理の流れについて、図２に基づいて説明する。図２は、実施形態１に係るメトロノーム装置の処理の流れを表すフローチャートである。 [Process flow in metronome equipment]
Next, the process flow of the metronome device according to the first embodiment will be described with reference to FIG. FIG. 2 is a flowchart showing a process flow of the metronome device according to the first embodiment.
　Ｓ１１において、画像取得部２０１は、奏者および楽器が含まれている画像を取得する。上記画像は、撮像装置１１によって撮像されたものである。 In S11, the image acquisition unit 201 acquires an image including a player and a musical instrument. The image is taken by the imaging device 11.
　Ｓ１２において、画像認識部２０２は、画像取得部２０１から受け取った画像における、奏者の位置および楽器の位置を認識する。 In S12, the image recognition unit 202 recognizes the position of the player and the position of the instrument in the image received from the image acquisition unit 201.
　Ｓ１３において、画像判定部２０３は、画像認識部２０２から受け取った画像（奏者の位置および楽器の位置が認識されている画像）において、奏者と楽器との位置関係が所定の位置関係であるか否かを判定する。奏者と楽器との位置関係が所定の位置関係であるか否かの判定は、例えば、画像認識部２０２から受け取った画像と、基準画像３１とを比較することによって行えばよい。 In S13, the image determination unit 203 determines whether or not the positional relationship between the player and the musical instrument is a predetermined positional relationship in the image received from the image recognition unit 202 (an image in which the position of the player and the position of the musical instrument is recognized). Determine whether. The determination as to whether or not the positional relationship between the player and the musical instrument is a predetermined positional relationship may be made, for example, by comparing the image received from the image recognition unit 202 with the reference image 31.
　一実施形態において、上記奏者と楽器との位置関係は、奏者の手、足、口の少なくともいずれかと、楽器との位置関係である。一般的な楽器は、奏者の手、足、口の少なくともいずれかによって演奏されるためである。上記実施形態においては、上記所定の位置関係も、奏者の手、足、口の少なくともいずれかと、楽器との位置関係でありうる。また、基準画像３１も、奏者の手、足、口の少なくともいずれかと、楽器との位置関係を表す画像でありうる。このような構成とすることにより、上記奏者と楽器との位置関係が、上記所定の位置関係であるか否かの判定に要する処理時間を短縮することができる。 In one embodiment, the positional relationship between the player and the musical instrument is a positional relationship between the musical instrument and at least one of the player's hands, feet, and mouth. This is because a general musical instrument is played by at least one of a player's hand, foot, and mouth. In the embodiment described above, the predetermined positional relationship may also be a positional relationship between at least one of the player's hands, feet, and mouth and the musical instrument. The reference image 31 may also be an image representing the positional relationship between the instrument and at least one of the player's hands, feet, or mouth. By adopting such a configuration, it is possible to shorten the processing time required for determining whether or not the positional relationship between the player and the musical instrument is the predetermined positional relationship.
　画像判定部２０３によって、上記奏者と楽器との位置関係が上記所定の位置関係であると判定された場合は、Ｓ１４に進む。逆に、画像判定部２０３によって、上記奏者と楽器との位置関係が上記所定の位置関係でないと判定された場合は、Ｓ１５に進む。 If the image determination unit 203 determines that the positional relationship between the player and the musical instrument is the predetermined positional relationship, the process proceeds to S14. Conversely, if the image determination unit 203 determines that the positional relationship between the player and the instrument is not the predetermined positional relationship, the process proceeds to S15.
　Ｓ１４において、出力制御部２０４は、出力部１２にメトロノーム出力させる。一方、Ｓ１５において、出力制御部２０４は、出力部１２にメトロノーム出力させないようにする。Ｓ１４またはＳ１５のステップが終了した後、メトロノーム装置１の処理は、再びＳ１１に戻る。 In S14, the output control unit 204 causes the output unit 12 to output a metronome. On the other hand, in step S15, the output control unit 204 prevents the output unit 12 from outputting a metronome. After the step of S14 or S15 is completed, the process of the metronome device 1 returns to S11 again.
　以上に説明した構成および処理の流れによって、メトロノーム装置１は、以下の機能を有することができる。すなわち、メトロノーム装置１は、ユーザの操作に基づくのではなく、メトロノーム装置１が取得した画像に基づいて、メトロノーム出力を制御することができる。 With the configuration and processing flow described above, the metronome device 1 can have the following functions. That is, the metronome device 1 can control the metronome output based on the image acquired by the metronome device 1 rather than based on the user's operation.
　加えて、メトロノーム装置１は、奏者と楽器との位置関係が所定の位置関係である場合にメトロノーム出力することができる。逆に、奏者と楽器との位置関係が所定の位置関係でない場合にメトロノーム出力しないこともできる。 In addition, the metronome device 1 can output a metronome when the positional relationship between the player and the musical instrument is a predetermined positional relationship. Conversely, if the positional relationship between the player and the musical instrument is not a predetermined positional relationship, the metronome can be output.
　上述の機能を、より具体的な例を挙げて説明すると、以下の通りである。すなわち、メトロノーム装置１は、「鍵盤に手を載せる」、「マウスピースに口を当てる」などの奏者の動きを検知し、メトロノーム出力をＯＮにすることができる。また、メトロノーム装置１は、「鍵盤から手を離す」、「マウスピースから口を離す」などの奏者の動きを検知し、メトロノーム出力をＯＦＦにすることができる。 The above-described function will be described with a more specific example as follows. That is, the metronome device 1 can detect a player's movement such as “put a hand on the keyboard”, “put a mouth on the mouthpiece”, and turn on the metronome output. Further, the metronome device 1 can detect a player's movement such as “release the hand from the keyboard”, “release the mouth from the mouthpiece”, and turn off the metronome output.
　〔実施形態２〕
　［メトロノーム装置の構成］
　実施形態２に係るメトロノーム装置の要部構成について、図３に基づいて説明する。実施形態２に係るメトロノーム装置は、実施形態１に係るメトロノーム装置の構成に加えて、駆動部１３を備えている。また、実施形態２に係るメトロノーム装置の制御部は、実施形態１に係るメトロノーム装置の制御部に加えて、顔認識部２０５、顔判定部２０６および駆動制御部２０７を含んでいる。さらに、実施形態２に係るメトロノーム装置の記憶部は、実施形態１に係るメトロノーム装置の記憶部に加えて、顔基準画像３３を含んでいる。なお、説明の便宜上、実施形態１において説明した部材と同じ機能を有する部材については、同じ符号を付記し、その説明を省略する。 [Embodiment 2]
[Configuration of metronome device]
A main configuration of the metronome device according to the second embodiment will be described with reference to FIG. The metronome device according to the second embodiment includes a drive unit 13 in addition to the configuration of the metronome device according to the first embodiment. In addition to the control unit of the metronome device according to the first embodiment, the control unit of the metronome device according to the second embodiment includes a face recognition unit 205, a face determination unit 206, and a drive control unit 207. Further, the storage unit of the metronome device according to the second embodiment includes a face reference image 33 in addition to the storage unit of the metronome device according to the first embodiment. For convenience of explanation, members having the same functions as those described in the first embodiment are denoted by the same reference numerals and description thereof is omitted.
　実施形態２において、出力部１２の行うメトロノーム出力は、視覚により認識されるメトロノーム出力である。このようなメトロノーム出力としては、例えば、発光、画像、ジェスチャが挙げられる。 In the second embodiment, the metronome output performed by the output unit 12 is a metronome output recognized visually. Examples of such a metronome output include light emission, image, and gesture.
　駆動部１３は、メトロノーム装置１の各パーツを駆動させる。駆動部１３は、メトロノーム装置１を変型、移動などさせることにより、奏者に対する出力部１２の位置を移動させる。このような移動は、メトロノーム装置１全体を移動させることによって達成してもよいし、出力部１２を含むメトロノーム装置１の一部を移動させることによって達成してもよい。駆動部１３は、適宜、公知の手段によって構成されうる。 The driving unit 13 drives each part of the metronome device 1. The drive unit 13 moves the position of the output unit 12 relative to the player by changing or moving the metronome device 1. Such movement may be achieved by moving the entire metronome device 1 or may be achieved by moving a part of the metronome device 1 including the output unit 12. The drive unit 13 can be appropriately configured by known means.
　例えば、メトロノーム装置１が人型ロボット端末である場合、駆動部１３は、出力部１２の高さと奏者の目の高さとが対応するように、メトロノーム装置１を立位状態から座位状態へと変形させることができる（図１７参照）。 For example, when the metronome device 1 is a humanoid robot terminal, the drive unit 13 deforms the metronome device 1 from the standing state to the sitting state so that the height of the output unit 12 corresponds to the height of the player's eyes. (See FIG. 17).
　顔認識部２０５は、画像取得部２０１から画像を受け取り、当該画像に含まれる奏者の画像から、奏者の目の位置を認識する。 The face recognition unit 205 receives an image from the image acquisition unit 201 and recognizes the position of the player's eyes from the player's image included in the image.
　顔判定部２０６は、顔認識部２０５から受け取った画像（奏者の目の位置が認識されている画像）において、出力部１２と上記奏者の目の位置とが所定の位置関係にあるか否か、を判定する。上記判定の判定結果は、駆動制御部２０７に送られる。出力部１２と上記奏者の目の位置とが所定の位置関係にあるか否かの判定は、例えば、顔認識部２０５から受け取った画像と、記憶部３０から読み出した顔基準画像とを比較することによって行われる。 The face determination unit 206 determines whether or not the output unit 12 and the player's eye position are in a predetermined positional relationship in the image received from the face recognition unit 205 (an image in which the player's eye position is recognized). , Is determined. The determination result of the determination is sent to the drive control unit 207. Whether the output unit 12 and the player's eye position are in a predetermined positional relationship is determined by, for example, comparing an image received from the face recognition unit 205 with a face reference image read from the storage unit 30. Is done by.
　より具体的な例を挙げると、上記判定は、顔認識部２０５から受け取った画像に含まれる顔の輪郭中に、左右両目が含まれているかを判定することにより行うことができる。上記の例において、顔判定部２０６は、出力部が奏者にとって視認しやすい位置にあるか否かを判定していることになる。 As a more specific example, the above determination can be made by determining whether the left and right eyes are included in the face outline included in the image received from the face recognition unit 205. In the above example, the face determination unit 206 determines whether or not the output unit is in a position that is easily visible to the player.
　顔基準画像３３は、顔判定部２０６が判定を行う際の、判定基準を提供するデータである。 The face reference image 33 is data that provides a determination reference when the face determination unit 206 makes a determination.
　［メトロノーム装置における処理の流れ］
　次に、実施形態２に係るメトロノーム装置の処理の流れについて、図４に基づいて説明する。図４は、実施形態２に係るメトロノーム装置の処理の流れを表すフローチャートである。 [Process flow in metronome equipment]
Next, the process flow of the metronome device according to the second embodiment will be described with reference to FIG. FIG. 4 is a flowchart showing a process flow of the metronome device according to the second embodiment.
　Ｓ２１において、画像取得部２０１は、奏者の画像を取得する。このステップは、Ｓ１１と同様である。 In S21, the image acquisition unit 201 acquires the player's image. This step is the same as S11.
　Ｓ２２において、顔認識部２０５は、画像取得部２０１から受け取った画像に含まれている、奏者の目の位置を認識する。一実施形態において、上記認識は、上記画像に含まれる上記奏者の顔を認識することによって行われる。このような認識は、公知の顔認識技術によって行われうる。 In step S22, the face recognition unit 205 recognizes the position of the player's eyes included in the image received from the image acquisition unit 201. In one embodiment, the recognition is performed by recognizing the player's face included in the image. Such recognition can be performed by a known face recognition technique.
　Ｓ２３において、顔判定部２０６は、顔認識部２０５から受け取った画像（奏者の目の位置が認識されている画像）において、出力部１２が上記奏者にとって視認しやすい位置にあるか否かを判定する。出力部１２が上記奏者にとって視認しやすい位置にあるか否かの判定は、例えば、顔認識部２０５から受け取った画像と、顔基準画像３３とを比較することによって行えばよい。 In step S <b> 23, the face determination unit 206 determines whether the output unit 12 is easily visible to the player in the image received from the face recognition unit 205 (an image in which the player's eye position is recognized). To do. The determination as to whether or not the output unit 12 is in a position that is easily visible to the player may be performed by comparing the image received from the face recognition unit 205 with the face reference image 33, for example.
　一実施形態において、出力部１２が奏者にとって視認しやすい位置にあるか否かの判定は、Ｓ２２において認識された上記奏者の顔に、上記奏者の両目が含まれているか否か、によって判定される。上記奏者の両目が含まれている場合は、「出力部１２が奏者にとって視認しやすい位置にある」と判定することができる。逆に、上記奏者の少なくとも一方の目が含まれていない場合は、「出力部１２が奏者にとって視認しやすい位置にない」と判定することができる。 In one embodiment, the determination as to whether or not the output unit 12 is easily visible to the player is made based on whether or not the player's eyes recognized in S22 include both eyes of the player. The When both eyes of the player are included, it can be determined that “the output unit 12 is in a position where the player can easily see”. Conversely, when at least one eye of the player is not included, it can be determined that “the output unit 12 is not in a position where the player can easily recognize”.
　顔判定部２０６によって、出力部１２が奏者にとって視認しやすい位置にあると判定された場合は、Ｓ２４に進む。逆に、顔判定部２０６によって、出力部１２が奏者にとって視認しやすい位置にないと判定された場合は、Ｓ２５に進む。 If the face determination unit 206 determines that the output unit 12 is easily visible to the player, the process proceeds to S24. Conversely, if the face determination unit 206 determines that the output unit 12 is not in a position that is easily visible to the player, the process proceeds to S25.
　Ｓ２４において、駆動制御部２０７は、出力部１２の位置を保つように、駆動部１３を制御する。Ｓ２５において、駆動制御部２０７は、出力部１２の位置が上記奏者に視認しやすいように、メトロノーム装置１を駆動させる。この駆動は、例えば、メトロノーム装置１の全部または一部が移動することによって行われる。 In S24, the drive control unit 207 controls the drive unit 13 so that the position of the output unit 12 is maintained. In S25, the drive control unit 207 drives the metronome device 1 so that the player can easily recognize the position of the output unit 12. This driving is performed, for example, by moving all or part of the metronome device 1.
　一実施形態において、Ｓ２５においては、画像取得部２０１によって取得された画像に奏者の両目が含まれるようになるまで出力部１２の位置が移動するように、出力部１２の位置が駆動される。このような移動が行われるためには、撮像装置１１は、出力部１２の位置から見た奏者の画像を撮像できるように構成されていることが好ましい。このような構成によれば、出力部１２が奏者にとって視認しやすい位置にあるか否かを、より正確に判定することができる。 In one embodiment, in S25, the position of the output unit 12 is driven so that the position of the output unit 12 moves until the player's eyes are included in the image acquired by the image acquisition unit 201. In order for such movement to be performed, the imaging device 11 is preferably configured to be able to capture an image of a player viewed from the position of the output unit 12. According to such a configuration, it can be more accurately determined whether or not the output unit 12 is in a position that is easily visible to the player.
　Ｓ２４またはＳ２５のステップが終了した後、メトロノーム装置１の処理は、再びＳ２１に戻る。 After step S24 or S25 ends, the process of the metronome device 1 returns to S21 again.
　以上に説明した構成および処理の流れによれば、メトロノーム装置１は、以下の機能を有することができる。すなわち、メトロノーム装置１は、ユーザの操作に基づくのではなく、メトロノーム装置１が取得した画像に基づいて、メトロノーム出力を奏者の視認しやすい位置に移動させることができる。 According to the configuration and processing flow described above, the metronome device 1 can have the following functions. That is, the metronome device 1 can move the metronome output to a position where the player can easily recognize it based on the image acquired by the metronome device 1, not based on the user's operation.
　〔実施形態３〕
　実施形態３に係るメトロノームシステムの要部構成について、図５～７に基づいて説明する。 [Embodiment 3]
The main configuration of the metronome system according to the third embodiment will be described with reference to FIGS.
　図５は、実施形態３に係るメトロノームシステムの、全体を表すブロック図である。メトロノームシステム１０００には、親メトロノーム装置１ａおよび子メトロノーム装置１ｂが含まれている。親メトロノーム装置１ａと子メトロノーム装置１ｂとは、通信部１４ａと通信部１４ｂとを介して、有線通信または無線通信を行う。上記通信には、所定の通信時間を要する。なお、図５には、子メトロノーム装置は１つしか図示されていないが、２つ以上の子メトロノーム装置が含まれていてもよい。 FIG. 5 is a block diagram showing the entire metronome system according to the third embodiment. The metronome system 1000 includes a parent metronome device 1a and a child metronome device 1b. The parent metronome device 1a and the child metronome device 1b perform wired communication or wireless communication via the communication unit 14a and the communication unit 14b. The communication requires a predetermined communication time. FIG. 5 shows only one child metronome device, but two or more child metronome devices may be included.
　［親メトロノーム装置の構成］
　図６は、メトロノームシステム１０００に含まれる親メトロノーム装置１ａの、要部構成を表すブロック図である。図６に示されているように、親メトロノーム装置１ａは、撮像装置１１ａ、出力部１２ａ、通信部１４ａ、制御部２００ａ、記憶部３０ａを備えている。制御部２００ａには、画像取得部２０１ａ、画像認識部２０２ａ、画像判定部２０３ａ、出力制御部２０４ａおよび通信制御部２０８ａが含まれている。記憶部３０ａには、基準画像３１ａ、拍子・伴奏データ３２ａおよび通信時間データ３４ａが含まれている。 [Configuration of parent metronome device]
FIG. 6 is a block diagram showing a main configuration of the parent metronome device 1a included in the metronome system 1000. As shown in FIG. 6, the parent metronome device 1a includes an imaging device 11a, an output unit 12a, a communication unit 14a, a control unit 200a, and a storage unit 30a. The control unit 200a includes an image acquisition unit 201a, an image recognition unit 202a, an image determination unit 203a, an output control unit 204a, and a communication control unit 208a. The storage unit 30a includes a reference image 31a, time signature / accompaniment data 32a, and communication time data 34a.
　画像判定部２０３ａは、実施形態１において説明した機能に加えて、「奏者と楽器との位置関係が所定の位置関係であるか否か」の判定結果を、通信制御部２０８ａにも送る。 In addition to the functions described in the first embodiment, the image determination unit 203a also sends a determination result “whether or not the positional relationship between the player and the instrument is a predetermined positional relationship” to the communication control unit 208a.
　出力制御部２０４ａは、実施形態１において説明した機能に変更が加わっている。すなわち、出力制御部２０４ａは、画像判定部２０３ａから受け取る判定結果に基づいて、親メトロノーム装置１ａと子メトロノーム装置１ｂとの通信に要する時間（以下、単に「通信時間」とも表記する）を反映させた上で、出力部１２ａのメトロノーム出力を制御する。より詳細には、「奏者と楽器との位置関係が所定の位置関係である」との判定結果を画像判定部２０３ａから受け取ったとき、出力制御部２０４ａは、通信部１４ａが出力指示を送信した時点から通信時間が経過後、出力部１２ａにメトロノーム出力させる（すなわち、メトロノーム出力をＯＮにする）。逆に、メトロノーム出力中に、「奏者と楽器との位置関係が所定の位置関係でない」との判定結果を画像判定部２０３ａから受け取った場合、出力制御部２０４ａは、通信部１４ａが出力指示を送信した時点から通信時間が経過後、出力部１２ａにメトロノーム出力させないようにする（すなわち、メトロノーム出力をＯＦＦにする）。 The output control unit 204a is modified in the function described in the first embodiment. That is, the output control unit 204a reflects the time required for communication between the parent metronome device 1a and the child metronome device 1b (hereinafter also simply referred to as “communication time”) based on the determination result received from the image determination unit 203a. After that, the metronome output of the output unit 12a is controlled. More specifically, when the determination result “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203a, the output control unit 204a has transmitted the output instruction from the communication unit 14a. After the communication time has elapsed from the time, the output unit 12a outputs a metronome (that is, turns on the metronome output). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203a during the metronome output, the output control unit 204a causes the communication unit 14a to issue an output instruction. After the communication time has elapsed from the time of transmission, the output unit 12a is prevented from outputting the metronome (that is, the metronome output is turned off).
　通信部１４ａは、子メトロノーム装置との間で通信を行う。通信部１４ａには、子メトロノーム装置へデータを送る送信部と、子メトロノーム装置からデータを受け取る受信部が含まれている。通信部の具体的な構成は、採用する通信の種類により、適宜設定しうる。 The communication unit 14a communicates with the child metronome device. The communication unit 14a includes a transmission unit that transmits data to the child metronome device and a reception unit that receives data from the child metronome device. The specific configuration of the communication unit can be appropriately set depending on the type of communication employed.
　通信制御部２０８ａは、通信部１４ａ（送信部）に送信すべきデータを送り、また通信部１４ａ（受信部）が受信したデータを取得する。 The communication control unit 208a sends data to be transmitted to the communication unit 14a (transmission unit) and acquires data received by the communication unit 14a (reception unit).
　通信制御部２０８ａが画像判定部２０３ａから判定結果を受け取ったとき、通信制御部２０８ａは、当該判定結果に基づいた指示を、通信部から送信させる。すなわち、「奏者と楽器との位置関係が所定の位置関係である」との判定結果を画像判定部２０３ａから受け取った場合、通信制御部２０８ａは、通信部１４ａに出力指示を送信させる。上記出力指示は、子メトロノーム装置１ｂに、メトロノーム出力させる内容の指示である。逆に、子メトロノーム装置１ｂがメトロノーム出力中に「奏者と楽器との位置関係が所定の位置関係でない」との判定結果を画像判定部２０３ａから受け取った場合、通信制御部２０８ａは、通信部１４ａに停止指示を送信させる。上記停止指示は、子メトロノーム装置１ｂに、メトロノーム出力させないようにする内容の指示である。 When the communication control unit 208a receives the determination result from the image determination unit 203a, the communication control unit 208a causes the communication unit to transmit an instruction based on the determination result. That is, when the determination result that “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203a, the communication control unit 208a causes the communication unit 14a to transmit an output instruction. The output instruction is an instruction of contents to be output to the metronome device 1b by the metronome apparatus 1b. On the other hand, when the child metronome device 1b receives a determination result from the image determination unit 203a that “the positional relationship between the player and the instrument is not a predetermined positional relationship” during the metronome output, the communication control unit 208a includes the communication unit 14a. To send a stop instruction. The stop instruction is an instruction to prevent the child metronome device 1b from outputting the metronome.
　また、通信部１４ａが、子メトロノーム装置１ｂから、通信時間に関する情報を受信したとき、通信制御部２０８ａは、上記情報を受け取り、通信時間データ３４ａとして記憶部３０に記録する。なお、親メトロノーム装置１ａが通信時間を測定する構成を取る場合は、この通信制御部２０８ａの機能は、必ずしも必要ではない。 Further, when the communication unit 14a receives information on the communication time from the child metronome device 1b, the communication control unit 208a receives the information and records it in the storage unit 30 as communication time data 34a. When the parent metronome device 1a is configured to measure the communication time, the function of the communication control unit 208a is not always necessary.
　通信時間データ３４ａは、親メトロノーム装置１ａと子メトロノーム装置１ｂとの通信に要する時間に関するデータである。通信時間データ３４ａは、出力制御部２０４ａがメトロノーム出力を制御する際に参照される。 The communication time data 34a is data relating to the time required for communication between the parent metronome device 1a and the child metronome device 1b. The communication time data 34a is referred to when the output control unit 204a controls the metronome output.
　なお、親メトロノーム装置１ａに含まれる、上述以外の部材については、実施形態１における同名の部材の説明が援用される。 In addition, about members other than the above-mentioned contained in the parent metronome apparatus 1a, description of the member of the same name in Embodiment 1 is used.
　［子メトロノーム装置の構成］
　図７は、メトロノームシステム１０００に含まれている子メトロノーム装置１ｂの、要部構成を表すブロック図である。図７に示されているように、子メトロノーム装置１ｂは、出力部１２ｂ、通信部１４ｂ、制御部２００ｂおよび記憶部３０ｂを備えている。制御部２００ｂは、出力制御部２０４ｂ、通信制御部２０８ｂ、通信時間測定部２０９ｂおよび命令判定部２１０ｂを含んでいる。記憶部３０ｂは、拍子・伴奏データ３２ｂおよび命令表３５ｂを含んでいる。 [Configuration of child metronome device]
FIG. 7 is a block diagram showing a main configuration of a child metronome device 1b included in the metronome system 1000. As shown in FIG. 7, the child metronome device 1b includes an output unit 12b, a communication unit 14b, a control unit 200b, and a storage unit 30b. The control unit 200b includes an output control unit 204b, a communication control unit 208b, a communication time measurement unit 209b, and a command determination unit 210b. The storage unit 30b includes time signature / accompaniment data 32b and an instruction table 35b.
　出力制御部２０４ｂは、命令判定部２１０ｂの判定結果に基づいて、出力部１２ｂを制御する。すなわち、「出力指示を受信した」と命令判定部２１０ｂが判定した場合、出力制御部２０４ｂは、出力部１２ｂにメトロノーム出力させる。逆に、「停止指示を受信した」と命令判定部２１０ｂが判定した場合、出力制御部２０４ｂは、出力部１２ｂにメトロノーム出力させないようにする。 The output control unit 204b controls the output unit 12b based on the determination result of the instruction determination unit 210b. That is, when the command determination unit 210b determines that “an output instruction has been received”, the output control unit 204b causes the output unit 12b to output a metronome. Conversely, when the command determination unit 210b determines that “a stop instruction has been received”, the output control unit 204b prevents the output unit 12b from outputting a metronome.
　通信制御部２０８ｂは、通信部１４ｂ（送信部）に送信すべきデータを送り、また通信部１４ｂ（受信部）が受信したデータを取得する。 The communication control unit 208b sends data to be transmitted to the communication unit 14b (transmission unit), and acquires data received by the communication unit 14b (reception unit).
　通信制御部２０８ｂが通信部１４ｂから出力指示または停止指示を受け取ったとき、通信制御部２０８ｂは、上記指示を命令判定部２１０ｂに送る。 When the communication control unit 208b receives an output instruction or a stop instruction from the communication unit 14b, the communication control unit 208b sends the instruction to the instruction determination unit 210b.
　また、通信時間測定部２０９ｂが通信時間を測定したとき、通信制御部２０８ｂは、通信時間測定部２０９ｂから通信時間に関する情報を受け取り、通信部１４ｂに送信させる。なお、親メトロノーム装置１ａが通信時間を測定する構成を取る場合は、この通信制御部２０８ｂの機能は、必ずしも必要ではない。 Further, when the communication time measuring unit 209b measures the communication time, the communication control unit 208b receives information on the communication time from the communication time measuring unit 209b and causes the communication unit 14b to transmit the information. When the parent metronome device 1a is configured to measure the communication time, the function of the communication control unit 208b is not always necessary.
　通信時間測定部２０９ｂは、通信時間を測定する。通信時間は、例えば以下の手順によって測定される。（１）まず、親メトロノーム装置１ａは、通信時間測定信号を送信する。上記通信時間測定信号には、当該信号が送信される瞬間の時刻が含まれている。（２）次に、子メトロノーム装置１ｂは、「上記通信時間測定信号に含まれている当該信号が送信される瞬間の時刻」と、「上記通信時間測定信号を受信した時刻」とを比較する。（３）比較結果を基に、通信時間を測定する。通信時間測定部２０９ｂは、通信時間を測定した後、通信時間に関する情報を生成し、通信制御部２０８ｂに送る。 The communication time measuring unit 209b measures the communication time. The communication time is measured by the following procedure, for example. (1) First, the parent metronome device 1a transmits a communication time measurement signal. The communication time measurement signal includes the instant at which the signal is transmitted. (2) Next, the child metronome device 1b compares “the time at which the signal included in the communication time measurement signal is transmitted” with “the time when the communication time measurement signal is received”. . (3) Measure the communication time based on the comparison result. After measuring the communication time, the communication time measuring unit 209b generates information about the communication time and sends it to the communication control unit 208b.
　なお、通信時間測定部は、親メトロノーム装置１ａに設ける構成としてもよい。この場合、例えば、（１）子メトロノーム装置１ｂから親メトロノーム装置１ａに通信時間測定信号を送信する、（２）親メトロノーム装置１ａは通信時間を測定する、（３）親メトロノーム装置１ａは通信時間に関するデータを通信時間データとして記録する、というステップを踏むことにより、上記に説明したシステムと同様の機能を得られるようになる。 The communication time measuring unit may be provided in the parent metronome device 1a. In this case, for example, (1) the communication time measurement signal is transmitted from the child metronome device 1b to the parent metronome device 1a, (2) the parent metronome device 1a measures the communication time, and (3) the parent metronome device 1a transmits the communication time. By taking the step of recording the data relating to the communication time data, the same function as the system described above can be obtained.
　命令判定部２１０ｂは、通信制御部２０８ｂから受け取った命令が、出力指示であるか停止指示であるかを判定する。上記判定は、例えば、通信制御部から受け取った命令と、命令表とを比較することにより行われる。命令表３５ｂは、命令判定部２１０ｂが、「通信制御部２０８ｂから受け取った命令は、出力指示であるか停止指示であるか」を判定する際に、判定基準を提供するデータである。 The command determination unit 210b determines whether the command received from the communication control unit 208b is an output instruction or a stop instruction. The determination is performed, for example, by comparing a command received from the communication control unit with a command table. The instruction table 35b is data that provides a determination criterion when the instruction determination unit 210b determines whether the instruction received from the communication control unit 208b is an output instruction or a stop instruction.
　以上に説明した以外の部材については、実施形態１または親メトロノーム装置の構成において説明されている、同名の部材の説明が援用される。 For members other than those described above, the description of the members of the same name described in the configuration of the first embodiment or the parent metronome device is incorporated.
　［親メトロノーム装置における処理の流れ］
　次に、実施形態３に係るメトロノームシステムの処理の流れについて、図８、９に基づいて説明する。図８は、メトロノームシステム１０００に含まれている親メトロノーム装置１ａの、処理の流れを表すフローチャートである。 [Processing flow in the parent metronome device]
Next, the process flow of the metronome system according to the third embodiment will be described with reference to FIGS. FIG. 8 is a flowchart showing the processing flow of the parent metronome device 1a included in the metronome system 1000.
　Ｓ３１において、親メトロノーム装置１ａは、子メトロノーム装置１ｂとの通信に要する通信時間に関する情報を取得する。通信時間に関する情報の取得は、より具体的には、以下のサブステップによって行われる。（１）通信時間測定部２０９ｂは、通信時間を測定し、通信時間に関する情報を生成する。（２）通信制御部２０８ｂは、上記通信時間に関する情報を受け取り、通信部１４ｂに送信させる。（３）通信制御部２０８ａは、通信部１４ａが受信した上記通信時間に関する情報を取得する。（４）通信制御部２０８ａは、上記通信時間に関する情報を、通信時間データ３４ａとして記録する。 In S31, the parent metronome device 1a acquires information related to the communication time required for communication with the child metronome device 1b. More specifically, acquisition of information related to communication time is performed by the following sub-steps. (1) The communication time measuring unit 209b measures the communication time and generates information related to the communication time. (2) The communication control unit 208b receives information related to the communication time and causes the communication unit 14b to transmit the information. (3) The communication control unit 208a acquires information related to the communication time received by the communication unit 14a. (4) The communication control unit 208a records information related to the communication time as communication time data 34a.
　なお、通信時間測定部を親メトロノーム装置１ａに設ける場合は、Ｓ３１のステップを、以下の２つのサブステップによって行うことができる。（１）上記通信時間測定部は、通信時間を測定する。（２）上記通信時間測定部は、上記通信時間から通信時間に関する情報を生成し、通信時間データ３４ａとして記録する。 When the communication time measuring unit is provided in the parent metronome device 1a, the step of S31 can be performed by the following two substeps. (1) The communication time measuring unit measures communication time. (2) The communication time measuring unit generates information related to the communication time from the communication time and records it as communication time data 34a.
　Ｓ３２、Ｓ３３およびＳ３４のステップは、図２のＳ１１、Ｓ１２およびＳ１３のステップに、それぞれ対応する。これらのステップを通じて、親メトロノーム装置１ａは、奏者と楽器とが所定の位置関係にあるか否かを判定する。画像判定部２０３ａが「奏者と楽器とが所定の位置関係にある」と判定した場合はＳ３５に進み、「奏者と楽器とが所定の位置関係にない」と判定した場合はＳ３７に進む。 Steps S32, S33, and S34 correspond to steps S11, S12, and S13 in FIG. 2, respectively. Through these steps, the parent metronome device 1a determines whether or not the player and the musical instrument are in a predetermined positional relationship. If the image determination unit 203a determines that “the player and the instrument are in a predetermined positional relationship”, the process proceeds to S35, and if it is determined that “the player and the instrument are not in a predetermined positional relationship”, the process proceeds to S37.
　Ｓ３５において、「奏者と楽器とが所定の位置関係にある」との判定結果を受け取った通信制御部２０８ａは、通信部１４ａ（送信部）に、出力指示を送信させる。上記出力指示は、子メトロノーム装置１ｂに、メトロノーム出力させる内容の指示である。 In S35, the communication control unit 208a that has received the determination result that “the player and the musical instrument are in a predetermined positional relationship” causes the communication unit 14a (transmission unit) to transmit an output instruction. The output instruction is an instruction of contents to be output to the metronome device 1b by the metronome apparatus 1b.
　Ｓ３６において、「奏者と楽器とが所定の位置関係にある」との判定結果を受け取った出力制御部２０４ａは、通信時間を反映させた上で、出力部１２ａにメトロノーム出力させる。より具体的には、「通信部１４ａ（送信部）が上記出力指示を送信した時点から、さらに通信時間だけ経過した時点」において、メトロノーム出力するよう、出力部１２ａを制御する。なお、親メトロノーム装置１ａにおける「通信部１４ａ（送信部）が出力指示を送信した時点」とは、奏者にとっては「奏者と楽器との位置関係が所定の位置関係になった時点」となる。Ｓ３６の後、親メトロノーム装置１ａの処理は、Ｓ３２に戻る。 In S36, the output control unit 204a that has received the determination result that “the player and the musical instrument are in a predetermined positional relationship” causes the output unit 12a to output a metronome after reflecting the communication time. More specifically, the output unit 12a is controlled so that the metronome is output at the “time when the communication unit 14a (transmission unit) further transmits a communication time after the output instruction is transmitted”. It should be noted that “when the communication unit 14a (transmission unit) transmits an output instruction” in the parent metronome device 1a is “when the positional relationship between the player and the instrument becomes a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1a returns to S32.
　Ｓ３７において、「奏者と楽器とが所定の位置関係にない」との判定結果を受け取った通信制御部２０８ａは、通信部１４ａ（送信部）に、停止指示を送信させる。上記停止指示は、子メトロノーム装置１ｂに、メトロノーム出力を出力させないようにする内容の指示である。 In S37, the communication control unit 208a that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” causes the communication unit 14a (transmission unit) to transmit a stop instruction. The stop instruction is an instruction to prevent the child metronome device 1b from outputting the metronome output.
　Ｓ３８において、「奏者と楽器とが所定の位置関係にない」との判定結果を受け取った出力制御部２０４ａは、通信時間を反映させた上で、出力部１２ａにメトロノーム出力させないようにする。より具体的には、「通信部１４ａ（送信部）が上記停止指示を送信した時点から、さらに通信時間だけ経過した時点」において、メトロノーム出力させなくするよう、出力部１２ａを制御する。なお、親メトロノーム装置１ａにおける「通信部１４ａ（送信部）が停止指示を送信した時点」とは、奏者にとっては「奏者と楽器との位置関係が所定の位置関係ではなくなった時点」となる。Ｓ３６の後、親メトロノーム装置１ａの処理は、Ｓ３２に戻る。 In S38, the output control unit 204a that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” reflects the communication time and prevents the output unit 12a from outputting the metronome. More specifically, the output unit 12a is controlled so that the metronome is not output when “the communication unit 14a (transmission unit) transmits the stop instruction and when the communication time further elapses”. It should be noted that “when the communication unit 14a (transmission unit) transmits a stop instruction” in the parent metronome device 1a is “when the positional relationship between the player and the instrument is no longer a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1a returns to S32.
　［子メトロノーム装置における処理の流れ］
　図９は、メトロノームシステム１０００に含まれている子メトロノーム装置１ｂの、処理の流れを表すフローチャートである。 [Processing flow in child metronome device]
FIG. 9 is a flowchart showing a process flow of the child metronome device 1b included in the metronome system 1000.
　Ｓ４１において、通信時間測定部２０９ｂは、通信時間を測定する。上記通信時間は、例えば、通信時間測定部２０９ｂの説明で例示した方法によって測定される。その後、通信時間測定部２０９ｂは、通信時間に関する情報を生成する。 In S41, the communication time measuring unit 209b measures the communication time. The communication time is measured by, for example, the method exemplified in the description of the communication time measurement unit 209b. Thereafter, the communication time measurement unit 209b generates information related to the communication time.
　Ｓ４２において、通信制御部２０８ｂは、通信時間測定部２０９ｂから通信時間に関する情報を受け取り、通信部１４ｂに送信させる。 In S42, the communication control unit 208b receives information on the communication time from the communication time measurement unit 209b and causes the communication unit 14b to transmit the information.
　なお、通信時間制御部を親メトロノーム装置１ａに設ける場合は、Ｓ４１、Ｓ４２のステップは省略することができる。 If the communication time control unit is provided in the parent metronome device 1a, the steps S41 and S42 can be omitted.
　Ｓ４３において、通信部１４ｂは、親メトロノーム装置１ａから送信された命令を受信する。受信した命令は通信制御部２０８ｂによって取得される。なお、Ｓ４３において受信した命令は、Ｓ３５またはＳ３７において送信された命令（出力指示または停止指示）である。 In S43, the communication unit 14b receives the command transmitted from the parent metronome device 1a. The received command is acquired by the communication control unit 208b. The command received in S43 is the command (output instruction or stop instruction) transmitted in S35 or S37.
　Ｓ４４において、命令判定部２１０ｂは、通信制御部２０８ｂから命令を受け取り、上記命令が出力指示であるか、停止指示であるかを判定する。上記判定は、例えば、通信制御部２０８ｂから受け取った命令と、記憶部３０ｂから読み出した命令表３５ｂとを比較することによって行われる。上記命令が出力指示であると判定された場合は、Ｓ４５に進む。上記命令が停止指示であると判定された場合は、Ｓ４６に進む。 In S44, the instruction determination unit 210b receives an instruction from the communication control unit 208b, and determines whether the instruction is an output instruction or a stop instruction. The determination is performed, for example, by comparing the command received from the communication control unit 208b with the command table 35b read from the storage unit 30b. If it is determined that the command is an output instruction, the process proceeds to S45. If it is determined that the instruction is a stop instruction, the process proceeds to S46.
　Ｓ４５において、出力制御部２０４ｂは、出力部１２ｂにメトロノーム出力させる。一方、Ｓ４６において、出力制御部２０４ｂは、出力部１２ｂにメトロノーム出力させないようにする。Ｓ４５またはＳ４６のステップが終了した後、子メトロノーム装置１ｂの処理は、再びＳ４３に戻る。 In S45, the output control unit 204b causes the output unit 12b to output a metronome. On the other hand, in S46, the output control unit 204b prevents the output unit 12b from outputting the metronome. After the step of S45 or S46 is completed, the process of the child metronome device 1b returns to S43 again.
　以上に説明した構成および処理の流れによって、メトロノームシステム１０００は、以下の機能を有することができる。すなわち、親メトロノーム装置１ａと子メトロノーム装置１ｂとは、同じ時刻にメトロノーム出力を制御することができる。より具体的には、親メトロノーム装置１ａと子メトロノーム装置１ｂとは、同じタイミングでメトロノーム出力をＯＮ／ＯＦＦすることができる。これにより、複数のメトロノーム装置間で、同期されたメトロノーム出力を得ることができる。 With the configuration and processing flow described above, the metronome system 1000 can have the following functions. That is, the parent metronome device 1a and the child metronome device 1b can control the metronome output at the same time. More specifically, the parent metronome device 1a and the child metronome device 1b can turn on / off the metronome output at the same timing. Thereby, a synchronized metronome output can be obtained among a plurality of metronome devices.
　なお、メトロノームシステム１０００においては、親メトロノーム装置１ａを使用する奏者は、楽器との間に所定の位置関係を取ってから通信時間だけ経過した後に、メトロノーム出力がＯＮになったことを認識する。このため、上記通信時間は、上記親メトロノーム装置１ａを使用する奏者が不便を感じない程度の短さである（例えば、０．０１秒程度）ことが好ましい。 In the metronome system 1000, the player who uses the parent metronome device 1a recognizes that the metronome output is turned on after the communication time has elapsed after taking a predetermined positional relationship with the musical instrument. For this reason, it is preferable that the communication time is as short as possible so that the player who uses the parent metronome device 1a does not feel inconvenience (for example, about 0.01 seconds).
　〔実施形態４〕
　実施形態４に係るメトロノームシステムの要部構成について、図５～７に基づいて説明する。 [Embodiment 4]
The main configuration of the metronome system according to the fourth embodiment will be described with reference to FIGS.
　図１０は、実施形態４に係るメトロノームシステムの、全体を表すブロック図である。メトロノームシステム２０００には、親メトロノーム装置１ｃ、および子メトロノーム装置１ｄ、１ｅが含まれている。なお、図５には、子メトロノーム装置は２つしか図示されていないが、３つ以上の子メトロノーム装置が含まれていてもよい。 FIG. 10 is a block diagram showing the entire metronome system according to the fourth embodiment. The metronome system 2000 includes a parent metronome device 1c and child metronome devices 1d and 1e. Although only two child metronome devices are illustrated in FIG. 5, three or more child metronome devices may be included.
　親メトロノーム装置１ｃと子メトロノーム装置１ｄとは、通信部１４ｃと通信部１４ｄとを介して、有線通信または無線通信を行う。親メトロノーム装置１ｃと子メトロノーム装置１ｄと通信には、第１の通信時間を要する。また、親メトロノーム装置１ｃと、子メトロノーム装置１ｅとは、通信部１４ｃと通信部１４ｅとを介して、有線通信または無線通信を行う。親メトロノーム装置１ｃと子メトロノーム装置１ｅと通信には、第２の通信時間を要する。 The parent metronome device 1c and the child metronome device 1d perform wired communication or wireless communication via the communication unit 14c and the communication unit 14d. A first communication time is required for communication between the parent metronome device 1c and the child metronome device 1d. In addition, the parent metronome device 1c and the child metronome device 1e perform wired communication or wireless communication via the communication unit 14c and the communication unit 14e. Communication between the parent metronome device 1c and the child metronome device 1e requires a second communication time.
　［親メトロノーム装置の構成］
　図１１は、メトロノームシステム２０００に含まれる親メトロノーム装置１ｃの、要部構成を表すブロック図である。図１１に示されているように、親メトロノーム装置１ｃは、撮像装置１１ｃ、出力部１２ｃ、通信部１４ｃ、制御部２００ｃ、記憶部３０ｃを備えている。制御部２００ｃには、画像取得部２０１ｃ、画像認識部２０２ｃ、画像判定部２０３ｃ、出力制御部２０４ｃ、通信制御部２０８ｃおよび最大通信時間抽出部２１１ｃが含まれている。記憶部３０ｃには、基準画像３１ｃ、拍子・伴奏データ３２ｃおよび通信時間データ３４ｃが含まれている。 [Configuration of parent metronome device]
FIG. 11 is a block diagram showing a main configuration of the parent metronome device 1c included in the metronome system 2000. As shown in FIG. 11, the parent metronome device 1c includes an imaging device 11c, an output unit 12c, a communication unit 14c, a control unit 200c, and a storage unit 30c. The control unit 200c includes an image acquisition unit 201c, an image recognition unit 202c, an image determination unit 203c, an output control unit 204c, a communication control unit 208c, and a maximum communication time extraction unit 211c. The storage unit 30c includes a reference image 31c, time signature / accompaniment data 32c, and communication time data 34c.
　出力制御部２０４ｃは、実施形態３において説明した機能に変更が加わっている。すなわち、出力制御部２０４ｃは、画像判定部２０３ｃから受け取る判定結果に基づいて、親メトロノーム装置１ｃと子メトロノーム装置１ｄ、１ｅとの通信に要する時間のうち最大の時間（以下、単に「最大通信時間」とも表記する）を反映させた上で、出力部１２ｃのメトロノーム出力を制御する。図１０における「最大通信時間」は、第１の通信時間と第２の通信時間のうち、より長い通信時間である。 The output control unit 204c is modified in the function described in the third embodiment. That is, based on the determination result received from the image determination unit 203c, the output control unit 204c determines the maximum time (hereinafter simply referred to as “maximum communication time”) required for communication between the parent metronome device 1c and the child metronome devices 1d and 1e. And the metronome output of the output unit 12c is controlled. The “maximum communication time” in FIG. 10 is a longer communication time out of the first communication time and the second communication time.
　したがって、「奏者と楽器との位置関係が所定の位置関係である」との判定結果を画像判定部２０３ｃから受け取った場合、出力制御部２０４ｃは、通信部１４ｃが出力指示を送信した時点から最大通信時間が経過した後、出力部１２ｃにメトロノーム出力させる（すなわち、メトロノーム出力をＯＮにする）。逆に、メトロノーム出力中に、「奏者と楽器との位置関係が所定の位置関係でない」との判定結果を画像判定部２０３ｃから受け取った場合、出力制御部２０４ｃは、通信部１４ｃが出力指示を送信した時点から最大通信時間が経過した後、出力部１２ｃにメトロノーム出力させないようにする（すなわち、メトロノーム出力をＯＦＦにする）。 Therefore, when the determination result “the positional relationship between the player and the musical instrument is a predetermined positional relationship” is received from the image determination unit 203c, the output control unit 204c is the maximum from the time when the communication unit 14c transmits the output instruction. After the communication time elapses, the output unit 12c outputs the metronome (that is, turns the metronome output ON). On the other hand, when the determination result “the positional relationship between the player and the instrument is not a predetermined positional relationship” is received from the image determination unit 203c during the metronome output, the output control unit 204c causes the communication unit 14c to issue an output instruction. After the maximum communication time has elapsed from the time of transmission, the output unit 12c is prevented from outputting a metronome (that is, the metronome output is turned off).
　通信制御部２０８ｃは、通信部１４ｃ（送信部）に送信すべきデータを送り、また通信部１４ｃ（受信部）が受信したデータを取得する。 The communication control unit 208c sends data to be transmitted to the communication unit 14c (transmission unit) and acquires data received by the communication unit 14c (reception unit).
　通信制御部２０８ｃは、最大通信時間抽出部２１１ｃから最大通信時間に関する情報を受け取り、通信部１４ｃを介して、子メトロノーム装置１ｄ、１ｅに送信する。 The communication control unit 208c receives information on the maximum communication time from the maximum communication time extraction unit 211c, and transmits the information to the child metronome devices 1d and 1e via the communication unit 14c.
　また、通信部１４ｃが、子メトロノーム装置１ｄ、１ｅから、通信時間に関する情報を受信したとき、通信制御部２０８ｃは、上記情報を受け取り、通信時間データ３４ｃとして記憶部３０に記録する。したがって、通信時間データ３４ｃには、子メトロノーム装置の数と同数の、通信時間に関する情報が含まれていることになる。なお、親メトロノーム装置１ｃが通信時間を測定する構成を取る場合は、この通信制御部２０８ｃの機能は、必ずしも必要ではない。 Further, when the communication unit 14c receives information on the communication time from the child metronome devices 1d and 1e, the communication control unit 208c receives the information and records it in the storage unit 30 as communication time data 34c. Therefore, the communication time data 34c includes the same number of information about communication time as the number of child metronome devices. Note that, when the parent metronome device 1c is configured to measure the communication time, the function of the communication control unit 208c is not necessarily required.
　通信制御部２０８ａが、画像判定部２０３ａから判定結果を受け取ったときの機能は、実施形態３と同様である。 The function when the communication control unit 208a receives the determination result from the image determination unit 203a is the same as that of the third embodiment.
　最大通信時間抽出部２１１ｃは、記憶部３０ｃから通信時間データ３４ｃを読み出し、通信時間データ３４ｃに含まれる最大通信時間に関する情報を抽出する。抽出された最大通信時間に関する情報は、出力制御部２０４ｃおよび通信制御部２０８ｃに送られる。 The maximum communication time extraction unit 211c reads the communication time data 34c from the storage unit 30c, and extracts information related to the maximum communication time included in the communication time data 34c. Information regarding the extracted maximum communication time is sent to the output control unit 204c and the communication control unit 208c.
　通信時間データ３４ｃは、親メトロノーム装置１ｃと、各子メトロノーム装置との間における通信時間に関する情報が記録されている。したがって、図１０に示されているメトロノームシステム２０００の構成の場合、通信時間データ３４ｃには、第１の通信時間に関する情報、および第２の通信時間に関する情報が含まれている。 In the communication time data 34c, information on communication time between the parent metronome device 1c and each child metronome device is recorded. Therefore, in the case of the configuration of the metronome system 2000 shown in FIG. 10, the communication time data 34c includes information related to the first communication time and information related to the second communication time.
　なお、親メトロノーム装置１ｃに含まれる、上述以外の部材については、実施形態１、３における同名の部材の説明が援用される。 In addition, about members other than the above-mentioned contained in the parent metronome apparatus 1c, description of the member of the same name in Embodiment 1, 3 is used.
　［子メトロノーム装置の構成］
　図１２は、メトロノームシステム１０００に含まれている子メトロノーム装置１ｄの、要部構成を表すブロック図である。図１２に示されているように、子メトロノーム装置１ｄは、出力部１２ｄ、通信部１４ｄ、制御部２００ｄおよび記憶部３０ｄを備えている。制御部２００ｄは、出力制御部２０４ｄ、通信制御部２０８ｄ、通信時間測定部２０９ｄ、命令判定部２１０ｄおよび差分時間計算部２１２ｄを含んでいる。記憶部３０ｄは、拍子・伴奏データ３２ｄ、通信時間データ３４ｄおよび命令表３５ｄを含んでいる。 [Configuration of child metronome device]
FIG. 12 is a block diagram showing the main configuration of the child metronome device 1d included in the metronome system 1000. As shown in FIG. 12, the child metronome device 1d includes an output unit 12d, a communication unit 14d, a control unit 200d, and a storage unit 30d. The control unit 200d includes an output control unit 204d, a communication control unit 208d, a communication time measurement unit 209d, a command determination unit 210d, and a difference time calculation unit 212d. The storage unit 30d includes time signature / accompaniment data 32d, communication time data 34d, and a command table 35d.
　出力制御部２０４ｄは、命令判定部２１０ｄの判定結果に基づき、差分時間を反映して、出力部１２ｄを制御する。すなわち、「出力指示を受信した」と命令判定部２１０ｄが判定した場合、出力制御部２０４ｄは、「上記出力指示を受信した時点から差分時間だけ経過した時点」において、出力部１２ｄにメトロノーム出力させる。逆に、「停止指示を受信した」と命令判定部２１０ｄが判定した場合、出力制御部２０４ｄは、上記停止指示を受信した時点から差分時間だけ経過した時点において、出力部１２ｄにメトロノーム出力させないようにする。出力制御部２０４ｄが出力部１２ｄを制御するために必要な、差分時間に関する情報は、差分時間計算部２１２ｄから受け取る。 The output control unit 204d controls the output unit 12d by reflecting the difference time based on the determination result of the instruction determination unit 210d. That is, when the command determination unit 210d determines that “the output instruction has been received”, the output control unit 204d causes the output unit 12d to output a metronome at “a time when the difference time has elapsed from the time when the output instruction is received”. . On the other hand, when the command determination unit 210d determines that “stop instruction has been received”, the output control unit 204d does not cause the output unit 12d to output the metronome when the difference time has elapsed from the time when the stop instruction is received. To. Information regarding the difference time necessary for the output control unit 204d to control the output unit 12d is received from the difference time calculation unit 212d.
　通信制御部２０８ｄは、通信部１４ｄ（送信部）に送信すべきデータを送り、また通信部１４ｄ（受信部）が受信したデータを取得する。 The communication control unit 208d sends data to be transmitted to the communication unit 14d (transmission unit) and acquires data received by the communication unit 14d (reception unit).
　まず、通信制御部２０８ｄが通信部１４ｄから最大通信時間に関する情報を受け取ったとき、通信制御部２０８ｄは、上記最大通信時間に関する情報を、通信時間データ３４ｄとして記憶部３０ｄに書き込む。 First, when the communication control unit 208d receives information on the maximum communication time from the communication unit 14d, the communication control unit 208d writes the information on the maximum communication time in the storage unit 30d as communication time data 34d.
　通信制御部２０８ｄが、通信部１４ｂから出力指示または停止指示を受け取ったときの機能は、実施形態３と同様である。また、通信時間測定部２０９ｂが通信時間を測定したときの、通信制御部２０８ｄの機能も、実施形態３と同様である。 The function when the communication control unit 208d receives an output instruction or a stop instruction from the communication unit 14b is the same as that of the third embodiment. The function of the communication control unit 208d when the communication time measuring unit 209b measures the communication time is the same as that of the third embodiment.
　通信時間測定部２０９ｄは、通信時間を測定する。また、通信時間測定部２０９ｄは、通信時間を測定した後、通信時間に関する情報を生成し、通信制御部２０８ｂに送るとともに、記憶部３０ｄに通信時間データ３４ｄとして書き込む。 The communication time measuring unit 209d measures the communication time. Further, after measuring the communication time, the communication time measuring unit 209d generates information related to the communication time, sends the information to the communication control unit 208b, and writes the communication time data 34d in the storage unit 30d.
　差分時間計算部２１２ｄは、記憶部３０ｄから通信時間データ３４ｄを読み出し、差分時間を計算する。その後、差分時間計算部２１２ｄは、差分時間に関する情報を生成して、出力制御部２０４ｄに送る。 The difference time calculation unit 212d reads the communication time data 34d from the storage unit 30d and calculates the difference time. Thereafter, the difference time calculation unit 212d generates information on the difference time and sends it to the output control unit 204d.
　上記差分時間とは、最大通信時間から、子メトロノーム装置１ｄと親メトロノーム装置１ｃとの通信時間を引いた時間である。すなわち、上記差分時間は、（１）最大通信時間、および（２）自装置と親メトロノーム装置との通信時間、の差である。したがって、自装置と親メトロノーム装置との通信時間が最大通信時間である場合、差分時間は０になる。 The difference time is a time obtained by subtracting the communication time between the child metronome device 1d and the parent metronome device 1c from the maximum communication time. That is, the difference time is a difference between (1) the maximum communication time and (2) the communication time between the own device and the parent metronome device. Therefore, when the communication time between the own device and the parent metronome device is the maximum communication time, the difference time is zero.
　通信時間データ３４ｄには、（１）通信制御部２０８ｄから書き込まれる、最大通信時間に関する情報、および（２）通信時間測定部２０９ｄから書き込まれる、自装置と親メトロノーム装置１ｃとの通信時間に関する情報、が含まれる。なお、通信時間測定部が親メトロノーム装置１ｃに設けられている構成の場合は、上記自装置と親メトロノーム装置１ｃとの通信時間に関する情報も、通信制御部２０８ｄによって書き込まれる。 In the communication time data 34d, (1) information related to the maximum communication time written from the communication control unit 208d, and (2) information related to communication time between the own device and the parent metronome device 1c written from the communication time measurement unit 209d. , Is included. When the communication time measuring unit is provided in the parent metronome device 1c, information related to the communication time between the own device and the parent metronome device 1c is also written by the communication control unit 208d.
　また、通信時間データ３４ｄは、差分時間計算部に読み出され、差分時間を計算するための情報として供与される。 Further, the communication time data 34d is read by the difference time calculation unit and provided as information for calculating the difference time.
　以上に説明した以外の部材については、実施形態１、３において説明されている、同名の部材の説明が援用される。 For members other than those described above, the description of the members with the same names described in the first and third embodiments is incorporated.
　［親メトロノーム装置における処理の流れ］
　次に、実施形態４に係るメトロノームシステムの処理の流れについて、図１３、１４に基づいて説明する。図１３は、メトロノームシステム１０００に含まれている親メトロノーム装置１ｃの、処理の流れを表すフローチャートである。 [Processing flow in the parent metronome device]
Next, the process flow of the metronome system according to the fourth embodiment will be described with reference to FIGS. FIG. 13 is a flowchart showing a process flow of the parent metronome device 1c included in the metronome system 1000.
　Ｓ５１において、親メトロノーム装置１ｃは、子メトロノーム装置１ｄ、１ｅとの通信に要する通信時間に関する情報を取得する。それぞれの子メトロノーム装置との間における通信時間に関する情報を取得する方法は、実施形態３に記載の通りである。また、通信時間測定部を親メトロノーム装置１ｃに設ける場合の説明についても、実施形態３に記載の通りである。取得された通信時間は、通信時間データ３４ｃとして、記憶部３０ｃに書き込まれる。 In S51, the parent metronome device 1c acquires information related to the communication time required for communication with the child metronome devices 1d and 1e. A method for acquiring information related to communication time with each child metronome device is as described in the third embodiment. Further, the description when the communication time measuring unit is provided in the parent metronome device 1c is also as described in the third embodiment. The acquired communication time is written in the storage unit 30c as communication time data 34c.
　Ｓ５２において、最大通信時間抽出部２１１ｃは、通信時間データ３４ｃを読み出し、それぞれの通信時間に関する情報の中から、最大通信時間に関する情報を抽出する。上記最大通信時間に関する情報とは、上記それぞれの通信時間に関する情報のうち、最も長い通信時間を示している通信時間に関する情報である。抽出された最大通信時間に関する情報は、通信制御部２０８ｃに送られ、通信部１４ｃを介して子メトロノーム装置１ｄ、１ｅに送信される。 In S52, the maximum communication time extraction unit 211c reads the communication time data 34c, and extracts information related to the maximum communication time from information related to each communication time. The information on the maximum communication time is information on the communication time indicating the longest communication time among the information on the respective communication times. The extracted information related to the maximum communication time is sent to the communication control unit 208c and transmitted to the child metronome devices 1d and 1e via the communication unit 14c.
　Ｓ５３、Ｓ５４およびＳ５５のステップは、図２のＳ１１、Ｓ１２およびＳ１３のステップに、それぞれ対応する。これらのステップを通じて、親メトロノーム装置１ｃは、奏者と楽器とが所定の位置関係にあるか否かを判定する。画像判定部２０３ｃが「奏者と楽器とが所定の位置関係にある」と判定した場合はＳ５６に進み、「奏者と楽器とが所定の位置関係にない」と判定した場合はＳ５８に進む。 Steps S53, S54 and S55 correspond to the steps S11, S12 and S13 in FIG. 2, respectively. Through these steps, the parent metronome device 1c determines whether or not the player and the musical instrument are in a predetermined positional relationship. If the image determination unit 203c determines that “the player and the instrument are in a predetermined positional relationship”, the process proceeds to S56, and if it is determined that “the player and the instrument are not in a predetermined positional relationship”, the process proceeds to S58.
　Ｓ５６およびＳ５８は、図８のＳ３５およびＳ３７に、それぞれ対応する。これらのステップにおいて、通信制御部２０８ｃは、通信部１４ｃを介して、出力指示または停止指示を子メトロノーム装置１ｄ、１ｅに送信する。 S56 and S58 correspond to S35 and S37 in FIG. 8, respectively. In these steps, the communication control unit 208c transmits an output instruction or a stop instruction to the child metronome devices 1d and 1e via the communication unit 14c.
　Ｓ５７において、「奏者と楽器とが所定の位置関係にある」との判定結果を受け取った出力制御部２０４ｃは、最大通信時間を反映させた上で、出力部１２ｃにメトロノーム出力させる。より具体的には、「通信部１４ｃ（送信部）が出力指示を送信した時点から、さらに最大通信時間だけ経過した時点」において、メトロノーム出力を行うよう、出力部１２ｃを制御する。なお、親メトロノーム装置１ｃにおける「通信部１４ｃ（送信部）が出力指示を送信した時点」とは、奏者にとっては「奏者と楽器との位置関係が所定の位置関係になった時点」となる。Ｓ３６の後、親メトロノーム装置１ｃの処理は、Ｓ５３に戻る。 In S57, the output control unit 204c that has received the determination result that “the player and the instrument are in a predetermined positional relationship” causes the output unit 12c to output a metronome after reflecting the maximum communication time. More specifically, the output unit 12c is controlled so that the metronome output is performed “at the time when the maximum communication time has elapsed from when the communication unit 14c (transmission unit) transmits the output instruction”. It should be noted that “when the communication unit 14c (transmission unit) transmits an output instruction” in the parent metronome device 1c is “when the positional relationship between the player and the instrument becomes a predetermined positional relationship” for the player. After S36, the process of the parent metronome device 1c returns to S53.
　Ｓ５９において、「奏者と楽器とが所定の位置関係にない」との判定結果を受け取った出力制御部２０４ｃは、最大通信時間を反映させた上で、出力部１２ｃにメトロノーム出力させないようにする。より具体的には、「通信部１４ｃ（送信部）が上記停止指示を送信した時点から、さらに最大通信時間だけ経過した時点」において、メトロノーム出力させなくするよう、出力部１２ｃを制御する。なお、親メトロノーム装置１ｃにおける「通信部１４ｃ（送信部）が停止指示を送信した時点」とは、奏者にとっては「奏者と楽器との位置関係が所定の位置関係ではなくなった時点」となる。Ｓ５９の後、親メトロノーム装置１ｃの処理は、Ｓ５３に戻る。 In S59, the output control unit 204c that has received the determination result that “the player and the musical instrument are not in a predetermined positional relationship” reflects the maximum communication time and prevents the output unit 12c from outputting the metronome. More specifically, the output unit 12c is controlled so that the metronome is not output when “the maximum communication time has elapsed after the communication unit 14c (transmission unit) transmits the stop instruction”. Note that “the point in time when the communication unit 14c (transmission unit) transmits a stop instruction” in the parent metronome device 1c is “the point in time when the positional relationship between the player and the instrument is no longer a predetermined positional relationship” for the player. After S59, the process of the parent metronome device 1c returns to S53.
　［子メトロノーム装置における処理の流れ］
　図１４は、メトロノームシステム２０００に含まれている子メトロノーム装置１ｄの、処理の流れを表すフローチャートである。なお、子メトロノーム装置１ｅにおいても、下記の説明と同様の処理が行われる。 [Processing flow in child metronome device]
FIG. 14 is a flowchart showing a process flow of the child metronome device 1d included in the metronome system 2000. The sub-metronome device 1e also performs the same processing as described below.
　Ｓ６１において、通信時間測定部２０９ｄは、通信時間を測定する。上記通信時間は、例えば、実施形態３で例示した方法によって測定される。その後、通信時間測定部２０９ｄは、通信時間（自装置と親メトロノーム装置１ｃとの間の通信時間）に関する情報を生成する。また、通信時間測定部２０９ｄは、上記通信時間に関する情報を、通信時間データとして、記憶部３０ｄに書き込む。 In S61, the communication time measuring unit 209d measures the communication time. The communication time is measured by the method exemplified in the third embodiment, for example. Thereafter, the communication time measuring unit 209d generates information related to the communication time (communication time between the own device and the parent metronome device 1c). In addition, the communication time measurement unit 209d writes information related to the communication time in the storage unit 30d as communication time data.
　Ｓ６２において、通信制御部２０８ｄは、通信時間測定部２０９ｄから通信時間に関する情報を受け取り、通信部１４ｄに送信させる。 In S62, the communication control unit 208d receives information related to the communication time from the communication time measurement unit 209d and causes the communication unit 14d to transmit the information.
　なお、通信時間制御部を親メトロノーム装置１ｃに設ける場合は、Ｓ６１のステップは、以下のステップに置き換えることができる。すなわち、（１）通信部１４ｄは、親メトロノーム装置の通信時間測定部が生成した、通信時間（自装置と親メトロノーム装置１ｃとの間の通信時間）に関する情報を受信する。（２）通信制御部２０８ｄは、上記通信時間に関する情報を取得し、通信時間データ３４ｄとして、記憶部３０ｄに書き込む。また、上記の場合、Ｓ６２は省略することができる。 When the communication time control unit is provided in the parent metronome device 1c, the step of S61 can be replaced with the following steps. That is, (1) The communication unit 14d receives information on the communication time (communication time between the own device and the parent metronome device 1c) generated by the communication time measurement unit of the parent metronome device. (2) The communication control unit 208d acquires information related to the communication time and writes the information as communication time data 34d in the storage unit 30d. In the above case, S62 can be omitted.
　Ｓ６３において、通信部１４ｄは、親メトロノーム装置１ｃから送信された最大通信時間に関する情報を受信する。次いで、通信制御部２０８ｄは、通信部１４ｄから上記最大通信時間に関する情報を取得し、通信時間データ３４ｄとして、記憶部３０ｄに書き込む。 In S63, the communication unit 14d receives information on the maximum communication time transmitted from the parent metronome device 1c. Next, the communication control unit 208d acquires information on the maximum communication time from the communication unit 14d, and writes the information as communication time data 34d in the storage unit 30d.
　Ｓ６４において、差分時間計算部２１２ｄは、通信時間データ３４ｄを記憶部３０ｄから読み出し、差分時間を計算する。より具体的には、差分時間計算部２１２ｄは、通信時間データ３４ｄに含まれる「最大通信時間に関する情報」および「通信時間に関する情報」に基づいて、差分時間を計算する。その後、差分時間計算部２１２ｄは、差分時間に関する情報を生成する。 In S64, the difference time calculation unit 212d reads the communication time data 34d from the storage unit 30d and calculates the difference time. More specifically, the difference time calculation unit 212d calculates the difference time based on “information about maximum communication time” and “information about communication time” included in the communication time data 34d. Thereafter, the difference time calculation unit 212d generates information about the difference time.
　Ｓ６５およびＳ６６は、図９のＳ４３およびＳ４４に、それぞれ対応する。これらのステップを通じて、子メトロノーム装置１ｄは、受信した命令が出力指示であるか、停止指示であるかを判定し、出力制御部２０４ｄに判定結果を送る。 S65 and S66 correspond to S43 and S44 of FIG. 9, respectively. Through these steps, the child metronome device 1d determines whether the received command is an output instruction or a stop instruction, and sends a determination result to the output control unit 204d.
　Ｓ６７において、出力制御部２０４ｄは、差分時間を反映させて、出力部１２ｄにメトロノーム出力させる。より具体的には、出力制御部２０４ｄは、「上記出力指示を受信した時点から差分時間だけ経過した時点」において、出力部１２ｄにメトロノーム出力させる。Ｓ６７のステップが終了した後、子メトロノーム装置１ｄの処理は、再びＳ６５に戻る。 In S67, the output control unit 204d reflects the difference time and causes the output unit 12d to output a metronome. More specifically, the output control unit 204d causes the output unit 12d to output a metronome at a “time when a difference time has elapsed from the time when the output instruction is received”. After the step of S67 is completed, the process of the child metronome device 1d returns to S65 again.
　Ｓ６８において、出力制御部２０４ｄは、差分時間を反映させて、出力部１２ｄにメトロノーム出力させないようにする。より具体的には、出力制御部２０４ｄは、「上記出力指示を受信した時点から差分時間だけ経過した時点」において、出力部１２ｄにメトロノーム出力させないようにする。Ｓ６８のステップが終了した後、子メトロノーム装置１ｄの処理は、再びＳ６５に戻る。 In S68, the output control unit 204d reflects the difference time and prevents the output unit 12d from outputting the metronome. More specifically, the output control unit 204d prevents the output unit 12d from outputting the metronome at the “time when the difference time has elapsed from the time when the output instruction is received”. After the step of S68 is completed, the process of the child metronome device 1d returns to S65 again.
　以上に説明した構成および処理の流れによって、メトロノームシステム２０００は、以下の機能を有することができる。すなわち、親メトロノーム装置１ｃと子メトロノーム装置１ｄ、１ｅとは、同じ時刻にメトロノーム出力を制御することができる。より具体的には、親メトロノーム装置１ｃと子メトロノーム装置１ｄ、１ｅとは、同じタイミングでメトロノーム出力をＯＮ／ＯＦＦすることができる。これにより、３台以上のメトロノーム装置間で、同期されたメトロノーム出力を得ることができる。 With the configuration and processing flow described above, the metronome system 2000 can have the following functions. That is, the parent metronome device 1c and the child metronome devices 1d and 1e can control the metronome output at the same time. More specifically, the parent metronome device 1c and the child metronome devices 1d and 1e can turn on / off the metronome output at the same timing. Thereby, a synchronized metronome output can be obtained between three or more metronome devices.
　なお、メトロノームシステム２０００においては、親メトロノーム装置１ｃを使用する奏者は、楽器との間に所定の位置関係を取ってから最大通信時間だけ経過した後に、メトロノーム出力がＯＮになったことを認識する。このため、上記最大通信時間は、上記親メトロノーム装置１ｃを使用する奏者が不便を感じない程度の短さである（例えば、０．０１秒程度）ことが好ましい。 In the metronome system 2000, the player using the parent metronome device 1c recognizes that the metronome output is turned on after the maximum communication time has elapsed since the predetermined positional relationship with the musical instrument has been established. . For this reason, it is preferable that the maximum communication time is as short as possible (for example, about 0.01 seconds) so that the player who uses the parent metronome device 1c does not feel inconvenience.
　〔変形例１〕
　実施形態３、４における親メトロノーム装置の構成を、実施形態２に記載のメトロノーム装置の構成とすることができる。このような構成によれば、親メトロノーム装置は、ユーザの操作に基づくのではなく、親メトロノーム装置が取得した画像に基づいて、メトロノーム出力を奏者の視認しやすい位置に移動させることができる。 [Modification 1]
The configuration of the parent metronome device in the third and fourth embodiments can be the configuration of the metronome device described in the second embodiment. According to such a configuration, the parent metronome device can move the metronome output to a position where the player can easily view the image based on the image acquired by the parent metronome device, not based on the user's operation.
　〔変形例２〕
　実施形態３、４および変形例１において、親メトロノーム装置および子メトロノーム装置の構成を、同一とすることができる。すなわち、一方のメトロノーム装置にのみ備わっている部材を、他方のメトロノーム装置にも備えさせることができる。このような構成により、同じメトロノーム装置を、あるときは親メトロノーム装置として、別のときは子メトロノーム装置として、使用することができる。 [Modification 2]
In the third and fourth embodiments and the first modification, the configurations of the parent metronome device and the child metronome device can be the same. That is, a member provided only in one metronome device can be provided in the other metronome device. With this configuration, the same metronome device can be used as a parent metronome device in some cases and as a child metronome device in other cases.
　〔ソフトウェアによる実現例〕
　メトロノーム装置１の制御部２００、親メトロノーム装置１ａ、１ｃの制御部２００ａ、２００ｃ、および子メトロノーム装置１ｂ、１ｄ、１ｅの制御部２００ｂ、２００ｄ、２００ｅは、集積回路（ＩＣチップ）等に形成された論理回路（ハードウェア）によって実現してもよいし、ＣＰＵ（Central Processing Unit）を用いてソフトウェアによって実現してもよい。 [Example of software implementation]
The control unit 200 of the metronome device 1, the control units 200a and 200c of the parent metronome devices 1a and 1c, and the control units 200b, 200d and 200e of the child metronome devices 1b, 1d and 1e are formed in an integrated circuit (IC chip) or the like. Alternatively, it may be realized by a logic circuit (hardware) or by software using a CPU (Central Processing Unit).
　後者の場合、メトロノーム装置１、親メトロノーム装置１ａ、１ｃ、および子メトロノーム装置１ｂ、１ｄ、１ｅは、各機能を実現するソフトウェアであるプログラムの命令を実行するＣＰＵ、上記プログラムおよび各種データがコンピュータ（またはＣＰＵ）で読み取り可能に記録されたＲＯＭ（Read Only Memory）または記憶装置（これらを「記録媒体」と称する）、上記プログラムを展開するＲＡＭ（Random Access Memory）などを備えている。そして、コンピュータ（またはＣＰＵ）が上記プログラムを上記記録媒体から読み取って実行することにより、本発明の目的が達成される。上記記録媒体としては、「一時的でない有形の媒体」、例えば、テープ、ディスク、カード、半導体メモリ、プログラマブルな論理回路などを用いることができる。また、上記プログラムは、該プログラムを伝送可能な任意の伝送媒体（通信ネットワークや放送波等）を介して上記コンピュータに供給されてもよい。なお、本発明の一態様は、上記プログラムが電子的な伝送によって具現化された、搬送波に埋め込まれたデータ信号の形態でも実現され得る。 In the latter case, the metronome device 1, the parent metronome devices 1a, 1c, and the child metronome devices 1b, 1d, 1e are a CPU that executes instructions of a program that is software for realizing each function, and the program and various data are stored in a computer ( Alternatively, a ROM (Read Only Memory) or a storage device (these are referred to as “recording media”) and a RAM (Random Access Memory) that expands the program are recorded. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.
　〔メトロノーム装置以外の態様〕
　上記の実施形態１～４では、メトロノーム装置を例に挙げて、本発明の実施の形態を説明した。しかし、本発明の範囲はメトロノーム装置に限定されない。例えば、メトロノーム出力に代えて楽曲などを出力する出力装置であってもよい。 [Aspects other than metronome devices]
In the first to fourth embodiments, the embodiment of the present invention has been described by taking the metronome device as an example. However, the scope of the present invention is not limited to metronome devices. For example, an output device that outputs music instead of the metronome output may be used.
　〔まとめ〕
　本発明の態様１に係る出力装置（メトロノーム装置１）は、楽器を含む奏者の画像を取得する画像取得部２０１と、上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力（メトロノーム出力）を制御する出力制御部２０４とを備えている。 [Summary]
The output device (metronome device 1) according to aspect 1 of the present invention outputs an image using an image acquisition unit 201 that acquires an image of a player including a musical instrument, and the positional relationship between the player and the musical instrument recognized from the image ( And an output control unit 204 for controlling (metronome output).
　上記の構成によれば、ユーザの操作に基づくのではなく、出力装置（メトロノーム装置１）が取得した画像に基づいて、出力（メトロノーム出力）を制御することができる。 According to the above configuration, output (metronome output) can be controlled based on an image acquired by the output device (metronome device 1), not based on a user operation.
　本発明の態様２に係る出力装置（メトロノーム装置１）は、上記態様１において、上記出力制御部２０４は、上記位置関係が所定の位置関係となったときに出力（メトロノーム出力）を行ってもよい。 In the output device (metronome device 1) according to aspect 2 of the present invention, in the above-described aspect 1, the output control unit 204 may perform output (metronome output) when the positional relationship becomes a predetermined positional relationship. Good.
　上記の構成によれば、出力装置（メトロノーム装置１）は、奏者と楽器との位置関係が所定の位置関係である場合に出力（メトロノーム出力）を行うことができる。具体例を挙げると、出力装置（メトロノーム装置１）は、「鍵盤に手を載せる」、「マウスピースに口を当てる」などの奏者の動きを検知し、出力（メトロノーム出力）をＯＮにすることができる。 According to the above configuration, the output device (metronome device 1) can perform output (metronome output) when the positional relationship between the player and the musical instrument is a predetermined positional relationship. To give a specific example, the output device (metronome device 1) detects the player's movements such as “put your hand on the keyboard” or “put your mouth on the mouthpiece” and turn on the output (metronome output). Can do.
　本発明の態様３に係る出力装置（メトロノーム装置１）は、上記態様１または２において、視覚により認識される上記出力（メトロノーム出力）を行う出力部１２と、上記画像から認識した上記奏者と上記出力部１２との位置関係を用いて、上記出力（メトロノーム出力）が上記奏者に視認しやすいように、上記奏者に対する上記出力部１２の位置を移動させる駆動部１３と、をさらに備えていてよい。 The output device (metronome device 1) according to aspect 3 of the present invention is the output device 12 that performs the above-mentioned output (metronome output) recognized visually, the player recognized from the image, and the above-described player. A drive unit 13 for moving the position of the output unit 12 relative to the player may be further provided so that the output (metronome output) is easily visible to the player using the positional relationship with the output unit 12. .
　上記の構成によれば、出力装置（メトロノーム装置１）は、ユーザの操作に基づくのではなく、出力装置（メトロノーム装置１）が取得した画像に基づいて、出力（メトロノーム出力）を奏者の視認しやすい位置に移動させることができる。 According to the above configuration, the output device (metronome device 1) is not based on the user's operation, but the player visually recognizes the output (metronome output) based on the image acquired by the output device (metronome device 1). It can be moved to an easy position.
　本発明の態様４に係る出力装置（メトロノーム装置１）は、上記態様１～３において、上記出力は、メトロノーム出力および楽曲の少なくとも一方である。 In the output device (metronome device 1) according to aspect 4 of the present invention, in the above-described aspects 1 to 3, the output is at least one of metronome output and music.
　上記の構成によれば、メトロノーム出力および楽曲の少なくとも一方を出力することのできる、出力装置（メトロノーム装置１）が得られる。 According to the above configuration, an output device (metronome device 1) that can output at least one of metronome output and music is obtained.
　本発明の態様５に係る出力システム（メトロノームシステム１０００）は、親出力装置（親メトロノーム装置１ａ）と、１または複数の子装置（子メトロノーム装置１ｂ）とを含む出力システム（メトロノームシステム１０００）であって、上記親出力装置（親メトロノーム装置１ａ）は、楽器を含む奏者の画像を取得し、上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子装置（子メトロノーム装置１ｂ）に出力指示を送信し、上記出力指示を送信したときから、所定時間が経過したとき、出力（メトロノーム出力）を行い、上記子装置（子メトロノーム装置１ｂ）は、上記親出力装置（親メトロノーム装置１ａ）から上記出力指示を受信し、上記出力指示を受信したときに出力（メトロノーム出力）を行う。 The output system (metronome system 1000) according to the fifth aspect of the present invention is an output system (metronome system 1000) including a parent output device (parent metronome device 1a) and one or more child devices (child metronome device 1b). The parent output device (parent metronome device 1a) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome) When an output instruction is transmitted to the device 1b) and a predetermined time elapses from when the output instruction is transmitted, an output (metronome output) is performed, and the child device (child metronome device 1b) The output instruction is received from the parent metronome apparatus 1a), and when the output instruction is received, output (metronome output) is performed.
　上記の構成によれば、親出力装置（親メトロノーム装置１ａ）が出力（メトロノーム出力）を行う場合に、子装置（子メトロノーム装置１ｂ）も出力（メトロノーム出力）を行うことができる。例えば、親出力装置（親メトロノーム装置１ａ）の出力（メトロノーム出力）のＯＮ／ＯＦＦに応じて、子装置（子メトロノーム装置１ｂ）の出力（メトロノーム出力）をＯＮ／ＯＦＦすることができる。 According to the above configuration, when the parent output device (parent metronome device 1a) performs output (metronome output), the child device (child metronome device 1b) can also perform output (metronome output). For example, the output (metronome output) of the child device (child metronome device 1b) can be turned on / off in accordance with the ON / OFF of the output (metronome output) of the parent output device (parent metronome device 1a).
　本発明の態様６に係る出力システム（メトロノームシステム１０００）は、親出力装置（親メトロノーム装置１ａ）と、１または複数の子装置（子メトロノーム装置１ｂ）とを含む出力システム（メトロノームシステム１０００）であって、上記親出力装置（親メトロノーム装置１ａ）は、楽器を含む奏者の画像を取得し、上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子装置（子メトロノーム装置１ｂ）に出力指示を送信し、上記出力指示を送信したときから、自装置（親出力装置（親メトロノーム装置１ａ））と上記子装置（子メトロノーム装置１ｂ）との通信に要する時間が経過したとき、出力（メトロノーム出力）を行い、上記子装置（子メトロノーム装置１ｂ）は、上記親出力装置（親メトロノーム装置１ａ）ａから上記出力指示を受信し、上記出力指示を受信したときに出力（メトロノーム出力）を行う。 The output system (metronome system 1000) according to the sixth aspect of the present invention is an output system (metronome system 1000) including a parent output device (parent metronome device 1a) and one or more child devices (child metronome device 1b). The parent output device (parent metronome device 1a) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome) Since the output instruction is transmitted to the apparatus 1b), the time required for communication between the own apparatus (parent output apparatus (parent metronome apparatus 1a)) and the child apparatus (child metronome apparatus 1b) has elapsed since the output instruction is transmitted. Output (metronome output), the child device (child metronome device 1b) is connected to the parent output device (parent metronome device). Receiving the output instruction from a) a, it performs output (metronome output) when it receives the output instruction.
　上記の構成によれば、親出力装置（親メトロノーム装置１ａ）と子装置（子メトロノーム装置１ｂ）とは、同じ時刻に出力（メトロノーム出力）を制御することができる。具体例を挙げると、親出力装置（親メトロノーム装置１ａ）と子装置（子メトロノーム装置１ｂ）とは、同じタイミングで出力（メトロノーム出力）をＯＮ／ＯＦＦすることができる。これにより、複数の出力装置（メトロノーム装置）間で、同期された出力（メトロノーム出力）を得ることができる。 According to the above configuration, the parent output device (parent metronome device 1a) and the child device (child metronome device 1b) can control the output (metronome output) at the same time. As a specific example, the parent output device (parent metronome device 1a) and the child device (child metronome device 1b) can turn ON / OFF the output (metronome output) at the same timing. Thereby, a synchronized output (metronome output) can be obtained among a plurality of output devices (metronome devices).
　本発明の態様７に係る出力システム（メトロノームシステム２０００）は、親装置（親メトロノーム装置１ｃ）と、複数の子装置（子メトロノーム装置１ｄ、１ｅ）とを含む出力システム（メトロノームシステム２０００）であって、上記親装置（親メトロノーム装置１ｃ）は、楽器を含む奏者の画像を取得し、上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子装置（子メトロノーム装置１ｄ、１ｅ）に出力（メトロノーム出力）の出力指示を送信し、上記出力指示を送信したときから、自装置（親装置（親メトロノーム装置１ｃ））と上記複数の子装置（子メトロノーム装置１ｄ、１ｅ）との通信に要する時間のうち、最大の時間である最大通信時間が経過したとき、出力（メトロノーム出力）を行い、上記子装置（子メトロノーム装置１ｄ）は、上記親装置（親メトロノーム装置１ｃ）から上記出力指示を受信し、上記出力指示を受信したときから、自装置（子装置（子メトロノーム装置１ｄ））と上記親装置（親メトロノーム装置１ｃ）との通信時間と上記最大通信時間との差分が経過したとき、出力（メトロノーム出力）を行う。 The output system (metronome system 2000) according to aspect 7 of the present invention is an output system (metronome system 2000) including a parent device (parent metronome device 1c) and a plurality of child devices ( child metronome devices 1d and 1e). The parent device (parent metronome device 1c) acquires an image of a player including a musical instrument, and when the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, the child device (child metronome device 1d). 1e), an output instruction for output (metronome output) is transmitted, and when the output instruction is transmitted, the own apparatus (parent apparatus (parent metronome apparatus 1c)) and the plurality of child apparatuses ( child metronome apparatuses 1d, 1e) ) When the maximum communication time, which is the maximum time, has elapsed (metronome output), (Child metronome device 1d) receives the output instruction from the parent device (parent metronome device 1c), and when receiving the output instruction, the own device (child device (child metronome device 1d)) and the parent device When the difference between the communication time with the parent metronome device 1c and the maximum communication time has elapsed, output (metronome output) is performed.
　上記構成によれば、親装置（親メトロノーム装置１ｃ）と子装置（子メトロノーム装置１ｄ、１ｅ）とは、同じ時刻に出力（メトロノーム出力）を制御することができる。具体例を挙げると、親装置（親メトロノーム装置１ｃ）と子装置（子メトロノーム装置１ｄ、１ｅ）とは、同じタイミングで出力（メトロノーム出力）をＯＮ／ＯＦＦすることができる。これにより、３台以上の出力装置（メトロノーム装置）間で、同期された出力（メトロノーム出力）を得ることができる。 According to the above configuration, the parent device (parent metronome device 1c) and the child devices ( child metronome devices 1d, 1e) can control the output (metronome output) at the same time. As a specific example, the parent device (parent metronome device 1c) and the child devices ( child metronome devices 1d, 1e) can turn ON / OFF the output (metronome output) at the same timing. Thereby, a synchronized output (metronome output) can be obtained between three or more output devices (metronome devices).
　本発明の態様８に係る出力装置（メトロノーム装置）の制御方法は、楽器を含む奏者の画像を取得する画像取得工程（Ｓ１１）と、上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力（メトロノーム出力）を制御する出力制御工程（Ｓ１３、Ｓ１４、Ｓ１５）と、を含んでいる。上記の構成によれば、上記態様１と同様の効果を奏する。 The control method of the output device (metronome device) according to the aspect 8 of the present invention includes an image acquisition step (S11) for acquiring an image of a player including a musical instrument, and a positional relationship between the player recognized from the image and the musical instrument. And an output control process (S13, S14, S15) for controlling the output (metronome output). According to said structure, there exists an effect similar to the said aspect 1. FIG.
　本発明の各態様に係る出力装置（メトロノーム装置）（親装置（親メトロノーム装置）および子装置（子メトロノーム装置）を含む）は、コンピュータによって実現してもよく、この場合には、コンピュータを上記出力装置（メトロノーム装置）が備える各部（ソフトウェア要素）として動作させることにより上記出力装置（メトロノーム装置）をコンピュータにて実現させる出力装置（メトロノーム装置）の制御プログラム、およびそれを記録したコンピュータ読み取り可能な記録媒体も、本発明の範疇に入る。 The output device (metronome device) (including the parent device (parent metronome device) and the child device (child metronome device)) according to each aspect of the present invention may be realized by a computer. A control program of the output device (metronome device) that realizes the output device (metronome device) by a computer by operating as each unit (software element) included in the output device (metronome device), and a computer readable recording thereof Recording media also fall within the scope of the present invention.
　本発明は上述した各実施形態に限定されるものではなく、請求項に示した範囲で種々の変更が可能であり、異なる実施形態にそれぞれ開示された技術的手段を適宜組み合わせて得られる実施形態についても本発明の技術的範囲に含まれる。さらに、各実施形態にそれぞれ開示された技術的手段を組み合わせることにより、新しい技術的特徴を形成することができる。 The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.
１　メトロノーム装置（出力装置）
１ａ、１ｃ　親メトロノーム装置（親出力装置）
１ｂ、１ｄ、１ｅ　子メトロノーム装置（子出力装置）
１１、１１ａ、１１ｃ　撮像装置
１２、１２ａ、１２ｂ、１２ｃ、１２ｄ　出力部
１３　駆動部
１４ａ、１４ｂ、１４ｃ、１４ｄ、１４ｅ　通信部
２００、２００ａ、２００ｂ、２００ｃ、２００ｄ　制御部
２０１、２０１ａ、２０１ｃ　画像取得部
２０２、２０２ａ、２０２ｃ　画像認識部
２０３、２０３ａ、２０３ｃ　画像判定部
２０４、２０４ａ、２０４ｂ、２０４ｃ、２０４ｄ　出力制御部
２０５　顔認識部
２０６　顔判定部
２０７　駆動制御部
２０８ａ、２０８ｂ、２０８ｃ、２０８ｄ、２０８ｅ　通信制御部
２０９ｂ、２０９ｄ　通信時間測定部
２１０ｂ、２１０ｄ　命令判定部
２１１ｃ　最大通信時間抽出部
２１２ｄ　差分時間計算部
３０、３０ａ、３０ｂ、３０ｃ、３０ｄ　記憶部
３１、３１ａ、３１ｃ、　基準画像
３２、３２ａ、３２ｂ、３２ｃ、３２ｄ　伴奏データ
３３　顔基準画像
３４ａ、３４ｃ、３４ｄ　通信時間データ
３５ｂ、３５ｄ　命令表
１０００、２０００　メトロノームシステム（出力システム） 1 Metronome device (output device)
1a, 1c Parent metronome device (parent output device)
1b, 1d, 1e Child metronome device (child output device)
11, 11a, 11c Imaging device 12, 12a, 12b, 12c, 12d Output unit 13 Drive unit 14a, 14b, 14c, 14d, 14e Communication unit 200, 200a, 200b, 200c, 200d Control unit 201, 201a, 201c Image acquisition 202, 202a, 202c Image recognition unit 203, 203a, 203c Image determination unit 204, 204a, 204b, 204c, 204d Output control unit 205 Face recognition unit 206 Face determination unit 207 Drive control unit 208a, 208b, 208c, 208d, 208e Communication control unit 209b, 209d Communication time measurement unit 210b, 210d Command determination unit 211c Maximum communication time extraction unit 212d Difference time calculation unit 30, 30a, 30b, 30c, 30d Storage units 31, 31a, 31c, reference images 32, 32a, 32b, 32c, 3 2d Accompaniment data 33 Face reference images 34a, 34c, 34d Communication time data 35b, 35d Command table 1000, 2000 Metronome system (output system)

Claims (9)

  1. 　楽器を含む奏者の画像を取得する画像取得部と、
    　上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力を制御する出力制御部と、を備えていることを特徴とする出力装置。     An image acquisition unit for acquiring an image of a player including a musical instrument;
    An output device comprising: an output control unit that controls output using a positional relationship between the player and the musical instrument recognized from the image.
  2. 　上記出力制御部は、上記位置関係が所定の位置関係となったときに出力を行うことを特徴とする、請求項１に記載の出力装置。 The output device according to claim 1, wherein the output control unit outputs when the positional relationship becomes a predetermined positional relationship.
  3. 　視覚により認識される上記出力を行う出力部と、
    　上記画像から認識した上記奏者と上記出力部との位置関係を用いて、上記出力が上記奏者に視認しやすいように、上記奏者に対する上記出力部の位置を移動させる駆動部と、を備えていることを特徴とする請求項１または２に記載の出力装置。     An output unit for performing the output recognized by vision;
    A drive unit that moves the position of the output unit relative to the player so that the player can easily see the output using the positional relationship between the player recognized from the image and the output unit; The output device according to claim 1, wherein the output device is an output device.
  4. 　上記出力は、メトロノーム出力および楽曲の少なくとも一方である、請求項１～３のいずれか１項に記載の出力装置。 The output device according to any one of claims 1 to 3, wherein the output is at least one of a metronome output and a music piece.
  5. 　親出力装置と、１または複数の子出力装置とを含む出力システムであって、
    　上記親出力装置は、
    　　楽器を含む奏者の画像を取得し、
    　　上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子出力装置に出力指示を送信し、
    　　上記出力指示を送信したときから、所定時間が経過したとき、出力を行い、
    　上記子出力装置は、
    　　上記親出力装置から上記出力指示を受信し、
    　　上記出力指示を受信したときに出力を行う、ことを特徴とする出力システム。     An output system including a parent output device and one or more child output devices,
    The parent output device is
    Get an image of the player including the instrument,
    When the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, an output instruction is transmitted to the child output device,
    When a predetermined time has passed since the output instruction was sent, output is performed.
    The child output device is
    Receiving the output instruction from the parent output device;
    An output system, wherein an output is performed when the output instruction is received.
  6. 　親出力装置と、１または複数の子出力装置とを含む出力システムであって、
    　上記親出力装置は、
    　　楽器を含む奏者の画像を取得し、
    　　上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子出力装置に出力指示を送信し、
    　　上記出力指示を送信したときから、自装置と上記子出力装置との通信に要する時間が経過したとき、出力を行い、
    　上記子出力装置は、
    　　上記親出力装置から上記出力指示を受信し、
    　　上記出力指示を受信したときに出力を行う、ことを特徴とする出力システム。     An output system including a parent output device and one or more child output devices,
    The parent output device is
    Get an image of the player including the instrument,
    When the positional relationship between the player and the musical instrument becomes a predetermined positional relationship, an output instruction is transmitted to the child output device,
    When the time required for communication between the own device and the child output device has elapsed since the output instruction was transmitted, output is performed.
    The child output device is
    Receiving the output instruction from the parent output device;
    An output system, wherein an output is performed when the output instruction is received.
  7. 　親出力装置と、複数の子出力装置とを含む出力システムであって、
    　上記親出力装置は、
    　　楽器を含む奏者の画像を取得し、
    　　上記奏者と上記楽器との位置関係が所定の位置関係となったとき、上記子出力装置に出力の出力指示を送信し、
    　　上記出力指示を送信したときから、自装置と上記複数の子出力装置との通信に要する時間のうち、最大の時間である最大通信時間が経過したとき、出力を行い、
    　上記子出力装置は、
    　　上記親出力装置から上記出力指示を受信し、
    　　上記出力指示を受信したときから、自装置と上記親出力装置との通信時間と上記最大通信時間との差分が経過したとき、出力を行う、ことを特徴とする出力システム。     An output system including a parent output device and a plurality of child output devices,
    The parent output device is
    Get an image of the player including the instrument,
    When the positional relationship between the player and the instrument is a predetermined positional relationship, an output output instruction is transmitted to the child output device,
    When the maximum communication time, which is the maximum time, has elapsed among the time required for communication between the own device and the plurality of child output devices since the output instruction is transmitted,
    The child output device is
    Receiving the output instruction from the parent output device;
    An output system, wherein output is performed when a difference between a communication time between the own device and the parent output device and the maximum communication time has elapsed since the output instruction was received.
  8. 　楽器を含む奏者の画像を取得する画像取得工程と、
    　上記画像から認識した上記奏者と上記楽器との位置関係を用いて出力を制御する出力制御工程と、を含んでいることを特徴とする出力装置の制御方法。     An image acquisition step of acquiring an image of a player including a musical instrument;
    An output control step of controlling output using a positional relationship between the player and the musical instrument recognized from the image.
  9. 　請求項１～４のいずれか１項に記載の出力装置としてコンピュータを機能させるための制御プラグラムであって、コンピュータを上記画像取得部および上記出力制御部として機能させるための制御プログラム。 A control program for causing a computer to function as the output device according to any one of claims 1 to 4, wherein the control program causes the computer to function as the image acquisition unit and the output control unit.
PCT/JP2018/015600 2017-05-31 2018-04-13 Output device, output system, method for controlling output device, and control program WO2018221038A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017108756 2017-05-31
JP2017-108756 2017-05-31

Publications (1)

Publication Number Publication Date
WO2018221038A1 true WO2018221038A1 (en) 2018-12-06

Family

ID=64454742

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/015600 WO2018221038A1 (en) 2017-05-31 2018-04-13 Output device, output system, method for controlling output device, and control program

Country Status (1)

Country Link
WO (1) WO2018221038A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002215139A (en) * 2001-01-17 2002-07-31 Casio Comput Co Ltd Method and device for recording playing operation
JP2004205483A (en) * 2002-10-29 2004-07-22 Ric:Kk Electronic metronome and metronome cellular phone
JP2008008946A (en) * 2006-06-27 2008-01-17 Yamaha Corp Musical sound controller and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002215139A (en) * 2001-01-17 2002-07-31 Casio Comput Co Ltd Method and device for recording playing operation
JP2004205483A (en) * 2002-10-29 2004-07-22 Ric:Kk Electronic metronome and metronome cellular phone
JP2008008946A (en) * 2006-06-27 2008-01-17 Yamaha Corp Musical sound controller and program

Similar Documents

Publication Publication Date Title
US8079962B2 (en) Method and apparatus for reproducing content data
JP6845322B2 (en) Mixed reality display system
US20170337910A1 (en) Automatic performance system, automatic performance method, and sign action learning method
JP6776788B2 (en) Performance control method, performance control device and program
US20100222144A1 (en) Image-linked sound output method and device
US11404036B2 (en) Communication method, sound generation method and mobile communication terminal
WO2018010401A1 (en) Projection-based piano playing instructing system and control method
JP5793900B2 (en) Image projection apparatus, function setting method, and function setting program
JP2017032693A (en) Video recording/playback device
WO2020138258A1 (en) Information processing device, information processing method, and information processing program
US20210335331A1 (en) Image control system and method for controlling image
TWI559299B (en) Singing visual effect system and method for processing singiing visual effect
WO2018221038A1 (en) Output device, output system, method for controlling output device, and control program
US10269389B2 (en) Video processing apparatus, video processing method, and program
JP2005300971A (en) System and method for supporting operation
JP2007140180A (en) Display device, program, and information storage medium
KR102087491B1 (en) Music score video output device connected to karaoke system and musical score output method using the same
JP2003223166A (en) Information processor, musical score page change method therefor, program for musical score display and recording medium
JP6793382B1 (en) Imaging equipment, information processing equipment, methods and programs
JP6098083B2 (en) Performance device, performance method and program
JP6065224B2 (en) Karaoke equipment
JP2014235301A (en) Command input discrimination system using gesture
JP6940079B2 (en) Desk lamp type camera device and recording system
US20240105151A1 (en) Automatic musician assistance
JP2017021266A (en) Data processing device and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18810058

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18810058

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP