JP2015191034A - Karaoke device, program, and karaoke system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke device, a program, and a karaoke system which does not need to register information for acquiring moving image data to be used as a background video in advance and can display an arbitrary moving image.SOLUTION: A portable terminal 1 transmits data information of moving image data designated by a user to a karaoke device 2. The karaoke device 2 receives the moving image data via a network N on the basis of the data information. The karaoke device 2 starts audio output based on music data and starts displaying to a monitoring device 6 a moving image based on the moving image data successively received. Thus, in the karaoke device 2, the audio output based on the music data and moving image display by the monitoring device 6 are synchronously performed.

Description

  The present invention relates to a karaoke apparatus and program for outputting audio based on music data, and a karaoke system including the karaoke apparatus.

  Patent Document 1 proposes a karaoke apparatus capable of displaying not only a background video preset for each music piece but also an arbitrary web page as a background image. In the technique disclosed in Patent Document 1, a URL (Uniform Resource Locator) is registered in association with a music piece when making a music reservation, and the karaoke apparatus starts a web corresponding to the URL when the music performance starts. A page is acquired via the Internet and used as a background image.

  Patent Document 2 proposes a karaoke apparatus capable of displaying a video reflecting the user's preference as a background video. In the technique disclosed in Patent Document 2, user information is registered in association with music when making a music reservation, and when the karaoke apparatus starts playing music, user information is obtained from a large number of posted videos. A projection image corresponding to (for example, age, sex, etc.) is selected and used as a background image.

JP 2010-204681 A JP 2012-68346 A

  In the techniques disclosed in Patent Documents 1 and 2, it is necessary to register an arbitrary URL or user information at the time of music reservation. Also, since an arbitrary URL or user information is registered for each song, the video based on the URL or user information is only used as a background video while the corresponding song is being played.

  The present invention has been made in view of such problems. The object is to provide a karaoke apparatus, a program, and a karaoke system that can display an arbitrary video without having to register information for acquiring video data used as a background video in advance. It is in.

  The karaoke apparatus according to the present invention is a karaoke apparatus that performs audio output based on music data, a receiving unit that receives data information about moving image data from an external device, and the moving image data based on the data information received by the receiving unit. And a display control unit for displaying a moving image based on the moving image data acquired by the acquiring unit on a display unit in accordance with an execution status of audio output based on the music data.

  The karaoke apparatus according to the present invention is characterized in that the display control unit displays a moving image based on the moving image data acquired by the acquiring unit when audio output based on the music data is being executed. To do.

  In the karaoke apparatus according to the present invention, the acquisition unit is configured to acquire the moving image data and audio data associated with the moving image data, and according to an execution status of audio output based on the music data, A volume control unit that controls the volume of sound based on the audio data acquired by the acquisition unit; and a sound output unit that performs output of sound whose volume is controlled by the volume control unit and audio output based on the music data. It is characterized by.

  In the karaoke apparatus according to the present invention, the acquisition unit acquires the moving image data and audio data associated with the moving image data, and among the audio data acquired by the acquiring unit, An audio specifying unit that specifies partial audio data corresponding to music data, and a moving image specifying that specifies partial moving image data corresponding to the partial audio data specified by the audio specifying unit among the moving image data acquired by the acquisition unit And the display control unit displays a moving image based on the partial moving image data specified by the moving image specifying unit.

  In the karaoke apparatus according to the present invention, the receiving unit receives device information indicating a providing device that provides the moving image data, and the acquiring unit is based on the device information received by the receiving unit, The moving image data is obtained from a providing device indicated by the device information.

  In the karaoke apparatus according to the present invention, the receiving unit receives search information for searching for the moving image data, and the acquisition unit performs a search process based on the search information received by the receiving unit. The moving image data corresponding to the search information is acquired.

  In the karaoke apparatus according to the present invention, when the audio output based on the music data ends during the display of the video based on the video data, the display control unit ends the video display based on the video data, and the music When the display of the moving image based on the moving image data ends before the audio output based on the data ends, the display of the moving image based on the same or different moving image data is started.

  The karaoke apparatus according to the present invention includes a comparison unit that compares an audio output time based on the music data and a moving image display time based on the moving image data, and the display control unit is configured such that the comparison unit is more than the audio output time. When it is determined that the moving image display time is longer, a moving image based on the moving image data is displayed so that the moving image display time is shortened.

  In the karaoke apparatus according to the present invention, when the display control unit is not executing the audio output based on the music data or when the remaining audio output time in the audio output being executed is less than a predetermined time, the next music Corresponding to the execution of audio output based on data, a moving image based on the moving image data acquired by the acquisition unit is displayed.

  The program according to the present invention obtains the moving image data based on the receiving step of receiving data information relating to moving image data from an external device to a computer that performs audio output based on the music data, and the data information received in the receiving step. And a step of displaying a moving image based on the moving image data acquired in the acquiring step on a display unit in accordance with an execution status of audio output based on the music data.

  The karaoke system according to the present invention is a karaoke system comprising a karaoke device that performs audio output based on music data and a communication device that can communicate with the karaoke device, wherein the communication device provides data information relating to video data. The karaoke device has a transmission unit that transmits to the karaoke device, the karaoke device receives the data information transmitted by the transmission unit, and obtains the moving image data based on the data information received by the reception unit. And a display control unit that causes the display unit to display a moving image based on the moving image data acquired by the acquiring unit in accordance with an execution status of audio output based on the music data.

  In the karaoke system according to the present invention, the communication device receives a correspondence information receiving unit that receives correspondence information associated with moving image data from an external device, and accepts a selection for the correspondence information received by the correspondence information receiving unit. A transmission section, wherein the transmission section is configured to transmit data information related to moving image data corresponding to the correspondence information received by the reception section to the karaoke apparatus.

  According to the present invention, a karaoke apparatus that performs audio output based on music data receives data information about moving image data from an external apparatus. The karaoke apparatus acquires moving image data based on the received data information, and causes the display unit to display a moving image based on the acquired moving image data in accordance with the execution status of audio output based on the music data. Therefore, an arbitrary moving image can be displayed based on moving image data that can be acquired by the karaoke device using the data information, and the options of the moving image displayed on the karaoke device are expanded. In addition, it is possible to switch whether or not an arbitrary moving image is displayed depending on the execution status of audio output by the karaoke apparatus.

  According to the present invention, when the karaoke device is executing audio output, the karaoke device displays a moving image based on the moving image data acquired based on the data information. Therefore, the karaoke apparatus can use the acquired moving image data as a background image in audio output.

  According to the present invention, the karaoke apparatus acquires not only moving image data but also audio data associated with the moving image data. The karaoke apparatus controls the sound volume based on the acquired sound data according to the execution status of the audio output based on the music data. The karaoke apparatus displays a moving image based on the acquired moving image data on the display unit, and outputs a sound whose volume is controlled and an audio output based on the music data. For example, the karaoke apparatus controls the sound volume based on the acquired sound data to be small when the audio output based on the music data is being executed, and the sound volume based on the acquired sound data when the audio output is not being executed. Is greatly controlled (or output at the same volume). Thereby, in the karaoke apparatus, the audio output based on the music data is not disturbed by the sound based on the sound data acquired from the outside.

  According to the present invention, the karaoke apparatus specifies partial audio data corresponding to music data among audio data associated with video data, and specifies partial video data corresponding to partial audio data from the video data. . And a karaoke apparatus displays the moving image based on the specified partial moving image data on a monitor apparatus. Therefore, the karaoke apparatus can restrict the moving image data to be displayed (reproduced) according to the music data, and can display only the moving image corresponding to the music data.

  According to the present invention, the karaoke device receives device information indicating a providing device that provides moving image data from an external device, and acquires moving image data from the providing device based on the received device information. Therefore, since the moving image based on the moving image data that the karaoke device can acquire from the external providing device can be displayed, the options of the moving image displayed on the karaoke device are expanded.

  According to the present invention, the karaoke device receives search information for searching for moving image data from an external device, and acquires moving image data by a search process based on the received search information. Therefore, since the moving image based on the moving image data that can be acquired by the karaoke device by the search process can be displayed, the options of the moving image displayed on the karaoke device are expanded.

  According to the present invention, the karaoke apparatus ends the display of the moving image based on the moving image data when the audio output based on the music data ends during the display of the moving image based on the moving image data. Further, the karaoke apparatus starts displaying the moving image based on the same or different moving image data when the displaying of the moving image based on the moving image data ends before the audio output based on the music data ends. Therefore, the karaoke apparatus can display a moving image based on the moving image data while executing the audio output.

  According to the present invention, the karaoke apparatus compares the audio output time based on the music data with the moving image display time based on the moving image data. When the moving image display time is longer than the audio output time, the karaoke apparatus displays the moving image so that the moving image display time is shortened. For example, the moving image display speed (moving image reproduction speed) is increased. As a result, the audio output time and the moving image display time based on the moving image data can be made comparable. That is, it is possible to match the end timing of audio output with the end timing of moving image display based on moving image data.

  According to the present invention, when the karaoke apparatus is not performing audio output based on music data, or when the remaining audio output time in the audio output being performed is less than a predetermined time, the moving image display unit based on the moving image data In response to the execution of audio output based on the next music data, the moving image is displayed on the display unit. Therefore, when the karaoke apparatus is not outputting audio, or when the remaining output time of the music being output is less than the predetermined time, a new moving image display on the display unit is not started.

  According to the present invention, a communication device that transmits data information about moving image data to a karaoke device receives correspondence information associated with moving image data from an external device, and accepts a selection for the received correspondence information. And a communication apparatus transmits the data information regarding the moving image data corresponding to the selected corresponding | compatible information to a karaoke apparatus. Therefore, the user can select the video data based on the correspondence information associated with the video data, such as the thumbnail image, data name, and file name of the video data, and can display any video on the karaoke device. Become.

  In the present invention, it is not necessary for the user to register in advance information for acquiring moving image data to be used as a background image, and any moving image can be used as a background image of karaoke.

It is a schematic diagram which shows the structural example of the karaoke system which concerns on this embodiment. It is a block diagram which shows the internal structural example of a karaoke apparatus and an input device. It is a schematic diagram which shows the structural example of a reservation music table. It is a block diagram which shows the internal structural example of a portable terminal. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the karaoke process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the karaoke process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the search process of the moving image data by a portable terminal. It is a schematic diagram which shows the example of a display screen of a portable terminal.

Hereinafter, a karaoke apparatus, a program, and a karaoke system according to the present invention will be described in detail with reference to the drawings showing a karaoke system as an embodiment thereof.
FIG. 1 is a schematic diagram illustrating a configuration example of a karaoke system according to the present embodiment. The karaoke system of this embodiment includes a karaoke device 2 installed in a karaoke store, a server device 4 managed by a karaoke distribution company, a mobile terminal 1 of a user who uses the karaoke store, and the like.

  The karaoke device 2 and the server device 4 can be connected to a network N such as the Internet, and the server device 4 sends music data related to the music used for karaoke via the network N in response to a request from the karaoke device 2. Provided to the karaoke device 2. Specifically, the server device 4 stores a large amount of music data that can be provided (distributed) to the karaoke device 2 and manages each music data with a music ID attached thereto. The karaoke device 2 designates a song ID when requesting the song data from the server device 4, and the server device 4 provides the karaoke device 2 with the song data of the requested song ID. The music data is, for example, MIDI (Musical Instrument Digital Interface) data, and accompaniment information of all musical instruments used in the music, tempo, tone, strength (velocity), chord constituent sound, lyrics, Includes timing information.

The mobile terminal 1 is a communication device such as a smartphone, a mobile phone, and a tablet terminal, and can be connected to the network N.
In addition to the karaoke device 2, the karaoke store is provided with an input device 3 that performs input to the karaoke device 2, a monitor device 6, a speaker 7, a microphone 8, and the like. In the present embodiment, the input device 3 performs wireless communication with the karaoke device 2, and the monitor device 6, the speaker 7, and the microphone 8 are each connected to the karaoke device 2 via the relay device 5. The relay device 5 has the function of an access point used for wireless communication so that the mobile terminal 1 can perform wireless communication with the relay device 5 and communicate with the karaoke device 2 via the relay device 5. It is configured. The input device 3 may be configured to communicate with the karaoke device 2 via the relay device 5 in the same manner as the portable terminal 1 in addition to the configuration of performing wireless communication directly with the karaoke device 2. Moreover, although this embodiment demonstrates the structure provided with each apparatus which comprises a karaoke system 1 each, you may provide multiple each apparatus.

FIG. 2 is a block diagram illustrating an internal configuration example of the karaoke device 2 and the input device 3. The karaoke apparatus 2 includes a control unit 20, a RAM (Random Access Memory) 21, a storage unit 22, a first communication unit 23, a second communication unit 24, a third communication unit 25, and the like. These units are connected to each other via a bus.
The control unit 20 is a CPU (Central Processing Unit), an MPU (Micro Processor Unit), or the like, and controls operations of the above-described hardware units connected through a bus. In addition, the control unit 20 executes a predetermined operation by reading a control program stored in advance in the storage unit 22 into the RAM 21 and sequentially executing the program.

The RAM 21 is an SRAM (Static RAM), a DRAM (Dynamic RAM), a flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 20.
The storage unit 22 is an HDD (Hard Disk Drive), a flash memory, or the like, and stores a control program executed by the control unit 20 and various data in advance. The storage unit 22 stores a reserved music table 22a. Further, the storage unit 22 also stores music data (MIDI data) downloaded from the server device 4.

  FIG. 3 is a schematic diagram showing a configuration example of the reserved music table 22a. The reserved song table 22a stores information on songs reserved for karaoke via the input device 3 or the portable terminal 1 in the order of reservation. The reserved music table 22a stores a music ID, reserved person information, background video information, and the like in association with each reserved music. In the music ID column, music identification information for identifying music is stored. The music identification information is information that can specify the music data stored in the storage unit 22. In the reservation information column, user identification information for identifying a reserved user (reservation person) is stored. The user identification information includes information required when the karaoke device 2 communicates with each user's mobile terminal 1 via the relay device 5 (hereinafter also referred to as terminal information). In the column of background video information, information (data information) relating to moving image data used for the background video during performance of the music is stored. The data information is information necessary for acquiring moving image data, and is, for example, URL (Uniform Resource Locator) information given to moving image data published via the network N. Further, information (device information) including IP (Internet Protocol) address assigned to a server device (providing device) that provides moving image data, a folder name and a file name for storing moving image data in the server device, is used as data information. It may be used. Furthermore, search information (search wording) used when searching for moving image data published via the network N or moving image data stored in a predetermined server device may be used as the data information. Note that, for music that does not store background video information, a default background video that is preset for the music is used.

The contents stored in the reserved music table 22a are updated by the control unit 20 each time a new music is reserved. Note that the designation of the moving image data used for the background video can be performed not only when making a karaoke reservation, but also for a song that has already been reserved. Therefore, the stored content in the background video information column is updated by the control unit 20 every time moving image data to be used for the background video is designated or every time use of the default background video is designated.
The reserved music table 22a is, for example, a first-in first-out table (queue), and is added to the tail when the information of the reserved music is registered, and is read from the head when the information is read.

The first communication unit 23 is an interface for connecting to the network N, and communicates with the server device 4 via the network N, for example.
The second communication unit 24 is an interface for connecting to the relay device 5 and performs communication with the relay device 5 connected via a predetermined signal line. The second communication unit 24 outputs screen information to the monitor device 6 and outputs audio information to the speaker 7 via the relay device 5 in accordance with an instruction from the control unit 20. Further, the second communication unit 24 acquires the voice information collected by the microphone 8 via the relay device 5. Further, the second communication unit 24 communicates with the mobile terminal 1 via the relay device 5.

The third communication unit 25 is a wireless local area network (LAN) module, an infrared communication module, a Bluetooth (registered trademark) module, or the like, and performs wireless communication with the input device 3.
The first communication unit 23 may be configured to connect to the network N by wireless communication, the second communication unit 24 may be configured to perform wireless communication with the relay device 5, and the third communication unit 25 may A configuration in which wired communication with the input device 3 via a predetermined signal line may be performed.

The input device 3 includes a control unit 30, a RAM 31, a storage unit 32, a communication unit 33, a touch panel 34, and the like. These units are connected to each other via a bus.
The control unit 30 is a CPU, an MPU, or the like, and controls operations of the above-described hardware units connected via a bus. The control unit 30 executes a predetermined operation by reading out a control program stored in advance in the storage unit 32 to the RAM 31 and sequentially executing the program.

The RAM 31 is an SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 30.
The storage unit 32 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 30 and various data.

  The communication unit 33 is a communication unit similar to the third communication unit 25 of the karaoke device 2, and performs wireless communication with the karaoke device 2. In addition, when the 3rd communication part 25 of the karaoke apparatus 2 is a structure which performs a wired communication via a predetermined signal line, the communication part 33 also performs the wired communication via a predetermined signal line between the karaoke apparatuses 2. Configured to do.

The touch panel 34 includes an operation unit 34a and a display unit 34b.
The operation unit 34 a has various operation keys necessary for the user to operate the input device 3 and the karaoke device 2, receives information corresponding to the operation key operated by the user, and receives the received information to the control unit 30. Send it out. The control unit 30 executes various processes according to information acquired from the operation unit 34a.
The display unit 34 b is a liquid crystal display, a plasma display, an organic EL (Electro Luminescence) display, or the like, and displays various information according to instructions from the control unit 30.

FIG. 4 is a block diagram illustrating an internal configuration example of the mobile terminal 1. The mobile terminal 1 includes a control unit 10, a RAM 11, a storage unit 12, a touch panel 13, a first communication unit 14, a second communication unit 15, and the like. These units are connected to each other via a bus.
The control unit 10 is a CPU, an MPU, or the like, and controls the operation of each hardware unit connected via a bus. In addition, the control unit 10 executes a predetermined operation by reading a control program stored in advance in the storage unit 12 into the RAM 11 and sequentially executing the program.

The RAM 11 is SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 10.
The storage unit 12 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 10 and various data. For example, the storage unit 12 stores a browser for browsing various data disclosed via the network N, a search program for searching for desired data from the various data, and the like.

The touch panel 13 includes an operation unit 13a and a display unit 13b.
The operation unit 13 a has various operation keys necessary for the user to operate the mobile terminal 1, receives information corresponding to the operation key operated by the user, and sends the received information to the control unit 10.
The display unit 13 b is a liquid crystal display, a plasma display, an organic EL display, or the like, and displays various types of information according to instructions from the control unit 10.

The first communication unit 14 is an interface for connecting to the network N by wireless communication, and can communicate with various server apparatuses that disclose various data via the network N. The second communication unit 15 is a wireless LAN module, an infrared communication module, a Bluetooth module, or the like, and performs wireless communication with the relay device 5.
The first communication unit 14 and the second communication unit 15 may be configured to perform wired communication through a predetermined signal line.

  In the karaoke system of this embodiment, when the karaoke apparatus 2 performs audio output based on the music data with the speaker 7, the lyrics included in the music data are displayed on the monitor device 6. Further, the karaoke apparatus 2 is configured to be able to display a moving picture based on moving picture data prepared in advance or moving picture data designated by a user as a background image of lyrics displayed on the monitor device 6.

  Below, the process which each apparatus which has the structure mentioned above performs in the karaoke system of this embodiment is demonstrated based on a flowchart. First, processing performed by the mobile terminal 1 when the user makes a karaoke reservation using the mobile terminal 1 will be described. The karaoke reservation is to register a song (music) that the user wants to sing in the karaoke apparatus 2.

  FIG. 5 is a flowchart showing a procedure of processing performed by the mobile terminal 1. The control unit 10 of the portable terminal 1 displays a karaoke reservation reception screen (hereinafter referred to as a reservation reception screen) on the touch panel 13 by executing a predetermined application program stored in the storage unit 12 (S1). ). The mobile terminal 1 may be configured to access a predetermined server device (for example, the server device 4) and acquire a reservation acceptance screen from the predetermined server device. The user who enters the karaoke store (enters the room) operates the touch panel 13 and selects a music piece to be reserved via the reservation reception screen. The control part 10 of the portable terminal 1 receives the music selected by the user via the touch panel 13 (S2).

In addition, when the user wants to display an arbitrary background video during the performance of the selected music piece, the user specifies moving image data to be used for the background video on the reservation reception screen. Note that the moving image data that can be specified as the background image is moving image data that is made public via the network N, moving image data that is stored in an external device that can be accessed by the karaoke apparatus 2, and the like. Also, audio data may be associated with these moving image data.
The control unit 10 of the portable terminal 1 receives data information of moving image data designated via the touch panel 13 (S3). The data information is URL information or search information. Also, the designation of the moving image data used for the background video may not be performed on the reservation reception screen.

  The control unit 10 of the mobile terminal 1 receives the reservation information including the music ID of the music received in step S2, the identification information (reserver information) of the mobile terminal 1, and the data information received in step S3 in the second communication. It transmits to the karaoke apparatus 2 from the part (transmission part) 15 via the relay apparatus 5 (S4), and complete | finishes a process. In addition, when the moving image data used for the background video is not specified, the control unit 10 transmits reservation information that does not include data information. Further, the identification information of the mobile terminal 1 may include terminal information used when the karaoke apparatus 2 communicates with the mobile terminal 1. Furthermore, when the mobile terminal 1 is configured to make a karaoke reservation via a predetermined server device (for example, the server device 4), user information registered in advance in the server device may be used as identification information of the mobile terminal 1.

Next, processing performed by the karaoke apparatus 2 when the user makes a karaoke reservation using the mobile terminal 1 will be described. FIG. 6 is a flowchart showing a procedure of processing performed by the karaoke apparatus 2.
The control unit 20 of the karaoke device 2 determines whether or not the reservation information transmitted by the portable terminal 1 in step S4 in FIG. 5 is received by the second communication unit (reception unit) 24 via the relay device 5. (S11). If it is determined that it has not been received (S11: NO), the control unit 20 waits until reception. If it is determined that it has been received (S11: YES), the control unit 20 of the karaoke apparatus 2 registers the content of the received reservation information in the reserved song table 22a (S12). Specifically, the control unit 20 sets the music ID included in the reservation information, the identification information and data information of the mobile terminal 1, the music ID column, the reservation information column, and the background video information column of the reserved music table 22a. Respectively. When the reservation information does not include data information, the control unit 20 leaves the background video information column blank.

Based on the song ID stored in the reserved song table 22a, the control unit 20 of the karaoke device 2 requests the song data of this song ID from the server device 4 and acquires (downloads) it from the server device 4 via the network N. (S13). The control unit 20 stores the acquired music data in the storage unit 22 and ends the process.
Once the music data is downloaded from the server device 4 to the karaoke device 2, it is stored in the storage unit 22 of the karaoke device 2. Therefore, in the process shown in FIG. 6, when the control unit 20 of the karaoke device 2 requests the music data from the server device 4, it confirms whether or not it has already been stored in the storage unit 22. You may request | require from the server apparatus 4 only in the case.

  Next, karaoke processing performed by the karaoke device 2 based on the reserved song table 22a after the karaoke reservation is performed as described above and the reservation information is stored in the reserved song table 22a of the karaoke device 2 will be described. The karaoke process performed by the karaoke apparatus 2 is a process necessary for performing karaoke. For example, the karaoke apparatus 2 performs audio output (voice output, music performance) to the speaker 7 based on music data, based on music data. There is a process of displaying lyrics on the monitor device 6. The karaoke device 2 also performs a process of scoring the user's singing voice input via the microphone 8 based on the music data downloaded from the server device 4, a process of displaying the scoring result on the monitor device 6, and the like.

  7 and 8 are flowcharts showing the procedure of the karaoke process performed by the karaoke apparatus 2. When starting the karaoke process, the control unit 20 of the karaoke apparatus 2 reads information on the music stored at the head of the reserved music table 22a (S21). Based on the read information, the control unit 20 determines whether or not the user has designated any video data as the background video for this music (S22). Specifically, the control unit 20 determines whether or not data information is included in the read information. If included, the control unit 20 determines that the background video is specified.

  When it is determined that the background video is not designated (S22: NO), the control unit 20 of the karaoke apparatus 2 reads the song data of the song ID read from the reserved song table 22a from the storage unit 22, and based on the read song data. Audio output is started at the speaker 7 (S23). And the control part 20 of the karaoke apparatus 2 judges whether the started audio output was complete | finished (S24), and when it is judged that it was not complete | finished (S24: NO), the audio output based on music data is continued. . When it is determined that the audio output has ended (S24: YES), the control unit 20 of the karaoke apparatus 2 determines whether or not the operation end has been instructed (S25). When the user operates the input device 3 (the karaoke device 2) to instruct the end of the operation of the karaoke device 2, the control unit 20 determines that the end of the operation has been instructed.

  If it is determined that the operation end has not been instructed (S25: NO), the control unit 20 of the karaoke apparatus 2 returns the process to step S21 and reads the information of the music stored at the head of the reserved music table 22a ( S21). That is, the information on the next reserved music is read out, and the processes after step S22 are repeated based on the read-out information. When it is determined that the operation end is instructed (S25: YES), the control unit 20 of the karaoke apparatus 2 ends the karaoke process.

  If it is determined that the background video is specified (S22: YES), the control unit 20 of the karaoke apparatus 2 starts receiving the moving image data specified for the background video based on the data information read from the reserved song table 22a. (S26). For example, when the data information is URL information, the control unit 20 requests the moving image data indicated by the URL information from the server indicated by the URL information via the network N in the first communication unit (acquisition unit) 23. Start receiving from the server. Note that the control unit 20 receives not only moving image data but also audio data associated with the moving image data via the network N.

  When the data information is search information (search wording) used when searching for moving image data, the control unit 20 performs a search process based on the data information (search information) and is made public via the network N. The moving image data used for the background image is searched from the moving image data and the moving image data stored in a predetermined server device on the network N. Note that the search processing for moving image data is performed using a known search program. For example, the control unit 20 searches for moving image data including any word of the search information in additional data such as a title, an explanation column, a tag, and a file name added to the moving image data. Moreover, the control part 20 specifies more optimal moving image data, when searching several moving image data. For example, the control unit 20 specifies moving image data that includes more search terms in additional data, moving image data that includes search terms with higher priority assigned to the search terms, respectively, in the additional data, and the like. Further, the control unit 20 specifies moving image data in which the moving image display time based on the moving image data is approximately the same as the performance time (audio output time) of the music designated as the background image. The control unit 20 requests the specified moving image data from the server device storing the moving image data, and starts receiving the data from the server device.

The control unit 20 of the karaoke apparatus 2 determines whether or not the moving image data that has been received is promotion video data (hereinafter referred to as PV data) of the song with the song ID read from the reserved song table 22a (S27). .
The additional data such as the title, description column, or tag added to the PV data may include a word indicating that the data is PV data such as a promotion video, promotion, promotion, music video, MV, etc. Many. Therefore, the control unit 20 of the karaoke apparatus 2 determines whether or not the above-mentioned wording is included in the additional data of the moving image data that has started to be received. to decide. In addition, a music title, a singer name, and the like are added to the PV data. Therefore, when it is determined that the moving image data that has started to be received is PV data, the control unit 20 and the song name and singer name of the song with the song ID read from the reserved song table 22a and the moving image data that has started to be received (PV It is determined whether or not the song name and singer name added to (data) match. When it is determined that they match, the control unit 20 determines that the received moving image data is the PV data of the song with the song ID read from the reserved song table 22a.

  When the control unit 20 of the karaoke apparatus 2 starts to receive the moving image data, the control unit 20 first receives the additional data of the moving image data, and based on the received additional data, the moving image data is read from the reserved song table 22a. It is determined whether or not the PV data of the music having the ID. In addition, the wording used to determine whether the data is PV data is not limited to the wording described above. Moreover, the determination method of whether moving image data is the PV data of the music selected by the user is not restricted to the method mentioned above.

  When it is determined that the moving image data that has started to be received is PV data of a song with a song ID read from the reserved song table 22a (S27: YES), the control unit 20 of the karaoke apparatus 2 uses the PV data (received movie data). The singing start position in the PV data is specified based on the audio data (audio data associated with the moving image data) included in the video data (S28). For example, the control unit 20 performs frequency conversion on voice data, determines a position where a frequency component (frequency waveform) of a human voice first appears, and specifies this position as a singing start position. In addition, the information which shows a singing start position may be previously added to PV data (video data), and in the case of such PV data, the control part 20 starts singing based on the information added to PV data. The position can be specified.

  In addition, the control part 20 of the karaoke apparatus 2 receives PV data sequentially from the head, and specifies a song start position based on the audio | voice data contained in the received PV data. For example, some PV data published via the network N has advertisement data added to the head. In the case of such PV data, the control unit 20 can specify the start position (song start position) of the PV data based on the difference in the characteristics of the audio data between the advertisement data and the PV data. Moreover, you may identify a song start position based on moving image data other than the structure which identifies a song start position based on the audio | voice data matched with moving image data. For example, in the case of PV data with advertisement data added to the head, the control unit 20 determines the start position (singing start position) of the PV data based on the difference in the characteristics of the moving image data between the advertisement data and the PV data. Can be identified.

  When the singing start position in the moving image data (PV data) that has started reception is specified, the control unit 20 of the karaoke apparatus 2 specifies the vocal sound start position in the song data of the song ID read from the reserved song table 22a (S29). ). In addition, the control part 20 can specify a vocal sound start position based on the various information contained in music data.

  The control unit 20 of the karaoke apparatus 2 uses the moving image data (PV data) that has been received based on the vocal sound starting position in the music data specified in step S29 and the singing start position in the moving image data specified in step S28. The reproduction start position is specified (S30). For example, the control unit 20 calculates the time from the performance start position of the music data to the vocal sound start position. And the control part 20 specifies the position before the calculated time to the reproduction | regeneration start position from the song start position specified by step S28 in the moving image data (PV data) which started reception. In addition, the control part (audio | voice specific part, moving image specific part) 20 specifies the part (partial moving image data and partial audio | voice data) corresponding to music data among moving image data by specifying the reproduction start position in moving image data. Can be identified.

  When the reproduction start position of the moving image data is specified, the control unit (display control unit) 20 of the karaoke apparatus 2 uses the moving image monitor device 6 based on the moving image data (PV data) sequentially received from the specified reproduction start position. Display is started (S31). Specifically, the control unit 20 sequentially transmits moving image data sequentially received by the first communication unit 23 from the second communication unit 24 to the monitor device 6 via the relay device 5, and the moving image data based on the moving image data is transmitted. It is displayed on the monitor device 6. In addition, the control part 20 displays the moving image based on moving image data on the monitor apparatus 6 as a background image of the lyrics contained in music data.

  On the other hand, the control unit (sound volume control unit) 20 of the karaoke apparatus 2 performs a process (for example, a mute process) for reducing the sound volume based on the audio data received via the network N together with the moving image data (S32). Moreover, the control part 20 of the karaoke apparatus 2 reads the music data of the music ID read from the reserved music table 22a in step S21 from the storage part 22, and starts the audio output based on the read music data on the speaker 7 (S33). . At this time, the control unit (audio output unit) 20 outputs not only audio output based on music data but also audio based on audio data received together with moving image data. Note that the volume of the voice based on the voice data is reduced in step S32, so that it does not interfere with the audio output.

If it is determined in step S27 that the moving image data that has started reception is not PV data (S27: NO), the control unit 20 of the karaoke apparatus 2 skips the processing in steps S28 to S30 and is based on the sequentially received moving image data. Display of the moving image on the monitor device 6 is started (S31). Moreover, the control part 20 of the karaoke apparatus 2 performs the process which reduces the sound volume based on the audio | voice data received with the moving image data (S32), and outputs the audio output based on the music data of the music ID read from the reserved music table 22a. The process starts with the speaker 7 (S33).
Even when the moving image data that has started to be received is not PV data, for example, the reproduction start position is determined based on the moving image data or the audio data associated with the moving image data, and the determined reproduction start position is used. Video display based on video data and audio output based on audio data may be started. For example, in the case of moving image data with advertisement data added to the head, the control unit 20 of the karaoke apparatus 2 may specify the end position of the advertisement data and determine this position as the reproduction start position.

  The control unit 20 of the karaoke apparatus 2 determines whether or not the audio output started in step S33 has ended (S34). Specifically, when the audio output based on the music data is executed to the end, or when the user operates the input device 3 (karaoke device 2) and instructs the output stop during the audio output, the control unit 20 Determines that the audio output has ended. When it is determined that the audio output has ended (S34: YES), the control unit 20 of the karaoke apparatus 2 ends the moving image display started in step S31 (S35). That is, the control unit 20 ends the moving image display started with the start of the audio output (music performance) based on the music data when the audio output ends. In addition, when ending a moving image display, the control part 20 also complete | finishes the audio | voice output based on the audio | voice data received with the moving image data.

  If it is determined that the audio output has not ended (S34: NO), the control unit 20 of the karaoke apparatus 2 determines whether or not the moving image display started in step S31 has ended (S36). When it is determined that the moving image display has not ended (S36: NO), that is, when both the audio output based on the music data and the moving image display based on the moving image data have not ended, the control unit 20 performs the process in step S34. return.

  When it is determined that the moving image display is finished (S36: YES), that is, when the moving image display is finished before the audio output is finished, the control unit 20 of the karaoke apparatus 2 uses the first communication unit 23 to connect the network N. The display of the moving image based on the moving image data received via the network is started again (S37), and the process returns to step S34. At this time, the control unit 20 of the karaoke apparatus 2 may be configured to display again a moving image based on the same moving image data as the previously displayed moving image data, or may be configured to display a moving image based on different moving image data. For example, when specifying moving image data to be used for a background image via a reservation reception screen, the user can specify whether the same moving image data is used (reproduced) only once or repeatedly (reproduced). It is good. In addition, when the moving image data to be used for the background image is specified via the reservation reception screen, the user may specify a plurality of moving image data and the use order (reproduction order) of each moving image data. Thereby, the control part 20 of the karaoke apparatus 2 switches whether the moving image display should be ended or the same or different moving image display should be started according to the user's designation when the moving image display is ended before the audio output is ended. be able to.

Further, if the data information stored in the reserved song table 22a is search information, the control unit 20 of the karaoke apparatus 2 will end up displaying the moving image before the audio output is finished, if the video display is finished. The search process based on the corresponding data information may be performed again to start displaying a moving image based on the searched moving image data. In this case, while the audio output is being performed, a plurality of moving images related to the music being output are sequentially displayed.
In addition, when displaying the same moving image, the control unit 20 may be configured to start the display from the reproduction start position determined in step S30, or start the display after newly performing the reproduction start position specifying process. It may be configured. In addition, when displaying different moving images, the control unit 20 may be configured to start the display after performing the reproduction start position specifying process for different moving image data, or start the display without performing the specifying process. It may be configured.

  When the audio output is finished and the moving image display is finished, the control unit 20 of the karaoke apparatus 2 determines whether or not the operation end is instructed (S38). When it is determined that the operation end is not instructed (S38: NO), the control unit 20 of the karaoke apparatus 2 returns the process to step S21, and performs step information about the music information stored at the head of the reserved music table 22a. The processes after S21 are repeated. When it is determined that the operation end has been instructed (S38: YES), the control unit 20 of the karaoke apparatus 2 ends the karaoke process.

  7 and FIG. 8, the karaoke apparatus 2 can acquire (receive) moving image data based on the data information acquired from the mobile terminal 1, and can use the received moving image data as a background image of karaoke. In the process shown in FIGS. 7 and 8, the karaoke apparatus 2 also ends the moving image display based on the moving image data when the audio output is ended. In addition to this, even after the audio output is completed, the moving image display based on the moving image data may be continued until the karaoke apparatus 2 starts the audio output based on the next reserved music data. Also, in this case, between the end of audio output and the start of the next audio output, the sound volume based on the sound data received together with the moving image data is returned to the original sound volume and the sound is output. Good. That is, only a moving image based on moving image data may be displayed during audio output, and a moving image display based on moving image data and an audio output based on audio data may be performed in an audio output waiting state. As a result, it is possible to view arbitrary content data when waiting for audio output.

  In the processing shown in FIGS. 7 and 8, when the moving image data designated as the background video is PV data, the karaoke apparatus 2 specifies the singing start position in the PV data, and the specified singing start position and music data can be stored. The playback start position in the PV data is specified based on the vocal sound start position. In addition, a configuration in which the user manually designates the reproduction start position in the moving image data designated as the background video may be used. For example, on the reservation reception screen, the user can reproduce (moving image display and audio output) the moving image data designated as the background image on the portable terminal 1 and can execute the fast forward function and the rewind function. And it is good also as a structure which can designate the reproduction | regeneration start position which a user wants to use for the background image | video of karaoke based on the displayed moving image and the output audio | voice via a reservation reception screen. In this case, the reservation information transmitted from the portable terminal 1 to the karaoke apparatus 2 includes not only data information but also information indicating the reproduction start position. Thereby, the moving image display based on the moving image data can be performed from an arbitrary reproduction start position. In this case, the data information of the moving image data designated as the background video and the information indicating the reproduction start position designated by the user may be stored in the storage unit 12 in association with each other. Thereby, when the same moving image data is used for the background image of karaoke next time, it is not necessary to designate the reproduction start position again. Further, the information on the reproduction start position stored in the storage unit 12 of the mobile terminal 1 as described above may be shared among a plurality of mobile terminals 1. For example, the mobile terminal 1 requests a plurality of other mobile terminals for information on the reproduction start position of certain moving image data, and the mobile terminal having the requested information is requested from among other mobile terminals. It is good also as a structure which transmits the information of a reproduction | regeneration start position to the portable terminal 1.

  In the processes shown in FIGS. 7 and 8, it is desirable that the processes in steps S26 to S30 be performed before the audio output based on the music data is started. Therefore, for example, the processing of steps S21 and S22 and the processing of steps S26 to S30 may be performed when the background video is specified during the audio output of the music piece with the previous reservation order. Further, the process of step S31 and the processes of steps S32 and S33 can be executed in parallel.

In the present embodiment, designation of arbitrary video data used for the background image of the lyrics displayed on the monitor device 6 is not only performed when making a karaoke reservation, but also when a karaoke reservation has already been made or audio output has already started. It can also be performed on existing music.
Below, the process which the portable terminal 1 performs when a user designates the moving image data used for a background image | video using the portable terminal 1 at the time other than when performing a karaoke reservation is demonstrated.

  FIG. 9 is a flowchart showing a procedure of processing performed by the mobile terminal 1. The control unit 10 of the mobile terminal 1 executes a predetermined application program stored in the storage unit 12, so that a background image of a song that is already being played or a song that is already reserved (a song waiting for audio output) is displayed. A reception screen (hereinafter referred to as a background reception screen) for receiving arbitrary video data to be used is displayed on the touch panel 13. Note that the background reception screen displays not only the music data used for the background video when the music is specified and the specified music is played (audio output), but no music is specified and any music is played. It is also possible to accept (specify) moving image data used for the background video at the time. The user operates the touch panel 13 to specify moving image data to be used for the background video on the background reception screen. In this case as well, the moving image data used for the background image may be moving image data published via the network N, moving image data stored in an external device accessible by the karaoke device 2, and the like. Audio data may be associated with the moving image data.

  The control unit 10 of the mobile terminal 1 determines whether or not designation of moving image data has been received via the touch panel 13 (S41). If it is determined that it has not been received (S41: NO), the control unit 10 of the mobile terminal 1 waits until it is received. When it is determined that the designation of the moving image data has been received (S41: YES), the control unit 10 of the mobile terminal 1 determines whether or not the designation of the music that uses the specified moving image data for the background image has been received (S42). . When it is determined that the designation of the music is not accepted (S42: NO), that is, when the music using the designated moving image data for the background video is not designated, the control unit 10 of the portable terminal 1 is designated. The data information of the moving image data is transmitted to the karaoke apparatus 2 (S43), and the process ends. At this time, the control unit 10 may transmit the data information together with information indicating that the music using the moving image data for the background video is not designated.

  When it is determined that a song that uses the designated moving image data for the background video is designated (S42: YES), the control unit 10 of the mobile terminal 1 is the song that is currently outputting audio. It is determined whether or not (S44). For example, the control unit 10 acquires information (music ID, music title, singer name, etc.) of the music currently being output from the karaoke device 2 and the music being reserved (waiting for audio output) (music ID, music title, singer name, etc.) 13 is displayed. And the control part 10 receives selection of the music which uses designated moving image data for a background image from the music in display by operation of the touch panel 13 by a user. Therefore, the control unit 10 can determine whether the music that uses the specified moving image data for the background video is the music that is currently outputting audio or the music that is waiting for audio output according to the selected music.

  When it is determined that the music is not being output (S44: NO), that is, when the music is waiting for audio output (reserved), the control unit 10 of the portable terminal 1 specifies the music ID of the specified music and the specified music. The reservation information including the data information of the moving image data is transmitted from the second communication unit 15 to the karaoke apparatus 2 (S45), and the process is terminated. The control unit 20 of the karaoke apparatus 2 that has received such reservation information stores the data information of the received reservation information in the column of background video information corresponding to the song ID of the received reservation information in the reserved song table 22a. Store.

  If it is determined that the music is being output as audio (S44: YES), the control unit 10 of the mobile terminal 1 uses the data information of the specified video data as the background video of the music currently being output as audio. It transmits to the karaoke apparatus 2 with the information which shows using (S46), and complete | finishes a process.

Next, the process performed by the karaoke apparatus 2 when moving image data is designated via the background reception screen and the mobile terminal 1 transmits data information as described above will be described. FIG.10 and FIG.11 is a flowchart which shows the procedure of the process which the karaoke apparatus 2 performs.
The control unit 20 of the karaoke device 2 determines whether or not the data information transmitted by the mobile terminal 1 in step S43 or S46 in FIG. 9 is acquired by the second communication unit 24 via the relay device 5 ( S51). When it is determined that the data information has not been acquired (S51: NO), the control unit 20 of the karaoke apparatus 2 stands by while performing other processes.

  When it is determined that the data information has been acquired (S51: YES), the control unit 20 of the karaoke apparatus 2 is currently outputting audio data based on the data information based on the information acquired from the portable terminal 1 together with the data information. It is determined whether the moving image data is used for the background image of the song (S52). When it is determined that the video data is used for the background video of the music being output (S52: YES), the control unit 20 of the karaoke device 2 designates the video as the background video based on the data information acquired from the mobile terminal 1. The received video data is started (S53). Note that the control unit 20 receives the moving image data by the same process as step S26 in FIG. Further, the control unit 20 receives not only moving image data but also audio data associated with the moving image data via the network N.

The control unit 20 of the karaoke apparatus 2 determines whether or not the moving image data that has been received is the PV data of the music that is being output (S54). Note that the control unit 20 determines whether or not the data is PV data by the same processing as step S27 in FIG.
When it is determined that the moving image data that has started to be received is the PV data of the music being output (S54: YES), the control unit 20 of the karaoke apparatus 2 performs the PV data through the same process as step S28 in FIG. The singing start position in (received moving image data) is specified (S55).

  Next, the control unit 20 of the karaoke apparatus 2 specifies information (music data information) indicating the vocal sound start position and the current output position in the music data of the music being output (S56). The control unit 20 of the karaoke apparatus 2 specifies the playback start position in the moving image data (PV data) designated as the background video based on the specified music data information and the singing start position specified in step S55 (S57). ). For example, the control unit 20 calculates the time from the vocal sound start position of the music data to the current output position based on the specified music data information. And the control part 20 specifies the position after the calculated time to the reproduction | regeneration start position from the song start position specified by step S55 in the moving image data (PV data) which started reception.

  The control unit 20 of the karaoke apparatus 2 starts displaying the moving image on the monitor device 6 based on the moving image data (PV data) sequentially received from the reproduction start position of the specified moving image data (S58). Further, the control unit 20 of the karaoke apparatus 2 performs a process (for example, a mute process) for reducing the sound volume based on the sound data sequentially received via the network N together with the moving image data (S59), along with the audio output being executed, Audio output based on the audio data received together with the moving image data is started (S60). Note that the volume of the voice based on the voice data is reduced in step S59, so that it does not interfere with the audio output.

If it is determined in step S54 that the moving image data that has started reception is not PV data (S54: NO), the control unit 20 of the karaoke apparatus 2 skips the processing of steps S55 to S57 and is based on the sequentially received moving image data. Display of the moving image on the monitor device 6 is started (S58). Moreover, the control part 20 of the karaoke apparatus 2 performs the process which reduces the sound volume based on the audio | voice data received with moving image data (S59), and starts the output of the audio | voice which reduced the sound volume with the audio output in process. (S60).
Even when the moving image data that has started to be received is not PV data, for example, the reproduction start position is determined based on the moving image data or the audio data associated with the moving image data, and the determined reproduction start position is used. Video display based on video data and audio output based on audio data may be started. For example, in the case of moving image data with advertisement data added to the head, the control unit 20 of the karaoke apparatus 2 may specify the end position of the advertisement data and determine this position as the reproduction start position.

  When the control unit 20 of the karaoke apparatus 2 starts displaying the moving image based on the moving image data on the monitor device 6 in step S58, the remaining audio output time in the music data being output is a predetermined time (for example, 10 seconds) or more may be determined. Then, the control unit 20 may start displaying a moving image on the monitor device 6 when the remaining audio output time is equal to or longer than a predetermined time. That is, when the remaining audio output time is less than the predetermined time, the control unit 20 may not display the moving image on the monitor device 6. At this time, the control unit 20 also does not perform the process of reducing the volume of the sound based on the audio data corresponding to the moving image data (S59) and the process of outputting the sound with the reduced volume (S60).

  The control unit 20 of the karaoke apparatus 2 determines whether or not the audio output being executed has ended (S61). Specifically, when the audio output based on the music data is executed to the end, or when the user operates the input device 3 (karaoke device 2) and instructs the output stop during the audio output, the control unit 20 Determines that the audio output has ended. When it is determined that the audio output has not ended (S61: NO), the control unit 20 of the karaoke apparatus 2 continues the audio output based on the music data and the moving image display based on the moving image data. If it is determined that the audio output has ended (S61: YES), the control unit 20 of the karaoke apparatus 2 ends the moving image display started in step S58 (S62). That is, the control unit 20 ends the moving image display when the audio output (music performance) based on the music data ends. In addition, when complete | finishing a moving image display, the control part 20 also complete | finishes the audio | voice output based on the audio | voice data started by step S60.

  With the above-described processing, it is possible to display an arbitrary moving image based on moving image data designated by the user via the mobile terminal 1 as a background image even for a piece of music for which audio output has already been started. When the specified moving image data is PV data, the reproduction start position (display start position) in the moving image data is specified based on the current audio output position. Therefore, the display timing of the moving image based on the moving image data by the monitor device 6 and the audio output timing by the karaoke device 2 can be synchronized with respect to the music for which audio output has already started.

  When it is determined in step S52 that the video data is not used for the background video of the music being output (S52: NO), the control unit 20 of the karaoke apparatus 2 is currently performing audio output based on any of the music data. It is determined whether or not (S63). When it is determined that the audio output is not being executed (S63: NO), the control unit 20 of the karaoke device 2 monitors an error message indicating that the moving image data designated via the portable terminal 1 cannot be displayed on the karaoke device 2. The information is displayed on the device 6 (S64), and the process is terminated. In addition, the control part 20 of the karaoke apparatus 2 is good also as a structure which transmits an error message to the portable terminal 1 which has transmitted data information, and displays it on the touch panel 13 of the portable terminal 1. FIG.

  If it is determined that audio output is being executed (S63: YES), the control unit 20 of the karaoke apparatus 2 starts to receive moving image data based on the data information acquired from the mobile terminal 1 (S65). And the control part 20 of the karaoke apparatus 2 starts the display to the monitor apparatus 6 of the moving image based on the moving image data received sequentially (S66). At this time, the control unit 20 also starts audio output based on audio data sequentially received via the network N together with the moving image data. In addition, the control unit 20 of the karaoke device 2 sends the video data to the video monitor device 6 based on the video data that is sequentially received when the remaining audio output time of the music data being output is equal to or longer than a predetermined time (for example, 10 seconds). It is good also as a structure which starts a display. In addition, the control unit 20 of the karaoke device 2 suspends the video display on the monitor device 6 when the audio is not being output or when the remaining audio output time in the music data being output is less than a predetermined time. Then, it may be configured to display the suspended video in synchronization with the timing of starting audio output based on the reserved music data.

  The control unit 20 of the karaoke apparatus 2 determines whether or not the display of the moving image based on the sequentially received moving image data is finished (S67), and when it is determined that the display is not finished (S67: NO), the moving image display and the sound are displayed. If the output is continued and it is determined that the process has been completed (S67: YES), the process is terminated. Thereby, the karaoke apparatus 2 can display the moving image based on the moving image data acquired from the external device based on the data information on the monitor device 6. Whether or not to display an arbitrary moving image depending on whether or not audio output by the karaoke apparatus 2 is being executed when an instruction to display a moving image based on moving image data is given without specifying a song. Can be switched.

  In the processing shown in FIGS. 10 and 11, after the audio output is completed, the moving image display based on the moving image data is continued until the karaoke apparatus 2 starts the audio output based on the next reserved music data. But you can. Also, in this case, between the end of audio output and the start of the next audio output, the sound volume based on the sound data received together with the moving image data is returned to the original sound volume and the sound is output. Good.

  In the karaoke system of the present embodiment, the karaoke apparatus 2 is configured to continue moving image display based on moving image data received via the network N until the audio output ends. Note that the karaoke apparatus 2 processes the moving image data so that the moving image display time is approximately equal to the audio output time, depending on the output time required for audio output based on the music data and the moving image display time based on the moving image data. You may have the structure to do. Specifically, the control unit (comparison unit) 20 of the karaoke device 2 specifies the remaining output time of the music being output, and the remaining display time of the moving image based on the moving image data currently displayed on the monitor device 6 Compare with For example, when the moving image display time is longer than the audio output time, the control unit 20 of the karaoke apparatus 2 processes the moving image data so as to shorten the moving image display time (for example, increases the reproduction speed), and after the processing The moving image based on the moving image data is displayed on the monitor device 6. For the music waiting for audio output, the karaoke apparatus 2 specifies the output time required for audio output, and compares it with the display time of the moving image based on the moving image data specified for the background image of this song. When the moving image display time is longer than the audio output time, the control unit 20 of the karaoke apparatus 2 processes the moving image data so that the moving image display time is approximately the audio output time, and the processed moving image data Is displayed on the monitor device 6. Thereby, the end timing of the audio output can be matched with the end timing of the display by the monitor device 6 of the moving image based on the moving image data.

In the karaoke system of the present embodiment, the user searches for moving image data to be used for the background image of karaoke in advance, and designates the searched moving image data via the reservation reception screen or the background reception screen. Met. Furthermore, the mobile terminal 1 may have a configuration in which the moving image data is automatically searched based on the music information that the user has reserved for karaoke or the music information of the music that is going to be reserved for karaoke via the reservation reception screen.
Below, the process which the portable terminal 1 searches automatically the moving image data used for the background image | video of karaoke is demonstrated.

FIG. 12 is a flowchart illustrating the procedure of the moving image data search process performed by the mobile terminal 1, and FIG. 13 is a schematic diagram illustrating a display screen example of the mobile terminal 1.
The control unit 10 of the portable terminal 1 performs the following processing when the user designates arbitrary moving image data as a background image of karaoke. First, the control unit 10 of the mobile terminal 1 acquires music information such as a music ID, a music title, and a singer name of a music that is desired to use arbitrary video data as a background video (S71). Specifically, when the user selects a song for which karaoke reservation is to be made via the reservation reception screen, the control unit 10 acquires song information of the selected song. In addition, when the user specifies the video data that the user wants to use for the background video via the background reception screen, the user is currently outputting the music that the background video is to be changed to any video data before specifying the video data. Select from music and music waiting for audio output. And the control part 10 acquires the music information of the music which the user selected via the background reception screen. For example, the control unit 10 acquires the music information of the music from the karaoke apparatus 2.

  As shown in FIG. 13A, the control unit 10 of the portable terminal 1 displays the acquired music information and also displays a search screen on the touch panel 13 that accepts selection of whether to perform automatic search or manual search (S72). . In the search screen shown in FIG. 13A, search processing based on music information is automatically performed on moving image data stored in a predetermined server device (“automatic search within a predetermined server”) or via the network N. It is possible to select whether to perform automatically on the moving image data released ("automatic search in the network") or manually by the user ("manual search"). Note that “automatic search within a predetermined server” and “automatic search within a network” may be collectively referred to as “automatic search”.

  The control unit 10 of the portable terminal 1 determines whether execution of automatic search is selected via the search screen (S73). When it is determined that execution of automatic search is selected (S73: YES), specifically, when “automatic search within a predetermined server” or “automatic search within a network” is selected, the control unit 10 selects the selected process. Accordingly, a search process based on the music information is performed on the moving image data stored in the predetermined server device or the moving image data released via the network N (S74). Note that the search processing for moving image data is performed using a known search program. Further, the control unit 10 searches for moving image data in which any word of music information is included in additional data such as a title, an explanation column, a tag, and a file name added to the moving image data.

  The control unit (corresponding information receiving unit) 10 of the mobile terminal 1 receives the information of the searched moving image data (corresponding information associated with the moving image data) from the search destination device, and as shown in FIG. A search result screen showing the result of the search process is displayed on the touch panel 13 (S75). In the search result screen shown in FIG. 13B, thumbnail images and data names (file names) of three moving image data are displayed as search results. Note that the information displayed on the search result screen is not limited to these, and any information that can identify each moving image data (corresponding information associated with the moving image data) may be used. The search result screen shown in FIG. 13B is configured so that moving image data to be used for the background video of karaoke can be designated from each moving image data of the search result. The search result screen may be configured so that each moving image data of the search result can be preview-displayed so that the user can confirm it before designating it as the background video. When the control unit (accepting unit) 10 of the mobile terminal 1 receives specification (selection) of moving image data used for the background image via the search result screen (S76), the data information of the specified moving image data, that is, Information necessary for receiving the designated moving image data via the network N (data information relating to the moving image data) is acquired (S77). And the control part 10 complete | finishes the above-mentioned search process.

  If the user has made a karaoke reservation via the reservation reception screen, the control unit 10 of the mobile terminal 1 returns the display screen of the touch panel 13 to the reservation reception screen, and the data information acquired in step S77 is used as the background video. Accepted as data information of video data used for If the user has specified moving image data to be used for the background video via the background reception screen, the control unit 10 of the mobile terminal 1 returns the display screen of the touch panel 13 to the background reception screen, and is acquired in step S77. The received data information is received as data information of moving image data used for the background video. In addition, after acquiring the data information of the designated moving image data, the control unit 10 of the mobile terminal 1 performs, for example, the process of step S4 in FIG. 5 and the process after step S42 in FIG.

  When it is determined in step S73 that execution of automatic search is not selected (S73: NO), specifically, when “manual search” is selected, the control unit 10 of the portable terminal 1 passes through the touch panel 13. Processing according to the user's operation is performed, and designation of moving image data to be used for the background video is accepted (S76). And the control part 10 of the portable terminal 1 acquires the data information of the designated moving image data (S77), and complete | finishes a process.

  In the process shown in FIG. 12, the user designates moving image data to be used for the background video from the search results. In addition to this, the mobile terminal 1 may further include a configuration for selecting moving image data optimal for the background image of karaoke from the search result. For example, the control unit 10 of the mobile terminal 1 identifies the moving image data whose display time of the moving image is closest to the audio output time of the music selected by the user from among the moving image data of the search result, and uses it for the background image. You may select as animation data. In addition, the control unit 10 of the mobile terminal 1 identifies the video data in which the music information of the music selected by the user is most contained in the data added to the video data among the video data of the search results, and the background You may select as animation data used for a picture.

  In the karaoke system of the present embodiment, various kinds of moving image data that can be received by the karaoke apparatus 2 via the network N can be used for the background video of karaoke. Therefore, not only the moving image data stored in advance in a predetermined server device but also various moving image data disclosed via the network N can be used for the background image of karaoke. Further, the moving image based on the moving image data received by the karaoke device 2 can be displayed on the monitor device 6 not only in the background image of the lyrics of the karaoke but also when the audio output (karaoke performance) is not performed. At this time, by outputting sound based on the sound data transmitted together with the moving image data through the speaker 7, for example, during the break of karaoke, arbitrary moving image data (content data) is viewed on the monitor device 6 and the speaker 7. be able to.

In the karaoke system of the present embodiment, the mobile terminal 1 transmits the data information of the moving image data designated as the karaoke background image to the karaoke device 2, and the karaoke device 2 transmits the moving image data based on the data information via the network N. It is the structure which receives by. Therefore, an increase in communication load between the mobile terminal 1 and the karaoke apparatus 2 is suppressed.
Moreover, in the karaoke system of this embodiment, the function of the access point used for radio | wireless communication is provided in the relay apparatus 5, and the portable terminal 1 transmits the data information of moving image data to the karaoke apparatus 2 via the relay apparatus 5. It is. In addition to this, the function of the access point may be provided in the karaoke device 2, and the mobile terminal 1 may directly transmit the data information to the karaoke device 2. Alternatively, a predetermined server device may be prepared in advance in the network N, and the mobile terminal 1 may transmit data information to the karaoke device 2 via the server device on the network N. Further, the monitor device 6, the speaker 7, and the microphone 8 may be directly connected to the karaoke device 2.

  In the karaoke system of the present embodiment, the karaoke device 2 has a configuration in which the video display based on the video data ends when the audio output ends, or the karaoke device 2 outputs the audio output based on the next reserved music data. The video display was continued until the start. In addition to this, the karaoke device 2 temporarily stops displaying the video when the audio output is finished, and when the audio output of the same music is performed again, or when the audio output of the music reserved by the same user is performed, Alternatively, the configuration may be such that, when audio output is performed for a song whose genre is the same as or similar to the song for which audio output has been completed, the moving image display is resumed from the point where it was stopped.

  In the karaoke system of the present embodiment, the karaoke apparatus 2 may be configured to store each combination of the music ID and the background video information once stored in the reserved music table 22a in a predetermined table in the storage unit 22. With such a configuration, it is not necessary to specify moving image data to be used for the background video when the same music is reserved or audio is output next time.

  In the karaoke system of the present embodiment, the karaoke device 2 may be realized by installing a predetermined karaoke program in a personal computer, a game machine, a television device or the like in addition to the device installed in the karaoke store. .

  It should be thought that embodiment disclosed this time is an illustration and restrictive at no points. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 Mobile terminal (communication device)
2 Karaoke device 4 Server device 6 Monitor device (display unit)
10 Control unit (corresponding information receiving unit, receiving unit)
12 memory | storage part 15 2nd communication part (transmission part)
20 control unit (display control unit, volume control unit, audio output unit)
23 First communication unit (acquisition unit)
24 Second communication unit (receiving unit)

Claims (12)

In a karaoke device that performs audio output based on music data,
A receiving unit that receives data information about the video data from an external device;
An acquisition unit for acquiring the moving image data based on the data information received by the reception unit;
A karaoke apparatus comprising: a display control unit configured to display a moving image based on the moving image data acquired by the acquiring unit on a display unit according to an execution status of audio output based on the music data. The karaoke according to claim 1, wherein the display control unit is configured to display a moving image based on the moving image data acquired by the acquiring unit when audio output based on the music data is being executed. apparatus. The acquisition unit is configured to acquire the moving image data and audio data associated with the moving image data;
A volume control unit that controls the volume of audio based on the audio data acquired by the acquisition unit according to the execution status of audio output based on the music data;
The karaoke apparatus according to claim 1, further comprising: an audio output unit that outputs an audio based on the music data and an audio output based on the music data. The acquisition unit is configured to acquire the moving image data and audio data associated with the moving image data;
Among the audio data acquired by the acquisition unit, an audio specifying unit that specifies partial audio data corresponding to the music data;
Among the moving image data acquired by the acquisition unit, a moving image specifying unit that specifies partial moving image data corresponding to the partial sound data specified by the sound specifying unit, and
The karaoke apparatus according to any one of claims 1 to 3, wherein the display control unit displays a moving image based on the partial moving image data specified by the moving image specifying unit. The receiving unit is configured to receive device information indicating a providing device that provides the moving image data;
The acquisition unit is configured to acquire the moving image data from a providing device indicated by the device information based on the device information received by the receiving unit. Karaoke apparatus as described in 1. The receiving unit is configured to receive search information for searching the moving image data;
The acquisition unit is configured to perform a search process based on the search information received by the reception unit, and to acquire moving image data according to the search information. Karaoke apparatus as described in 1. When the audio output based on the music data ends during the display of the video based on the video data, the display control unit ends the display of the video based on the video data, and the audio output based on the music data ends. The display of the moving image based on the same or different moving image data is started when the display of the moving image based on the moving image data is finished before. Karaoke equipment. A comparison unit that compares the audio output time based on the music data and the video display time based on the video data;
When the comparison unit determines that the moving image display time is longer than the audio output time, the display control unit displays a moving image based on the moving image data so that the moving image display time is shortened. The karaoke device according to claim 1, wherein the karaoke device is provided. When the audio output based on the music data is not being executed, or when the remaining audio output time in the audio output being executed is less than a predetermined time, the display control unit performs the audio output based on the next music data. Correspondingly, a moving image based on the moving image data acquired by the acquisition unit is displayed. The karaoke apparatus according to any one of claims 1 to 8, wherein the moving image is displayed. To a computer that outputs audio based on song data,
A receiving step of receiving data information about the video data from an external device;
An acquisition step of acquiring the video data based on the data information received in the reception step;
A program for causing a display unit to display a moving image based on the moving image data acquired in the acquiring step according to an execution status of audio output based on the music data. A karaoke device that performs audio output based on music data;
A karaoke system comprising a communication device capable of communicating with the karaoke device,
The communication device includes a transmission unit that transmits data information about moving image data to the karaoke device,
The karaoke device
A receiver for receiving data information transmitted by the transmitter;
An acquisition unit for acquiring the moving image data based on the data information received by the reception unit;
A karaoke system comprising: a display control unit configured to display a moving image based on the moving image data acquired by the acquiring unit on a display unit according to an execution status of audio output based on the music data. The communication device
A correspondence information receiving unit that receives correspondence information associated with video data from an external device;
A reception unit that receives a selection for the correspondence information received by the correspondence information reception unit;
The karaoke system according to claim 11, wherein the transmission unit is configured to transmit data information related to moving image data corresponding to the correspondence information received by the reception unit to the karaoke apparatus.

Images