JP2015191035A - Program, karaoke device, and karaoke system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program, a karaoke device, and a karaoke system which can display an arbitrary moving image as a background video without preparing moving image data that a user hopes to use as a background video in advance.SOLUTION: A karaoke device 2 transmits a synchronization signal to a portable terminal 1 when performing audio output based on music data. The portable terminal 1 transmits moving image data designated by a user to the karaoke device 2 on the basis of the received synchronization signal. The karaoke device 2 starts the audio output based on the music data and starts transmitting the received moving image data to a monitoring device 6. Thus, the audio output by the karaoke device 2 and the moving image display by the monitoring device 6 are synchronously performed.

Description

  The present invention relates to a program executed by a computer that communicates with a karaoke device that performs audio output based on music data, the karaoke device, and a karaoke system including the karaoke device.

  Patent Document 1 discloses a karaoke performance terminal capable of displaying an external input image as a background video as well as a background video preset for each music piece. Specifically, the karaoke performance terminal is provided with a connection terminal of an external storage device, and the karaoke performance terminal captures image data stored in the external storage device connected to the connection terminal, and a background video during music performance Used for.

JP 2009-8777 A

  In the technique disclosed in Patent Document 1, it is necessary for the user to prepare image data to be used as a background video in advance and store it in an external storage device, which is a burden on the user.

  The present invention has been made in view of such problems. An object of the invention is to provide a program, a karaoke apparatus, and a karaoke system that can display an arbitrary moving image without preparing moving image data to be used as a background image in advance.

  A program according to the present invention is a program for causing a computer to communicate with a karaoke device that performs audio output based on music data, wherein the computer receives a moving image data from an external device, and the karaoke device. The acquisition step of acquiring the status information indicating the execution status of the audio output by the step, and the transmission step of transmitting the video data received in the reception step to the karaoke device according to the execution status indicated by the status information acquired in the acquisition step Are executed.

  The program according to the present invention causes the computer to further execute an information receiving step for receiving data information related to moving image data from an external device, and a receiving step for receiving a selection for the data information received in the information receiving step. In the step, the computer is caused to receive moving image data corresponding to the data information accepted in the accepting step from the external device.

  The program according to the present invention is such that, in the transmission step, when the execution status indicated by the status information acquired in the acquisition step is being executed in audio output, the moving image data received in the reception step is stored in the computer. It is transmitted to a karaoke device.

  In the receiving step, the program causes the computer to receive the moving image data and the audio data associated with the moving image data, and causes the computer to receive the audio data received in the receiving step. A processing step of performing a process of controlling the volume of the sound based on the audio data is further executed, and in the transmission step, the computer performs the processing in the moving image data received in the reception step and the processing step. The voice data is transmitted to the karaoke apparatus.

  In the reception step, the program causes the computer to receive the moving image data and the audio data associated with the moving image data, and causes the computer to receive the audio data received in the receiving step. The step of specifying the partial audio data corresponding to the music data, and the step of specifying the partial video data corresponding to the specified partial audio data among the video data received in the receiving step, In the transmission step, the computer is caused to transmit the specified partial moving image data to the karaoke apparatus.

  The program according to the present invention causes the computer to execute a step of acquiring a synchronization signal for synchronizing output processing from the karaoke device, and in the transmission step, based on the acquired synchronization signal, The transmission of the moving image data received in the receiving step to the karaoke apparatus is started.

  The program according to the present invention obtains an end signal indicating the end of audio output based on the music data from the karaoke device to the computer, and acquires the end signal during transmission of the moving image data to the karaoke device. In this case, the step of ending the transmission of the moving image data to the karaoke device and the karaoke of the same or different moving image data when the transmission of the moving image data to the karaoke device is completed before obtaining the end signal. And a step of starting transmission to the apparatus.

  The program according to the present invention includes the step of acquiring, in the computer, an audio output time based on the music data by the karaoke device, a step of comparing the acquired audio output time and a moving image display time based on the moving image data, If it is determined that the video display time is longer than the audio output time, the video data is further processed so that the video display time based on the video data is shortened. A computer is caused to transmit the processed moving image data to the karaoke apparatus.

  In the program according to the present invention, in the transmission step, when the execution status indicated by the status information acquired in the acquisition step is not being executed in the audio output based on the music data, or in the audio output being executed in the computer When the remaining audio output time is less than a predetermined time, the video data received in the receiving step is transmitted to the karaoke device in response to execution of audio output based on the next music data by the karaoke device. Features.

  The karaoke device according to the present invention is a karaoke device that performs audio output based on music data, a receiving unit that receives moving image data and audio data associated with the moving image data from an external device, and the receiving unit receives A volume control unit that controls the volume of the sound based on the audio data, a sound output unit that outputs the sound whose volume is controlled by the volume control unit and an audio output based on the music data, and a video received by the receiving unit And a display control unit that displays a moving image based on the data on the display unit.

  The program according to the present invention includes a reception step of receiving moving image data and audio data associated with the moving image data from an external device to a computer that outputs audio based on the music data, and the audio received in the receiving step A volume control step for controlling the volume of sound based on the data; a step of outputting the sound whose volume is controlled in the volume control step; and an audio output based on the music data; and based on the moving image data received in the reception step And a step of displaying a moving image on a display unit.

  A karaoke system according to the present invention is a karaoke system including a karaoke device that performs audio output based on music data and a communication device that can communicate with the karaoke device, wherein the communication device receives video data from an external device. A receiving unit for receiving, an acquiring unit for acquiring status information indicating an execution status of audio output by the karaoke device, and moving image data received by the receiving unit according to an execution status indicated by the status information acquired by the acquiring unit Transmitting to the karaoke device, the karaoke device outputs an output unit that outputs status information indicating the execution status of the audio output, and a receiving unit that receives the video data transmitted by the transmitter And a display control unit that causes the display unit to display a moving image based on the moving image data received by the receiving unit.

  According to the present invention, a computer that can communicate with a karaoke device that performs audio output based on music data acquires status information indicating an execution status of audio output by the karaoke device. The computer transmits the moving image data received from the external device to the karaoke device according to the execution status of the audio output by the karaoke device. The karaoke device receives the moving image data transmitted by the communication device and causes the display unit to display a moving image based on the received moving image data. Therefore, the moving image based on the moving image data received by the computer from the external device can be displayed on the karaoke device, the arbitrary moving image can be displayed on the karaoke device, and the options of the moving image displayed on the karaoke device are expanded. In addition, it is possible to switch whether or not an arbitrary moving image is displayed depending on the execution status of audio output by the karaoke apparatus.

  According to the present invention, the computer receives data information regarding moving image data from an external device, and accepts a selection for the received data information. Then, the computer receives moving image data corresponding to the selected data information from the external device. Therefore, the user can select the moving image data based on the data information such as the thumbnail image, data name, and file name of the moving image data, and the arbitrary moving image can be displayed by the karaoke apparatus.

  According to the present invention, when the karaoke device is executing audio output, the computer transmits the moving image data to the karaoke device. Therefore, the moving image data transmitted from the computer is used for the background image in the audio output performed by the karaoke apparatus.

  According to the present invention, the computer receives not only the moving image data but also the audio data associated with the moving image data from the external device and transmits it to the karaoke device. In addition, the computer performs a process for controlling the volume of the sound based on the received sound data, and transmits the processed sound data together with the moving image data to the karaoke apparatus. Therefore, the karaoke apparatus displays a moving image based on the moving image data received from the computer on the display unit, and outputs a sound whose volume is controlled by the computer and an audio output based on the music data. For example, when the karaoke apparatus is executing audio output based on music data, the computer performs processing for reducing the sound volume based on the sound data, and when audio output is not being performed, the sound volume based on the sound data is performed. Is performed (or the process of controlling the volume is not performed). Thereby, in the karaoke apparatus, the audio output based on the music data is not disturbed by the sound based on the sound data transmitted from the computer.

  According to the present invention, the computer specifies partial audio data corresponding to music data among audio data associated with video data, and specifies partial video data corresponding to partial audio data from the video data. Then, the computer transmits the specified partial moving image data to the karaoke apparatus. Therefore, the computer can transmit only moving image data (partial moving image data) that needs to be reproduced (displayed) on the karaoke device to the karaoke device, avoiding unnecessary data from being transmitted to the karaoke device, and reducing the communication load. Is done.

  According to the present invention, when performing audio output based on music data, the karaoke apparatus outputs a synchronization signal for synchronizing output processing to the computer. The computer starts transmission of the moving image data to the karaoke apparatus based on the acquired synchronization signal. Therefore, since the moving image data is transmitted from the computer to the karaoke device in synchronization with the audio output based on the music data by the karaoke device, the moving image display based on the moving image data by the karaoke device can be performed in synchronization with the audio output. Become.

  According to the present invention, the karaoke apparatus transmits an end signal indicating the end of audio output based on the music data to the computer. When the computer receives the end signal while transmitting the moving image data to the karaoke device, the computer ends the transmission of the moving image data to the karaoke device. In addition, when the computer ends the transmission of the moving image data before receiving the end signal, the computer starts transmitting the same or different moving image data to the karaoke apparatus. Therefore, while audio output is performed by the karaoke device, the computer can transmit moving image data to the karaoke device, and the karaoke device can display moving images based on the received moving image data. Become.

  According to the present invention, the computer compares the audio output time of the karaoke device with the moving image display time based on the moving image data transmitted to the karaoke device. When the moving image display time is longer than the audio output time, the computer processes the moving image data so as to shorten the moving image display time, and then transmits it to the karaoke apparatus. As a result, the audio output time by the karaoke device and the moving image display time based on the moving image data by the karaoke device can be made comparable. That is, it is possible to match the end timing of audio output with the end timing of moving image display based on moving image data.

  According to the present invention, when the karaoke device is not executing audio output based on music data, or when the remaining audio output time in the audio output being executed is less than a predetermined time, the computer can store video data to the karaoke device. Is not sent. And when a karaoke apparatus performs the audio output based on the following music data, a computer transmits the moving image data to a karaoke apparatus. Therefore, when the karaoke apparatus is not outputting audio, or when the remaining output time of the music of the audio output is less than the predetermined time, transmission of new moving image data from the computer to the karaoke apparatus is not performed.

  According to the present invention, the karaoke apparatus receives moving image data and audio data associated with the moving image data. The karaoke apparatus controls the sound volume based on the received sound data. The karaoke apparatus performs output of the controlled sound and audio output based on the music data, and displays a moving image based on the received moving image data on the display unit. For example, the karaoke device controls the sound volume based on the sound data to be small when the audio output based on the music data is being executed, and controls the sound volume based on the sound data to be large when the audio output is not being executed. (Or output at the same volume). Thereby, in the karaoke device, the audio output based on the music data is not disturbed by the sound based on the sound data received from the external device.

  In the present invention, the user does not need to prepare moving image data to be used as a background image in advance, and an arbitrary moving image can be used as a background image of karaoke.

It is a schematic diagram which shows the structural example of the karaoke system which concerns on this embodiment. It is a block diagram which shows the internal structural example of a karaoke apparatus and an input device. It is a schematic diagram which shows the structural example of a reservation music table. It is a block diagram which shows the internal structural example of a portable terminal. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the karaoke process which a karaoke apparatus performs. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the process which a portable terminal performs. It is a flowchart which shows the procedure of the search process of the moving image data by a portable terminal. It is a schematic diagram which shows the example of a display screen of a portable terminal.

Below, the program concerning the present invention, a karaoke device, and a karaoke system are explained in full detail based on a drawing which shows a karaoke system which is the embodiment.
FIG. 1 is a schematic diagram illustrating a configuration example of a karaoke system according to the present embodiment. The karaoke system of this embodiment includes a karaoke device 2 installed in a karaoke store, a server device 4 managed by a karaoke distribution company, a mobile terminal 1 of a user who uses the karaoke store, and the like.

  The karaoke device 2 and the server device 4 can be connected to a network N such as the Internet, and the server device 4 sends music data related to the music used for karaoke via the network N in response to a request from the karaoke device 2. Provided to the karaoke device 2. Specifically, the server device 4 stores a large amount of music data that can be provided (distributed) to the karaoke device 2 and manages each music data with a music ID attached thereto. The karaoke device 2 designates a song ID when requesting the song data from the server device 4, and the server device 4 provides the karaoke device 2 with the song data of the requested song ID. The music data is, for example, MIDI (Musical Instrument Digital Interface) data, and accompaniment information of all musical instruments used in the music, tempo, tone, strength (velocity), chord constituent sound, lyrics, Includes timing information.

The mobile terminal 1 is a communication device (computer) such as a smartphone, a mobile phone, or a tablet terminal, and can be connected to the network N.
In addition to the karaoke device 2, the karaoke store is provided with an input device 3 that performs input to the karaoke device 2, a monitor device 6, a speaker 7, a microphone 8, and the like. In the present embodiment, the input device 3 performs wireless communication with the karaoke device 2, and the monitor device 6, the speaker 7, and the microphone 8 are each connected to the karaoke device 2 via the relay device 5. The relay device 5 has the function of an access point used for wireless communication so that the mobile terminal 1 can perform wireless communication with the relay device 5 and communicate with the karaoke device 2 via the relay device 5. It is configured. The input device 3 may be configured to communicate with the karaoke device 2 via the relay device 5 in the same manner as the portable terminal 1 in addition to the configuration of performing wireless communication directly with the karaoke device 2. Moreover, although this embodiment demonstrates the structure provided with each apparatus which comprises a karaoke system 1 each, you may provide multiple each apparatus.

FIG. 2 is a block diagram illustrating an internal configuration example of the karaoke device 2 and the input device 3. The karaoke apparatus 2 includes a control unit 20, a RAM (Random Access Memory) 21, a storage unit 22, a first communication unit 23, a second communication unit 24, a third communication unit 25, and the like. These units are connected to each other via a bus.
The control unit 20 is a CPU (Central Processing Unit), an MPU (Micro Processor Unit), or the like, and controls operations of the above-described hardware units connected through a bus. In addition, the control unit 20 executes a predetermined operation by reading a control program stored in advance in the storage unit 22 into the RAM 21 and sequentially executing the program.

The RAM 21 is an SRAM (Static RAM), a DRAM (Dynamic RAM), a flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 20.
The storage unit 22 is an HDD (Hard Disk Drive), a flash memory, or the like, and stores a control program executed by the control unit 20 and various data in advance. The storage unit 22 stores a reserved music table 22a. Further, the storage unit 22 also stores music data (MIDI data) downloaded from the server device 4.

  FIG. 3 is a schematic diagram showing a configuration example of the reserved music table 22a. The reserved song table 22a stores information on songs reserved for karaoke via the input device 3 or the portable terminal 1 in the order of reservation. The reserved music table 22a stores a music ID, reservation information, presence / absence of background change, and the like associated with each reserved music. In the music ID column, music identification information for identifying music is stored. The music identification information is information that can specify the music data stored in the storage unit 22. In the reservation information column, user identification information for identifying a reserved user (reservation person) is stored. The user identification information includes information required when the karaoke device 2 communicates with each user's mobile terminal 1 via the relay device 5 (hereinafter also referred to as terminal information). In the “Background change presence / absence” column, information indicating whether or not display of an arbitrary background video is instructed during performance of the music is stored, “Yes” is stored when instructed, and when not instructed “None” is stored. In addition, for music for which display of an arbitrary background video is not instructed, a default background video preset for the music is displayed.

The contents stored in the reserved music table 22a are updated by the control unit 20 each time a new music is reserved. Note that an instruction whether or not to display an arbitrary background video can be given not only when making a karaoke reservation, but also for a song that has already been reserved. Accordingly, the stored content in the column for whether or not the background is changed is updated by the control unit 20 every time display of an arbitrary background video is instructed or whenever display of a default background video is instructed.
The reserved music table 22a is, for example, a first-in first-out table (queue), and is added to the tail when the information of the reserved music is registered, and is read from the head when the information is read.

The first communication unit 23 is an interface for connecting to the network N, and communicates with the server device 4 via the network N, for example.
The second communication unit 24 is an interface for connecting to the relay device 5 and performs communication with the relay device 5 connected via a predetermined signal line. The second communication unit 24 outputs screen information to the monitor device 6 and outputs audio information to the speaker 7 via the relay device 5 in accordance with an instruction from the control unit 20. Further, the second communication unit 24 acquires the voice information collected by the microphone 8 via the relay device 5. Further, the second communication unit 24 communicates with the mobile terminal 1 via the relay device 5.

The third communication unit 25 is a wireless local area network (LAN) module, an infrared communication module, a Bluetooth (registered trademark) module, or the like, and performs wireless communication with the input device 3.
The first communication unit 23 may be configured to connect to the network N by wireless communication, the second communication unit 24 may be configured to perform wireless communication with the relay device 5, and the third communication unit 25 may A configuration in which wired communication with the input device 3 via a predetermined signal line may be performed.

The input device 3 includes a control unit 30, a RAM 31, a storage unit 32, a communication unit 33, a touch panel 34, and the like. These units are connected to each other via a bus.
The control unit 30 is a CPU, an MPU, or the like, and controls operations of the above-described hardware units connected via a bus. The control unit 30 executes a predetermined operation by reading out a control program stored in advance in the storage unit 32 to the RAM 31 and sequentially executing the program.

The RAM 31 is an SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 30.
The storage unit 32 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 30 and various data.

  The communication unit 33 is a communication unit similar to the third communication unit 25 of the karaoke device 2, and performs wireless communication with the karaoke device 2. In addition, when the 3rd communication part 25 of the karaoke apparatus 2 is a structure which performs a wired communication via a predetermined signal line, the communication part 33 also performs the wired communication via a predetermined signal line between the karaoke apparatuses 2. Configured to do.

The touch panel 34 includes an operation unit 34a and a display unit 34b.
The operation unit 34 a has various operation keys necessary for the user to operate the input device 3 and the karaoke device 2, receives information corresponding to the operation key operated by the user, and receives the received information to the control unit 30. Send it out. The control unit 30 executes various processes according to information acquired from the operation unit 34a.
The display unit 34 b is a liquid crystal display, a plasma display, an organic EL (Electro Luminescence) display, or the like, and displays various information according to instructions from the control unit 30.

FIG. 4 is a block diagram illustrating an internal configuration example of the mobile terminal 1. The mobile terminal 1 includes a control unit 10, a RAM 11, a storage unit 12, a touch panel 13, a first communication unit 14, a second communication unit 15, and the like. These units are connected to each other via a bus.
The control unit 10 is a CPU, an MPU, or the like, and controls the operation of each hardware unit connected via a bus. In addition, the control unit 10 executes a predetermined operation by reading a control program stored in advance in the storage unit 12 into the RAM 11 and sequentially executing the program.

The RAM 11 is SRAM, DRAM, flash memory, or the like, and temporarily stores data generated when various control programs are executed by the control unit 10.
The storage unit 12 is an HDD or a flash memory, and stores in advance a control program executed by the control unit 10 and various data. For example, the storage unit 12 stores a browser for browsing various data disclosed via the network N, a search program for searching for desired data from the various data, and the like. Moreover, the memory | storage part 12 has memorize | stored the karaoke application (henceforth a karaoke application) 12a which is a program based on this invention. The processing performed by the control unit 10 by executing the karaoke application 12a will be described later. The karaoke application 12 a is downloaded from a predetermined web server via the network N and stored in the storage unit 12.

The touch panel 13 includes an operation unit 13a and a display unit 13b.
The operation unit 13 a has various operation keys necessary for the user to operate the mobile terminal 1, receives information corresponding to the operation key operated by the user, and sends the received information to the control unit 10.
The display unit 13 b is a liquid crystal display, a plasma display, an organic EL display, or the like, and displays various types of information according to instructions from the control unit 10.

The first communication unit 14 is an interface for connecting to the network N by wireless communication, and can communicate with various server apparatuses that disclose various data via the network N. The second communication unit 15 is a wireless LAN module, an infrared communication module, a Bluetooth module, or the like, and performs wireless communication with the relay device 5.
The first communication unit 14 and the second communication unit 15 may be configured to perform wired communication through a predetermined signal line.

  In the karaoke system of this embodiment, when the karaoke apparatus 2 performs audio output based on the music data with the speaker 7, the lyrics included in the music data are displayed on the monitor device 6. Further, the karaoke apparatus 2 is configured to be able to display a moving picture based on moving picture data prepared in advance or moving picture data designated by a user as a background image of lyrics displayed on the monitor device 6.

  Below, the process which each apparatus which has the structure mentioned above performs in the karaoke system of this embodiment is demonstrated based on a flowchart. First, processing performed by the mobile terminal 1 when the user makes a karaoke reservation using the mobile terminal 1 will be described. The karaoke reservation is to register a song (music) that the user wants to sing in the karaoke apparatus 2.

  5 and 6 are flowcharts showing a procedure of processing performed by the mobile terminal 1. The control unit 10 of the portable terminal 1 displays a karaoke reservation reception screen (hereinafter referred to as a reservation reception screen) on the touch panel 13 by executing the karaoke application 12a stored in the storage unit 12 (S1). . The mobile terminal 1 may be configured to access a predetermined server device (for example, the server device 4) and acquire a reservation acceptance screen from the predetermined server device. The user who enters the karaoke store (enters the room) operates the touch panel 13 and selects a music piece to be reserved via the reservation reception screen. The control part 10 of the portable terminal 1 receives the music selected by the user via the touch panel 13 (S2).

In addition, when the user wants to display an arbitrary background video during the performance of the selected music piece, the user specifies moving image data to be used for the background video on the reservation reception screen. Note that the moving image data used for the background image may be moving image data stored in the storage unit 12 of the mobile terminal 1, moving image data published via the network N, or the like. Also, audio data may be associated with these moving image data.
The control unit 10 of the mobile terminal 1 determines whether or not moving image data to be used for the background video is specified via the touch panel 13 (S3). If it is determined that it is not specified (S3: NO), the control unit 10 uses the second reservation information including the music ID of the music received in step S2 and the identification information (reserver information) of the mobile terminal 1. It transmits to the karaoke apparatus 2 from the communication part 15 via the relay apparatus 5 (S4). The control unit 10 ends the process.

Note that the identification information of the mobile terminal 1 includes terminal information used when the karaoke apparatus 2 communicates with the mobile terminal 1. When the mobile terminal 1 is configured to make a karaoke reservation via a predetermined server device (for example, the server device 4), user information registered in advance in the server device may be used as identification information for the mobile terminal 1.
When it is determined that the moving image data to be used for the background video is designated (S3: YES), the control unit 10 of the mobile terminal 1 and the music ID of the music received in step S2 and the identification information (reserver information) of the mobile terminal 1 ) And information indicating that the background video is designated is transmitted from the second communication unit 15 to the karaoke apparatus 2 via the relay apparatus 5 (S5).

Next, the control unit 10 of the mobile terminal 1 determines whether or not the moving image data designated as the background video is promotion video data (hereinafter referred to as PV data) of the music selected by the user (S6).
The additional data such as the title, description column, or tag added to the PV data may include a word indicating that the data is PV data such as a promotion video, promotion, promotion, music video, MV, etc. Many. Therefore, the control unit 10 determines whether or not the above-described wording is included in the additional data of the designated moving image data, and if it is included, determines that the data is PV data. In addition, a music title, a singer name, and the like are added to the PV data. Therefore, the control unit 10 determines whether or not the song name and singer name of the song received in step S2 match the song name and singer name added to the moving image data (PV data) specified in the background video. Judging. When it is determined that they match, the control unit 10 determines that the moving image data designated as the background video is the PV data of the music selected by the user.

  When the specified moving image data is moving image data released via the network N, the control unit 10 receives only the additional data of the specified moving image data, and based on the received additional data, It is determined whether or not the specified moving image data is PV data of the music selected by the user. In addition, the wording used to determine whether the data is PV data is not limited to the wording described above. Moreover, the determination method of whether the designated moving image data is the PV data of the music selected by the user is not limited to the method described above.

  When it is determined that the designated moving image data is the PV data of the music selected by the user (S6: YES), the control unit 10 of the mobile terminal 1 is included in the PV data (moving image data designated as the background image). The singing start position in the music (PV data) is specified based on the audio data (audio data associated with the moving image data) (S7). For example, the control unit 10 performs frequency conversion on voice data, determines a position where a frequency component (frequency waveform) of a human voice first appears, and specifies this position as a singing start position. In addition, the information which shows a singing start position may be previously added to PV data (video data), and in the case of such PV data, the control part 10 starts singing based on the information added to PV data. The position can be specified.

Further, in the case of PV data published via the network N, the control unit 10 sequentially receives the PV data from the top, specifies the singing start position based on the audio data included in the received PV data, and sings When the start position can be specified, the reception of PV data is stopped. That is, the control unit 10 receives only data necessary for specifying the singing start position.
Some PV data published via the network N has advertisement data added to the head. In the case of such PV data, the control unit 10 can specify the start position (song start position) of the PV data based on the difference in the characteristics of the audio data between the advertisement data and the PV data. Moreover, you may identify a song start position based on moving image data other than the structure which identifies a song start position based on the audio | voice data matched with moving image data. For example, in the case of PV data with advertisement data added to the head, the control unit 10 determines the start position (singing start position) of the PV data based on the difference in the characteristics of the moving image data between the advertisement data and the PV data. Can be identified.

  When the singing start position in the video data (PV data) is specified, the control unit 10 of the mobile terminal 1 determines whether or not the second communication unit 15 has received the synchronization signal transmitted from the karaoke device 2. (S8). The karaoke device 2 transmits (outputs) a synchronization signal for synchronizing the output timing of each song to the portable terminal 1 via the relay device 5 when performing audio output based on the stored contents of the reserved song table 22a. The synchronization signal includes the song ID read from the reserved song table 22 a and terminal information used when the karaoke apparatus 2 communicates with the mobile terminal 1. When the terminal information included in the received synchronization signal is information of its own mobile terminal 1, the control unit 10 of the mobile terminal 1 receives it as a synchronization signal addressed to its own mobile terminal 1, and receives its own mobile terminal 1. If it is not, the received synchronization signal is discarded. Moreover, the control part 10 of the portable terminal 1 grasps | ascertains the music output in the karaoke apparatus 2 next by music ID contained in a synchronizing signal.

  If it is determined that the synchronization signal from the karaoke apparatus 2 has not been received (S8: NO), the control unit 10 of the mobile terminal 1 waits until it is received. When it is determined that the synchronization signal has been received (S8: YES), the control unit 10 of the mobile terminal 1 uses the karaoke apparatus to display information (music data information) indicating the vocal sound start position in the music data of the music ID included in the synchronization signal. 2 (S9). The music data information may be transmitted from the karaoke device 2 together with the synchronization signal, or the mobile terminal 1 that has received the synchronization signal requests the karaoke device 2 after receiving the synchronization signal, and the karaoke device 2 The structure which receives from may be sufficient.

  Based on the received music data information and the singing start position specified in step S7, the control unit 10 of the mobile terminal 1 specifies the reproduction start position in the moving image data (PV data) designated as the background video (S10). ). For example, the control unit 10 calculates the time from the performance start position of the music data to the vocal sound start position based on the received music data information. And the control part 10 specifies the position before the calculated time to the reproduction | regeneration start position from the song start position specified by step S7 in moving image data (PV data). In addition, the control part 10 can specify the part (partial moving image data and partial audio | voice data) corresponding to music data among moving image data by specifying the reproduction | regeneration start position in moving image data.

  After specifying the reproduction start position of the moving image data, the control unit 10 of the mobile terminal 1 determines the moving image data (PV data) from the specified reproduction start position based on the synchronization signal transmitted to the karaoke apparatus 2. 2 is started (S11). The control unit 10 transmits not only the moving image data but also the audio data associated with the moving image data from the second communication unit (transmitting unit) 15 to the karaoke device 2 via the relay device 5. The control unit 10 may not only transmit the moving image data to the karaoke apparatus 2 but also transmit the moving image based on the moving image data to the karaoke apparatus 2 while displaying the moving image on the touch panel 13 of the own apparatus. Further, when the moving image data designated as the background image is PV data released via the network N, the control unit 10 uses the first communication unit (receiving unit) 14 to transmit the moving image data via the network N. (PV data) is received and transmitted (transferred) to the karaoke apparatus 2.

  If it is determined in step S6 that the moving image data designated as the background video is not PV data (S6: NO), the control unit 10 of the portable terminal 1 uses the second communication unit as a synchronization signal transmitted from the karaoke device 2. It is determined whether or not it is received at 15 (S12). When it is determined that the synchronization signal has not been received (S12: NO), the control unit 10 of the mobile terminal 1 stands by until it is received. When it is determined that the synchronization signal has been received (S12: YES), the control unit 10 of the mobile terminal 1 starts transmitting the moving image data designated as the background image to the karaoke apparatus 2 based on the received synchronization signal. (S11). Even when the moving image data designated as the background image is not PV data, the reproduction start position may be determined based on, for example, moving image data or audio data associated with the moving image data. In this case, the control unit 10 transmits the moving image data to the karaoke apparatus 2 from the determined reproduction start position. For example, in the case of moving image data with advertisement data added to the head, the control unit 10 may specify the end position of the advertisement data and determine this position as the reproduction start position.

  After starting transmission of the moving image data to the karaoke device 2, the control unit 10 of the mobile terminal 1 determines whether or not the second communication unit 15 has received an end signal transmitted from the karaoke device 2 ( S13). The karaoke device 2 transmits an end signal notifying the end of the performance to the portable terminal 1 via the relay device 5 every time the performance (audio output) of each music is ended. The end signal includes the song ID of the song that has been played and the terminal information used when the karaoke apparatus 2 communicates with the mobile terminal 1. When the terminal information included in the received end signal is information of its own mobile terminal 1, the control unit 10 of the mobile terminal 1 receives it as an end signal addressed to its own mobile terminal 1. If it is not information, the received end signal is discarded. Moreover, the control part 10 of the portable terminal 1 grasps | ascertains the music to which performance was complete | finished by music ID contained in an end signal.

When it is determined that the end signal from the karaoke apparatus 2 has been received (S13: YES), the control unit 10 of the mobile terminal 1 ends the transmission of the moving image data being executed (S14) and ends the process. That is, the control part 10 complete | finishes transmission of the moving image data transmitted to the karaoke apparatus 2 corresponding to the music of music ID contained in an end signal. Thereby, the transmission of the moving image data from the portable terminal 1 to the karaoke device 2 is completed together with the end of the audio output (music performance) by the karaoke device 2, and the display of the moving image by the karaoke device 2 (monitor device 6) is completed.
When determining that the end signal from the karaoke device 2 has not been received (S13: NO), the control unit 10 determines whether or not the transmission of the moving image data to the karaoke device 2 has ended (S15). If it is determined that the transmission of the moving image data has not ended (S15: NO), that is, if the audio output by the karaoke device 2 and the transmission of the moving image data from the portable terminal 1 to the karaoke device 2 have not ended, the control The unit 10 returns the process to step S13.

  If it is determined that the transmission of the moving image data has ended (S15: YES), that is, if the transmission of the moving image data from the portable terminal 1 to the karaoke device 2 has ended before the audio output by the karaoke device 2 ends, The control unit 10 of the terminal 1 returns the process to step S11 and starts transmission of the moving image data to the karaoke apparatus 2 again (S11). At this time, the control unit 10 of the mobile terminal 1 may be configured to transmit the same moving image data as the previously transmitted moving image data, or may be configured to newly transmit different moving image data. For example, when specifying moving image data to be used for a background image via a reservation reception screen, the user can specify whether the same moving image data is used (reproduced) only once or repeatedly (reproduced). It is good. In addition, when the moving image data to be used for the background image is specified via the reservation reception screen, the user may specify a plurality of moving image data and the use order (reproduction order) of each moving image data. Thereby, the control part 10 of the portable terminal 1 should finish transmission of moving image data according to a user's designation | designated, when transmission of the moving image data to the karaoke apparatus 2 is complete | finished before the audio output by the karaoke apparatus 2 is complete | finished. And whether to transmit the same or different moving image data can be switched.

  Moreover, when transmitting the same moving image data, the control part 10 may be the structure which transmits from the reproduction | regeneration start position determined by step S10, and transmits to the karaoke apparatus 2 after performing the reproduction | regeneration start position specific process newly. It may be configured. Moreover, when transmitting different moving image data, the control part 10 may be the structure which transmits to the karaoke apparatus 2 after performing the specific process of the reproduction start position with respect to this moving image data, or a karaoke apparatus without performing a specific process 2 may be used.

  5 and 6, when the moving image data specified as the background video is PV data, the mobile terminal 1 specifies the singing start position in the PV data, and the specified singing start position and the karaoke device 2. The reproduction start position in the PV data is specified based on the music data information received from In addition, a configuration in which the user manually designates the reproduction start position in the moving image data designated as the background video may be used. For example, on the reservation reception screen, the user can reproduce (moving image display and audio output) the moving image data designated as the background image on the portable terminal 1 and can execute the fast forward function and the rewind function. And it is good also as a structure which a user can specify via the reservation reception screen by specifying the reproduction | regeneration start position which should be reproduced | regenerated with the karaoke apparatus 2 based on the displayed moving image and the output audio | voice. In this case, the moving image display based on the specified moving image data can be performed from an arbitrary reproduction start position. In this case, if the specified moving image data is data stored in the storage unit 12 of the mobile terminal 1, information indicating the reproduction start position specified by the user is associated with the moving image data in the storage unit 12. You may remember it. Thereby, when the same moving image data is used for the background image of karaoke next time, it is not necessary to designate the reproduction start position again. Further, the information on the reproduction start position of each moving image data stored in the storage unit 12 of the mobile terminal 1 as described above may be shared among a plurality of mobile terminals 1. For example, the mobile terminal 1 requests a plurality of other mobile terminals for information on the reproduction start position of certain moving image data, and the mobile terminal having the requested information is requested from among other mobile terminals. It is good also as a structure which transmits the information of a reproduction | regeneration start position to the portable terminal 1.

Next, processing performed by the karaoke apparatus 2 when the user makes a karaoke reservation using the mobile terminal 1 will be described. FIG. 7 is a flowchart showing a procedure of processing performed by the karaoke apparatus 2.
The control unit 20 of the karaoke device 2 determines whether or not the reservation information transmitted by the portable terminal 1 in step S4 or S5 in FIG. 5 is received by the second communication unit 24 via the relay device 5. (S21). If it is determined that it has not been received (S21: NO), the control unit 20 waits until reception. If it is determined that it has been received (S21: YES), the control unit 20 of the karaoke apparatus 2 registers the contents of the received reservation information in the reserved song table 22a (S22). Specifically, the control unit 20 stores the music ID and the identification information of the mobile terminal 1 included in the reservation information in the music ID column and the reservation information column of the reserved music table 22a, respectively. Further, the control unit 20 stores “present” in the column of whether or not the background is changed in the reserved music table 22a when the reservation information includes information indicating that the background video is specified, and changes the background when the information is not included. “None” is stored in the presence / absence column.

Based on the song ID stored in the reserved song table 22a, the control unit 20 of the karaoke device 2 requests the song data of this song ID from the server device 4 and acquires (downloads) it from the server device 4 via the network N. (S23). The control unit 20 stores the acquired music data in the storage unit 22 and ends the process.
Once the music data is downloaded from the server device 4 to the karaoke device 2, it is stored in the storage unit 22 of the karaoke device 2. Therefore, in the process shown in FIG. 7, the control unit 20 of the karaoke device 2 checks whether or not the music data is already stored in the storage unit 22 when requesting the music data from the server device 4. You may request | require from the server apparatus 4 only in the case.

  Next, karaoke processing performed by the karaoke device 2 based on the reserved song table 22a after the karaoke reservation is performed as described above and the reservation information is stored in the reserved song table 22a of the karaoke device 2 will be described. The karaoke process performed by the karaoke apparatus 2 is a process necessary for performing karaoke. For example, the karaoke apparatus 2 performs audio output (voice output, music performance) to the speaker 7 based on music data, based on music data. There is a process of displaying lyrics on the monitor device 6. The karaoke device 2 also performs a process of scoring the user's singing voice input via the microphone 8 based on the music data downloaded from the server device 4, a process of displaying the scoring result on the monitor device 6, and the like.

  FIG. 8 is a flowchart showing a procedure of karaoke processing performed by the karaoke apparatus 2. When starting the karaoke process, the control unit 20 of the karaoke apparatus 2 reads information on the music stored at the head of the reserved music table 22a (S31). Based on the read information, the control unit 20 determines whether or not the user has designated any video data as a background video for this music (S32). Specifically, the control unit 20 determines whether or not the information indicating the presence or absence of the background change is “Yes” in the read information, and if it is “Yes”, the background video is designated. Judge.

  When it is determined that the background video is designated (S32: YES), the control unit 20 of the karaoke device 2 sends a synchronization signal for synchronizing the timing of audio output based on the music data from the second communication unit 24 to the relay device 5. Is output (transmitted) to the portable terminal 1 via (step S33). Here, the synchronization signal output from the karaoke apparatus 2 is received by the portable terminal 1 in step S8 or S12 in FIG. If synchronization is established between the karaoke device 2 and the portable terminal 1 based on the synchronization signal, the portable terminal 1 starts transmitting moving image data to the karaoke device 2 in step S11 in FIG.

  The control unit 20 of the karaoke apparatus 2 determines whether or not the mobile terminal 1 has started to receive the moving image data that has been transmitted in step S11 in FIG. 6 (S34). The control unit 20 receives the moving image data transmitted from the mobile terminal 1 by the second communication unit (reception unit) 24 via the relay device 5. If it is determined that the reception of moving image data has not been started (S34: NO), the control unit 20 waits until the moving image data is received. When it is determined that the reception of the moving image data is started (S34: YES), the control unit (display control unit) 20 of the karaoke apparatus 2 displays the moving image on the monitor device (display unit) 6 based on the received moving image data. Is started (S35). Specifically, the control unit 20 sequentially transmits moving image data sequentially received by the second communication unit 24 from the second communication unit 24 to the monitor device 6 via the relay device 5, and a moving image based on the moving image data is transmitted. It is displayed on the monitor device 6. In addition, the control part 20 displays the moving image based on moving image data on the monitor apparatus 6 as a background image of the lyrics contained in music data.

  On the other hand, the control unit (volume control unit) 20 of the karaoke apparatus 2 performs a process (for example, a mute process) for reducing the volume of audio based on the audio data received from the mobile terminal 1 together with the moving image data (S36). Further, the control unit 20 of the karaoke apparatus 2 reads the music data of the music ID read from the reserved music table 22a in step S31 from the storage unit 22, and starts audio output based on the read music data on the speaker 7 (S37). . At this time, the control unit (audio output unit) 20 outputs not only the audio output based on the music data but also the audio based on the audio data received from the mobile terminal 1 together with the moving image data. Note that the volume of the voice based on the voice data is reduced in step S36, so that it does not interfere with the audio output. In addition to the configuration performed by the karaoke apparatus 2, the process of reducing the volume of the sound based on the audio data associated with the moving image data may be performed by the mobile terminal 1. In this case, when the control unit 10 of the mobile terminal 1 transmits the sound data together with the moving image data to the karaoke device 2, the sound data is subjected to a process for reducing the sound volume based on the sound data. What is necessary is just to transmit to the karaoke apparatus 2.

  The control unit 20 of the karaoke apparatus 2 determines whether or not the audio output started in step S37 has ended (S38). Specifically, when the audio output based on the music data is executed to the end, or when the user operates the input device 3 (karaoke device 2) and instructs the output stop during the audio output, the control unit 20 Determines that the audio output has ended. When it is determined that the audio output has not ended (S38: NO), the control unit 20 continues the audio output based on the music data and the moving image display based on the moving image data. When it is determined that the audio output has ended (S38: YES), the control unit 20 transmits an end signal notifying the end of the audio output from the second communication unit 24 to the mobile terminal 1 via the relay device 5 (S39). ). Here, the end signal transmitted from the karaoke apparatus 2 is received by the portable terminal 1 in step S13 in FIG. The control unit 20 shifts the process to step S42.

  If it is determined in step S32 that no background video is specified (S32: NO), the control unit 20 of the karaoke apparatus 2 reads the song data of the song ID read from the reserved song table 22a in step S31 from the storage unit 22. Then, audio output based on the read music data is started by the speaker 7 (S40). And the control part 20 of the karaoke apparatus 2 judges whether the started audio output was complete | finished (S41), and when it is judged that it was not complete | finished (S41: NO), the audio output based on music data is continued. . When it is determined that the audio output has ended (S41: YES), the control unit 20 of the karaoke apparatus 2 determines whether or not the operation end has been instructed (S42). When the user operates the input device 3 (the karaoke device 2) to instruct the end of the operation of the karaoke device 2, the control unit 20 determines that the end of the operation has been instructed.

  When it is determined that the operation end is not instructed (S42: NO), the control unit 20 of the karaoke apparatus 2 returns the process to step S31 and reads the information of the music stored at the head of the reserved music table 22a ( S31). That is, the information on the next reserved music is read out, and the processes after step S32 are repeated based on the read-out information. When it is determined that the operation end is instructed (S42: YES), the control unit 20 of the karaoke apparatus 2 ends the karaoke process.

As described above, the mobile terminal 1 and the karaoke device 2 perform the respective processes, thereby starting display of the moving image based on the moving image data transmitted from the portable terminal 1 to the karaoke device 2 and the audio by the karaoke device 2. The start of output can be synchronized. In addition, the process of step S35 in FIG. 8 and the processes of steps S36 and S37 can be executed in parallel.
In the process described above, when the audio output by the karaoke device 2 is finished, the transmission of the moving image data from the portable terminal 1 to the karaoke device 2 is also finished. In addition to this, after the audio output is completed, the transmission of the moving image data from the portable terminal 1 to the karaoke device 2 is continued until the karaoke device 2 starts the audio output based on the next reserved music data. But you can. In this case, the audio volume based on the audio data transmitted from the portable terminal 1 to the karaoke apparatus 2 is returned to the original volume until the next audio output is started after the audio output is completed. You may make it output. That is, only a moving image based on moving image data may be displayed during audio output, and a moving image display based on moving image data and an audio output based on audio data may be performed in an audio output waiting state.

In the present embodiment, designation of arbitrary video data used for the background image of the lyrics displayed on the monitor device 6 is not only performed when making a karaoke reservation, but also when a karaoke reservation has already been made or audio output has already started. It can also be performed on existing music.
Below, the process which the portable terminal 1 performs when a user designates the moving image data used for a background image | video using the portable terminal 1 at the time other than when performing a karaoke reservation is demonstrated.

  FIG. 9 and FIG. 10 are flowcharts showing a procedure of processing performed by the mobile terminal 1. The control unit 10 of the mobile terminal 1 uses the karaoke application 12a stored in the storage unit 12 to use as a background image of a song that is already being played or a song that has already been reserved (a song waiting for audio output). A reception screen (hereinafter referred to as a background reception screen) for receiving designation of arbitrary video data is displayed on the touch panel 13. Note that the background reception screen displays not only the music data used for the background video when the music is specified and the specified music is played (audio output), but no music is specified and any music is played. It is also possible to accept (specify) moving image data used for the background video at the time. The user operates the touch panel 13 to specify moving image data to be used for the background video on the background reception screen. In this case as well, the moving image data used for the background image may be moving image data stored in the storage unit 12 of the mobile terminal 1, moving image data published via the network N, and the like. Audio data may be associated with the data.

  The control unit 10 of the mobile terminal 1 determines whether or not the designation of moving image data has been received via the touch panel 13 (S51). If it is determined that it has not been received (S51: NO), the control unit 10 of the mobile terminal 1 waits until it is received. When it is determined that the designation of the moving image data has been received (S51: YES), the control unit 10 of the mobile terminal 1 determines whether or not the designation of the music piece that uses the designated moving image data for the background image has been accepted (S52). . When it is determined that the designation of the music is not accepted (S52: NO), that is, when the music using the designated moving image data for the background video is not designated, the control unit 10 of the portable terminal 1 performs the karaoke device 2 Is currently being executed for audio output based on any piece of music data (S53).

  The control unit (output unit) 20 of the karaoke apparatus 2 is a signal indicating each status such as audio output based on music data being executed, audio output not being executed (waiting for audio output), and the like. (Status information) is output as appropriate. Therefore, the control part (acquisition part) 10 of the portable terminal 1 acquires the signal (situation information) which shows the execution status of the audio output by the karaoke apparatus 2 by receiving the signal output from the karaoke apparatus 2. Then, the control unit 10 can determine whether or not the karaoke apparatus 2 is currently outputting audio based on the acquired signal. When the karaoke device 2 determines that the audio output is not being executed (S53: NO), the control unit 10 of the mobile terminal 1 displays an error message indicating that the designated moving image data cannot be displayed on the karaoke device 2 on the touch panel 13 ( The information is displayed on the display unit 13b (S54), and the process is terminated.

  When it is determined that the karaoke device 2 is executing audio output (S53: YES), the control unit 10 of the portable terminal 1 starts transmitting the specified moving image data to the karaoke device 2 (S55). In addition, the control part 10 transmits also the audio | voice data matched with moving image data to the karaoke apparatus 2 with moving image data. Moreover, the control part 10 of the portable terminal 1 is a structure which transmits moving image data to the karaoke apparatus 2 when the remaining audio output time in the music data which the karaoke apparatus 2 is audio-outputting is more than predetermined time (for example, 10 seconds). It is good. In addition, when the karaoke device 2 is not outputting audio, or when the remaining audio output time in the music data being output is less than a predetermined time, the control unit 10 of the portable terminal 1 The transmission to the karaoke apparatus 2 is suspended in synchronization with the timing at which the karaoke apparatus 2 starts audio output based on the music data reserved next, and the transmission to the karaoke apparatus 2 is performed. It is good also as a structure. Thereby, when the audio output by the karaoke device 2 is not executed, or when the remaining audio output time in the music data being output is less than the predetermined time, new video data is transferred from the mobile terminal 1 to the karaoke device. 2 can be prohibited. Note that the control unit 10 of the portable terminal 1 can also acquire information on the remaining audio output time in the music data being output from the karaoke device 2, and based on the acquired information, the remaining audio output time is a predetermined time or more. It can be determined whether or not there is.

  The control unit 10 of the mobile terminal 1 determines whether or not the transmission of the designated moving image data has ended (S56), and if it determines that the transmission has not ended (S56: NO), the moving image data karaoke device Continue sending to 2. When it is determined that the transmission of the moving image data has ended (S56: YES), the control unit 10 of the mobile terminal 1 ends the process. Thereby, the karaoke apparatus 2 can display the moving image based on the moving image data transmitted from the portable terminal 1 on the monitor device 6.

  When it is determined that a song that uses the designated moving image data as the background video is designated (S52: YES), the control unit 10 of the mobile terminal 1 outputs the designated song as an audio signal at the current karaoke device 2. It is determined whether or not it is a medium music (S57). For example, the control unit 10 acquires information (music ID, music title, singer name, etc.) of the music currently being output from the karaoke device 2 and the music being reserved (waiting for audio output) (music ID, music title, singer name, etc.) 13 is displayed. And the control part 10 receives selection of the music which uses designated moving image data for a background image from the music in display by operation of the touch panel 13 by a user. In this case, the control unit 10 can determine whether the music that uses the specified moving image data for the background video is a music that is currently being output as audio or a music that is waiting for audio output.

When it is determined that the music is not being output (S57: NO), that is, when the music is waiting for audio output, the control unit 10 of the mobile terminal 1 specifies the music ID of the specified music and the background video. Reservation information including information indicating the presence of the data is transmitted from the second communication unit 15 to the karaoke apparatus 2 via the relay apparatus 5 (S58). Note that the control unit 20 of the karaoke apparatus 2 that has received such reservation information changes the background change column corresponding to the song ID of the received reservation information from “No” to “Yes” in the reserved song table 22a. Update.
Then, the control part 10 of the portable terminal 1 performs the same process as the process after step S6 in FIG.5 and FIG.6. As a result, when the video data used for the background video is specified for the music waiting for audio output, the same processing as when the video data used for the background video is specified when making a karaoke reservation is performed. Is called.

  When it is determined that the music is being output as audio (S57: YES), the control unit 10 of the mobile terminal 1 uses the PV data of the music that uses the moving image data as the background video. It is determined whether or not there is (S59). In addition, the control part 10 judges whether it is PV data by the process similar to step S6 in FIG. When it is determined that the specified moving image data is PV data (S59: YES), the control unit 10 of the mobile terminal 1 specifies the singing start position in the moving image data (PV data) specified as the background image (S60). ). In addition, the control part 10 pinpoints a song start position by the process similar to step S7 in FIG.

  Next, the control unit 10 of the portable terminal 1 requests the karaoke apparatus 2 for information (music data information) indicating the vocal sound start position and the current output position in the music data of the music being output, and receives from the karaoke apparatus 2. (S61). Based on the received music data information and the singing start position specified in step S60, the control unit 10 of the mobile terminal 1 specifies the reproduction start position in the moving image data (PV data) designated as the background video (S62). ). For example, the control unit 10 calculates the time from the vocal sound start position of the music data to the current output position based on the received music data information. And the control part 10 specifies the position after the calculated time from the singing start position specified by step S60 in the moving image data (PV data) designated as the background image | video as a reproduction | regeneration start position.

  After specifying the playback start position of the moving image data, the control unit 10 of the mobile terminal 1 starts transmitting the moving image data (PV data) to the karaoke apparatus 2 from the specified playback start position (S63). The control unit 10 transmits not only moving image data but also audio data associated with the moving image data to the karaoke apparatus 2. The control unit 10 may not only transmit the moving image data to the karaoke apparatus 2 but also transmit the moving image based on the moving image data to the karaoke apparatus 2 while displaying the moving image on the touch panel 13 of the own apparatus. Further, the control unit 10 receives a predetermined signal (situation information) from the karaoke apparatus 2 and acquires the remaining audio output time in the music data being output. Then, the control unit 10 may transmit the moving image data to the karaoke apparatus 2 when the remaining audio output time is equal to or longer than a predetermined time (for example, 10 seconds). That is, when the remaining audio output time is less than the predetermined time, the control unit 10 may not transmit the moving image data to the karaoke apparatus 2.

  If it is determined in step S59 that the moving image data specified for the background video is not PV data (S59: NO), the control unit 10 of the mobile terminal 1 moves the process to step S63, and the moving image specified for the background video. Transmission of data to the karaoke apparatus 2 is started (S63). Here, for example, the playback start position may be determined based on the moving image data or the audio data associated with the moving image data, and the moving image data may be transmitted from the determined playback start position. Also here, the portable terminal 1 switches whether to transmit the moving image data to the karaoke apparatus 2 according to whether or not the remaining audio output time in the music data being output is longer than a predetermined time. Good.

  After starting transmission of the moving image data to the karaoke device 2, the control unit 10 of the portable terminal 1 determines whether or not an end signal transmitted from the karaoke device 2 has been received (S64), and determines that it has been received. If so (S64: YES), the transmission of the moving image data is terminated (S65), and the process is terminated. When determining that the end signal from the karaoke device 2 has not been received (S64: NO), the control unit 10 determines whether or not the transmission of the moving image data to the karaoke device 2 has ended (S66). When determining that the transmission of the moving image data has not ended (S66: NO), the control unit 10 returns the process to step S64.

  When it is determined that the transmission of the moving image data has ended (S66: YES), the control unit 10 of the mobile terminal 1 returns the process to step S63 and starts transmitting the moving image data to the karaoke apparatus 2 again (S63). At this time, the control unit 10 of the mobile terminal 1 may be configured to transmit the same moving image data as the previously transmitted moving image data, or may be configured to newly transmit different moving image data. In this case as well, when the moving image data to be used for the background image is specified via the background reception screen, the user can select whether the same moving image data is used (reproduced) only once or repeatedly (reproduced). It is good also as a structure. In addition, when the moving image data to be used for the background video is specified via the background reception screen, the user may specify a plurality of moving image data and the use order (reproduction order) of each moving image data.

  As described above, when the moving image data to be used for the background image is specified for the music being output, the karaoke device 2 sends the moving image based on the moving image data sequentially transmitted from the mobile terminal 1 to the monitor device 6. Display. In addition, the karaoke apparatus 2 displays the moving image based on moving image data on the monitor apparatus 6 as a background image of the lyrics included in the music data. Therefore, it is possible to change the background video to an arbitrary moving image even for the music that is already being output. Further, when the designated moving image data is PV data, the reproduction start position (transmission start position) in the moving image data is specified based on the current audio output position. Therefore, the display timing of the moving image based on the moving image data by the monitor device 6 and the audio output timing by the karaoke device 2 can be synchronized with respect to the music for which audio output has already started.

  9 and 10, the moving image from the portable terminal 1 to the karaoke device 2 until the karaoke device 2 starts audio output based on the next reserved music data even after the audio output is completed. It may be configured to continue data transmission. In this case, the audio volume based on the audio data transmitted from the portable terminal 1 to the karaoke apparatus 2 is returned to the original volume until the next audio output is started after the audio output is completed. You may make it output. Thereby, not only the display of the moving image based on the moving image data transmitted from the portable terminal 1 to the karaoke apparatus 2 but also the viewing of arbitrary content data is possible by the audio output based on the audio data.

9 and 10 may be configured such that the user manually specifies the reproduction start position in the moving image data (PV data).
In the above-described processing, when the moving image data specified as the background image of the music being output is not PV data, the mobile terminal 1 specifies the start of the specified moving image data without specifying the reproduction start position in the moving image data. The structure which transmits to the karaoke apparatus 2 in order from may be sufficient. Moreover, it is good also as a structure which switches whether the portable terminal 1 performs the process which specifies the reproduction | regeneration start position in moving image data by a user's selection.

  In the karaoke system of this embodiment, the portable terminal 1 is a structure which continues transmission of the moving image data to the karaoke apparatus 2 until the audio output by the karaoke apparatus 2 is complete | finished. Furthermore, according to the output time required for the audio output by the karaoke device 2 and the display time of the moving image based on the moving image data transmitted to the karaoke device 2, the mobile terminal 1 has the same moving image display time as the audio output time. In this way, the moving image data may be processed. Specifically, the control unit 10 of the mobile terminal 1 acquires the remaining output time of the music being output by the karaoke device 2 from the karaoke device 2, and generates a moving image based on the moving image data currently being transmitted to the karaoke device 2. Compare with remaining display time. For example, when the moving image display time is longer than the audio output time, the control unit 10 of the mobile terminal 1 processes the moving image data so as to shorten the moving image display time (for example, increase the playback speed), and after the processing Are transmitted to the karaoke apparatus 2. For the music waiting for audio output by the karaoke device 2, the control unit 10 of the portable terminal 1 acquires the output time required for audio output from the karaoke device 2 by the karaoke device 2, and sends it to the karaoke device 2 during audio output of this music. Compare with the video display time based on the video data to be sent. When the moving image display time is longer than the audio output time, the control unit 10 of the mobile terminal 1 processes the moving image data so that the moving image display time is approximately the audio output time, and the processed moving image data Is transmitted to the karaoke apparatus 2. Thereby, the end timing of audio output by the karaoke device 2 and the end timing of display by the video monitor device 6 based on the video data transmitted from the mobile terminal 1 can be matched.

In the karaoke system of the present embodiment, the user searches for moving image data to be used for the background image of karaoke in advance, and designates the searched moving image data via the reservation reception screen or the background reception screen. Met. Furthermore, the mobile terminal 1 may have a configuration in which the moving image data is automatically searched based on the music information that the user has reserved for karaoke or the music information of the music that is going to be reserved for karaoke via the reservation reception screen.
Below, the process which the portable terminal 1 searches automatically the moving image data used for the background image | video of karaoke is demonstrated.

FIG. 11 is a flowchart showing a procedure of moving image data search processing by the mobile terminal 1, and FIG. 12 is a schematic diagram showing a display screen example of the mobile terminal 1.
The control unit 10 of the portable terminal 1 performs the following processing when the user designates arbitrary moving image data as a background image of karaoke. First, the control unit 10 of the mobile terminal 1 acquires music information such as a music ID, a music title, and a singer name of a music that is desired to use arbitrary video data as a background video (S71). Specifically, when the user selects a song for which karaoke reservation is to be made via the reservation reception screen, the control unit 10 acquires song information of the selected song. In addition, when the user specifies the video data that the user wants to use for the background video via the background reception screen, the user is currently outputting the music that the background video is to be changed to any video data before specifying the video data. Select from music and music waiting for audio output. And the control part 10 acquires the music information of the music which the user selected via the background reception screen. For example, the control unit 10 acquires the music information of the music selected by the user from the karaoke apparatus 2.

  As shown in FIG. 12A, the control unit 10 of the mobile terminal 1 displays the acquired music information and also displays a search screen on the touch panel 13 that accepts selection of whether to perform automatic search or manual search (S72). . In the search screen shown in FIG. 12A, whether the search process based on the music information is automatically performed on the moving image data stored in the mobile terminal 1 (“automatic search in mobile terminal”), or is made public via the network N. It is possible to select whether to automatically execute the moving image data (“automatic search within the network”) or manually by the user (“manual search”).

  The control unit 10 of the portable terminal 1 determines whether execution of automatic search is selected via the search screen (S73). When it is determined that execution of automatic search has been selected (S73: YES), specifically, when “automatic search within mobile terminal” or “automatic search within network” is selected, the control unit 10 selects the selected process. Accordingly, a search process based on the music information is performed on the moving image data stored in the mobile terminal 1 or the moving image data released via the network N (S74). Note that the search processing for moving image data is performed using a known search program. The search processing is processing for extracting moving image data in which any word of music information is included in additional data such as a title, an explanation column, a tag, and a file name added to the moving image data.

  The control unit 10 of the mobile terminal 1 receives the information of the searched moving image data (data information related to the moving image data) from the search destination device, and touches a search result screen indicating the result of the search processing as shown in FIG. 12B. 13 (S75). In the search result screen shown in FIG. 12B, thumbnail images and data names (file names) of three moving image data are displayed as search results. Note that the information displayed on the search result screen is not limited to this, and any information that can identify each moving image data (data information on moving image data) may be used. The search result screen shown in FIG. 12B is configured so that moving image data to be used for the background video of karaoke can be designated from each moving image data of the search result. The search result screen may be configured so that each moving image data of the search result can be preview-displayed so that the user can confirm it before designating it as the background video. The control part 10 of the portable terminal 1 complete | finishes the above-mentioned search process, when designation | designated (selection) of the moving image data used for a background image is received via a search result screen (S76). When the user has made a karaoke reservation via the reservation reception screen, the control unit 10 of the mobile terminal 1 returns the display screen of the touch panel 13 to the reservation reception screen, and the moving image data designated in step S76 is changed to the background. Accepted as video data used for video. If the user has specified the moving image data to be used for the background video via the background reception screen, the control unit 10 of the mobile terminal 1 returns the display screen of the touch panel 13 to the background reception screen and specifies in step S76. The received moving image data is received as moving image data used for the background image. Note that the control unit 10 of the mobile terminal 1 performs, for example, the processing after step S5 in FIG. 5 and the processing after step S52 in FIG. 9 after receiving the designation of the moving image data used for the background video. .

  When it is determined in step S73 that execution of automatic search is not selected (S73: NO), specifically, when “manual search” is selected, the control unit 10 of the portable terminal 1 passes through the touch panel 13. Processing according to the user's operation is performed, and designation of moving image data to be used for the background video is accepted (S76). When “manual search” is selected, the control unit 10 of the mobile terminal 1 performs the processing shown in FIGS. 5 and 6 or the same processing as the processing shown in FIGS. 9 and 10.

  In the process shown in FIG. 11, the user designates moving image data to be used for the background video from the search results. In addition, the mobile terminal 1 may further include a configuration that automatically selects moving image data that is optimal for a background image of karaoke from the search result. For example, the control unit 10 of the mobile terminal 1 identifies the moving image data whose display time of the moving image is closest to the audio output time of the music selected by the user from among the moving image data of the search result, and uses it for the background image. You may select as animation data. In addition, the control unit 10 of the mobile terminal 1 identifies the video data in which the music information of the music selected by the user is most contained in the data added to the video data among the video data of the search results, and the background You may select as animation data used for a picture.

  As described above, according to the portable terminal 1 having a configuration for automatically searching for moving image data, when the transmission of moving image data from the portable terminal 1 to the karaoke device 2 is completed during audio output by the karaoke device 2, the portable terminal 1 1 can also be configured to perform a search process of moving image data based on the music information of the music being output, and to start transmitting the searched moving image data to the karaoke apparatus 2. In this case, while the audio output is being performed, a plurality of moving images related to the music being output is displayed on the monitor device 6 sequentially.

  In the karaoke system of the present embodiment, various types of moving image data that can be played back (viewed) on the mobile terminal 1 can be used for the background video of karaoke. Therefore, not only the moving image data stored in the mobile terminal 1 in advance, but also various moving image data disclosed through the network N, for example, can be used for the background image of karaoke. In addition, the moving image based on the moving image data transmitted from the mobile terminal 1 to the karaoke device 2 is displayed on the monitor device 6 not only when the karaoke lyrics are background but also when the karaoke device 2 is not outputting audio. Can be made. At this time, by outputting sound based on the sound data transmitted together with the moving image data through the speaker 7, for example, during the break of karaoke, arbitrary moving image data (content data) is viewed on the monitor device 6 and the speaker 7. be able to.

In the karaoke system of the present embodiment, the relay device 5 is provided with the function of an access point used for wireless communication, and the mobile terminal 1 transmits the moving image data used for the karaoke background video to the karaoke device 2 via the relay device 5. It was the composition to do. In addition to this, the function of the access point may be provided in the karaoke device 2, and the mobile terminal 1 may directly transmit the moving image data to the karaoke device 2. Alternatively, a predetermined server device may be prepared in advance in the network N, and the mobile terminal 1 may transmit the moving image data to the karaoke device 2 via the server device on the network N. In these configurations, an optimal configuration may be employed according to the data amount of moving image data to be transmitted, the communication speed between devices, and the like.
Further, the monitor device 6, the speaker 7, and the microphone 8 may be directly connected to the karaoke device 2.

  In the karaoke system of the present embodiment, when the karaoke device 2 receives the moving image data and the audio data from the mobile terminal 1 and displays the moving image based on the moving image data on the monitor device 6, the sound based on the audio data is displayed on the speaker 6. Output. At this time, when audio output based on music data is performed, the karaoke apparatus 2 is configured to control the sound volume based on the sound data received from the mobile terminal 1 to be small (for example, mute processing) and output the sound. In addition, it is good also as a structure which transmits to the karaoke apparatus 2 after the portable terminal 1 performs the process which controls a sound volume with respect to audio | voice data, or transmits only audio | voice data to the karaoke apparatus 2 without transmitting audio | voice data. It is good also as a structure which transmits.

  In the karaoke system of the present embodiment, the portable terminal 1 is based on the configuration in which the transmission of the video data to the karaoke device 2 is terminated when the audio output by the karaoke device 2 is completed, or the music data reserved next. Until the karaoke device 2 starts audio output, the transmission of the video data to the karaoke device 2 is continued. In addition to this, when the audio output by the karaoke device 2 is finished, the mobile terminal 1 once stops the transmission of the moving image data to the karaoke device 2, and when the audio output of the same music is performed again, the same user When the audio output of the reserved music is performed, or when the audio output of the music whose genre is the same as or similar to that of the music for which the audio output has been completed is performed, the transmission of the moving image data may be resumed from the stopped position. .

  In the karaoke system of the present embodiment, the karaoke device 2 may be realized by installing a predetermined karaoke program in a personal computer, a game machine, a television device or the like in addition to the device installed in the karaoke store. .

  It should be thought that embodiment disclosed this time is an illustration and restrictive at no points. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 Mobile terminal (communication device)
2 Karaoke device 4 Server device 6 Monitor device (display unit)
10 Control unit (acquisition unit)
12 storage unit 14 first communication unit (receiving unit)
15 Second communication unit (transmission unit)
20 control unit (display control unit, volume control unit, audio output unit, output unit)
24 Second communication unit (receiving unit)

Claims (12)

A program for causing a computer to communicate with a karaoke device that performs audio output based on music data,
In the computer,
A receiving step for receiving video data from an external device;
An acquisition step of acquiring status information indicating an execution status of audio output by the karaoke device;
According to the execution status indicated by the status information acquired in the acquisition step, a transmission step of transmitting the moving image data received in the reception step to the karaoke apparatus is executed. In the computer,
An information receiving step for receiving data information relating to moving image data from an external device;
A reception step of receiving a selection for the data information received in the information reception step;
In the receiving step, the computer
The program according to claim 1, wherein the moving image data corresponding to the data information received in the receiving step is received from the external device. In the transmitting step, the computer is
The said moving image data received at the said reception step are transmitted to the said karaoke apparatus, when the execution condition which the said situation information acquired at the said acquisition step shows is performing audio output. The listed program. In the receiving step, the computer
Receiving the moving image data and audio data associated with the moving image data;
In the computer,
A process step of performing a process of controlling the volume of the sound based on the sound data with respect to the sound data received in the receiving step;
In the transmitting step, the computer is
The program according to any one of claims 1 to 3, wherein the moving image data received in the receiving step and the audio data subjected to the processing in the processing step are transmitted to the karaoke apparatus. In the receiving step, the computer
Receiving the moving image data and audio data associated with the moving image data;
In the computer,
Of the audio data received in the receiving step, identifying partial audio data corresponding to the music data;
A step of specifying partial video data corresponding to the specified partial audio data among the video data received in the reception step; and
In the transmitting step, the computer is
The specified partial moving image data is transmitted to the karaoke device. The program according to any one of claims 1 to 4. In the computer,
Obtaining a synchronization signal for synchronizing output processing from the karaoke device;
In the transmitting step, the computer is
6. The program according to claim 1, wherein transmission of the moving image data received in the reception step to the karaoke device is started based on the acquired synchronization signal. In the computer,
Obtaining an end signal indicating the end of audio output based on the music data from the karaoke device;
If the end signal is acquired during transmission of the moving image data to the karaoke device, the step of ending transmission of the moving image data to the karaoke device;
The step of starting transmission of the same or different moving image data to the karaoke device when the transmission of the moving image data to the karaoke device is completed before obtaining the end signal is performed. The program according to any one of 1 to 6. In the computer,
Obtaining an audio output time based on the music data by the karaoke device;
Comparing the acquired audio output time and the moving image display time based on the moving image data;
If the video display time is determined to be longer than the audio output time, further processing the video data so as to shorten the video display time based on the video data; and
In the transmitting step, the computer is
The program according to any one of claims 1 to 7, wherein the processed moving image data is transmitted to the karaoke apparatus. In the transmitting step, the computer is
When the execution status indicated by the status information acquired in the acquisition step is not during execution of audio output based on music data, or when the remaining audio output time in the audio output being executed is less than a predetermined time, the karaoke device 9. The video data received in the receiving step is transmitted to the karaoke device in response to execution of audio output based on the next music data by the method according to any one of claims 1 to 8. program. In a karaoke device that performs audio output based on music data,
A receiving unit for receiving moving image data and audio data associated with the moving image data from an external device;
A volume control unit for controlling the volume of audio based on the audio data received by the receiving unit;
A sound output unit that performs sound output based on the music data and output of the sound whose volume control unit controls the volume;
A karaoke apparatus comprising: a display control unit configured to display a moving image based on moving image data received by the receiving unit on a display unit. To a computer that outputs audio based on song data,
A receiving step of receiving moving image data and audio data associated with the moving image data from an external device;
A volume control step for controlling the volume of audio based on the audio data received in the receiving step;
Outputting the sound whose volume is controlled in the volume control step and outputting the audio based on the music data;
Causing the display unit to display a moving image based on the moving image data received in the receiving step. A karaoke device that performs audio output based on music data;
A karaoke system comprising a communication device capable of communicating with the karaoke device,
The communication device
A receiver for receiving video data from an external device;
An acquisition unit for acquiring status information indicating an execution status of audio output by the karaoke device;
A transmission unit that transmits the video data received by the reception unit to the karaoke device according to the execution status indicated by the status information acquired by the acquisition unit;
The karaoke device
An output unit for outputting status information indicating an execution status of the audio output;
A receiver for receiving the video data transmitted by the transmitter;
A karaoke system comprising: a display control unit configured to display a moving image based on the moving image data received by the receiving unit on a display unit.

Images