JP5611163B2 - Image reproduction device, remote control device, and image reproduction system - Google Patents

Description

  The present invention relates to an image reproducing device, a remote control device, and an image reproducing system installed in restaurants, karaoke boxes, homes, and the like.

  Patent Document 1 describes a karaoke device that can display advertising information related to popular songs and highly topical songs on an image display device during or between karaoke songs. Further, Patent Document 2 describes a karaoke device that can display a standard critique message on an image display device during singing.

JP 2003-345326 A JP-A-3-290692

  However, in the conventional karaoke apparatus, advertisement information or standard critique message information is only displayed in a part of the background image regardless of the object included in the background image displayed in the background of the lyrics image. It does not display message information or advertisement information that has a sense of unity with the object included in the background image. For this reason, it has been impossible to improve the entertainment of karaoke by displaying message information and advertisement information in various representation formats in the background image.

  The present invention has been made in view of such circumstances, and transmits character string data to an image reproduction device using a remote operation device capable of inputting characters, or character string data is transmitted using a touch panel provided on the device itself. By accepting and displaying the character string data in a character string display area set in advance on an object in the image (background image), the message information and advertisement information, etc. that have a sense of unity with the background image are shown to the user. An object of the present invention is to provide an image reproducing device, a remote control device, and an image reproducing system.

Image reproducing apparatus of the present invention includes means for outputting the music selected from among a plurality of songs, and a display unit, in parallel with the output of the music corresponding to musical composition, the display image including the object in the image reproducing apparatus and a display control means for performing control to display the parts and the outside of the image display device, comprising a reception means to receive the character string data, the at least one object included in the image, A determination means for determining whether or not a character string display area capable of displaying a character string corresponding to character string data is preset, and the number of the character string data is larger than the number of the character string display areas. Further, the display control means is set as an object to be displayed on the image display device when the determination means determines that the number of the character string data is larger than the number of the character string display areas. Within the character string display area To display a character string corresponding to a part of the character string data, by displaying a character string corresponding to the other of the character string data in the set to an object to be displayed on the display unit a character string display region It is characterized by.
In the image reproduction device of the present invention, the determination unit further determines whether or not the character size when the character string corresponding to the character string data is displayed in the character string display area exceeds a predetermined point. The display control means enlarges the text display area displayed on the display unit when the judgment means judges that the predetermined point or less, and the character string is displayed in the enlarged text display area. Is displayed.

  In the present invention, in order to display a character string received from the outside in a character string display area set in advance on an object included in the image, a character string having a sense of unity with the image can be displayed. .

The image reproduction apparatus of the present invention further comprises storage means for storing character string data, and reading means for reading character string data from the storage means, and the display control means adds the character string data received by the receiving means to the character string data received by the receiving means. A corresponding character string is displayed in a character string display area set in an object displayed on the image display device, and a character string corresponding to character string data read by the reading unit is displayed on the display unit. It is characterized in that it is displayed in a character string display area set for the object displayed on the screen .

  In the present invention, when there is a character string display area not associated with the character string data, that is, when there is an empty area in the character string display area, the character input by the user in the character string display area Since a character string different from the column (for example, a character string related to advertisement data) is displayed, the character string display area can be used without waste.

  The image reproduction apparatus of the present invention further includes a determination unit that determines whether or not character string data has been received, and the display control unit is read by the reading unit when the determination unit determines NO. A character string corresponding to character string data is displayed in the character string display area.

  In the present invention, when character string data is not received from the outside, that is, when character string data is not transmitted from the outside, a character different from the character string input by the user in the character string display area. Since a column (for example, a character string representing an advertisement) is displayed, all the character string display areas can be used effectively.

Image reproducing apparatus of the present invention includes means for outputting the music selected from among a plurality of songs, and a display unit, in parallel with the output of the music corresponding to musical composition, the display image including the object And a display control means for performing display control on an external image display apparatus, and a receiving means for receiving character string data. At least one of the objects included in the image includes a character A character string display area capable of displaying a character string corresponding to the column data is set in advance, and the display control means sets a character string corresponding to the character string data received by the receiving means as an object. Citea so as to display the character string display region is, further, Yes configured to instruction to fast-forward or stop the reproduction of the image containing the object is input, the display control means, the reproduction fast forward or stop If the instruction is inputted, the character string corresponding to the character string data received by the receiving unit, and wherein the to be displayed on the display unit.

  In the present invention, the character string is received by the touch panel provided in the apparatus itself, and the character string received from the outside is displayed in the character string display area of the object associated with the music. An image including a character string in the character string display area may be displayed on the display unit or may be displayed on an external image display device.

  In the present invention, when the reproduction of the image including the object is fast-forwarded or stopped, the character string corresponding to the character string data received by the touch panel is displayed in the character string display area set for the object. Although there is a possibility that the opportunity to display with inclusion may be lost, in this case, the received character string is displayed without being included in the character string display area.

The remote control device according to the present invention is a remote control device for remotely operating an image playback device for outputting a song selected from a plurality of songs, a receiving means for receiving character string data, and image data associated with the song. an acquisition unit configured to acquire from the image reproducing apparatus, based on the image data to which the acquisition unit has acquired, a creation unit in which a plurality of images to create a list of a plurality of reduced images reduced, corresponding to the reduced image Requesting means for requesting the character string data to the image reproducing device, means for receiving the character string data transmitted from the image reproducing device in response to a request by the requesting means, and corresponding to the received character string data select the text, and display means for displaying in the corresponding reduced image, at least one of the reduced image from among a plurality of reduced image created by the creating means A selection unit, a unit that associates an image corresponding to the reduced image selected by the selection unit with the character string data received by the reception unit, and a transmission unit that transmits the character string data. To do.

  In the present invention, character string data is received, an image is acquired from the image playback device, a list of reduced images (thumbnail) of the acquired images is created, and characters corresponding to the reduced image selected from the list are displayed. The column data is associated and the character string data is transmitted to the image reproduction device. Therefore, it is possible to quickly know the entire image of the image that is scheduled to be displayed during the performance, and the user can prepare in advance a character string to be displayed for each image.

  The remote control device according to the present invention further comprises storage means for storing information related to a time during which an image corresponding to the reduced image is displayed for each piece of music, and the transmission means is configured to read characters according to the information related to time read from the storage means It is characterized by transmitting column data.

  According to the present invention, since the time information indicating the time at which each background image is displayed for each piece of music is stored, the message information can be automatically transmitted to the karaoke device when a predetermined time has elapsed. .

The image reproduction system of the present invention, means for outputting the music selected from among a plurality of songs, corresponding to music piece in parallel with the output of the display unit and the music, the display displays an image including the object And an image playback device including display control means for controlling display on an external image display device, and a remote operation device for remotely operating the image playback device and receiving data transmitted from the image playback device In the image reproduction system, the remote operation device includes a reception unit that receives character string data, and a unit that transmits the received character string data to the image reproduction device. The image reproduction device is connected to the remote operation device. Receiving means for receiving the transmitted character string data, and at least one of the objects included in the image displays a character string corresponding to the character string data Possible character string display region is set in advance, further comprising determining means for determining whether the number of the character string data is greater than the number of the character string display region, the display control means, said determination When the means determines that the number of the character string data is larger than the number of the character string display areas, a part of the characters in the character string display area set in the object displayed on the image display device A character string corresponding to the column data is displayed, and a character string corresponding to the other character string data is displayed in a character string display area set in the object displayed on the display unit .

  In the present invention, the character string received from the outside is displayed in the character string display area of the object associated with the music.

The image reproduction system of the present invention includes a means for outputting a music selected from a plurality of music, and a display control means for controlling display of an image including an object in association with the music in parallel with the output of the music. An image reproduction system comprising: an image reproduction device including: a remote operation device that remotely operates the image reproduction device and receives data transmitted from the image reproduction device; wherein the image reproduction device is the remote operation device. A character string display area capable of displaying a character string corresponding to the character string data is set in advance in at least one of the objects included in the image. And the display control means displays a character string corresponding to the character string data received by the receiving means in a character string display area set in the object. The remote control device includes: a receiving unit that receives character string data; an acquisition unit that acquires image data associated with music from the image reproduction device; and a plurality of images based on the image data acquired by the acquisition unit. A creation unit that creates a list of a plurality of reduced images that have been reduced; and a request unit that requests character string data associated with the reduced image to the image reproduction device, wherein the image reproduction device includes the request unit. Means for transmitting character string data associated with the reduced image in response to a request by the remote control device, wherein the remote control device receives the character string data transmitted from the image reproduction device in response to a request by the requesting unit. means for receiving a character string corresponding to the character string data received, and display means for displaying in the corresponding reduced image, multiple condensed created by the creation means Selecting means for selecting at least one reduced image from images, means for associating an image corresponding to the reduced image selected by the selecting means, and character string data received by the receiving means, and character string data Means for transmitting to the image reproduction apparatus.

  In the present invention, in order to display a character string received from the outside in a character string display area set in advance on an object included in the image, a character string having a sense of unity with the image can be displayed. In addition, since the entire image can be grasped in advance, the user can prepare in advance a character string to be displayed for each image.

  According to the present invention, it is possible to display a character string (for example, message information, advertisement information, etc.) in a character string display area set in advance in an object included in an image corresponding to a music piece. It is possible to make the user watch a character string that has no sense of incongruity and has a sense of unity with the image.

It is explanatory drawing which shows one structural example of a karaoke system typically. It is a block diagram which shows one structural example of a central apparatus. It is explanatory drawing which shows an example of the record layout of a user information database typically. It is explanatory drawing which shows typically an example of the record layout of a music database. It is explanatory drawing which shows an example of the record layout of a background image database typically. It is explanatory drawing which shows the example of a background image. It is a block diagram which shows the structural example of a karaoke apparatus. It is a block diagram which shows the structural example of a remote control apparatus. It is explanatory drawing which shows an example of the thumbnail display screen which displays a list of thumbnails. It is explanatory drawing which shows an example of the display screen in which one thumbnail is expanded and displayed. It is explanatory drawing which shows an example of the message information input screen displayed on the display apparatus. It is explanatory drawing which showed a mode that the message information input into the remote control apparatus was displayed on the text display area of a background image. It is explanatory drawing which showed a mode that the message information input into the remote control apparatus was displayed on the text display area of a background image. It is explanatory drawing which showed a mode that the message information input into the remote control apparatus was displayed on the text display area of a background image. It is a flowchart which shows the flow of the process which displays the message information which the remote control apparatus received, or the advertisement information which the karaoke apparatus beforehand memorize | stored in a background image. It is a flowchart which shows the flow of the process which displays the message information which the remote control apparatus received, or the advertisement information which the karaoke apparatus beforehand memorize | stored in a background image. It is a flowchart which shows the flow of the process which displays the message information which the remote control apparatus received, or the advertisement information which the karaoke apparatus beforehand memorize | stored in a background image. It is explanatory drawing which shows an example of the screen for background image selection displayed on a remote control device after the start of a karaoke performance. It is explanatory drawing which shows an example of the message information input screen for inputting message information with respect to the background image selected on the background image selection screen. It is explanatory drawing which shows typically an example of the thumbnail database provided in the memory | storage part of the remote control apparatus. It is a flowchart which shows the flow of the process in connection with reception of the message information in a remote control device. It is a block diagram which shows the structural example of the karaoke apparatus which concerns on Embodiment 3. FIG. 12 is a flowchart illustrating a processing procedure of a control unit related to display of message information in the third embodiment. 12 is a flowchart illustrating a processing procedure of a control unit related to display of message information in the third embodiment. 12 is a flowchart illustrating a processing procedure of a control unit related to display of message information in the third embodiment. 10 is an explanatory diagram illustrating a method for displaying message information in Embodiment 3. FIG. 10 is a flowchart illustrating a processing procedure of a control unit according to a message display in the fourth embodiment. 10 is a flowchart illustrating a processing procedure of a control unit according to a message display in the fourth embodiment. 10 is an explanatory diagram illustrating a method for displaying message information in Embodiment 4. FIG. 10 is an explanatory diagram illustrating a method for displaying message information in Embodiment 4. FIG. It is the flowchart which showed the process sequence of the control part which concerns on the display of the message at the time of fast-forwarding or stopping a performance. It is explanatory drawing which shows the display method of the message at the time of fast-forwarding or stopping a performance. It is explanatory drawing which shows the display method of the message at the time of fast-forwarding or stopping a performance. It is explanatory drawing which shows the display method of the message at the time of fast-forwarding or stopping a performance. 18 is a flowchart illustrating a processing procedure of a control unit related to display of message information in the sixth embodiment. 18 is a flowchart illustrating a processing procedure of a control unit related to display of message information in the sixth embodiment. FIG. 20 is an explanatory diagram showing a method for displaying message information in the sixth embodiment. It is the flowchart which showed the process procedure of the control part which concerns on the display of message information. It is the flowchart which showed the process procedure of the control part which concerns on the display of message information. FIG. 38 is an explanatory diagram illustrating an example of a thumbnail display screen according to the seventh embodiment.

Hereinafter, embodiments will be specifically described with reference to the drawings.
Embodiment 1
FIG. 1 is an explanatory diagram schematically showing a configuration example of a karaoke system.
The karaoke system includes a central device 1 installed in a karaoke content provider, a karaoke device 4 installed in a store 2 such as a karaoke box or a restaurant (hereinafter referred to as “karaoke store 2”), a central device. A communication network N that connects the device 1 and the karaoke device 4 is provided.

The central device 1 distributes information related to karaoke (hereinafter referred to as “karaoke information”) to the karaoke device 4 and provides various services using karaoke to the karaoke store 2.
One karaoke device 4 is usually installed in each private room 21 of the karaoke store 2 and is connected to a router 31 installed in the karaoke store 2 via a wired LAN (Local Area Network) cable 32.
Each private room 21 is provided with a remote operation device 5 (also referred to as “electronic quick sample device”) that can remotely operate the karaoke device 4. The remote control device 5 is a board-type information input device composed of a touch panel capable of pen touch input. The remote control device 5 is used for input operations such as login to a karaoke system, selection of a song, message information related to a song, and comment information. A LAN for connecting a plurality of karaoke devices 4 to each other is laid in the karaoke store 2, and data transmission / reception between the remote control device 5 and the karaoke device 4 is performed via an access point 33 and a wired LAN cable 32. Is called.
The communication network N is composed of a telephone line or a dedicated line, and the central device 1 and the karaoke device 4 exchange data with each other via the communication network N.

FIG. 2 is a block diagram showing a configuration example of the central apparatus.
The central device 1 is a server that stores karaoke information including music data, background image data, advertisement data, and the like and periodically distributes the karaoke information to the karaoke device 4 via the communication line N. The music data is performance data for generating a performance sound and lyrics data for generating a lyric character image (also referred to as “lyric telop”). The background image data is image data for generating an image to be displayed on a display device installed in a private room during the performance of a music piece. The advertisement data is, for example, image data for generating advertisement images relating to new music information, song selection ranking, CD sales ranking, food and drink sold in the karaoke store 2, and the like. The advertisement data is the latest information on karaoke information and karaoke stores for singers and listeners via a display device in the karaoke store.

  The central device 1 includes a control unit 10, a ROM 11, a RAM 12, a storage device 13, and a communication unit 14 that control the operation of each component of the central device 1, and these units are connected to each other via a bus 15 to exchange data with each other. Send and receive.

The control unit 10 includes a CPU therein, and controls the central device 1 in an integrated manner and controls distribution of karaoke information to the karaoke device 4.
The ROM 11 is a memory such as a mask ROM or EEPROM that stores a program for instructing the operation of the control unit 10.
The RAM 12 is a memory such as a DRAM or an SRAM that temporarily stores data necessary for processing by the control unit 10 and data generated by the processing.

The storage device 13 is a hard disk, a nonvolatile memory, or the like that stores a computer program for causing a computer to function as the central device 1. Further, the storage device 13 is provided with a user information database 13a for storing data related to the user of the karaoke system, a music database 13b for storing music data, a background image database 13c for storing background image data, and an advertisement database 13d. .
The communication unit 14 transmits music data, background image data, and advertisement data to the karaoke apparatus 4 via the communication network N.

  FIG. 3 is an explanatory diagram schematically showing an example of a record layout of the user information database. FIG. 4 is an explanatory diagram schematically showing an example of the record layout of the music database. FIG. 5 is an explanatory diagram schematically showing an example of the record layout of the background image database.

The user information database 13a shown in FIG. 3 stores information relating to a user who uses the karaoke apparatus 4 in association with identification information unique to the user, that is, a user ID.
The record layout of the user information database 13a includes a plurality of columns, for example, a “user ID” column, a “nickname” column, a “birth date” column, a “gender” column, an “email address” column, a “password” column, and the like. The “user ID” column and other columns are stored in association with each other. Each row stores information corresponding to each column. Although not shown in the figure, the user information database 13a further includes information related to the music registered as a song that the singer is good at, history information of the music selected by the singer, for example, the music ID of the selected music, and the past of the singer. The information regarding the singing evaluation result is stored.

  The user ID, e-mail address, and password are authentication information required when the user logs in to the karaoke system and uses various services. The nickname is a temporary name of the user, and the users of the karaoke system identify each other using the nickname. The password consists of multiple alphanumeric strings.

  The music database 13b shown in FIG. 4 stores music data distributed to the karaoke apparatus 4 and data related thereto. The music data and related data are stored in association with identification information unique to each music, that is, a music ID.

  The table of the music database 13b is composed of a plurality of columns, for example, a “song ID” column, a “song name” column, a “singer name” column, a “song data” column, a “genre” column, etc. The column and other columns are stored in association with each other. Each row stores information corresponding to each column. The song name is the name of the song, the singer name is the name of the song singer, the song data is the song data including the accompaniment data of the song, and the genre is the music field to which the song belongs or the type of the television program or movie in which the song is used. Examples of genres include J-POP, drama, animation, Japanese pop music, and enka.

  In the “music data” column, for example, accompaniment data, lyrics data, and main melody data are stored. The accompaniment data is, for example, MIDI data, data specifying on / off of a sound, pitch data specifying a pitch, volume data specifying a volume, control data of a musical instrument, tone color data specifying a musical instrument, output time of each sound It consists of time data that specifies the interval. The main melody data is composed of the melody of the sound to be sung in accordance with the accompaniment, that is, the data indicating the on / off of the sound constituting the main melody, the pitch data, the volume data, the time data indicating the output time interval of each on of the main melody, etc. ing.

  The background image database 13c illustrated in FIG. 5 stores background image data to be distributed to the karaoke apparatus 4. In the example shown in FIG. 5A, the background image data is stored in association with the music ID and the background image ID. That is, the background image data is selected based on the music ID and the background image ID. In the example shown in FIG. 5B, the background image data is stored in association with the singer name and the background image ID. That is, the background image data is selected by the singer name and the background image ID. In the example shown in FIG. 5C, the background image data is stored in association with the genre name and the background image ID. That is, the background image data is selected based on the genre name and the background image ID. Furthermore, a text display area (character string display area) is associated with the background image data. The text display area is defined by the XY coordinate system. Here, the text display area represented by (x1, y1) to (x2, y2) is a rectangle, the coordinate value of the upper left point of the rectangle is (x1, y1), and the lower right point of the rectangle. Is assumed to be (x2, y2). In addition, two rectangles are defined in the text display area with the music ID 528 and the background image ID 303, which means that two text display areas are set in one background image. . The shape of the text display area is not limited to a rectangle, but may be a balloon shape, a circle, or a heart shape.

FIG. 6 is an explanatory diagram showing an example of a background image.
In the present embodiment, it is assumed that the background image is a still image whose main part is an object such as a landscape, a building, a vehicle, a home appliance, or a work of art. In the present embodiment, one or a plurality of rectangular or balloon-shaped text display areas are set in advance for the object displayed in the photographed background image. The background image may be a moving image. For example, a building image appears in a fixed position in the background of a passer-by, such as a moving image of a city with a large building in the background and people walking on the road in front of the building. In such a case, a text display area may be set in advance on the outer surface of the building. In FIG. 6, for example, a white area in a building wall or bus body is a text display area. The text display area can be set by designating coordinate information individually for each image, or can be set by using known image processing software or an authoring tool. In the case of the background images shown in FIGS. 6A to 6F, billboards (20a to 20e) installed on the walls of the building, the mouth (20f) of the sculpture that shows a person, the facing pages (20g and 20h) of magazines, and A text display area is set on the outside (20j) of the bus body. Although the details will be described later, the user of the karaoke device 4, particularly the listener, uses the remote control device 5 and messages such as impressions, support, tweets, etc. regarding singing in the text display area while the singer is singing. Information can be written in real time.

  The advertisement database 13d stores advertisement information. The advertisement information includes, for example, new karaoke information that can be played by the karaoke device 4, information on the number of songs selected in a predetermined period, CD sales ranking in a predetermined period, food and drink sold in a karaoke store, and the like Price, contents of services or campaigns being implemented or scheduled to be implemented at karaoke stores.

FIG. 7 is a block diagram illustrating a configuration example of the karaoke apparatus.
The karaoke device 4 includes a control unit 40, ROM 41, RAM 42, storage device 43, communication unit 44, transmission / reception unit 45, image encoder 46a, image control circuit 46b, and image decoder 46c that control the operation of each component of the karaoke device 4. , A scoring unit 47, an audio encoder 48a, a sound source 48b, and an audio decoder 48c.

An image encoder 46a, an image control circuit 46b, and an image decoder 46c are connected to the image mixer 46d, and a scoring unit 47, an audio encoder 48a, a sound source 48b, and an audio decoder 48c are connected to the audio mixer 48d. Furthermore, the karaoke apparatus 4 has an image input terminal, an image output terminal, an audio input terminal, and an audio output terminal (not shown), and each of the terminals has an imaging device 46e, an image display device 46f, a microphone 48e, and a speaker 48f. Is connected.
The image display device 46f is, for example, a CRT, a liquid crystal display, a plasma display, an organic EL display, or the like.

The control unit 40 includes a CPU inside, and controls the karaoke device 4 in an integrated manner and controls transmission / reception of karaoke information between the central device 1 and the remote control device 5.
When a music piece is selected via the remote control device 5, the control unit 40 registers the selected music piece in a reserved music list provided in the RAM 42. Next, the control unit 40 reads the selected music data from the storage device 43 and stores it in the RAM 42 according to the performance order of the music registered in the reserved music list. Further, the control unit 40 reads the music data from the RAM 42 as the music performance progresses, and supplies the music data to the sound source 48b. Further, the control unit 40 controls the image decoder 46c to reproduce a predetermined background image and display it on the image display device 46f. Further, the control unit 40 reads new music information, music selection ranking, and advertisement data of the karaoke store from the advertisement database 43c of the storage device 43 and displays them on the image display device 46f between the songs or during the performance.

The ROM 41 is a memory such as a mask ROM or EEPROM that stores a control program necessary for the operation of the computer.
The RAM 42 is a memory such as a DRAM or SRAM that temporarily stores various data generated when the control unit 40 executes processing.

  The storage device 43 is a hard disk, a nonvolatile semiconductor memory, or the like that stores a computer program for causing a computer to function as the karaoke device 4. The storage device 43 is provided with a music database 43a for storing music data, a background image database 43b for storing background image data, and an advertisement database 43c for storing advertisement data. New music data, background image data, advertisement data, etc. are regularly distributed from the central device 1 to the karaoke device 4 and stored in the music database 43a, background image database 43b, and advertisement database 43c of the storage device 43. . The basic configuration of these databases is the same as that of various databases provided in the storage device 13 of the central apparatus 1.

The communication unit 44 transmits and receives karaoke information and information related to various karaoke services to and from other karaoke devices 4 and the central device 1 connected via the communication network N.
The transmission / reception unit 45 transmits / receives information to / from the remote control device 5 via a wired LAN or a wireless LAN. For example, the karaoke device 4 receives a music selection input from the remote operation device 5 via the transmission / reception unit 45, and transmits a command for causing the remote operation device 5 to execute a predetermined process. Note that the communication unit 44 can send and receive information to and from the remote control device 5 via the access point 33.

The image encoder 46a is a circuit that compresses and encodes image data output from the imaging device 46e and input through an image input terminal. The compressed and encoded image data is temporarily stored in the RAM 42 or the storage device 43. The The compression encoding format is, for example, MPEG, but is not particularly limited to this.
The image control circuit 46b reads out image information from the RAM 42 or the storage device 43, generates image data representing various images, and executes various control processes related to the image, such as giving the image data to the image mixer 46d. For example, at the time of reproduction of music data, the image control circuit 46b provides image data representing the lyrics to the image mixer 46d based on the lyrics data included in the music data. In addition, the image control circuit 46b gives the image mixer 46d image data representing a menu screen regarding the operation of the karaoke apparatus 4, a singing score display screen, and the like.
The image decoder 46c reads, for example, background image data displayed during singing from the background image database 43b of the storage device 43, decodes it, and provides the decoded image data to the image mixer 46d. The background image data is, for example, MPEG format data.
The image mixer 46d synthesizes all or any two of the images sent from the image control circuit 46b, the image decoder 46c, and the imaging device 46e, and the image data obtained by the synthesis to the image display device 46f. Output. The image display device 46f displays an image based on the image data output from the image mixer 46d.

  The scoring unit 47 acquires audio data output from the microphone 48e and input through the audio input terminal, reads out music data from the music database 43a of the storage device 43, and is based on the main melody data included in the audio data and the music data. Then, singing voice and the pitch, volume and rhythm in the main melody are evaluated, and the singing ability is scored in real time.

The audio encoder 48a acquires audio data output from the microphone 48e and input through an audio input terminal, and compresses and encodes the acquired audio data. The compression encoding format is, for example, MP3, AAC (Advanced Audio Coding), AC3 (Audio Code number 3), etc., but is not particularly limited thereto.
The sound source 48 b is a MIDI (Musical Instrument Digital Interface) sound source that creates audio data such as musical instrument performance signals based on music data read from the music database 43 a of the storage device 43. The audio data created by the sound source 48b is given to the audio mixer 48d.
The audio decoder 48c decodes the audio data read from the music database 43a of the RAM 42 or the storage device 43, and gives the audio data obtained by decoding to the audio mixer 48d.
The audio mixer 48d synthesizes audio based on the audio data sent from the sound source 48b and the audio decoder 48c, and outputs the audio data obtained by the synthesis to the speaker 48f through the audio output terminal. The speaker 48f emits sound based on the sound data output from the sound mixer 48d.

FIG. 8 is a block diagram illustrating a configuration example of the remote control device.
The remote operation device 5 includes a control unit 50, ROM 51, RAM 52, storage unit 53, transmission / reception unit 54, display control unit 55, and input control unit 59 that control the operation of each component of the remote operation device 5. Are connected via the bus 100 and transmit / receive data to / from each other. A touch panel display 56 is connected to the display control unit 55 and the input control unit 59. The touch panel display 56 includes a display device 57 that displays a predetermined image, and a touch panel 58 that allows a user to input characters and the like by touching the touch pen. The display control unit 55 controls display by the display device 57, and the input control unit 59 controls input by the touch panel 58.

The ROM 51 is a memory such as a mask ROM or EEPROM that stores a control program necessary for the operation of the computer.
The RAM 52 is a memory such as a DRAM or SRAM that temporarily stores various data generated when the control unit 50 executes processing.

  The storage unit 53 is a hard disk, a nonvolatile semiconductor memory, or the like that stores a computer program for causing a computer to function as the remote control device 5. Further, the storage unit 53 stores music selection guide information such as a song name, an artist name, and a singing portion of lyrics corresponding to each piece of music data stored in the music database 43a of the karaoke apparatus 4 for each music ID. Various databases such as a message information database for storing message information are provided.

  The control unit 50 reads the music selection guide information from the storage unit 53 and causes the touch panel 58 to display predetermined music selection guide information based on the music selection guide information via the display device 57. When the user performs music selection input on the touch panel 58 according to the music selection guide information displayed on the touch panel 58, the control unit 50 performs control for transmitting a music selection reservation signal for reserving a music to the karaoke apparatus 4. . Further, the control unit 50 executes message information reception / display control described later.

Next, the message information input screen and the thumbnail display screen that the display device 57 of the remote control device 5 shows to the user will be described.
The control unit 50 controls the music selection input to the karaoke apparatus 4 in accordance with the operation by the touch panel display 56 by the user. That is, the control unit 50 causes the display device 57 to display a predetermined music selection input screen using the display control unit 55. Next, the control unit 50 uses the input control unit 59 to receive an input of a music ID on the music selection input screen displayed on the touch panel 58 and transmits the received music ID to the karaoke apparatus 4. The transmitted music ID is stored as a reserved music number in a reserved music list formed in the RAM 42 of the karaoke apparatus 4.

When the start of the performance of the selected music is instructed, the control unit 10 of the karaoke device 4 searches the background image database 43b based on the music ID transmitted from the remote terminal device 5 and displays the background image on the display device 57. At the same time, the background image ID and the background image data associated with the music ID are transmitted to the remote operation device 5.
The control unit 50 of the remote operation device 5 creates a reduced image of the background image (hereinafter referred to as “thumbnail”) using the background image ID and the background image data transmitted from the karaoke device 4, and stores them in the RAM 52. Remember me. Next, when receiving a thumbnail display instruction via the touch panel 58, the control unit 50 reads the thumbnails from the RAM 52 and causes the display device 57 to display a list of thumbnails.
In the above example, the background image ID and the background image data are transmitted from the karaoke device 4 to the remote operation device 5. However, considering the processing load, storage capacity and communication load of the remote operation device 5, the karaoke device 4 The device 4 may create a thumbnail from the background image, associate the thumbnail with the background image ID of the background image corresponding to the thumbnail, and transmit the thumbnail to the remote control device 5.

FIG. 9 is an explanatory diagram showing an example of a thumbnail display screen for displaying a list of thumbnails.
On the thumbnail display screen, a list of thumbnails of a plurality of background images associated with a song of one song ID selected by the user using the remote terminal device 5 is arranged. In the case of the arrangement shown in FIG. 9, the background images are displayed on the image display device 46f in the order of the first leftmost image to the rightmost image in the thumbnail list, and then the second leftmost image to the rightmost image. Will be displayed. The user can confirm all the background images displayed on the image display device 46f while the selected music is being played by viewing the entire thumbnails. As described above, one or a plurality of rectangular or balloon-shaped text display areas are set in advance for the object displayed in the background image. In the case of the thumbnail display screen shown in FIG. 9, an image obtained by reducing the background image shown in FIG. 6 is displayed. Similar to the background image shown in FIG. 6, billboards (30a to 30e) installed on the wall of the building, the mouth of a sculpture representing a person (30f), a magazine spread page (30g, 30h), and a bus A text display area is displayed on the outside (30j) of the vehicle body. The user of the karaoke device 4 can write message information in the text display area in the background image corresponding to these thumbnails using the remote control device 5. Further, an image may be written by providing an image display area in the background image.
If all the thumbnails cannot be displayed simultaneously on a single display screen due to the large number of thumbnails associated with one song, the vertical scroll bar 70 provided at the right end of the thumbnail display screen is operated. All thumbnails can be viewed by scrolling down the entire thumbnail display screen.

  Further, when one thumbnail of the thumbnails displayed in FIG. 9 is enlarged and confirmed in detail, the thumbnail is enlarged and displayed on the display device 57 by touching the thumbnail with a touch pen.

  FIG. 10 is an explanatory diagram illustrating an example of a display screen on which one thumbnail is displayed in an enlarged manner. With this display screen, the user can confirm the details of the background image that is the basis of the one thumbnail.

  The user selects a thumbnail to which message information is written after confirming the thumbnail list of the background image and determines the message information to be written. The selected thumbnail can be enlarged and displayed as shown in FIG. Thereby, the user can estimate how long message information can be written from the size of the text display area 40a.

FIG. 11 is an explanatory diagram illustrating an example of a message information input screen displayed on the display device.
When inputting the message information, the control unit 50 causes the display device 57 to display a character button 60 for inputting message information composed of characters such as Japanese syllabary or alphabet through the display control unit 55. Next, the control unit 50 receives an input of a character corresponding to the character button through the touch panel 58 in response to the touch pen touching the character button 60. At that time, the control unit 50 displays the input message information on the display window 61 at the top of the screen. At the top of the display window is the title "Let's skip your favorite words in the karaoke image". When the touch pen touches the “send this word” button 62 at the lower right of the screen, the control unit 50 sends the message information and the background image ID displayed on the display window 61 to the karaoke apparatus 4. The karaoke device 4 that has received the message information transmitted from the remote operation device 5 synthesizes the message information with the text display area of the background image associated with the received background image ID and causes the display device 57 to display the message information. If there are a plurality of text display areas in one background image, an area ID is defined for each text display area, message information is input for each text display area corresponding to the area ID, and the area ID corresponds to the area ID. The message information corresponding to the area ID is synthesized for each text display area.

  The remote operation device 5 must transmit the message information to the karaoke device 4 before the background image to be combined with the message information is displayed on the image display device 46f. Since the remote operation device 5 stores time information for each music, that is, time information indicating the time at which each background image is displayed, the remote operation device 5 automatically transmits message information and a background image ID to the karaoke device 4. It may be.

  On the other hand, if the message information is not input to the remote control device 5 even after a predetermined time has elapsed, the text display area in the background image becomes blank. In this case, the karaoke device 4 synthesizes the advertisement information there, An image in which information is combined with a background image is displayed. That is, when the text display area is blank, the karaoke apparatus 4 reads out new music information, music selection ranking, karaoke store advertisement, etc. from the advertisement database 43c, and synthesizes and displays these information in the blank.

FIG. 12 to FIG. 14 are explanatory diagrams showing how the message information input to the remote control device is displayed in the text display area of the background image.
According to FIG. 12A, message information “I want to go to Shibuya” is inputted by operating the remote control device 5. The input message information is transmitted from the remote control device 5 to the karaoke device 4 and is synthesized in the text display area 20a of the background image as shown in FIG. 12B.
According to FIG. 13A, the remote control device 5 is operated, and the message information “It is almost time for sale” is input. The input message information is transmitted from the remote control device 5 to the karaoke device 4 and is synthesized in the text display area 20b of the background image as shown in FIG. 13B. On the other hand, since no message information is input to the text display area 20c of the background image, advertisement information related to the new music is synthesized.
According to FIG. 14A, no message information is input to the remote control device 5. Therefore, as shown in FIG. 14B, advertisement information related to the new music is synthesized in the text display areas 20d and 20e of the background image.

  As described above, the first embodiment is an embodiment in which a list of background images is displayed as thumbnails to indicate the progress of the background image to the user in advance and message information is written in advance.

FIGS. 15 to 17 are flowcharts showing a flow of processing for displaying message information received by the remote control device or advertisement information stored in advance in the karaoke device in the background image.
The control unit 50 of the remote control device 5 reads the music selection guide information from the storage unit 53 and displays the music selection guide information on the touch panel 58 via the display device 57 (step S11). As described above, in the storage unit 53 of the remote control device 5, music selection guide information such as a song name and an artist name is stored for each song ID corresponding to each piece of song data stored in the song database 43a of the karaoke device 4. ing.
The control unit 50 accepts music input by the user operating the touch panel 58 of the remote control device 5 in accordance with the music selection guide information displayed on the touch panel 58 (step S12).
The controller 50 transmits music request data including the music ID of the input music to the karaoke apparatus 4 (step S13).

  The control unit 40 of the karaoke device 4 receives the music request data including the music ID transmitted from the remote operation device 5 (step S14), and transmits the music request data to the central device 1 (step S15).

  The control unit 10 of the central device 1 receives the music request data transmitted from the karaoke device 4 (step S16), and stores the music data and background image data corresponding to the music ID included in the received music data in the storage device 13. Read from each of the music database 13b and the background image database 13c. Next, the control unit 10 transmits the read song data and background image data to the song requesting karaoke device 4 (step S17).

The control unit 40 of the karaoke device 4 receives the music data and the background image data transmitted from the central device 1 (step S18), and the music database 43a and the background image database 43b provided in the storage device 43 of the karaoke device 4 respectively. Remember me. In the music database 43a and the background image database 43b, the music data and its music ID, and the background image data and the background image ID are stored in association with each other.
Based on the music ID transmitted from the remote operation device 5, the control unit 40 reads the background image ID and the background image data associated with the music ID from the background image database 43b and transmits them to the remote operation device 5 ( Step S19). The background image is as shown in FIG. As described above, one or more text display areas are set in advance in the background image.

The control unit 50 of the remote operation device 5 receives the background image ID and the background image data transmitted from the karaoke device 4 (step S20), creates a thumbnail list of the background image using them, and stores them in the RAM 52. (Step S21).
When the control unit 50 receives a thumbnail display instruction from the user via the touch panel 58, the control unit 50 reads the thumbnail list from the RAM 52 and causes the display device 57 to display the thumbnail list (step S22). The thumbnail list is as shown in FIG.

  On the display device 57, a thumbnail list of background images associated with the music of one music ID selected by the user using the remote terminal device 5 is displayed side by side and vertically.

After confirming the background image thumbnail list, the control unit 50 accepts selection of one or a plurality of thumbnails for composing message information (step S23).
Next, the control unit 50 displays a message input screen on the display device 57 in accordance with a user instruction, and determines whether or not message information has been accepted by operating a character button included in the message input screen (step S24). ).
When the message information is accepted (step S24: YES), the control unit 50 temporarily stores the input message information and the background image ID of the background image with which the message information is combined in the RAM 52.
When a predetermined time has elapsed since the start of the karaoke performance, the control unit 50 reads the message information and the background image ID from the RAM 52 and transmits them to the karaoke apparatus 4 (step S25).
The control unit 40 of the karaoke apparatus 4 searches the background image database 43b and acquires coordinate information of the text display area associated with the background image ID (step S26).
The control unit 40 identifies a text display area based on the acquired coordinate information, synthesizes message information in the text display area (step S27), and displays it on the image display device 46f (step S28).

On the other hand, if the message information is not received even after a predetermined time has elapsed (step S24: NO), that is, if the user has not input the message information, the message information is not displayed in the text display area in the background image. Instead, advertisement information is displayed. That is, when no message information is input in the text display area, the control unit 40 of the karaoke apparatus 4 reads new music information, music selection ranking, and karaoke store advertisement information from the advertisement database 43c (step S30).
The control unit 40 searches the background image database 43b and acquires coordinate information of the text display area associated with the background image ID (step S31).
The control unit 40 identifies a text display area based on the acquired coordinate information, synthesizes advertisement information in the text display area (step S32), and displays it on the image display device 46f (step S33).

Embodiment 2
The remote control device 5 stores time information indicating the time until each background image is displayed for each music piece. Therefore, in the second embodiment, a configuration is shown in which the user is shown how many seconds later each background image is displayed on the image display device 46f as the music progresses.

FIG. 18 is an explanatory diagram showing an example of a background image selection screen displayed on the remote control device after the start of karaoke performance.
A window screen 80 including a plurality of thumbnails is provided at the top of the background image selection screen. In the window screen 80, thumbnails are arranged in a horizontal row. On the image display device 46f, the background image corresponding to the left thumbnail and the background image corresponding to the right thumbnail are displayed on the image display device 46f in this order. Further, the thumbnails in the window screen 80 can be scrolled to the right by operating the horizontal scroll bar. Further, the thumbnail of the background image that has been displayed on the image display device 46f is deleted from the window screen 80.

  In the figure, time information “display after 50 seconds” below thumbnail 80a, “display after 1 minute 30 seconds” below background image 80b, and “display after 2 minutes 25 seconds” below background image 80c. Is displayed. These pieces of time information indicate the time until the background image is displayed on the image display device 46f. The user who inputs the message information selects one thumbnail from the thumbnails in the window screen 80 with reference to the thumbnails displayed in the window screen 80 and the time information corresponding to the thumbnails. The selected thumbnail corresponds to a background image into which message information is written. The thumbnail can be selected by specifying with a touch pen.

FIG. 19 is an explanatory diagram illustrating an example of a message information input screen for inputting message information to the background image selected on the background image selection screen.
The thumbnail of the background image selected on the background image selection screen is displayed on the upper left of the message information input screen, and the time until the background image is displayed on the image display device 46f is displayed on the upper right of the screen. Is displayed. The other screen layout is the same as the message information input screen shown in FIG. The user who inputs the message information checks the time displayed on the upper right of the message information input screen, inputs the message information before the background image is displayed on the image display device 46f, and sends the message information to the karaoke device 4. Complete the transmission.

FIG. 20 is an explanatory diagram schematically illustrating an example of a thumbnail database provided in the storage unit of the remote control device.
The control unit 50 of the remote control device 5 refers to the information stored in the thumbnail database and controls the display of the above thumbnails.

  The record layout of the thumbnail database shown in FIG. 20 includes a plurality of columns, for example, a “song ID” column, a “thumbnail ID” column, a “text display area” column, a “display time zone” column, and the like. The “ID” column and other columns are stored in association with each other. In the example illustrated in FIG. 20, a song having a song ID “01” is associated with a thumbnail having thumbnail IDs “0101” to “0120”. This indicates that 20 thumbnails are displayed in the window screen 80 during the performance of the music having the music ID “01”. Furthermore, each thumbnail having the thumbnail IDs “0101” to “0120” is associated with a text display area and a display time zone. For example, in the case of a thumbnail whose thumbnail ID is “0101”, the text display area is (x1, y1) to (x2, y2), and the display time zone is 0 minutes 0 seconds to 0 minutes 30 seconds. This is because the thumbnail includes one rectangular text display area defined by the coordinate information of (x1, y1) to (x2, y2), and a background image corresponding to the thumbnail is displayed as an image. The time displayed on the device 46f indicates that it is 30 seconds from the start time of the song. The control unit 50 of the remote operation device 5 reads the above information from the thumbnail database, and controls the display device 57 according to the read information.

FIG. 21 is a flowchart showing a flow of processing relating to reception of message information in the remote operation device.
When the performance of the music is started, the control unit 50 of the remote operation device 5 refers to the “music ID” column and the “thumbnail ID” column in the thumbnail database, and displays a thumbnail that can be displayed corresponding to the music in the RAM 52. (Step S50). Further, the control unit 50 refers to the “display time zone” column in the thumbnail database, and sets the time (remaining time) until the background image corresponding to the thumbnail is displayed on the display device 46 f of the karaoke device 4 for each thumbnail. (Step S51).

Next, the control unit 50 displays the thumbnail read in step S50 and the time calculated in step S51 on the background image selection screen described above (step S52).
The control unit 50 determines whether or not the selection of the background image by the user of the remote operation device 5 has been accepted (step S53). If the selection has been accepted (step S53: YES), the control unit 50 proceeds to the process of step S54 and selects the selection. If not accepted (step S53: NO), the process returns to step S51.
When the selection is received, the control unit 50 receives the message information (step S54), and transmits the received message information and the background image ID of the background image corresponding to the selected thumbnail to the karaoke apparatus 4 (step S55).
The karaoke apparatus 4 that has received the message information and the background image ID combines the message information with the text display area of the background image having the background image ID.

  In the second embodiment, the remote control device 5 displays time information indicating the time from when the music performance is started until each background image is displayed on the display device 57 together with the thumbnail of each background image. Therefore, the user of the remote control device 5 can input the message information while confirming the time information and the thumbnail.

Embodiment 3
Since the karaoke system according to the third embodiment is different from the first embodiment in that the karaoke device is provided with a touch panel display, accepts input of message information on the touch panel display, and displays a background image obtained by synthesizing the message. Below, the said difference is mainly demonstrated.
FIG. 22 is a block diagram illustrating a configuration example of the karaoke apparatus 4 according to the third embodiment. The karaoke apparatus 4 according to the third embodiment has the same configuration as that of the first embodiment, and further includes a touch panel display 46g. The touch panel display 46g is connected to the bus and includes a display unit 46h that displays a background image and the like, and a touch panel 46i that is arranged on the front surface of the display unit 46h and receives character string data. The control unit 40 performs image display by the display unit 46h and character string data reception processing by the touch panel 46i.

  FIG. 23 to FIG. 25 are flowcharts showing a processing procedure of the control unit 40 related to message information display in the third embodiment, and FIG. 26 is an explanatory diagram showing a message information display method in the third embodiment. Here, the processing related to the display of message information will be described from the start of the performance of a karaoke song.

  The control unit 40 starts reproduction of the music data designated by the user and transmitted from the central apparatus 11 and the background image data corresponding to the music data (step S71). Then, the control unit 40 transmits the background image ID and background image data associated with the music ID of the music being reproduced to the remote operation device 5 (step S72). The background image data transmitted here may be any thumbnail image data of the background image. Of course, the background image data itself may be transmitted to the remote control device 5.

  The control unit 50 of the remote operation device 5 receives the background image ID and the background image data transmitted from the karaoke device 4 (step S73). The RAM 52 stores the received background image ID and background image data.

  The control unit 50 monitors the operation state of the touch panel 58, and determines whether or not a thumbnail display instruction has been received from the user (step S74). If it is determined that an instruction for thumbnail display has been received (step S74: YES), the control unit 50 creates a thumbnail list of background images based on the background image data received in step S73 (step S75), and the created thumbnails. The list is displayed on the display device 57 (step S76).

  Next, the control unit 50 accepts selection of one or more thumbnails for compositing message information on the touch panel 58 (step S77). When the message information is input, the control unit 50 transmits the received message information and the background image ID of the background image with which the message information is combined to the karaoke apparatus 4 (step S78).

  The control unit 40 of the karaoke device 4 receives the message information and the background image ID transmitted from the remote operation device 5 (step S79).

  On the other hand, the control unit 40 of the karaoke apparatus 4 monitors the operation state of its own touch panel 46i, and determines whether or not a thumbnail display instruction has been received from the user (step S80). For convenience of explanation, in FIG. 23 and FIG. 24, when the process of step S79 is completed, or when it is determined in step S74 that an instruction for thumbnail display has not been received (step S74: NO), the control unit 40 performs the step. Although the process in which the process of S80 is executed is depicted, it goes without saying that the message information reception process by the remote control device 5 and the message information reception process by the karaoke apparatus 4 described later are in reverse order or in parallel. You may go.

  If it is determined that an instruction to display thumbnails has been received (step S80: YES), a thumbnail list of background images is created based on the background image data (step S81), and the created thumbnail list is displayed on the display unit 46h (step S81). S82). And the control part 40 receives selection of the 1 or several thumbnail which synthesize | combines message information with the touch panel 46i (step S83). When the message information is input, the control unit 40 associates the received message information with the background image ID of the background image with which the message information is combined and stores it in the RAM 42.

  When the process of step S83 is completed, or when it is determined in step S80 that an instruction for thumbnail display has not been received (step S80: NO), the control unit 40 searches the background image database 43b and uses the background image ID. The coordinate information of the text display area is acquired (step S84). Next, the control unit 40 determines whether there is message information to be combined with the background image to be reproduced (step S85). Specifically, the control unit 40 determines whether or not the RAM 42 stores message information associated with the background image ID of the background image to be reproduced. That is, the control unit 40 determines whether there is message information received by either the remote operation device 5 or the karaoke device 4.

  If it is determined that there is message information (step S85: YES), the control unit 40 identifies the text display area based on the coordinate information acquired in step S84, and synthesizes the message information in the text display area (step S86). The image is displayed on the image display device 46f (step S87).

  Next, the control unit 40 determines whether or not the size of the character when the message information is combined with the text display area exceeds a predetermined point (step S88). The predetermined point is that when the character string of the message information is synthesized in the text display area and displayed on the display unit 46h of the karaoke apparatus 4, the character string becomes too small and it becomes difficult for the user to check the message. A value indicating the size of the character.

  When it is determined that the character size when the message information is combined with the text display area is equal to or less than the predetermined point (step S88: NO), the control unit 40 expands the text display area (step S89), and FIG. As shown, the message information is synthesized in the enlarged text display area (step S90) and displayed on the display unit 46h of the karaoke apparatus 4 (step S91). If it is determined in step S88 that the character of the message information exceeds a predetermined point (step S88: YES), the control unit 40 synthesizes the message information in the standard text display area (step S90), The information is displayed on the display unit 46h (step S91).

  When it determines with there being no message information at step S85 (step S85: NO), the control part 40 reads the new music information, music selection ranking, and advertisement information of a karaoke store from the advertisement database 43c (step S92). And the control part 40 specifies a text display area based on the coordinate information acquired by step S84, and synthesize | combines advertisement information with the specified text display area (step S93). Next, the control unit 40 displays the background image combined with the advertisement information on the image display device 46f (step S94).

  Next, the control unit 40 determines whether or not the size of the advertisement character when the advertisement information is combined with the text display area exceeds a predetermined point (step S95). The predetermined point is that when a character string of the advertisement information is synthesized in the text display area and displayed on the display unit 46h of the karaoke apparatus 4, the character string becomes too small and it is difficult for the user to check the advertisement information. This value indicates the size of a large character.

  When it is determined that the character size when the advertisement information is combined with the text display area is equal to or less than the predetermined point (step S95: NO), the control unit 40 expands the text display area (step S96). Advertisement information is synthesized in the text display area (step S97) and displayed on the display unit 46h of the karaoke apparatus 4 (step S98). If it is determined in step S95 that the character of the advertisement information exceeds a predetermined point (step S95: YES), the control unit 40 synthesizes the advertisement information with the standard text display area (step S97). The information is displayed on the display unit 46h (step S98).

  When the process of step S91 or step S98 related to the display of the message information or the advertisement information is finished, the control unit 40 determines whether or not the music reproduction is finished (step S99). If it is determined that the music reproduction has not ended (step S99: NO), the control unit 40 returns the process to step S72, and executes a display process of message information and advertisement information. If it is determined that the music reproduction has ended (step S99: YES), the control unit 40 ends the process.

  Thus, according to the karaoke system according to Embodiment 3, the user inputs message information using not only the remote control device 5 but also the touch panel display 46g of the karaoke device 4, the image display device 46f, Message information can be displayed on both the display unit 46h of the apparatus 4.

Further, when the background image combined with the message information or the advertisement information is displayed on the display unit 46 h of the karaoke device 4, the text display area is enlarged so that characters are displayed larger. Even if the size of the display unit 46h is smaller than that of the image display device 46f, as shown in FIG. 26, message information and advertisement information can be displayed in a size that is easy to see.
In the third embodiment, the example in which the character information is received and displayed using the touch panel display 46g of the karaoke apparatus 4 as a modification of the first embodiment has been described. Also, the character information may be received and displayed by the touch panel display 46g of the karaoke apparatus 4.

Embodiment 4
Since the karaoke system according to Embodiment 4 differs from Embodiment 3 in the display method of message information and advertisement information, the above differences will be mainly described below. The configuration of the karaoke apparatus 4 is the same as that of the third embodiment.

  27 and 28 are flowcharts showing the processing procedure of the control unit 40 related to message display in the fourth embodiment, and FIGS. 29 and 30 are explanatory diagrams showing message information display methods in the fourth embodiment. is there. Here, the processing procedure of the part where the performance of the karaoke song is started and the message information or the advertisement information is synthesized and displayed on the background image will be described. Specifically, an example will be described in which the control unit 40 executes the processes of steps S111 to S126 after the process of step S83 of FIG. The processing from step S71 to step 83 is the same as in the third embodiment.

  The control unit 40 that has started the karaoke music and finished the message information receiving process searches the background image database 43b, and acquires the coordinate information of the text display area using the background image ID of the background image being reproduced. (Step S111). Moreover, the control part 40 reads advertisement information from the advertisement database 43c (step S112).

  Next, the control unit 40 determines whether there is message information to be combined with the background image to be reproduced (step S113). If it is determined that there is message information to be combined (step S113: YES), the control unit 40 searches the advertisement database 43c and determines whether there is advertisement information to be combined (step S114). If advertisement information to be displayed is always prepared, the process of step S114 is not necessary.

  If it is determined that there is advertisement information to be combined (step S114: YES), the control unit 40 searches the background image database 43b and determines whether there are a plurality of text display areas associated with the background image ID. Determination is made (step S115). When it is determined that there are not a plurality of text display areas, that is, when it is determined that there is only one text display area (step S115: NO), the control unit 40 determines the text display area based on the coordinate information acquired in step S111. The message information is combined with the specified text display area (step S116), and the background image combined with the message information is displayed on the image display device 46f (step S117). Further, the control unit 40 combines the advertisement information with the text display area (step S118), and displays the background image combined with the advertisement information on the display unit 46h of the karaoke apparatus 4 (step S119). As a result of the processing in steps S116 to S119, when message information and advertisement information exist and there is only one text display area, the message information is synthesized in the image display device 46f as shown in FIG. A background image is displayed, and the background image combined with the advertisement information is displayed on the display unit 46 h of the karaoke apparatus 4.

  Returning to FIG. 27, when it is determined in step S115 that there are a plurality of text display areas (step S115: YES), the control unit 40 specifies the text display area based on the coordinate information acquired in step S111. Message information and advertisement information are synthesized in a plurality of text display areas (step S120), and a background image in which the information is synthesized is displayed on the image display device 46f and the display unit 46h of the karaoke device 4 (step S121). When the message information and the advertisement information are present and there are a plurality of text areas, the message information is synthesized in some text display areas as shown in FIG. In the text display area, the background image combined with the advertisement information is displayed on the image display device 46 f and the display unit 46 h of the karaoke device 4.

  On the other hand, when it determines with there being no advertisement information at step S114 (step S114), the control part 40 specifies a text display area based on the coordinate information acquired at step S111, and synthesize | combines message information with the specified text display area. The background image combined with the message information is displayed on the image display device 46f and the display unit 46h of the karaoke device 4 (step S123).

  If it is determined in step S113 that there is no message information (step S113: NO), the control unit 40 searches the advertisement information database and determines whether there is advertisement information to be synthesized (step S124). . If advertisement information to be displayed is always prepared, the process of step S124 is not necessary.

  If it is determined that there is advertisement information (step S124: YES), the control unit 40 identifies the text display area based on the coordinate information acquired in step S111, and synthesizes the advertisement information with the identified text display area (step S124). In step S125, the background image combined with the advertisement information is displayed on the image display device 46f and the display unit 46h (step S126).

  When it determines with there being no advertisement information by step S124 (step S124: NO), when the process of step S119, step S121, step S123, or step S126 is complete | finished, the control part 40 determines whether music reproduction was complete | finished. Is determined (step S127). When it is determined that the music reproduction has not ended (step S127: NO), the control unit 40 returns the process to step S72 and executes the display process of message information and advertisement information, as in the third embodiment. When it determines with music reproduction having been complete | finished (step S127: YES), the control part 40 complete | finishes a process.

  According to the karaoke system according to the fourth embodiment, the message information is synthesized when the number of text display areas is one in spite of the message information to be synthesized and the advertisement information. The displayed background image can be displayed on the image display device 46f, and the background image combined with the advertisement information can be displayed on the display unit 46h of the karaoke device 4.

  The background image combined with the message information may be displayed on the display unit 46h of the karaoke apparatus 4, and the background image combined with the advertisement information may be displayed on the image display apparatus 46f.

  Further, when message information or advertisement information is displayed on the display unit 46h of the karaoke apparatus 4, the text display area may be enlarged and the message information or advertisement information may be combined as in the third embodiment. .

  Further, when message information or advertisement information is displayed on the display unit 46h of the karaoke apparatus 4, the advertisement information or message information may be scroll-displayed when characters are below a predetermined point.

  Furthermore, the karaoke device 4 accepts priority information indicating which of the image display device 46f or the display unit 46h of the karaoke device 4 should preferentially display the message information or the advertisement information, and the image according to the received priority information. The message information and the advertisement information may be displayed on either the display device 46f or the display unit 46h of the karaoke device 4. Further, when there is only one text display area, the message information and the advertisement information may be displayed sequentially.

Embodiment 5
FIG. 31 is a flowchart showing a processing procedure of the control unit 40 relating to display of a message at the time of fast-forwarding or stopping the performance, and FIGS. 32 to 34 are explanatory diagrams showing a method of displaying a message at the time of fast-forwarding or stopping the performance. . Here, a description will be given of a processing procedure relating to display of message information when karaoke music performance is started and fast stop and performance stop processing is performed. Specifically, an example in which the control unit 40 executes the processes of steps S151 to 161 after the process of step S98 of FIG. 25 is completed will be described. The processing from step S71 to step S98 is the same as that in the third embodiment.

  The control unit 40 of the karaoke device 4 monitors the operation content for the remote operation device 5 via the communication unit 44, and determines whether or not a fast-forward instruction has been input to the remote operation device 5 (step S151). . If it is determined that a fast-forward operation has been input (step S151: YES), the control unit 40 determines whether there is message information to be combined with the fast-forwarded background image (step S152). Specifically, the control unit 40 determines whether or not the RAM 42 stores message information associated with the background image ID of the background image to be reproduced.

  If it is determined that there is message information to be synthesized in the background image (step S152: YES), the control unit 40 creates a list of message information that should have been synthesized (step S153), as shown in FIG. A list of message information is displayed on the display unit 46h of the karaoke apparatus 4 (step S154). That is, message information that cannot be displayed by being combined with the background image because of fast-forward playback is displayed as a list on the display unit 46 h of the karaoke apparatus 4.

  When it determines with there being no message information (step S152: NO), the control part 40 reads advertisement information from the advertisement database 13d (step S155), and displays the read advertisement information on the karaoke apparatus 4 as shown in FIG. This is displayed on the part 46h (step S156).

  When the process of step S154 or step S156 is completed, the control unit 40 determines whether or not the performance of the fast-forwarded karaoke piece has been resumed (step S157). When it is determined that the performance has not been resumed (step S157: NO), the control unit 40 returns the process to step S152. When it is determined that the performance has been resumed (step S157: YES), or when it has been determined in step S151 that fast-forwarding has not been performed (step S151: NO), the control unit 40 inputs an instruction to stop the performance to the remote control device 5. It is determined whether or not it has been done (step S158). If it is determined that an instruction to stop performance has been input (step S158: YES), the control unit 40 creates a list of undisplayed messages (step S159), and creates the list of undisplayed messages as shown in FIG. Is displayed on the display unit 46h of the karaoke apparatus 4 (step S160), and the process ends. Note that the already displayed message information may be displayed together with the undisplayed message information. Further, when displaying already-displayed message information and non-displayed message information, it is preferable that the already-displayed message information and the non-displayed message information are displayed in different display modes.

  When it determines with the performance stop instruction | indication not being input by step S158 (step S158: NO), the control part 40 determines whether music reproduction was complete | finished (step S161). When it is determined that the music reproduction has not ended (step S161: NO), the control unit 40 returns the process to step S72 and executes the display process of message information and advertisement information, as in the third embodiment. When it determines with music reproduction having been complete | finished (step S161: YES), the control part 40 complete | finishes a process.

  According to the karaoke system according to the fifth embodiment, although the message information is input, the message information that has lost the opportunity to be combined with the background video due to fast-forwarding or stopping of the karaoke music is displayed on the display unit 46h of the karaoke apparatus 4. Can be displayed.

In the above-described embodiment, an example in which a list of message information is displayed has been described. However, message information may be displayed in a slide show format.
A list of message information may be displayed on the image display device 46f.

Embodiment 6
35 and 36 are flowcharts showing the processing procedure of the control unit 40 related to the display of message information in the sixth embodiment, and FIG. 37 is an explanatory diagram showing a message information display method in the sixth embodiment. Here, the processing procedure of the part where the performance of the karaoke song is started and the message information or the advertisement information is synthesized and displayed on the background image will be described. Specifically, an example will be described in which the control unit 40 executes the processes of steps S211 to 228 after the process of step S83 of FIG. The processing from step S71 to step 83 is the same as in the third embodiment.

  The control unit 40 that has started the karaoke music and finished the message information receiving process searches the background image database 43b, and acquires the coordinate information of the text display area using the background image ID of the background image being reproduced. (Step S211).

  Next, the control unit 40 determines whether there is message information to be combined with the background image to be reproduced (step S212). If it is determined that there is message information to be synthesized (step S212: YES), the control unit 40 searches the background image database 43b, identifies the number of text display areas associated with the background image ID, and stores the message information. It is determined whether or not the number is larger than the number of text display areas (step S213). For example, when message information is received from a plurality of users for a background image having only one text display area, the number of message information is larger than the number of text display areas.

  When it is determined that the number of message information is larger than the number of text display areas (step S213: YES), the control unit 40 combines a part of message information with the text display area (step S214). The background image combined with the message information is displayed on the image display device 46f (step S215). Next, the control unit 40 combines other message information with the text display area (step S216), and displays the background image combined with the other message information on the display unit 46h of the karaoke apparatus 4 (step S217). Even when the number of text display areas for displaying message information is insufficient, as shown in FIG. 37, some message information is displayed on the image display device 46f by the processing in steps S214 to S217. Is displayed on the display unit 46 h of the karaoke apparatus 4. In FIG. 37, an example in which two messages are displayed on the image display device 46f and the display unit 46h of the karaoke device 4 has been described. However, when there are three or more message information, there are two or more text display areas. Even in this case, the message information should be sorted and displayed in the same manner.

  When it is determined in step S213 that the number of messages is equal to or less than the number of text display areas (step S213: NO), the control unit 40 determines whether the number of message information is equal to the number of text display areas (step S213). S218). When it is determined that the number of message information and the number of text display areas are equal (step S218: YES), the control unit 40 combines the message information with the text display area (step S219), and the message information is combined. The background image is displayed on the image display device 46f and the display unit 46h of the karaoke device 4 (step S220).

  When it is determined in step S218 that the number of messages is not equal to the number of text display areas (step S218: NO), the control unit 40 determines whether or not the number of text display areas is larger than the number of message information. (Step S221). When it determines with the number of text display areas being larger than the number of message information (step S221: YES), the control part 40 reads advertisement information from the advertisement database 43c (step S222), message information and a text display area are read. The advertisement information is combined (step S223), and the background image combined with each information is displayed on the image display device 46f and the display unit 46h of the karaoke device 4 (step S224).

  On the other hand, when it is determined in step S212 shown in FIG. 35 that there is no message information (step S212: NO), as shown in FIG. 36, the control unit 40 reads the advertisement information from the advertisement database 43c (step S225) and displays the text. The advertisement information is combined with the area (step S226), and the background image combined with the advertisement information is displayed on the image display device 46f and the display unit 46h of the karaoke device 4 (step S227).

  When it is determined in step S221 that the number of text display areas is smaller than the number of message information (step S221: NO), when the process of step S217, step S220, step S224, or step S227 is completed, the control unit 40 Then, it is determined whether or not the music reproduction has ended (step S228). If it is determined that the music reproduction has not ended (step S228: NO), the control unit 40 returns the process to step S72 and executes the display process of message information and advertisement information, as in the third embodiment. When it determines with music reproduction having been complete | finished (step S228: YES), the control part 40 complete | finishes a process.

  According to the karaoke system according to the sixth embodiment, when a plurality of message information is received for one text display area, the background image combined with the one message information is displayed on the image display device 46f, and the other The background images combined with the message information can be respectively displayed on the display unit 46h of the karaoke apparatus 4.

Embodiment 7
38 and 39 are flowcharts showing the processing procedure of the control unit 40 related to the display of message information, and FIG. 40 is an explanatory diagram showing an example of a thumbnail display screen according to the seventh embodiment. Here, a processing part related to reception of message information will be described. Specifically, instead of the processes in steps S73 to S84 in the third embodiment, processes in steps S251 to 266 described later are executed.

  The second control of the remote operation device 5 receives the background image ID and the background image data transmitted from the karaoke device 4 (step S251). The RAM 52 stores the received background image ID and background image data.

  The control unit 50 monitors the operation state of the touch panel 58, and determines whether or not a thumbnail display instruction has been received from the user (step S252). When it is determined that an instruction for thumbnail display has been received (step S252: YES), the control unit 50 requests the registered message information from the karaoke apparatus 4 (step S253).

  The control unit 40 of the karaoke device 4 transmits the registered message information and the background image ID associated with the message information to the remote operation device 5 in response to a request from the remote operation device 5 (step S254). . The registered message information means message information that is already input to the remote control device 5 or the karaoke device 4 and stored in the karaoke device 4 when the request in step S253 is received.

  The control unit 50 of the remote operation device 5 receives the registered message information and the background image ID transmitted from the karaoke device 4 (step S255). Then, the control unit 50 creates a thumbnail list of background images based on the background image data received in step S251 (step S256), and synthesizes the registered message received in step S255 with the corresponding thumbnail image (step S256). S257). Next, as shown in FIG. 40, the control unit 50 displays a thumbnail list in which the registered message information is combined on the display device 57 (step S258).

  Next, the control unit 50 accepts selection of one or a plurality of thumbnails for compositing message information on the touch panel 58 (step S259). When the message information is input, the control unit 50 transmits the received message information and the background image ID of the background image with which the message information is combined to the karaoke apparatus 4 (step S260).

  The control unit 40 of the karaoke device 4 receives the message information and the background image ID transmitted from the remote operation device 5 (step S261).

  On the other hand, the control unit 40 of the karaoke apparatus 4 monitors the operation state of its own touch panel 46i, and determines whether or not an instruction to display thumbnails has been received from the user (step S262). For convenience of explanation, when the process of step S261 is completed, or when it is determined in step S252 that a thumbnail display instruction has not been received (step S252: NO), the control unit 40 executes the process of step S261. The circumstances in which the process is depicted are the same as in the third embodiment.

  If it is determined that a thumbnail display instruction has been received (step S262: YES), the control unit 40 creates a thumbnail list of background images (step S263), and combines the registered message with the corresponding thumbnail image (step S264). . Then, as shown in FIG. 40, the control unit 40 displays the created thumbnail list on the display unit 46h (step S265). And the control part 40 receives selection of the 1 or several thumbnail which synthesize | combines message information with the touch panel 46i (step S266). When the message information is input, the control unit 40 associates the received message information with the background image ID of the background image with which the message information is combined and stores it in the RAM 42.

According to the karaoke system according to the seventh embodiment, it is possible to prevent a plurality of message information from being input to one text display area.
When the technique of the seventh embodiment is combined with the sixth embodiment and a plurality of pieces of message information are input to a single text display area almost simultaneously, they are input redundantly by the technique of the sixth embodiment. The message information may be displayed on the image display device 46f and the display unit 46h of the karaoke device 4 respectively.

Embodiment 8
The karaoke system according to the eighth embodiment is different from the above-described embodiment in that the karaoke system includes a power saving mode, and the configuration and other processing contents are the same as those of the above-described third to seventh embodiments. Display unit 46h provided in karaoke apparatus 2 according to Embodiment 8 has a function of adjusting brightness. For example, the display unit 46h includes a liquid crystal panel and a backlight that illuminates the liquid crystal panel, and the control unit 40 can adjust the brightness of the display unit 46h by controlling power supply to the backlight. it can. In the power saving mode, when the message information is not included in the image displayed on the display unit 46h, the display unit 46h is dimmed. When the message information is included, the display unit 46h is brightened. The operation of 46h is controlled.
In addition, although the example which changes the brightness of the display part 46h was demonstrated, when message information is not included in the image displayed on the display part 46h, when the display part 46h is turned off and message information is included The display unit 46h may be controlled to be turned on.

  It should be understood that the embodiment disclosed this time is illustrative in all respects and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

DESCRIPTION OF SYMBOLS 1 Central apparatus 2 Karaoke store 4 Karaoke apparatus 5 Remote operation apparatus 10 Control part 13 Storage apparatus 13a User information database 13b Music database 13d Advertising database 40 Control part 43 Storage apparatus 43a Music database 43b Background image database 43c Advertising database 50 Control part 53 Storage 56 Touch panel display 57 Display device 58 Touch panel

Claims (7)

A means for outputting a music selected from a plurality of music , a display, and an output of the music, which is associated with the music and includes an object, is displayed on the display and the external image display device. in the image reproducing apparatus and a display control means for performing control to display,
A reception means to receive the character string data,
A character string display area capable of displaying a character string corresponding to character string data is preset in at least one of the objects included in the image,
A determination means for determining whether or not the number of the character string data is larger than the number of the character string display areas;
The display control means includes
When the determination unit determines that the number of the character string data is larger than the number of the character string display areas, a part of the character string display area set in the object displayed on the image display device Character strings corresponding to the character string data are displayed, and character strings corresponding to the other character string data are displayed in a character string display area set in an object displayed on the display unit. An image playback device.   The determination means includes
  Further, it is determined whether or not the size of the character when the character string corresponding to the character string data is displayed in the character string display area exceeds a predetermined point,
  The display control means includes
  When the determination means determines that the predetermined point or less, the text display area displayed on the display unit is enlarged, and the character string is displayed in the enlarged text display area.
  The image reproducing apparatus according to claim 1, wherein: Storage means for storing character string data;
And a reading means for reading character string data from the storage means,
The display control means includes
Character string data corresponding to the character string data received by the receiving means is displayed in a character string display area set in an object displayed on the image display device, and read by the reading means. character string corresponding to the image reproducing apparatus according to claim 1 or 2, characterized in that it is constituted such that it is displayed on the set character string display region in an object to be displayed on the display unit. A means for outputting a music selected from a plurality of music , a display, and an output of the music, which is associated with the music and includes an object, is displayed on the display and the external image display device. in the image reproducing apparatus and a display control means for performing control to display,
A receiving means for receiving character string data;
A character string display area capable of displaying a character string corresponding to character string data is preset in at least one of the objects included in the image,
Wherein the display control unit,
A character string corresponding to the character string data received by the receiving unit, Ri Citea so as to display the set character string display region in the object,
In addition, an instruction to fast-forward or stop the reproduction of the image including the object is input,
The display control means includes
An image reproducing apparatus that displays a character string corresponding to character string data received by the receiving unit on the display unit when an instruction to fast-forward or stop reproduction is input . In a remote operation device for remotely operating an image playback device that outputs a music selected from a plurality of music,
A receiving means for receiving character string data;
Acquisition means for acquiring image data associated with a song from the image reproduction device ;
Creating means for creating a list of a plurality of reduced images obtained by reducing a plurality of images based on the image data acquired by the acquisition means;
Requesting means for requesting the image reproduction device for character string data associated with the reduced image;
Means for receiving the character string data transmitted from the image reproduction device in response to a request by the request means;
Display means for displaying a character string corresponding to the received character string data in a corresponding reduced image;
Selection means for selecting at least one of the reduced images from among the plurality of reduced image created by the creating means,
Means for associating an image corresponding to the reduced image selected by the selecting means with the character string data received by the receiving means;
A remote operation device comprising: transmission means for transmitting character string data. A means for outputting a music selected from a plurality of music , a display unit and an output of the music are displayed in association with the music and displayed on the display unit and an external image display device in association with the music. In an image reproduction system comprising: an image reproduction device comprising display control means for performing display control; and a remote operation device for remotely operating the image reproduction device and receiving data transmitted from the image reproduction device.
The remote control device is:
A receiving means for receiving character string data;
Means for transmitting the received character string data to the image reproduction device,
The image reproduction device includes:
Receiving means for receiving character string data transmitted from the remote control device;
A character string display area capable of displaying a character string corresponding to character string data is preset in at least one of the objects included in the image,
A determination means for determining whether or not the number of the character string data is larger than the number of the character string display areas;
The display control means includes
When the determination unit determines that the number of the character string data is larger than the number of the character string display areas, a part of the character string display area set in the object displayed on the image display device Character strings corresponding to the character string data are displayed, and character strings corresponding to the other character string data are displayed in a character string display area set in an object displayed on the display unit. Image playback system. Means for outputting a piece of music selected from a plurality of pieces of music, and an image playback apparatus provided with display control means for controlling the display of an image including an object in association with the piece of music in parallel with the output of the piece of music; In an image reproduction system comprising a remote operation device for remotely operating an image reproduction device and receiving data transmitted from the image reproduction device,
The image reproduction device includes:
Receiving means for receiving character string data transmitted from the remote control device;
A character string display area capable of displaying a character string corresponding to character string data is preset in at least one of the objects included in the image,
The display control means is configured to display a character string corresponding to the character string data received by the receiving means in a character string display area set in an object,
The remote control device is:
A receiving means for receiving character string data;
Acquisition means for acquiring image data associated with a song from the image reproduction device;
Creating means for creating a list of a plurality of reduced images obtained by reducing a plurality of images based on the image data acquired by the acquisition means;
Requesting means for requesting the image reproduction device for character string data associated with the reduced image;
With
The image reproduction device includes:
Means for transmitting character string data associated with the reduced image in response to a request by the request means;
The remote control device is:
Means for receiving the character string data transmitted from the image reproduction device in response to a request by the request means;
Display means for displaying a character string corresponding to the received character string data in a corresponding reduced image;
Selection means for selecting at least one of the reduced images from among the plurality of reduced image created by the creating means,
Means for associating an image corresponding to the reduced image selected by the selecting means with the character string data received by the receiving means;
Means for transmitting character string data to the image reproduction apparatus.

Images