JP6317609B2 - COMMUNICATION TERMINAL DEVICE, SERVER DEVICE, PROGRAM, DATA PROVIDING METHOD, AND KARAOKE SYSTEM - Google Patents

Description

  The present invention belongs to a technical field for a communication terminal device to acquire content data.

  2. Description of the Related Art In recent years, karaoke in which music data composed only of accompaniment (so-called karaoke music data) and a user sing along with the reproduced music data is recognized as an entertainment and hobby. Also, when reproducing karaoke music data, various images are widely reproduced as background images and displayed on a monitor or other display device together with lyrics.

  On the other hand, recently, along with the development of network technology such as WWW (World Wide Web) and the progress of portable information communication terminal devices represented by smartphones and the like, the portable information communication terminal device is linked with the karaoke device. Has been put into practical use. In particular, it has also been put into practical use that an image captured by a user is supplied to a karaoke apparatus and the supplied image is displayed as a background image when reproducing music data for karaoke.

Japanese Patent Laid-Open No. 2004-246075

  However, in the system described in Patent Document 1, there is a desire to use not only an image captured by a portable information communication terminal device but also an image provided on a network as a background image. However, further promotion of the use of portable information communication terminal devices and networks is also desired.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to easily use an image provided on a network by a karaoke system, and in the karaoke system, a portable information communication terminal device or a network An object of the present invention is to provide a communication terminal device and the like that can further promote the use of the device.

  In order to solve the above problems, the communication terminal device or the like according to the present invention is a communication terminal device that provides image data as image data to a karaoke system that reproduces an image when a song is played according to the song data. Recording control means for controlling the recording means in which the music information having the music related information indicating the information and the music text data associated with the music related information is recorded, and the text input by the user as the input text And at least one of music text data having a text including the received input text and music related information, and searching for music related information or corresponding music related information of the corresponding music text data. The specifying means for specifying, and the specified music related information as a key A search means for searching for an image provided on the network to the network, and a providing means for acquiring the data of the searched image as image data and providing the acquired image data to the karaoke system. have.

  With this configuration, the communication terminal device of the present invention can easily search for images provided on a network that is assumed to match the user's hobbies and preferences using information related to the user's karaoke, This image can be easily provided to the karaoke system, so that the use of the portable information communication terminal device and the network can be further promoted in the karaoke system.

  The communication terminal device or the like according to the present invention can easily search for images provided on a network that is assumed to match the user's hobbies and preferences, using information related to the user's karaoke, Since it can be simply provided to the karaoke system, the use of the portable information communication terminal device and the network can be further promoted in the karaoke system.

It is a system configuration figure showing the composition of one embodiment in the network system concerning the present invention. It is a block diagram which shows the structure of the portable terminal device of one Embodiment. It is a figure for demonstrating the search keyword determination process performed in the search process part of one Embodiment. It is a figure for demonstrating the setting process in 1st Embodiment. It is a block diagram which shows the structure of the data provision server apparatus of one Embodiment. It is a flowchart (the 1) which shows the operation | movement of the search keyword determination process performed in the search process part of one Embodiment. It is a flowchart (the 2) which shows operation | movement of the search keyword determination process performed in the search process part of one Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is for a karaoke linkage system that links a portable terminal device and a server device having a database in which karaoke information is recorded and provides image data retrieved by the portable terminal device to the karaoke system. In this embodiment, the communication terminal device, the server device, the program, and the karaoke system of the present invention are applied.

[1] Karaoke interlocking system First, a schematic configuration of the karaoke interlocking system 1 of the present embodiment will be described with reference to FIG.

  FIG. 1 is a system configuration diagram showing the configuration of the karaoke linkage system 1 in the present embodiment. In order to prevent the figure from becoming complicated, only some users are shown in FIG. That is, in the actual karaoke linkage system 1, there are a larger number of communication terminal devices than those displayed in FIG.

  The karaoke linkage system 1 according to the present embodiment is a system that provides image data retrieved and acquired by a user as karaoke image data to a karaoke system 50 that reproduces music according to music data.

  The karaoke linkage system 1 of this embodiment manages and provides a portable communication terminal device (hereinafter referred to as “portable terminal device”) 10 used by a user, a network 20, and various data. A data providing server device for karaoke (hereinafter referred to as “data providing server device”) 30, a karaoke system 50 installed in a store, facility, home or the like for performing karaoke, and when searching for image data And a search server device 60 to be used to realize the above system.

  The network 20 is configured, for example, by connecting a public telephone network including a mobile telephone network and an IP (Internet Protocol) network. However, the configuration of the network 20 is not limited to this.

  The portable terminal device 10 is a communication terminal device such as a portable phone, a tablet information communication terminal device, a smartphone, or a portable game device, and has a function of reproducing user sound source data held by the own device. Yes. The portable terminal device 10 has a function for searching and acquiring image data provided on the network 20 in conjunction with the data providing server device 30 and the search server device 60 connected via the network 20. Have.

  In addition, the portable terminal device 10 has various functions such as a voice call function and an e-mail transmission / reception function, and uses a markup language such as XML (extensible Markup Language) or JSON (Java Script (registered trademark) Object Notation). It has a browsing function that acquires the described resource data based on the URL, and searches for, acquires, displays, and communicates images based on the acquired resource data.

  Furthermore, the portable terminal device 10 has a remote control function that allows a karaoke system 50 to search and select a karaoke song by downloading a remote control application provided by a karaoke company. And it can be used as a remote control by tying it with a karaoke device used when using the karaoke system.

  And the portable terminal device 10 provides the karaoke system 50 which reproduces | regenerates an image at the time of the performance of the music according to music data, the process for providing the image data searched and acquired based on a user's instruction | indication (henceforth "" It is referred to as “karaoke image search acquisition processing”).

  In particular, when the portable terminal device 10 executes the karaoke image search acquisition process, the portable terminal device 10 determines a keyword (hereinafter referred to as “search keyword”) for searching for image data (hereinafter referred to as “search keyword determination”). Process ").

Specifically, the portable terminal device 10 includes a karaoke image search acquisition process including a search keyword determination process.
(1) Management of music information having music related information indicating information related to music data of the corresponding user and music text data associated with the music related information;
(2) Accept as input text of text entered by the user,
(3) Retrieval of at least one of music text data and text related information having text including accepted input text, and identification of music related information or corresponding music related information of corresponding music text data,
(4) In conjunction with the search server device 60, search for an image provided on the network using the specified music related information as a search keyword and acquisition as image data;
(5) Providing the acquired image data to the data providing server device 30 or the direct karaoke system 50 in association with the corresponding karaoke data,
It has the structure which performs each process of these.

  The data providing server device 30 includes a database (hereinafter referred to as “DB”) 300 in which karaoke data and data relating to music for playing karaoke registered for each user (hereinafter referred to as “music information”) are recorded. Have.

  In addition, the data providing server device 30 provides karaoke data to the karaoke device 50 in accordance with a request from the karaoke device 50, and associates it with each karaoke data in accordance with a user request input via the portable terminal device 10. Is recorded in the DB 300 as user music information together with the user's karaoke history in association with the corresponding user. The data providing server device 30 has a configuration for providing user music information and karaoke history information (hereinafter simply referred to as “history information”) to the portable terminal device 10.

The karaoke data is associated with the type of karaoke sound source,
(1) Sound source data for karaoke,
(2) telop data including lyric data for karaoke (hereinafter referred to as “lyric data”), display control data for controlling the display timing of the lyrics and the color change timing of the displayed lyrics,
(3) Music information and history information having music related information and music text data;
Is included.

The music related information includes
(A) Song name information indicating the song name;
(B) Artist information indicating the artist name;
(C) a music selection number for selecting music in the karaoke system 50 and others;
Is included. The music text data is, for example, tie-up information, which is text data relating to music, and tags and other metadata registered in advance by an administrator of the karaoke system 50, an administrator who manages karaoke data, or the like. Indicates.

  By having such a configuration, the karaoke interlocking system 1 of this embodiment mobile phone can easily search for images provided on the network 20 assumed to match the user's hobbies and preferences, and these Since the image can be easily provided to the karaoke system 50, the use of the portable terminal device or the network 20 can be further promoted in the karaoke system 50.

[2] Portable Terminal Device Next, the portable terminal device 10 of the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram showing a configuration of the portable terminal device 10 of the present embodiment.

  As illustrated in FIG. 2, the portable terminal device 10 according to the present embodiment includes a network communication unit 110 that is communicatively connected to the network 20, a display unit 140, and a display control unit 150 that controls display of images on the display unit 140. And a recording unit 160 in which data corresponding to various types of information is recorded, an operation unit 170, a terminal management control unit 180, and a timer 190.

  And the portable terminal device 10 performs the image search acquisition process for karaokes including the search keyword decision process for providing the searched image to the karaoke system 50 which reproduces | regenerates an image in the performance of the music according to music data. An application execution unit 100 is included.

  In addition, each part of the portable terminal device 10 is mutually connected by the bus | bath B, and is exchanging data. Further, the portable terminal device 10 has a configuration capable of executing a function corresponding to the portable terminal device 10 or the like in the case of a portable phone or a portable game machine.

  The network communication unit 110 is a predetermined network interface, and the data providing server device 30 or the karaoke system 50 connected to the network 20 via the base station BS under the control of the terminal management control unit 180 and the application execution unit 100 The communication terminal device is constructed with a communication line, and various data are exchanged with the data providing server device 30 or the karaoke system 50 and other communication terminal devices.

  The display unit 140 has an image display area of a predetermined size (for example, 5 inches, W480 × H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 150. A predetermined image is displayed based on the display data.

  The display control unit 150 generates drawing data necessary for causing the display unit 140 to draw a predetermined image under the control of the terminal management control unit 180 and the application execution unit 100, and the generated drawing data is displayed on the display unit 140. Output to.

  The recording unit 160 includes, for example, an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash memory.

  The recording unit 160 records various applications (hereinafter referred to as “apps”) for executing the karaoke image search acquisition process including the search keyword determination process, and user information is recorded. User information recording unit 162, a first buffer 163 for recording user song information acquired from the data providing server device 30 when executing the search keyword determination process, and image data acquired in the karaoke image search acquisition process And a RAM 165 functioning as a work area used during the execution of the karaoke image search / acquisition process.

  In particular, the user information recording unit 162 records various types of information required when the user of the portable terminal device 10 is linked to the karaoke system 50. For example, in the user information recording unit 162, an account and a user ID used when the user works with the karaoke system 50, and a login password (that is, a login password) are recorded. However, these pieces of information may not be recorded, and these pieces of information may be input via the operation unit 170 when performing karaoke image search acquisition processing and karaoke.

  Further, in the first buffer 163, there is music information relating to karaoke registered by the individual recorded in the DB 300 at a predetermined timing. Specifically, as described above, the music title information, artist information, and music selection number are stored in the first buffer 163. In addition to the above, user song information including song related information, song text data, and history information including the date and time when the song information was registered and the date and time used for karaoke is recorded.

  Further, the second buffer 164 records image data provided on the network 20 and in various formats. The image data to be recorded may be moving image data or still image data.

  The operation unit 170 is composed of various confirmation buttons, operation buttons for inputting each operation command, other keys, or touch sensors provided on the display unit 140 for executing those key functions. To be used. In particular, the operation unit 170 is used to input text when searching for image data.

  The terminal management control unit 180 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and general functions and information of the portable terminal device 10. Overall control of the general functions for executing the provided program.

  The application execution unit 100 is configured by an independent central processing unit (CPU), or is configured using the central processing unit (CPU) of the terminal management control unit 180, and is controlled by the terminal management control unit 180. The karaoke image search acquisition process including the search keyword determination process is executed by executing the application.

  Specifically, the application execution unit 100 records the music information in the first buffer 163 and manages the music information management unit 101, searches the user music information, and executes a search keyword determination process. 102, an image providing processing unit 103 that records image data acquired by searching based on the determined search keyword in the second buffer 164 and performs various processes for providing the image data to the karaoke system 50; Is realized.

  For example, the search processing unit 102 according to the present embodiment constitutes a recording control unit, an input reception unit, a specifying unit, and a search unit according to the present invention, and the image provision processing unit 103 constitutes a provision unit according to the present invention. Details of the application execution unit 100 and each unit according to this embodiment will be described later.

[3] Application Execution Unit Next, the application execution unit 100 of this embodiment will be described with reference to FIG. FIG. 3 is a diagram for explaining search keyword determination processing executed in the search processing unit 102 of the present embodiment.

  The music information management unit 101 acquires user music information together with history information from the data providing server device 30 at every predetermined timing (for example, every time a predetermined Web site is browsed) when executing the search keyword determination process. The acquired history information and user music information are recorded in the first buffer 163.

  In particular, when the music information management unit 101 accesses and logs in to the data providing server device 30 in order to execute the search keyword determination process, the music information management unit 101 searches the DB 300 using the user ID used for the login and the corresponding history. User music information is acquired together with the information.

  In addition to the music information management unit 101 and the image provision processing unit 103, the search processing unit 102 performs a search keyword determination process in the karaoke image search acquisition process in conjunction with the network communication unit 110, the display control unit 150, and the operation unit 170. Run.

  Specifically, in the search keyword determination process, the search processing unit 102 searches the first buffer 163 based on text data including one or more texts corresponding to characters input to the operation unit 170 by the user. The music related information or the music text data including the text data is detected. In particular, each time a character is input by the user, the search processing unit 102 searches the first buffer 163 to detect music related information or music text data including the text data.

  Then, the search processing unit 102 extracts the text of the song name and the artist name from the song related information recorded in association with the detected song related information or song text data, and uses the extracted text as an input candidate by the user. It is displayed on the display unit 140 so as to be selectable.

For example, as shown in FIG.
(1) As an arbitrarily assigned ID “001”, song related information composed of song name information “Aiueoa”, artist information “Sashisuseyo” and song selection number “123456”, and song text data “TV drama” (Ai no Sato) User song information having “theme song” and “beer (raw first)”,
(2) As the arbitrarily assigned ID “002”, music related information composed of music name information “Kakiku Keko”, artist information “Tatsuteai” and music selection number “112233”, and music text data “CM: User music information having “0.00 Cosmetics” and “Loving skin”
Assume that is recorded.

  In this case, if the search processing unit 102 detects that the user has input two characters “Ai” to the operation unit 170, the music related information of each piece of music information “001” and “002” and Since both of the music text data have text data “Ai” indicating the input character, both the music information “001” and “002” are detected.

  When the search processing unit 102 detects that one character “NO” is further input after the input of “AI” and three characters “AINO” is input to the operation unit 170 by the user, Since the text data “Aino” indicating the character input only in the music text data of the music information “001” is included, only the music information “001” is detected.

  Then, when the two characters are input, the search processing unit 102 has both the song name and the artist name in the song related information of the detected song information, that is, the song name information “Aiueoa” and the artist information “Sashisuseo”, The song name information “Kakikukeko” and artist information “Tatsuteai” are extracted as texts, and at the time of entering three characters, the song name information “Aiueoa” and artist information “Sashisuseyo” are used as texts. The extracted text is displayed on the display unit 140 so as to be selectable by the operation unit 170 as an input candidate.

  Further, when the search processing unit 102 detects that one text is selected from the input candidates displayed on the display unit 140, the search processing unit 102 determines the selected text, for example, “Aiueoa” as a search keyword, This is provided to the provision processing unit 103.

  On the other hand, if the search processing unit 102 determines that a predetermined number or more of music related information has been detected, the search processing unit 102 extracts music related information having a predetermined condition. That is, the search processing unit 102 extracts music related information having a predetermined condition based on the history information recorded in the first buffer 163 together with the user music information.

Specifically, in the history information, since the music that the user has used in karaoke in the past (that is, the karaoke that has been played) is registered along with the date and time, the search processing unit 102 has a predetermined number or more of music related information. If it is determined that
(A1) User-related music information recorded in the first buffer 163 is music-related information, and
(A2) The music related information registered in the history information is extracted.

Alternatively, instead of the above, the search processing unit 102 determines that the search processing unit 102 has detected a predetermined number or more of music related information.
(B1) Music related information in the user music information recorded in the first buffer 163, and
(B2) Based on the history information, music related information indicating that it has been used for karaoke after a predetermined period (one month before) from the current time is extracted.

  If it is determined that a predetermined number or more of music related information has been detected even when (B1) and (B2) are used, the search processing unit 102 assigns priorities to the date and time used for karaoke in the order of newest. Then, the assigned high priority items may be displayed on the display unit 140 as a predetermined number of input candidate lists.

  In the present embodiment, if the search processing unit 102 determines that a predetermined number or more of music related information has been detected, the search processing unit 102 replaces the history information or in addition to the history information as a “favorite” in advance. Information registered as user music information (hereinafter referred to as “favorite information”) or information registered in advance for singing in subsequent karaoke (hereinafter referred to as “reservation list information”) may be used. Good. That is, when the search processing unit 102 determines that a predetermined number or more of music related information has been detected, the music recorded in the favorite information or the reservation list information as music related information having a predetermined condition. Related information may be extracted.

  The image provision processing unit 103 executes karaoke image search acquisition processing based on the determined search keyword. Specifically, the image provision processing unit 103 works in conjunction with the search server device 60, collects image data provided on the network 20 based on the provided search keyword, and works in conjunction with the display control unit 150. The collected image data is displayed on the display unit 140.

  Then, the image provision processing unit 103, in conjunction with the operation unit 170, records one or more pieces of selected image data from the displayed image data in the second buffer 164 and also records them based on a user instruction. The image data is provided to the karaoke system 50 via the data providing server device 30.

  At this time, when a plurality of pieces of image data are collected and displayed on the display unit 140, the image provision processing unit 103 and the operation unit 170 (specifically, a touch sensor provided on the display unit 140) When the user presses and holds on the displayed specific image data, the display may be enlarged or displayed on the full screen.

  In addition, the image provision processing unit 103 performs processing such as decoration, trimming, rotation, or image correction on the acquired image data in conjunction with the operation unit 170 and the display control unit 150, and the processed image data is processed. The karaoke system 50 may be provided.

[4] Data Providing Server Device Next, the data providing server device 30 of the present embodiment will be described with reference to FIG. FIG. 4 is a block diagram illustrating a configuration of the data providing server device 30 according to the present embodiment.

  As shown in FIG. 4, the data providing server device 30 according to the present embodiment controls a communication control unit 310 connected to the network 20, a ROM / RAM 320 functioning as various memories, a DB 300, and the entire device. The server management control unit 350 and various pieces of information for providing the user's music information corresponding to the execution of the karaoke image search acquisition process and providing the karaoke system 50 with the image data acquired from the portable terminal device 10. A data processing unit 360 that executes processing, and the above-described units are connected to each other by a bus B.

The communication control unit 310 is a predetermined network interface, and exchanges data with the portable terminal device 10 and the data via the network 20.

  Various programs necessary for driving the data providing server device 30 are recorded in the ROM / RAM 320. The ROM / RAM 320 is used as a work area when the server management control unit 350 and the data processing unit 360 execute various processes.

  The DB 300 is configured by an HDD (Hard Disc Drive) or an SSD (Solid State Drive), and includes a karaoke data DB 301 in which each karaoke data is recorded in the recording area, and a user song information DB 302 in which song information for each user is recorded. And at least.

Each karaoke data provided to the karaoke system 50 when karaoke is executed is recorded in the karaoke data DB 301. Specifically, the karaoke data DB 301 is associated with identification information (hereinafter also referred to as “karaoke ID”) of karaoke music,
(1) Karaoke sound source data,
(2) telop data including lyrics data and display control data;
(3) song information including song name and other song related information and song text data;
Is recorded.

  In the user song information DB 302, song information recorded in the karaoke data DB 301 described above is recorded together with history information as user song information for each user ID for identifying a user. In other words, the user song information DB 302 stores user song information to be provided based on a request from the portable terminal device 10 based on the user ID and history information corresponding to the song information. In particular, as history information, the date and time used for karaoke and the number of times used are recorded.

  The user music information DB 302 stores image data obtained by searching for and acquiring each user, that is, in association with the user ID and music information (music ID).

  Note that a karaoke ID may be recorded in place of the music information in the user music information DB 302 of this embodiment mobile phone. In this case, when a user music information acquisition request is received from the portable terminal device 10, the karaoke data DB 301 is searched from the karaoke ID and the corresponding music information is provided.

  The server management control unit 350 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the data providing server device 30 by executing a program.

  The data processing unit 360 is linked with the portable terminal device 10 under the control of the server management control unit 350 and executes a predetermined application, whereby the corresponding data recorded in the user song information DB 302 in the karaoke image search acquisition process. A music information distribution unit 361 that provides user music information to be performed, and a karaoke data management unit 362 that provides karaoke data and image data when performing karaoke.

  The music information distribution unit 361 specifies the corresponding user based on the information related to the login to the data providing server device 30 based on the user music information acquisition request transmitted from the portable terminal device 10, and specifies The user's music information is read from the user music information DB 302 and transmitted to the corresponding portable terminal device 10.

  Based on the karaoke data transmission request from the karaoke system 50, the karaoke data management unit 362 transmits the corresponding karaoke data from the karaoke data recorded in the karaoke data DB 301, and transmits the transmission request based on the user ID. When received, the image data recorded in association with the corresponding user ID is transmitted to the karaoke system 50 together with the karaoke data.

  The karaoke system 50 can use the acquired image data as a background image when reproducing karaoke data. For example, when the karaoke system 50 uses a plurality of still image data as background images, the karaoke system 50 switches images at a predetermined timing (slide show), plays an interlude or other still image at a predetermined period (slide show). Or reproduction by various processes such as insertion timing and wipe of each image.

  However, the karaoke system 50 may be executed based on an operation instruction to the karaoke system 50 by the user for various reproductions, or may be automatically executed by executing a predetermined application.

[5] Operation of Search Keyword Determination Process Next, the operation of the search keyword determination process executed during the karaoke image search acquisition process in the portable terminal device 10 of the present embodiment will be described with reference to FIGS. 5 and 6. . 5 and 6 are flowcharts showing the operation of the search keyword determination process executed during the karaoke image search acquisition process in the portable terminal device 10 of the present embodiment.

  In this operation, it is assumed that user song information of the corresponding user has already been recorded in the DB 300. Further, in this operation, the search processing unit 102 of the portable terminal device 10 controls the display control unit 150 to display the login for the data providing server device 30 by the user while the login input is operated. Assume that it is waiting to be performed on unit 170.

  First, when the search processing unit 102 detects a user input operation input via the operation unit 170 (step S <b> 101), the search processing unit 102 executes a search keyword determination processing application and executes login to the data providing server device 30. And waiting for reception of the corresponding user music information (step S102).

  At this time, the search processing unit 102 is linked to the display control unit 150 and the operation unit 170 and receives input of information necessary for various logins such as a login password for logging in while accessing the data providing server device 30.

  In the data providing server device 30, when the login is successful based on various information for login received by the communication control unit 310, the music information distribution unit 361 selects a corresponding user based on the information related to login. Identify. Then, the music information distribution unit 361 reads the specified user's music information from the user music information DB 302 and transmits it to the corresponding portable terminal device 10.

  Next, upon receiving the user song information transmitted from the data providing server device 30 (step S103), the song information management unit 101 records the received user song information in the first buffer 163 (step S104).

  Next, the search processing unit 102 displays an image (keyword input instruction) that prompts keyword input for searching for image data on the display unit 140 in conjunction with the display control unit 150 and the operation unit 170 and waits for the input. (Step S105).

  Next, when the search processing unit 102 detects a text (one character) input by the user via the operation unit 170 (step S111), generation of text data of the input text or text has already been input. In this case, generation of text data (hereinafter referred to as “search text data”) is executed by adding the input text to the end of the already input text (step S112).

  Next, the search processing unit 102 searches for the user song information recorded in the first buffer 163 based on the generated search text data, and the song related information and the song having the text including the text constituted by the text data. Music related information related to the text data is detected (step S113).

  Next, the search processing unit 102 determines the presence or absence of the detected music related information (step S114). At this time, if the search processing unit 102 determines that there is detected music-related information, the search processing unit 102 proceeds to the process of step S115. If it is determined that there is no detected music-related information, the search processing unit 102 proceeds to the process of step S121. Transition.

  Next, when it is determined that there is detected music-related information in the process of step S114, the search processing unit 102 determines whether a predetermined number or more (for example, 3 or more) of music-related information has been detected. (Step S115).

  At this time, when the search processing unit 102 determines that a predetermined number or more of music related information has been detected, the search processing unit 102 proceeds to the process of step S116 and determines that the predetermined number or more of music related information has not been detected. In step S117, the process proceeds to step S117.

  Next, when the search processing unit 102 determines in the process of step S115 that a predetermined number or more of music related information has been detected, the search processing unit 102 selects music related information having a predetermined condition from the detected music related information. Extract (step S116).

Specifically, when the search processing unit 102 determines that a predetermined number or more of music related information has been detected, as a predetermined condition,
(1) Based on the history information, is the music related information of the music used for karaoke during a period from the predetermined period before the current time to the current time (for example, January before the current time),
(2) whether it is music related information registered as a user music information in a period from a predetermined period before the current time to the current time (for example, January before the current time), and (3) an artist name or “summer” Or if there is a certain number of common information in all user song information, such as part of the song name such as “Winter”, etc.
And narrow down to a predetermined number of pieces of music related information.

  Note that the search processing unit 102 may assign priorities to each of the above conditions, and may extract a predetermined upper number of music related information from the highest priority as music related information having a predetermined condition. .

  Next, if the search processing unit 102 determines that the predetermined number or more pieces of music information have not been detected in the process of step S115, all of the detected music related information or the upper level specified in the process of step S116 The texts such as the song name, artist name and broadcast program name included in the song related information are extracted (step S117).

  Next, the search processing unit 102 operates in conjunction with the display control unit 150 to display the extracted text on the display unit 140 as a list of input candidates, and waits for input of text or selection of the displayed list of input candidates (Step). S118).

  The search processing unit 102 displays a part of a predetermined number of input candidates (for example, the top 3) on the display unit 140 so as to be selectable by the operation unit 170 in conjunction with the display control unit 150 and other input candidates. (For example, after the top four) may be displayed on the display unit 140 so as to be selectable by the operation unit 170 after a predetermined operation action (for example, after pressing the input candidate all display button).

  Next, when the search processing unit 102 detects a user input operation input via the operation unit 170 (step S121), the search processing unit 102 determines whether or not an input candidate is selected, that is, whether or not an input candidate is selected. It is then determined whether or not a single character has been input (step S122). At this time, if it is determined that the input candidate is not selected, the search processing unit 102 determines that one more character has been input, and proceeds to the process of step S112.

  On the other hand, if the search processing unit 102 determines that an input candidate has been selected, the search processing unit 102 operates in conjunction with the display control unit 150 and the operation unit 170 to determine the selected input candidate as a user search keyword. This is executed (step S123), and the determined search keyword is recorded in the RAM 165 and provided to the image provision processing unit 103 (step S124), and this operation is terminated.

  The image provision processing unit 103 executes karaoke image search acquisition processing based on the determined keyword after the end of this operation. Specifically, the image provision processing unit 103 works in conjunction with the search server device 60, collects image data provided on the network 20 based on the provided search keyword, and works in conjunction with the display control unit 150. The collected image data is displayed on the display unit 140.

  Then, the image provision processing unit 103 operates in conjunction with the operation unit 170 to record one or more pieces of selected image data from the displayed image data in the second buffer 164 and to store the recorded image data in the data provision server. The karaoke system 50 is provided via the device 30.

  In addition, when the karaoke system 50 is instructed to reproduce karaoke based on the corresponding user ID and the image data provided by the image providing processing unit 103 is selected, the karaoke system 50 reproduces the corresponding karaoke data. The provided image data is displayed as a background image.

  As described above, the karaoke linkage system 1 of the present embodiment can easily search for images provided on the network that is assumed to match the user's hobbies and preferences using the information related to the user's karaoke, Since an image can be easily provided to the karaoke system 50, the use of the portable terminal device 10 and the network 20 can be further promoted in the karaoke system 50.

[6] Modification [6.1] Modification 1
In the above embodiment, the karaoke data DB 101 and the user music information DB 102 are provided in the data providing server device 30, and these DBs are managed and controlled only by the data providing server device 30. The computer systems for management may be provided separately, and each may be individually managed and operated, or the data providing server device 30 may be realized by a plurality of server devices.

[6.2] Modification 2
In the above embodiment, the image providing processing unit 103 provides the image data to the karaoke system. However, the image data may be provided directly to the karaoke system 50 or to the data providing server device 30.

[6.3] Modification 3
In the above embodiment, the input candidate list is displayed on the display unit 140 so as to be selectable by the operation unit 170 based on the user music information, but the input history such as past search history by the user using the portable terminal device 30 is displayed. The input candidate based on the music information may be displayed on the display unit 140 so as to be interlocked with the music information.

  Specifically, the detection processing unit 103 associates the input character with the conversion result of the character in the RAM 165 as the input history of the character input performed by the user in the past with respect to the operation unit 170. The display unit 140 is capable of selecting text data constituting characters recorded as a part of input history as input candidates based on music information when recording and displaying input candidates and selecting them thereafter. You may add as a candidate to display.

  That is, the search processing unit 102 uses the operation unit 170 to generate an input candidate list by adding input candidates based on past character input to the input candidates (song name and artist name) extracted based on the music related information. You may display on the display part 140 so that setting is possible.

  On the other hand, when the search processing unit 102 detects a predetermined number or more of music related information and there is an input history, the search processing unit 102 calculates the date and time used for karaoke in the music related information and the date and time registered as the input history. In comparison, the music name and artist or the input history of the closest information from the current time are extracted until a predetermined number is reached, and the corresponding portable terminal device 10 is registered as an input candidate list.

  In this case, the search processing unit 102 sequentially alternates information having high priority in the music related information and information having high priority in the input history such as a large number of input histories for each type. Alternatively, the input unit list may be displayed on the display unit 140 so as to be selectable by the operation unit 170.

[6.4] Modification 4
In the above embodiment, the music information recorded for each user as karaoke data in the first buffer 163 of the portable terminal device 10 is used as user music information, but the search processing unit 102 is owned by the user, The search keyword determination process may be executed using music information in sound source data (hereinafter referred to as “user sound source data”) used for music appreciation.

  In this case, the search processing unit 102 searches the music related information including the song name and artist name included in the user sound source data based on the text data input by the operation unit 170 and identifies the corresponding music related information. Then, the song name and artist name of the specified song related information may be displayed on the display unit 140 as search keyword input candidates.

[6.5] Modification 5
In the above embodiment, the music information recorded for each user as karaoke data in the first buffer 163 of the portable terminal device 10 is used as user music information, but the search processing unit 102 and the data providing server device 30 A processing unit having the same function is provided, and the processing unit searches user song information in karaoke data or sound source data held by the user based on text data input to the operation unit 170 of the portable terminal device 10. The keyword determination process may be executed to distribute the determined keyword to the corresponding portable terminal device 10.

  In this case, the processing unit may execute the search keyword determination process in combination with not only the user song information or the user sound source data held by the user but also the input history.

Further, the processing unit is a case where search keyword determination processing is executed using user music information, user sound source data, and input history, and when a predetermined number or more of music related information and search keywords are specified,
Based on time information such as (1) number of playbacks or number of inputs, or (2) last playback time, last input time, time used for the last karaoke or input time, etc.
Calculate the priority. That is, for example, the processing unit assigns priorities in the order of the latest time information and uses a predetermined number or more of music related information or search keywords as a search keyword based on a predetermined number (displayable) of music related information. Input candidates may be displayed on the portable terminal device 10.

[6.6] Modification 6
In the above embodiment, the search processing unit 102 executes the search keyword determination process based on the user song information of a specific user recorded in the first buffer 163, but is recorded in the karaoke data DB 301. The search keyword determination process may be executed using music related information and music text data in all karaoke data.

  In this case, the search processing unit 102 may determine whether the predetermined condition is satisfied and specify the priority by using date / time information such as the registration date when the karaoke data is registered or the total number of times of reproduction. .

[6.7] Modification 7
In the above embodiment, the search processing unit 102 executes the search keyword determination process based on the user song information of a specific user recorded in the first buffer 163, but for the remote control provided by the karaoke company You may download an application, use the remote control function which can perform the music search and music selection of the karaoke which the karaoke system 50 has, and you may perform a search keyword determination process based on the user or music information in singing.

  In this case, the search processing unit 102 specifies the user information of the user who is singing or the music information being sung in the karaoke system 50, and the music-related information and music text data of the specified music information or during singing The search keyword determination process may be executed using music related information and music text data in the user music information.

[6.8] Modification 8
In the above embodiment, the search processing unit 102 generates search text data based on the text data input to the operation unit 170. However, the present invention is not limited to this, and there is no text input for a predetermined time. In addition, similar search text data may be generated to present search candidates.

DESCRIPTION OF SYMBOLS 1 ... Karaoke interlocking system 10 ... Communication terminal apparatus 20 ... Network 30 ... Data provision server apparatus 50 ... Karaoke system x60 ... Search server apparatus 100 ... Data processing part 101 ... Music information management part 102 ... Search processing part 103 ... Image provision processing part DESCRIPTION OF SYMBOLS 110 ... Network communication part 140 ... Display part 150 ... Display control part 160 ... Recording part 161 ... Application recording part 162 ... User information recording part 163 ... 1st buffer 164 ... 2nd buffer 165 ... RAM
170 ... operation unit 180 ... terminal management control unit 190 ... timer 310 ... communication control unit 350 ... server management control unit 360 ... data processing unit 361 ... music information distribution unit 362 ... karaoke data management unit

Claims (8)

In a communication terminal device that provides image data as image data to a karaoke system that reproduces an image when performing a song according to the song data,
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information Means,
An input receiving means for receiving text input by the user as input text;
A specifying means for searching for at least one of music text data having music including the accepted input text and music related information, and specifying music related information or corresponding music related information of the corresponding music text data; Search means for searching for an image provided on the network using the music-related information as a keyword; and providing means for acquiring data of the searched image as image data and providing the acquired image data to a karaoke system;
With
The specifying means is
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
The search means
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A communication terminal device that searches an image provided on a network for a keyword. The communication terminal device according to claim 1,
In the recording means, the music information is registered for each user,
The communication terminal apparatus, wherein the specifying unit extracts the music related information from music information of a user who has input the text as music related information having the predetermined condition. The communication terminal device according to claim 2,
The music information for each user includes history information including at least one of date / time information indicating the presence / absence and date / time used for karaoke,
The specifying means extracts the music related information recorded in the music information as the music related information having the predetermined condition, and the history information has a predetermined history condition. Communication terminal device. In a program for a communication terminal device that provides image data as image data to a karaoke system that reproduces an image according to music data,
Communication terminal device
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information Means,
Input receiving means for receiving text input by the user as input text;
A specifying means for searching for at least one of music text data having music including the received input text and music related information, and specifying music related information or corresponding music related information of the corresponding music text data;
Search means for searching for an image provided on the network using the specified music-related information as a keyword; and
Providing means for acquiring data of the searched image as image data and providing the acquired image data to a karaoke system;
Function as
The identifying means is
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
The search means
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A program for searching for an image provided on a network for a keyword. A server device that provides predetermined information to a communication terminal device that provides image data as image data to a karaoke system that reproduces an image according to music data,
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information Means,
An input receiving means for receiving text input by the user as input text;
A specifying means for searching for at least one of music text data having music including the accepted input text and music related information, and specifying music related information or corresponding music related information of the corresponding music text data; Transmission control means for controlling transmission means for transmitting the music-related information, which is the keyword data for searching the image, to the communication terminal device;
With
The identifying means is
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
The transmission control means is
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A server device, wherein the keyword data is transmitted to the communication terminal device by the transmission means. A server device that provides predetermined information to a communication terminal device that provides image data as image data to a karaoke system that reproduces an image according to music data;
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information means,
Input receiving means for receiving text input by the user as input text;
A means for searching for at least one of music text data and music related information having text including the accepted input text, and specifying music related information or corresponding music related information of the corresponding music text data; and
Transmission control means for controlling transmission means for transmitting the specified music-related information as keyword data for searching for the image to the communication terminal device;
Function as
The identifying means is
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
The transmission control means is
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A program that causes the transmission means to transmit the keyword data to the communication terminal device. In a data providing method for providing image data as image data to a karaoke system that reproduces an image according to music data,
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information Process,
An input receiving process for receiving text input by a user as input text;
A step of searching for at least one of music text data and music related information having text including the accepted input text, and specifying music related information or corresponding music related information of the corresponding music text data; A search step of searching for an image provided on the network using the music-related information as a keyword, a providing step of acquiring data of the searched image as image data, and providing the acquired image data to a karaoke system;
Including
In the specific step,
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
In the search step,
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A method for providing data, comprising: searching an image provided on a network for a keyword. In a karaoke system that reproduces an image according to music data, a communication terminal device that provides the image data as image data;
A playback device for playing back the music data while displaying an image based on the provided image data and a user request;
With
The communication terminal device
Recording control for controlling recording means for recording music information having music related information indicating information on the music title or artist name of the music data and previously registered music text data associated with the music related information Means,
An input receiving means for receiving text input by the user as input text;
A specifying means for searching for at least one of music text data having music including the accepted input text and music related information, and specifying music related information or corresponding music related information of the corresponding music text data; Search means for searching for an image provided on the network using the music-related information as a keyword; and providing means for acquiring data of the searched image as image data and providing the acquired image data to a karaoke system;
With
The specifying means is
When specifying the music related information of the corresponding music text data or the corresponding music related information, determine whether or not a predetermined number or more of music related information has been specified,
When the music-related information of a predetermined number or more is specified, the music-related information having a predetermined condition is extracted,
The search means
If the music related information of a predetermined number or more is not specified, all the music related information specified, or if the music related information of a predetermined number or more is specified, the extracted music related information, A karaoke system that searches images provided on a network for keywords.

Images