JP2005300787A - Music selecting device and music reproducing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a music selecting device capable of selecting music through easy operation and a music reproducing device. <P>SOLUTION: When an image is received (S30: Yes), character string recognition from the image is performed (S32) and a recognized character string is displayed on a display unit 40 (S34). When an indication for correction of the displayed character string is received through a communication part 28, the character string is corrected (S36) and a corrected character string is re-displayed (S38). When an indication for retrieval of a musical piece based upon the displayed character string is received through the communication part 28, the retrieval from a musical piece database stored on a hard disk 30 is performed and the name of the retrieved musical piece, a singer's name, a composer, etc., retrieved with the character string are displayed (S40). <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a music selection device and a music playback device that can easily select a desired music from among a large number of music.

  2. Description of the Related Art Conventionally, in a music playback device such as a karaoke device, a large number of music pieces are stored, and one of the music pieces is selected from the music pieces and played and enjoyed. In mobile phones and personal computers, a server is accessed via a network such as the Internet to obtain music data such as desired music and ringtones.

Japanese Patent Laid-Open No. 9-218688 (Patent Document 1) prints a song number, a song number input barcode, and three effect track selection barcodes corresponding to the song title on the table of contents of the karaoke song. A karaoke apparatus is disclosed in which a song number input barcode and an effect track selection barcode of a desired song are read by a reader so that music selection and sound field control effects can be set.
JP-A-9-218688

  However, in the invention disclosed in Patent Document 1, when selecting a song from a song or singer name, first, the corresponding page is searched from the table of contents, the corresponding song is searched from the page, and the bar corresponding to the song is searched. The procedure of holding a barcode reader over the chord is necessary, and it takes time and effort, and there is a problem that a song cannot be selected unless a bar code is attached corresponding to the song title.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a music selection device and a music playback device that can select music with a simple operation.

  In order to achieve this object, the music selection device according to claim 1 includes an image input unit for inputting an image, a character recognition unit for recognizing a character string from an image input by the image input unit, and a piece of music related to a plurality of pieces of music. Storage means for storing information; search means for searching for music from music stored in the storage means based on a character string recognized by the character recognition means; and music related to music searched by the search means Display means for displaying information.

  A music selection device according to a second aspect is the music selection device according to the first aspect, further comprising correction means for correcting the music information displayed on the display means.

  The music selection device according to claim 3 is the music selection device according to claim 1 or 2, wherein the display means displays music information related to a plurality of music searched by the search means, and is displayed on the display means. The image processing apparatus further includes a selection unit that selects a desired music from the plurality of music.

  According to a fourth aspect of the present invention, there is provided a music reproducing device for capturing an image, a character recognizing unit for recognizing a character string from the image captured by the image capturing unit, and a character string recognized by the character recognizing unit. Transmitting means; music information receiving means for receiving music information relating to music searched based on the character string transmitted by the server; display means for displaying music information received by the receiving means; and display on the display means Music data receiving means for receiving music data relating to the received music and playback means for playing back the music data received by the receiving means.

  According to a fifth aspect of the present invention, there is provided a music playback apparatus, an imaging unit that captures a color image, a binarization unit that converts the color image captured by the imaging unit into a monochrome image, Transmitting means for transmitting to the server, receiving means for receiving a character string recognized based on the monochrome image transmitted by the server and music data relating to the character string, and display for displaying the character string received by the receiving means Means and reproduction means for reproducing the received music data.

  According to a sixth aspect of the present invention, there is provided the music reproducing device according to the fourth or fifth aspect, further comprising a correcting means for correcting the music information displayed on the display means.

  The music playback device according to claim 7 is the music playback device according to any one of claims 4 to 6, wherein the display means displays music information related to a plurality of music searched by the search means. And a selecting means for selecting a desired music from a plurality of music displayed on the display means.

  Note that music data is data that can be played back music, such as encoded data such as PCM that is sampled and quantized by a predetermined sampling frequency, and automatic performance data of musical instruments. It also includes data that can be played by supplying the sound source.

  According to the music selection device of claim 1, the image input means for inputting an image, the character recognition means for recognizing a character string from the image input by the image input means, and the storage means for storing information on a plurality of music pieces Search means for searching for music from music stored in the storage means based on the character string recognized by the character recognition means, and display means for displaying music information related to the music searched by the search means. Since it is provided, there is no need to sequentially input a song number, a song name, and a singer name with numbers and characters, and there is an effect that a song can be selected by a simple operation of inputting an image. In addition, even if a mark such as a barcode is not attached to the song name, the song can be selected.

  According to the music selection device described in claim 2, in addition to the effect produced by the music selection device according to claim 1, the music selection device further includes correction means for correcting the music information displayed on the display means. Even if there is, there is an effect that it can be corrected.

  According to the music selection device described in claim 3, in addition to the effect achieved by the music selection device according to claim 1 or 2, the music selection device further includes selection means for selecting a desired music from a plurality of music searched by the search means. Therefore, there is an effect that a desired music can be selected from a plurality of music searched using a character string input by an image as a keyword.

  According to the music reproducing apparatus of the fourth aspect, the image capturing means for capturing an image, the character recognition means for recognizing the character string from the image captured by the image capturing means, and the character string recognized by the character recognition means to the server. Transmitting means for transmitting; music information receiving means for receiving music information relating to music searched for by the server based on the transmitted character string; display means for displaying music information received by the receiving means; A music data receiving means for receiving music data relating to the music displayed on the screen, and a playback means for playing back the music data received by the receiving means. There is an effect that music data of a desired music can be acquired and reproduced.

  According to the music reproducing apparatus of the fifth aspect, the imaging means for capturing a color image, the binarizing means for converting the color image captured by the imaging means into a monochrome image, and the monochrome converted by the binarizing means. Transmitting means for transmitting an image to the server, receiving means for receiving a character string recognized by the server based on the transmitted monochrome image and music data relating to the character string, and displaying the character string received by the receiving means Display means for reproducing and reproduction means for reproducing the received music data, there is an effect that the amount of data transmitted for character recognition can be reduced.

  The music playback device according to claim 6 is the music playback device according to claim 4 or 5, further comprising correction means for correcting the music information displayed on the display means. Even if there is, there is an effect that it can be corrected.

  The music playback device according to claim 7 is the music playback device according to any one of claims 4 to 6, wherein the display means displays music information related to a plurality of music searched by the search means. , And further comprising a selection means for selecting a desired music from the plurality of music displayed on the display means, so that a desired music is searched from a plurality of music searched using a character string input by an image as a keyword. There is an effect that can be selected.

  Hereinafter, a first preferred embodiment of the present invention will be described with reference to the accompanying drawings. In the first embodiment, when the mobile phone 10 captures an image including a character string and transmits the image to the karaoke device, the karaoke device can recognize characters from the image and select a karaoke song. is there.

  FIG. 1 is a block diagram of a mobile phone 10 and a karaoke device 20 including a music selection device according to an example of an embodiment of the present invention. The mobile phone 10 is a communication terminal that can perform a call wirelessly via a telephone station, and includes a camera unit 12, a display unit 14, an operation unit 16, and an infrared remote control unit 18 in addition to a wireless communication unit. The camera unit 12 is a so-called digital camera, and converts an image input via an optical lens into digital color image data using a CCD or the like. The image data captured by the camera unit 12 is stored in a flash memory or the like and can be displayed on the display unit 14.

  The operation unit 16 is provided with a function of various operations such as a camera shutter, a dial function as a normal telephone, and a character string input function capable of inputting a character string such as an e-mail.

  The infrared remote control unit 18 can transmit image data by infrared rays, and a control signal is transmitted by infrared rays when the operation element 16 is operated as a remote controller. Similarly to the karaoke apparatus described below, the mobile phone 10 is also controlled by a CPU (not shown) and includes a tone generation circuit that reproduces music data such as ringtones stored in a memory.

  Next, each structure of the karaoke apparatus 20 is demonstrated. The CPU 22 is a central processing unit and performs various processes according to a control program stored in the ROM 24. The ROM 24 stores various control programs and various data referred to by the programs.

  The RAM 26 is used as an area for storing temporary data when the CPU 22 executes a program, or is transferred to the RAM 26 and executed when executing a program stored in a hard disk.

  The communication unit 28 communicates with the mobile phone 10 by radio waves or infrared rays. When the mobile phone 10 receives image data taken by the mobile phone 10 or functions as an infrared remote controller, an instruction from the mobile phone 10 is given. Receive. Information is transmitted to the mobile phone 10 as necessary.

  The hard disk 30 is a large-capacity storage device and stores accompaniment data, lyric data, and image data of a large amount of music corresponding to music selection numbers. These data are stored in advance, and can be received and additionally recorded via the communication unit 28 when a new request is made by the user.

  It also stores a song database that stores song information such as song name, singer name, composer name, songwriter name, release date, release company name, song selection number, etc., and selecting this song by searching this song database can do.

  The operation element 32 is an operation element provided in the main body of the karaoke apparatus, and can set effects such as volume and echo depth.

  The sound source 34 generates accompaniment sound of karaoke music according to the performance data read by the CPU 22, and the musical sound signal generated by the sound source 34 is amplified by the amplifier 36 and emitted from the speaker 38.

  The display 40 displays the lyrics of the karaoke song together with the background video, or displays a plurality of candidate songs when selecting a song, and is configured by an LCD or CRT.

  FIG. 2 is a flowchart of processing performed by the CPU of the mobile phone 10. This process is started when the mobile phone 10 is turned on, and is repeatedly executed until the power is turned off. First, the operation state of the operator 16 is scanned to determine whether the camera shutter has been pressed (S10). If the shutter is pressed, the subject image is captured (S12).

  FIG. 4 shows a display mode of the display unit 14 when capturing an image of a subject. When the mobile phone 10 is set to a mode for inputting a character string, a capture frame is displayed on the display 14 as shown in FIG. The user places the mobile phone 10 and the subject so that the character string is positioned within the frame, and presses the shutter to capture an image including the character string.

  (B) shows an example in which the music selection number is taken from the music title shown in the table of contents of the karaoke music and the music selection number assigned to the music title. Similarly, (c) shows the singer name, (d) shows the title of the song, and (e) shows how the handwritten character string is captured. The singer name and song title can be input by photographing a character string described in a general magazine. Further, when the printed matter is not at hand, a character string can be input by handwriting on a memo or the like and photographing it.

  The cellular phone 10 stores the captured image in a flash memory or the like when the shutter is pressed, and displays the image on the display 14 (S14).

  When the user confirms this display and determines that the image is acceptable, the user operates the operation element 16 to transmit the image to the karaoke apparatus 20. In this case, in the mobile phone 10, the determination process in S10 is No, and in the process in S15, the captured color image is binarized and converted into monochrome image data. This binarization process is a well-known process that forms an image with binary values of black and white depending on whether or not the density of each pixel of the image data exceeds a predetermined threshold value. And the amount of image data to be transmitted can be reduced.

  Next, the cellular phone 10 transfers the binarized image data to the karaoke apparatus 20 (S16). At this time, the user inputs in the mobile phone 10 whether the transmitted image data is the music selection number, the singer name, or the song title, and the mobile phone 10 transmits the information to the karaoke apparatus by the infrared remote controller. .

  The user confirms the displayed character string, and if necessary, corrects the correction instruction by operating the operator 16 of the mobile phone 10. The cellular phone 10 transmits an instruction to correct the character string by this operation using the infrared remote controller (S18), and the karaoke apparatus displays the corrected character string.

  The user confirms the display, and if there is no need for correction, the user operates the operator 16 of the mobile phone 10 to perform a search from the music database based on the character string. The mobile phone 10 transmits an instruction to start the search by this operation to the karaoke apparatus 20 (S20).

  When the karaoke device receives the instruction, the karaoke device performs a search, and displays the searched song name and the like. The user confirms the display and issues a correction instruction if necessary. When a plurality of songs are displayed, the mobile phone 10 performs an operation for selecting one of the songs, and the mobile phone 10 transmits an operation instruction for music selection according to the operation to the karaoke apparatus (not shown). ). When the user sings the displayed song title, the user performs an operation to start the performance. In accordance with this operation, the mobile phone 10 transmits a control signal for starting performance to the karaoke apparatus 20 (S22).

  FIG. 3 is a flowchart of processing performed by the CPU 22 of the karaoke apparatus 20 that operates in response to an instruction from the mobile phone 10. As in the case of the mobile phone 10, this process is started when the power is turned on and is repeatedly executed until the power is turned off.

  First, it is determined whether an image has been received (S30). When an image is received (S30: Yes), character recognition is performed from the image (S32), and the recognized character string is displayed on the display 40 (S34). When an instruction to correct the displayed character string is received via the communication unit 28, the character string is corrected (S36), and the corrected character string is displayed again (S38).

  When an instruction to search for music based on the displayed character string is received via the communication unit 28, the music database stored in the hard disk 30 is searched. In the search, information on whether the character string is a song selection number, a song title, or a singer name is received from the mobile phone 10 and a search is performed based on the information. The music name, singer name, composer, etc. of the music searched by the character string are displayed (S40). When a correction instruction is given to the displayed music information, it is corrected. When a plurality of music is searched, one of them is selected, and then a control signal for a performance start instruction is received. In this case, the performance of the music and the display of the lyrics and the like are started based on the music selection number of the selected music (S42).

  Next, a second embodiment will be described with reference to FIG. In the second embodiment, an image captured by the mobile phone 10 is transmitted to a server (not shown), and the server extracts a character string from the image by character recognition processing, and the server holds the character string based on the character string. The music information such as a number of ringtones to be searched is searched, and the music information such as the searched music name is transmitted to the mobile phone 10. The user selects music from the music information transmitted from the server and requests music, and the server distributes music data corresponding to the music in response to the request.

  FIG. 5 shows the processing of the CPU of the mobile phone 10 in the second embodiment as a flowchart. The same steps as those in the flowchart shown in FIG. First, the operation state of the operator 16 is scanned to determine whether the camera shutter has been pressed (S10). When the shutter is pressed, the image is captured (S12), stored in a flash memory or the like, and the image is displayed on the display 14 (S14). The user confirms this display, and when searching for music based on the displayed image, the user operates the operation element 16 to instruct transmission.

  When transmission is instructed, the mobile phone 10 binarizes the color image and converts it into a monochrome image (S15), and transmits the converted image to the server wirelessly via the antenna (S16). The binarization of the color image in the cellular phone 10 has the advantage that the processing is relatively simple for character recognition and the amount of data can be reduced compared to the color image.

  The server recognizes a character string from the binarized image and transmits the character string to the mobile phone 10. The mobile phone 10 displays this character string on the display 14 (S42, S44). The user confirms the character string displayed on the display 14 and corrects it if necessary. The mobile phone 10 corrects the character string in accordance with this correction operation (S36), and redisplays the corrected character string (S38).

When performing a search from the music database using the displayed character string, the user performs an operation for instructing the search. In accordance with this operation, the mobile phone 10 transmits a search character string to the server and issues a search instruction (S40). The server performs a search according to the search instruction, and transmits the searched music information to the mobile phone 10. The mobile phone 10 receives the music information and displays it on the display 14 (S42, S44). The user confirms this display,
Make corrections if necessary. When downloading music data such as a displayed song name, an operation for instructing download is performed. The cellular phone 10 sends an instruction to the server to transmit the music data (S50), receives the music data of the music from the server, and stores it in the memory.

  As described above, in the music playback device, a character string such as a desired song name is photographed by the camera unit, the character string is recognized from the image, the desired song is searched, and the music data of the song is acquired. can do. The music data may be encoded data such as PCM or automatic performance data composed of performance data such as MIDI.

  In the second embodiment, the captured image is binarized and transmitted to the server, and the server recognizes the character string from the image. However, in the cellular phone 10, the character string is extracted from the captured image. Recognizing and sending the recognized character string to the server, the server may perform a search based on the received character string.

  The present invention has been described above based on the above embodiments, but the present invention is not limited to the above embodiments, and various improvements and modifications can be made without departing from the spirit of the present invention. It can be easily guessed.

  For example, in the first embodiment, the mobile phone 10 is provided with the camera unit and is configured to transmit the video captured by the mobile phone 10 to the karaoke device. However, the mobile phone 10 does not have a telephone function instead of the mobile phone. A remote control device may be used.

  In the first embodiment, the character string recognized as a character and the music information searched based on the character string are displayed on the display device 40 of the karaoke apparatus. May be transmitted to and displayed on the display of the mobile phone.

  In the first embodiment, the image captured by the mobile phone is binarized and the binarized image is transmitted to the karaoke device. The karaoke device recognizes the character string from the image. A character string may be recognized from the binarized image in the mobile phone, and the recognized character string may be transmitted to the karaoke apparatus.

  In the second embodiment, the mobile phone is an example of a music playback device. Instead, the mobile phone is a personal computer that downloads music data from a server of a site that supplies music data via the Internet. Alternatively, a song may be requested from a broadcast streaming station and the broadcasted song may be played back.

It is a block diagram of a mobile phone and a karaoke apparatus. It is a flowchart which shows the process in a mobile telephone. It is a flowchart which shows the process in a karaoke apparatus. It is a figure which shows the example of a display of the indicator at the time of taking in a character string in a mobile telephone. It is a flowchart which shows the process in the mobile telephone which is a 2nd Example.

Explanation of symbols

10 Mobile phone (music player)
12 Camera unit 14 Display (display means)
20 Karaoke device 22 CPU
28 Communication unit (image input means, receiving means)
34 Sound source 40 Display (display means)

Claims (7)

An image input means for inputting an image;
Character recognition means for recognizing a character string from an image input by the image input means;
Storage means for storing music information on a plurality of music pieces;
Search means for searching for music from music stored in the storage means based on the character string recognized by the character recognition means;
A music selection device comprising: display means for displaying music information relating to music searched by the search means.   2. The music selection device according to claim 1, further comprising correction means for correcting the music information displayed on the display means. The display means displays music information related to a plurality of music searched by the search means,
3. The music selection apparatus according to claim 1, further comprising selection means for selecting a desired music from a plurality of music displayed on the display means. Imaging means for capturing images;
Character recognition means for recognizing a character string from an image captured by the imaging means;
Transmitting means for transmitting the character string recognized by the character recognition means to the server;
Music information receiving means for receiving music information related to music searched by the server based on the character string;
Display means for displaying the music information received by the receiving means;
Music data receiving means for receiving music data relating to the music displayed on the display means;
A music reproducing apparatus comprising: reproducing means for reproducing the music data received by the music data receiving means. Imaging means for capturing a color image;
Binarization means for converting a color image captured by the imaging means into a monochrome image;
Transmitting means for transmitting the monochrome image converted by the binarizing means to the server;
Music information receiving means for receiving a character string recognized by the server based on the monochrome image and music information related to the music searched based on the character string;
Display means for displaying the music information received by the music information receiving means;
Music data receiving means for receiving music data relating to the music displayed on the display means;
A music reproducing apparatus comprising: reproducing means for reproducing the music data received by the music data receiving means.   6. The music reproducing apparatus according to claim 4, further comprising a correcting means for correcting the music information displayed on the display means. The display means displays music information related to a plurality of music searched by the search means,
The music playback device according to claim 4, further comprising a selection unit that selects a desired music from a plurality of music displayed on the display unit.

Images