JP2006190027A - Information processing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To show music data by a music recognition means on a display in real time when the music data are included in a content of TV broadcasting and the like. <P>SOLUTION: A music data display system 1 extracts information on a characteristic quantity by a characteristic quantity information extracting device 4 from the music information included in a content of TV broadcasting and the like received by a tuner 3, and transmits the information on a characteristic quantity to a server 9 through the Internet 11. The server 9 recognizes the music by carrying out the matching of the information on a characteristic quantity and the music data included in a music information database 10, and transmits information on a music title, information on an artist, and the like corresponding to the music to the characteristic quantity information extracting device 4 as the recognition result. The recognition result received by the characteristic quantity information extracting device 4 is associated with the content including the original music information and recorded in a storage device 5. When the content recorded in the storage device 5 is reproduced, the music is outputted from a speaker 13, and, at the same time, the recognition result is shown on a display 12. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an information processing apparatus using a music recognizing unit and including an image and audio receiving / displaying unit.

  Conventionally, a lot of music data is included in content such as a television program transmitted from a broadcasting station or the like. The music data in the content may be the main data such as the music in the music program, but the music may not be the main data such as a commercial song or a drama insertion song. In data that is not the main music, information such as the song name and artist name is often not displayed on the TV screen together with the music that is flowing, and TV viewers interested in the flowing music will immediately hear the song title. It was difficult to find the artist name.

  On the other hand, music recognition systems are widely used that specify music titles based on music data and determine transfer with known music. This music recognition system includes a server connected to the Internet or the like and having a database of music information, and a recognition device that is provided in a receiving system used by a viewer and communicates with the server via the Internet. The feature value information extracted from the music data contained in the received broadcast content is sent to the server, and the server matches the feature value information with the music information stored in the database, and extracts the song name and artist name of the music data. The recognition result is transmitted to the recognition device (see, for example, Patent Document 1).

JP 2002-258873 A

  However, in the means described in Patent Document 1, it takes a certain amount of time for the music recognition system to communicate with the server and receive the content recognition result. There is a certain time lag before the name appears on the screen. For this reason, when the song name or artist name is displayed on the screen, the music has already ended or the next music is flowing. Such a problem also arises when a viewer views a content such as a TV program recorded by a video while the music recognition system recognizes the content, which impairs convenience when the viewer who views the video knows the name of the song or artist. Become.

  The present invention has been made based on the above circumstances, and an object of the present invention is to display music title information, artist information, etc. of music data included in broadcast content in real time with the output of music data. The present invention provides a music data display system (including an information processing apparatus) and a music data display method that can be displayed on the screen.

  According to one aspect of the present invention, music data related information extracting means for extracting music data related information related to the music data from AV data including music data, and music data extracted by the music data related information extracting means Music information acquisition means for acquiring music information relating to music from outside using related information as a search key, music information acquired by the music information acquisition means, and storage means for storing the AV data in association with each other An information processing apparatus characterized by this is provided.

  It is preferable to provide output control means for outputting the music information stored in association with the AV data in the storage means when reproducing the AV data. It is preferable to have information combining means for combining the AV data and the music information, and output means for outputting the information combined by the information combining means.

  The music information acquisition means has characteristic amount information extraction means for extracting characteristic amount information characterizing music data from the music data related information, and communicates with the music information database storing the music data group via the Internet. Thus, by performing matching between the feature amount information and the music data group stored in the music information database, music data that matches the audio data can be acquired.

  According to the present invention, song name information, artist information, and the like of music data included in broadcast content can be output simultaneously with the output of AV data, and real-time performance can be ensured.

  An information processing technique according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an overall configuration diagram of a music data display system including an information processing apparatus according to an embodiment of the present invention. The music data display system 1 includes an antenna 2, a tuner 3, a feature amount information extraction device 4, a storage device 5, a first selector 6, a second selector 7, an OSD (On Screen Display) unit 8, A server 9, a music information database 10, a display 12, and a speaker 13 are provided. In the music data display system 1, the feature amount information extraction device 4, the storage device 5, the first selector 6, the second selector 7, the OSD unit 8, the tuner 3, the display 12, and the speaker 13 are On the other hand, the server 9 and the music information database 10 are provided on the Internet 11 so as to be able to communicate with the television receiver.

  The antenna 2 receives various radio broadcast signals transmitted from a broadcast station such as analog broadcast, BS digital broadcast, CS digital broadcast, terrestrial broadcast, satellite broadcast, and the like. However, when the television receiver receives a broadcast from an optical cable or the like, the antenna 2 may not be provided. The tuner 3 receives a broadcast signal from a broadcast station received by the antenna 2, detects a signal of a desired channel from the broadcast signal, and demodulates the original image data or audio data. The feature amount information extraction device 4 extracts feature amount information of the audio data output from the tuner 3 and communicates with the server 9 based on the feature amount information.

  FIG. 2 shows a block diagram of the configuration of the feature amount information extraction device 4. The feature amount information extraction device 4 includes a music reception unit 41, an A / D conversion unit 42, a normalization processing unit 43, a feature amount extraction unit 44, an information transmission unit 45, and an information reception unit 46. ing. The music receiver 41 receives audio data as an analog signal from the tuner 3 and the storage device 5. The A / D converter 42 quantizes the audio data of the analog signal and converts it into a digital signal. The normalization processing unit 43 performs normalization processing for adjusting the signal magnitude so that the peak value of the digitized audio data becomes a constant value. The feature amount extraction unit 44 extracts feature amounts from the normalized audio data. As the feature quantity extracted by the feature quantity extraction unit 44, for example, information that requires a small amount of data at the time of transmission, such as an appearance rate and an appearance interval of a peak value in audio data, and can identify music with high probability is used. The information transmission unit 45 transmits the feature amount information extracted by the feature amount extraction unit 44 to the server 9 via the Internet 11. The information receiving unit 46 receives music data to be described later from the server 9.

  Returning to FIG. 1, the storage device 5 is a large-capacity data recording medium such as a hard disk drive, and stores image data, audio data, and the like of television broadcasts received and detected by the tuner 3 as file format recording data. In addition, music data related to image data and sound data is also stored as recorded data in a form associated with the target image data and sound data.

  The first selector 6 is a multiplexer for selecting data, has two input units and one output unit, and is based on a control signal input by a changeover switch (not shown) provided in the television receiver. Then, one of the signals input to the input unit is selected and output to the output unit. The data output from the feature quantity information extraction device 4 and the recording data output from the storage device 5 are respectively input to the input unit, and one of the data is supplied to the OSD unit 8.

  The second selector 7 is also a data selection multiplexer, and has two input units and one output unit. Based on a control signal from a changeover switch (not shown), the second selector 7 Either one is selected and output to the output unit. The data output from the tuner 9 and the data output from the storage device 5 are input to the input unit, respectively, and one of the data is supplied to the OSD unit 8.

  The OSD unit 8 is a part of a control mechanism that controls information displayed on the display 12, and displays data such as character information and symbol information together with image data on a part of the display 12. The OSD unit 8 displays the recognition result received from the server 9 by the feature amount information extraction device 4 on the display 12 as character information or graphic information. Note that the display mode of the display 12 by the OSD unit 8 is different from the image data provided in a part of the screen in a display area different from the image data (for example, near the lower end and the left and right ends of the screen). (Display area) may be formed, or the image data displayed on the display 12 may be overlapped.

  The display 12 is a device for displaying various images such as a cathode ray tube, liquid crystal, and TFT. The television broadcast received and demodulated by the tuner 3, the recording data output from the storage device 5, and the character information output from the OSD unit 8. And graphic information. The speaker 13 converts audio data included in a television broadcast received and demodulated by the tuner 3 or recorded data output from the storage device 5 into audio and outputs the audio. The server 9 has a function as a network server, and communicates with the feature amount information extraction device 4 such as a television receiver used by the viewer via the Internet 11. Further, the server 9 performs matching with the music data group stored in the music information database 10 based on the feature amount information transmitted from the feature amount information extracting device 4, and receives the feature received from the feature amount information extracting device 4. The music related to the above information is recognized. As a result of the recognition performed by the server 9, the music data extracted from the music information database 10 as the data of the compatible music is transmitted to the feature amount information extraction device 4 via the Internet 11.

  The music information database 10 stores major music data that are sold and distributed around the world through media such as analog records, CDs (compact discs), and DVDs (digital versatile discs) as a music data group. The stored music data group includes sound information, information about the artist who made the music, such as the name of each singer, player, and composer, the name of the record company that released the media, such as the CD, and the name of the label. Information related to the artist, such as information related to CDs, concert information of artists, etc., is recorded. The sound information may be recorded directly as digital information on a sound source recorded on a CD or DVD, but may be recorded after being converted into feature amount information so that the server 9 can easily perform a matching process. .

  FIG. 3 shows a schematic diagram of a display mode of the display 12 when the music data display system 1 according to the present embodiment is used and data recorded in the storage device 5 is reproduced. The schematic diagram of FIG. 3 shows a state where music of a specific artist is played as BGM when a landscape (distant mountain) is displayed as image data. A landscape as image data is displayed on the most part of the display 12, and in a square frame provided at the lower right of the display 12, the song name information of the song currently output from the speaker 13 is displayed as song data. The record company information that is the CD release source of the music is displayed.

  As described above, by using the information processing technology according to the present embodiment, the music title information, artist information, and the like of the music data included in the broadcast content can be displayed on the display in real time with the output of the music data from the speaker. it can.

  The present invention is applicable to information processing technology related to music.

1 is an overall configuration diagram of a music data display system according to an embodiment of the present invention. It is a block diagram of the feature-value information extraction part of a music data display system. It is a display schematic diagram of a display using a music data display system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Music data display system (information processing apparatus), 3 ... Tuner, 4 ... Feature-value information extraction device, 8 ... OSD part, 9 ... Server, 10 ... Music information database 11 ... Internet, 12 ... display.

Claims (8)

Music data related information extracting means for extracting music data related information related to the music data from AV data including music data;
Music information acquisition means for acquiring music information related to music from outside using the music data related information extracted by the music data related information extraction means as a search key;
An information processing apparatus comprising: storage means for storing the music information acquired by the music information acquisition means and the AV data in association with each other.   2. The information processing apparatus according to claim 1, further comprising output control means for outputting the music information stored in association with the AV data in the storage means when reproducing the AV data. . Information synthesizing means for synthesizing the AV data and the music information;
The information processing apparatus according to claim 2, further comprising: an output unit that outputs information synthesized by the information synthesis unit. The music information acquisition means includes feature quantity information extraction means for extracting feature quantity information characterizing music data from the music data related information,
By communicating with the music information database storing the music data group via the Internet, the feature data and the music data group stored in the music information database are matched, and the music data matching the audio data is obtained. The information processing apparatus according to claim 1, wherein the information processing apparatus acquires the information processing apparatus. Music data related information extracting means for extracting music data related information related to the music data from AV data including music data;
Music information acquisition means for acquiring music information related to music from outside using the music data related information extracted by the music data related information extraction means as a search key, and extracting feature amount information characterizing the music data from the music data related information Music information acquisition means having characteristic amount information extraction means to perform,
An information processing apparatus having storage means for storing the music information acquired by the music information acquisition means in association with the AV data;
A music information database for storing song data groups;
By communicating with the music information database from the information processing device via the Internet, the feature amount information is matched with the music data group stored in the music information database, and music data matching the audio data is obtained. An information processing system characterized by acquiring. Extracting music data related information related to the music data from AV data including music data;
Obtaining music information related to music from outside using the extracted music data related information as a search key;
Storing the acquired music information and the AV data in association with each other;
And a step of outputting the music information stored in association with the stored AV data when reproducing the AV data. The step of acquiring the music information includes
It has the step of acquiring suitable music data based on the music information from the music data group stored in the music information database by communicating with the music information database storing the music data group via the Internet. The information processing method according to claim 6.   The program for making a computer perform the step of Claim 6 or 7.

Images