JP2004309920A - Information processor and portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically extract and join climax parts requested by a viewer from an audio signal or reproduce such a climax part. <P>SOLUTION: In an information providing device 10, an importance judgment part 11, when receiving a TV broadcast, checks the frequency intensity distribution of the audio signal for every prescribed time interval, performs a matching of the frequency intensity distribution with a frequency intensity distribution registered beforehand as an important pattern to judge a part where, for example, similarity is larger than a threshold as an important part. An extraction part 12 extracts audio and video of the part judged by the level of importance judgment part to be important and parts before and after it, copies the extracted parts, and records them in a recording part 13 separately from original video/audio signals. An integration part 14 integrates important parts recorded in the recording part 13 in time series or in arbitrary order. A transmission part 15 transmits the important parts integrated by the integration part 15 to a viewer, e.g. a user of portable telephone set etc. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an information processing device and a mobile terminal device that extract a prominent portion of an audio signal in a television broadcast or the like as an important portion or reproduce the important portion.
[0002]
[Prior art]
In general public broadcasts, the broadcast is generally continued as an information form, and a viewer selects and views a desired program from the broadcast. However, the viewer usually has a particularly interesting portion or an area of interest. For example, in sports programs, it is important to watch the game from the start of a certain competition until the final decision is made, but the moment when a goal is scored or the goal is determined, the viewers are particularly interested, It is common to think that one does not want to miss. For this reason, it is not rare that a broadcasting station creates a digest video such as a special program or a compilation, which is obtained by cutting out only a part desired by a viewer, and further broadcasting it as another program after the competition.
[0003]
Conventionally, as a method of creating such a digest video, there is a method of manually editing the video while viewing the video to create a digest video, or manually assigning an index based on the content and using the index. It was common to search and create a digest video. However, such a method requires a great deal of time and effort since a human needs to watch the entire video.
[0004]
Furthermore, with the development of network technology in recent years, so-called broadband such as ADSL and optical connection has begun to spread, and not only viewing a broadcast using a television receiver but also viewing a so-called streaming program via a network has increased. Have been. However, even in the case of digest video that is streamed via such a network, humans have conventionally manually created the digest video, and many of these have simply been converted from media for general public broadcasting through the network. Time and effort were needed.
[0005]
For this reason, Patent Literature 1 below automatically detects a climax part of an event such as a sport by combining a power level of an entire frequency band and a power level of a specific frequency component. A technique for providing an index has been proposed. According to this technique, since the sound that the audience gets excited is detected, the technique can be applied to many events in general, and a point important in the progress of the event can be automatically detected.
[0006]
[Patent Document 1]
JP 2001-143451 A
[0007]
[Problems to be solved by the invention]
However, according to the technology described in Patent Document 1, since only an excitement portion is indexed, when such an indexed video / audio signal is distributed to, for example, a user of a portable terminal device, the user receives a digest. In order to view the video, it was necessary to search for the index position, which was inconvenient.
[0008]
The present invention has been proposed in view of such conventional circumstances, and automatically extracts and integrates a swell portion required by a viewer from an audio signal, or information processing for reproducing such a swell portion. It is an object to provide a device and a portable terminal device.
[0009]
[Means for Solving the Problems]
In order to achieve the above object, an information processing apparatus according to the present invention, in an information processing apparatus for extracting an important part in an audio signal, obtains a characteristic amount of the audio signal for each predetermined time interval, and Importance judging means for judging importance in the time section based on the information, extracting means for extracting the important part based on the importance, and integrating means for integrating at least a part of the plurality of extracted important parts. It is provided with.
[0010]
Here, the information processing apparatus according to the present invention may further include an information transmitting unit that transmits the information integrated by the integrating unit to the outside.
[0011]
Such an information processing apparatus extracts, for example, an important part from an audio signal of a television broadcast, and integrates at least a part of the extracted plurality of important parts.
[0012]
Further, in order to achieve the above-described object, the portable terminal device according to the present invention obtains a feature amount of an audio signal for each predetermined time section, determines importance in the time section based on the feature amount, A communication unit that communicates with an information processing device that extracts and integrates an important part of the audio signal based on the importance, and a reproducing unit that reproduces the important part.
[0013]
Such a mobile terminal device receives, for example, an important part extracted and integrated from an audio signal of a television broadcast from an information processing apparatus, and reproduces the important part.
[0014]
Further, in order to achieve the above-mentioned object, a portable terminal device according to the present invention, which extracts and reproduces an important part of an audio signal, obtains a feature amount of the audio signal at predetermined time intervals. An importance determining means for determining the importance in the time section based on the feature amount; an extracting means for extracting the important part based on the importance; and at least a part of the plurality of extracted important parts. It is provided with an integrating means for integrating and a reproducing means for reproducing the integrated information.
[0015]
Such a mobile terminal device extracts an important part from, for example, an audio signal of a television broadcast, and integrates and reproduces at least a part of the extracted plurality of important parts.
[0016]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings. In this embodiment, an information providing apparatus for extracting an important part from a video / audio signal, integrating the information processing apparatus and the portable terminal apparatus according to the present invention, and providing the information to a viewer, and reproducing such information. Or a portable terminal device that extracts and integrates an important part from a video / audio signal. In the following embodiments, a television (hereinafter, referred to as TV) broadcast will be described as an example of a video / audio signal.
[0017]
First, before describing the information providing apparatus in the first embodiment, an example of a TV broadcast viewing mode is shown in FIG. The TV broadcast is transmitted from the broadcast station 1 by radio waves, and the telephone company 2 receives it via an antenna. Then, the telephone company 2 processes the TV program which is the received information, and transmits the TV program to a viewer, for example, a user of the receiving terminal 3 such as a mobile phone. Here, in FIG. 1, a normal TV broadcast is used between the broadcast station 1 and the telephone company 2, but the present invention is not limited to this. As shown in FIG. The connection with the company 2 may be made, the connection may be made by a network such as the Internet as shown in FIG. 3, or the connection may be made using satellite communication as shown in FIG. Further, the information that is ultimately provided to the user is not limited to the telephone company, but may be another company or individual other than the telephone company, or the broadcasting station itself. Hereinafter, a company or an individual who processes and provides information to a viewer in this way is defined as an information provider, and a device that performs such processing is defined as an information providing device.
[0018]
The information provider processes the received TV program into a form desired by the viewer. For example, in the case of a sports program, the viewer wants to watch the entire game, but often does not have the time to watch the entire game, or wants to easily watch multiple games, the moment the score is scored, or Often, you only want to see the parts that have developed in favor or disadvantage for the team or player you support. In a scene with such a score, the audience at the venue where the sport is held is also of high interest, and this is specifically shown in the sound in the venue. That is, an acoustic distribution of "Wow" appears acoustically as a response of the audience. In addition, since the venue is rarely changed or moved during the continuation of the game, the acoustic characteristics at the venue are considered to be almost the same, and as a result, the audience's reaction shows the same tendency. In other words, in a climax portion such as a scene with a score, the frequency distribution shows almost the same characteristics.
[0019]
Therefore, in the present embodiment, by utilizing this characteristic, a portion where the frequency distribution shows the above-described characteristic is determined as a swelling portion, and the swelling portion is extracted as an important portion. In the TV broadcast, since the audio and the video are synchronized, the corresponding video is also extracted as having high importance. At this time, if not only the part but also the part before and after the part is extracted within an adjustable range, for example, the scene before and after the score related to the score in the game can be extracted very accurately.
[0020]
FIG. 5 shows a conceptual configuration of an information providing apparatus for extracting an important part and providing the extracted information to a viewer. As shown in FIG. 5, the information providing apparatus 10 includes an importance determining unit 11 that determines a portion having a high importance from the frequency distribution of the audio signal, an extracting unit 12 that extracts the important portion, and a recording of the extracted information. And a transmitting unit 15 that transmits the integrated information to the viewer.
[0021]
Here, upon receiving the TV broadcast, the importance determination unit 11 first checks the frequency intensity distribution of the audio signal for each predetermined time interval. Then, the frequency intensity distribution is matched with a frequency intensity distribution registered in advance as an important pattern, and for example, a portion having a similarity equal to or larger than a threshold is determined as an important portion.
[0022]
That is, as shown in the flowchart of FIG. 6, first, in step S1, a frequency intensity distribution is obtained for each predetermined time interval, and in step S2, it is determined whether or not the frequency intensity distribution matches an important pattern registered in advance. Is determined. If they match in step S2 (Yes), it is determined to be an important part in step S3; otherwise (No), the process proceeds to step S4. In step S4, it is determined whether or not the signal (program) is the last. If the signal is the last (Yes), the process of determining importance is ended. If not (No), the process returns to step S1 to perform the determining process. Continue.
[0023]
Here, the time interval for obtaining the frequency intensity distribution may be, for example, every one second to several seconds, or every frame of the video. When the frequency intensity distribution is obtained for each frame, as shown in FIG. 7, the frequency analysis is performed by using the audio signal corresponding to the frame at the current time “01:20:14” as a selected area, and the frequency intensity distribution is obtained. At this time, the matching accuracy can be improved by using not only the audio signal corresponding to the frame but also the analysis result of the audio signal corresponding to the previous and next frames as shown in FIG. In this case, as shown in FIG. 9, a weighting coefficient having a shoulder around the current time is multiplied for each frequency component, and these are added to correspond to the frame at the current time “01:20:14”. This can be a result of frequency analysis of the audio signal.
[0024]
In addition, by making the threshold value adjustable at the time of matching, various judgments can be made, such as a case where they must exactly match each other or a case where they are similar to some extent. For ambiguous match searches, fuzzy searches using fuzzy and other techniques are available. Further, not only the registered pattern but also a learning function may be provided, and a pattern learned from the registered pattern may be used as a matching template.
[0025]
The extraction unit 12 extracts the video / audio of the part determined to be important by the importance determination unit 11, copies the part, and records it in the recording unit 13 separately from the original video / audio signal. At this time, it is preferable to extract not only the part but also the part before and after the part within an adjustable range. That is, as shown in FIG. 10, for example, when it is determined that the section corresponding to the frame at the time “01:20:14” is important, the section corresponding to the frames before and after that is also extracted. This range can be set, for example, to 3 minutes before and after the important part. Further, by making this range changeable, the range can be changed according to the program to be viewed, thereby increasing the convenience.
[0026]
Further, the extraction unit 12 may not extract the important part at the time when the video is flowing, and may record only the markers of the start point and the end point that the part is important in the recording unit 13. . Also in this case, it is preferable to include before and after the important part. The marker may be embedded or added in the original video / audio signal, but if it is not desired to change the signal itself, it can be recorded in the recording unit 13 as a database separately from the signal. However, in the case of a video signal, for example, it is necessary to easily understand which part of the original signal corresponds to, for example, using position information such as TBC (Time Base Collector) of the signal. It is.
[0027]
The integrating unit 14 integrates the important parts recorded in the recording unit 13 in, for example, a chronological order. At this time, header information for explaining the outline may be added between the important parts. Also, instead of following the time series, they may be replaced in any order and integrated.
[0028]
The transmitting unit 15 converts the important part integrated by the integrating unit 14 into a viewer, for example, a portable terminal device such as a mobile phone or a PDA (Personal Digital Assistance), or a receiving terminal 3 including a TV receiver, a PC (Personal Computer), and the like. Send to users. As a transmission method, the transmitting side may transmit at an arbitrary time, or the viewer may issue a transmission request at an arbitrary time and transmit from the transmitting side in response to the request. In the latter case, it is possible to watch at a time and place desired by the viewer. Further, the transmission form may be transmission using a general network such as the Internet or a dedicated line as shown in FIG. 11, and transmission using satellite communication as shown in FIG. May be used. When the broadcast station itself extracts the important part, the broadcast station may transmit the important part as in the case of the conventional TV broadcast, as shown in FIG.
[0029]
FIG. 14 shows a detailed configuration example of the information providing apparatus 10 described above. As shown in FIG. 14, the information providing apparatus 10 includes a CPU (Central Processing Unit) 100 that integrally controls each unit of the information providing apparatus 10, a ROM (Read Only Memory) 101 that is a nonvolatile memory, A RAM (Random Access Memory) 102 which is a volatile memory, a so-called TV tuner, for example, a video / audio data communication unit 103 for receiving a TV broadcast from a broadcasting station, and a climax for detecting a climax section as described above The section processing unit 104 and a communication circuit 105 that communicates via a network such as the Internet, a dedicated line, or satellite communication or the like are connected via a control line 110 and a data line 120.
[0030]
In such an information providing apparatus 10, the CPU 100 performs control for executing a program according to, for example, a program recorded in the ROM 101. The RAM 102 temporarily stores programs and data necessary for the CPU 100 to execute various processes as needed.
[0031]
The video / audio data communication unit 103 stores the video / audio signal received via the antenna 106 in the RAM 102, and the RAM 102 buffers the signal for a certain period of time and then sequentially outputs the signal to the climax section processing unit 104. It is needless to say that the information may be stored in an external storage device (not shown) such as a memory card instead of the RAM 102.
[0032]
As shown in FIG. 15, for example, the climax section processing unit 104 includes a spectrum conversion unit 150 that spectrally converts a signal on the time axis input via the data line 120 into a signal on the frequency axis, and a pre-registered important section. An important pattern storage unit 151 in which a pattern is stored, a determination unit 152 that determines whether or not data is a swell section for each time section, an extraction unit 153 that extracts a swell section, and each swell section are integrated. It is composed of an integration unit 154 and a data control unit 155 that controls the overall excitement section processing unit 104.
[0033]
The spectrum conversion unit 150 converts the input signal on the time axis into a frequency spectrum by FFT (Fast Fourier Transform) or the like for each of the above-described predetermined time intervals, and obtains a frequency intensity distribution. Then, the determination unit 152 determines the importance by comparing the frequency intensity distribution read from the important pattern storage unit 151 with the frequency intensity distribution obtained by the spectrum conversion. Notify the data control unit 155.
[0034]
Upon receiving the notification from the determination unit 152, the data control unit 155 activates the extraction unit 153, and the extraction unit 153 reads the signal before the important part from the RAM 102 (FIG. 14), and outputs the signal of the important part and the signal thereafter. To the integration unit 154. Then, the integration unit 154 sequentially stores the signals sent from the extraction unit 153 and integrates them as one signal.
[0035]
Returning to FIG. 14, the communication circuit 105 transmits the signal integrated by the integration unit 154 (FIG. 15) to the viewer at an arbitrary time or in response to a transmission request from the viewer.
[0036]
As described above, according to the first embodiment, the information providing apparatus 10 checks the frequency intensity distribution of the audio signal for each predetermined time interval, and performs matching of the frequency intensity distribution with an important pattern registered in advance. By doing so, it is possible to automatically extract and integrate important parts (excitement parts) required by the viewer from the TV broadcast, and to easily provide the important parts to the viewer. Also, the viewer can easily view important parts without performing cueing or the like.
[0037]
Next, in the second embodiment described below, the information providing apparatus 10 does not transmit all of the integrated important parts to the viewer as in the first embodiment, The list information is created and transmitted to the viewer's portable terminal device 20, and the viewer downloads only desired information from the important parts.
[0038]
That is, as shown in the flowchart of FIG. 16, first, in step S10, when the user of the mobile terminal device 20 requests a list of important parts, for example, a list of scoring scenes of team A versus team B, in step S11, the information providing apparatus 10 The list information as shown in FIG. 17 is transmitted to the portable terminal device 20. As a result, a screen as shown in FIG. 18 is displayed on the display unit of the portable terminal device 20.
[0039]
Next, when the user of the portable terminal device 20 checks the check box for the desired scoring scene in the list information shown in FIG. 18 and further selects the button “Receive selection unit”, the portable terminal device 20 proceeds to step S12. The terminal device 20 requests the information providing device 10 to transmit the selected portion.
[0040]
Subsequently, when the information providing apparatus 10 transmits one of the selected portions in step S13, the portable terminal device 20 saves or reproduces the received selected portion in step S14. Then, when the information providing device 10 transmits the last of the selected portion in step S15, the portable terminal device 20 transmits an end notification to the information providing device 10 in step S16.
[0041]
In the case of the mobile terminal device 20 that transmits the ACK notification, when one of the selected portions is received, an acknowledgment indicating that the mobile terminal device has been normally received is returned to the information providing device 10. Sends an acknowledgment indicating that the reception has failed to the information providing apparatus 10.
[0042]
FIG. 19 shows a detailed configuration example of the mobile terminal device 20 that performs such processing. As shown in FIG. 19, the mobile terminal device 20 includes a CPU 200 that controls and controls each unit of the mobile terminal device 20, a ROM 201 that is a nonvolatile memory, a RAM 202 that is a volatile memory, and a display unit 206. , A data reproduction unit 204 that reproduces information stored in the RAM 202 in a displayable manner on the display unit 206, and a communication circuit 205 that communicates via a network such as the Internet. Are connected via the control line 220 and the data line 230. Further, a numeric keypad 207 as an input means is connected to the control line 220, and a speaker 208 for outputting sound and a microphone 209 for collecting sound are connected to the data line 230.
[0043]
In such a mobile terminal device 20, the CPU 200 performs control for executing a program according to, for example, a program recorded in the ROM 201. The RAM 202 temporarily stores programs and data necessary for the CPU 200 to execute various processes as necessary.
[0044]
The communication circuit 205 communicates with the information providing apparatus 10 via the antenna 210, and receives the above-described important information list, information selected from the list, and the like. The communication circuit 205 stores the received information in the RAM 202. It is needless to say that the information may be stored in an external storage device (not shown) such as a memory card instead of the RAM 202.
[0045]
The data reproduction unit 204 performs a process of reproducing data such as a list of important information or selected important information stored in the RAM 202 so that the data can be displayed on the display unit 206.
[0046]
As described above, according to the second embodiment, list information of important parts (excitement parts) extracted in the information providing device 10 is created and transmitted to the viewer's mobile terminal device 20, and the mobile terminal device At 20, the viewer specifies and downloads only desired information from the important parts, so that only the part selected by the viewer can be viewed easily.
[0047]
Subsequently, in a third embodiment described below, unlike the first and second embodiments, an important part is extracted from a TV broadcast received by the portable terminal device itself without passing through the information providing device 10. Integrate and regenerate the integrated key parts.
[0048]
FIG. 20 shows a detailed configuration example of the mobile terminal device 30 that performs such processing. As shown in FIG. 20, the portable terminal device 30 includes a CPU 300 that controls and controls each unit of the portable terminal device 30, a ROM 301 that is a nonvolatile memory, a RAM 302 that is a volatile memory, and a so-called TV tuner. For example, a video / audio data communication unit 303 that receives a TV broadcast from a broadcasting station, an excitement section processing unit 304 that detects an excitement section as described above, and a display control that controls display of an image on the display unit 308. A data reproducing unit 306 that performs processing for reproducing information stored in the RAM 302 so as to be displayed on the display unit 308, and a communication circuit 307 that communicates via a network such as the Internet. And connected through. Further, a numeric keypad 309 as an input means is connected to the control line 320, and a speaker 310 for outputting sound and a microphone 311 for collecting sound are connected to the data line 330.
[0049]
In such a mobile terminal device 30, the CPU 300 performs control for executing a program according to, for example, a program recorded in the ROM 301. In the RAM 302, programs and data necessary for the CPU 300 to execute various processes are temporarily stored as needed.
[0050]
The video / audio data communication unit 303 stores the video / audio signal received via the antenna 312 in the RAM 302. The RAM 302 buffers this signal for a certain period of time, and then sequentially outputs the signal to the climax section processing unit 304. Of course, the data may be stored in an external storage device (not shown) such as a memory card instead of the RAM 302.
[0051]
For example, as shown in FIG. 21, the swelling section processing unit 304 stores a spectrum conversion unit 350 that spectrally converts a signal on the time axis input via the data line 330 into a signal on the frequency axis, and stores an important pattern. An important pattern storage unit 351, a determining unit 352 for determining whether or not the data is a rising section for each time section, an extracting unit 353 for extracting the rising section, and an integrating unit 354 for integrating the rising sections. , And a data control unit 355 that controls the climax section processing unit 304.
[0052]
The spectrum conversion unit 350 converts the input signal on the time axis into a frequency spectrum by FFT or the like for each of the above-described predetermined time sections, and obtains a frequency intensity distribution. Then, the determination unit 352 determines the importance by comparing the frequency intensity distribution read from the important pattern storage unit 351 with the frequency intensity distribution obtained by the spectrum conversion. The data control unit 355 is notified. The important pattern stored in the important pattern storage unit 351 may be a default pattern or a pattern arbitrarily created by the user. Further, the program may be downloaded from a broadcasting station that broadcasts the program via the antenna 313 of the communication circuit 307 before the broadcast of the program, or may be purchased from a predetermined site.
[0053]
Upon receiving the notification from the determination unit 352, the data control unit 355 activates the extraction unit 353, and the extraction unit 353 reads out the signal before the important part from the RAM 302 (FIG. 20), and outputs the signal of the important part and the signal thereafter. And sends it to the integration unit 354. Then, the integration unit 354 sequentially stores the signals sent from the extraction unit 353 and integrates them as one signal.
[0054]
Returning to FIG. 20, the data reproducing unit 306 reads out the signal integrated by the integrating unit 354 (FIG. 21) in response to a reproduction request from a user, for example, and performs a process of reproducing the signal to be displayed on the display unit 308.
[0055]
As described above, according to the third embodiment, the portable terminal device 30 examines the frequency intensity distribution of the audio signal for each predetermined time interval, and performs matching of the frequency intensity distribution with the important pattern. An important part (an exciting part) required by the user from the TV broadcast can be automatically extracted and integrated, and the important part can be easily viewed.
[0056]
It should be noted that the present invention is not limited to only the above-described embodiment, and it is needless to say that various changes can be made without departing from the gist of the present invention.
[0057]
For example, in the above-described embodiment, it has been described that whether or not an important part is determined based on the audio signal of the TV broadcast and audio and video of the important part are extracted. However, the present invention is not limited to this. For example, in the case of radio broadcasting, the same effect can be obtained by extracting only the audio signal of an important part.
[0058]
【The invention's effect】
As described in detail above, the information processing apparatus according to the present invention, in an information processing apparatus for extracting an important part in an audio signal, obtains a characteristic amount of the audio signal for each predetermined time interval, and calculates the characteristic amount based on the characteristic amount. Importance determining means for determining the importance in the time section, extracting means for extracting the important part based on the importance, and integrating means for integrating at least a part of the extracted plurality of important parts. It is provided.
[0059]
Here, the information processing apparatus according to the present invention may further include an information transmitting unit that transmits the information integrated by the integrating unit to the outside.
[0060]
According to such an information processing device, for example, in order to extract an important part from an audio signal of a television broadcast and integrate at least a part of the extracted plurality of important parts, for example, the integrated information is transmitted to a viewer. In this case, the viewer can easily view important parts.
[0061]
Further, the portable terminal device according to the present invention obtains a feature amount of the audio signal for each predetermined time interval, determines importance in the time interval based on the feature amount, and determines the audio signal based on the importance. And communication means for communicating with an information processing apparatus for extracting and integrating important parts, and reproducing means for reproducing the important parts.
[0062]
According to such a portable terminal device, for example, a user can easily view an important part by receiving an important part extracted and integrated from an audio signal of a television broadcast from an information processing apparatus and reproducing the important part. can do.
[0063]
Further, the portable terminal device according to the present invention, in a portable terminal device that extracts and reproduces an important part in an audio signal, obtains a feature amount of the audio signal for each predetermined time section, and determines the time based on the feature amount. Importance determining means for determining importance in a section; extracting means for extracting the important part based on the importance; integrating means for integrating at least a part of the extracted plurality of important parts; And reproducing means for reproducing the information.
[0064]
According to such a portable terminal device, for example, an important part is extracted from an audio signal of a television broadcast, and at least a part of the extracted plurality of important parts is integrated and reproduced, so that the user can easily identify the important part. You can watch.
[Brief description of the drawings]
FIG. 1 is a diagram showing an example of a TV broadcast viewing mode.
FIG. 2 is a diagram showing another example of a connection mode between a broadcasting station and a telephone station.
FIG. 3 is a diagram showing another example of a connection mode between a broadcasting station and a telephone station.
FIG. 4 is a diagram showing another example of a connection mode between a broadcasting station and a telephone station.
FIG. 5 is a diagram illustrating a conceptual configuration of an information providing apparatus according to the first embodiment.
FIG. 6 is a flowchart illustrating a processing procedure of an importance determining unit of the information providing apparatus.
FIG. 7 is a diagram illustrating an example in which a frequency intensity distribution of an audio signal is obtained for each frame of a video signal.
FIG. 8 is a diagram showing an example in which a frequency analysis result of an audio signal corresponding to frames before and after the current time is also used.
FIG. 9 is a diagram illustrating an example of using a frequency analysis result of a preceding frame and a subsequent frame.
FIG. 10 is a diagram showing an extraction section in an extraction unit of the information providing apparatus.
FIG. 11 is a diagram showing an example of a transmission mode from a transmission unit of the information providing apparatus.
FIG. 12 is a diagram illustrating an example of a transmission form from a transmission unit of the information providing apparatus.
FIG. 13 is a diagram illustrating an example of a transmission mode from a transmission unit of the information providing apparatus.
FIG. 14 is a diagram illustrating a detailed configuration example of an information providing apparatus according to the first embodiment.
FIG. 15 is a diagram showing an internal configuration of a climax section processing unit in the information providing apparatus.
FIG. 16 is a flowchart illustrating transmission and reception of data between the portable terminal device and the information providing device according to the second embodiment.
FIG. 17 is a diagram showing an example of an important information list created by the information providing apparatus.
FIG. 18 is a diagram showing a display example on the portable terminal device that has received the important information list.
FIG. 19 is a diagram illustrating a detailed configuration example of a portable terminal device according to the second embodiment.
FIG. 20 is a diagram illustrating a detailed configuration example of a portable terminal device according to the third embodiment.
FIG. 21 is a diagram showing an internal configuration of a climax section processing unit in the information processing apparatus.
[Explanation of symbols]
Reference Signs List 1 broadcasting station, 2 telephone company, 3 receiving terminal, 10 information providing device, 11 importance judging unit, 12 extracting unit, 13 recording unit, 14 integrating unit, 15 transmitting unit, 20 portable terminal device, 103, 303 video / audio Data communication unit, 104, 304 climax section processing unit, 105, 205, 307 communication circuit, 203 display control unit, 204, 306 data reproduction unit, 206, 308 display unit, 207 numeric keypad, 208, 310 speaker

Claims (16)

In an information processing apparatus for extracting an important part in an audio signal,
Importance determining means for determining a characteristic amount of the audio signal for each predetermined time interval, and determining importance in the time interval based on the characteristic amount;
Extracting means for extracting the important part based on the importance,
An integration unit that integrates at least a part of the extracted plurality of important parts. 2. The information processing apparatus according to claim 1, further comprising information transmitting means for transmitting the information integrated by the integrating means to the outside. 2. The information processing apparatus according to claim 1, wherein the importance determining means determines the importance based on a frequency intensity distribution of the audio signal for each time section. The said importance judgment means judges the said importance by comparing the said frequency intensity distribution calculated | required for every said time area with the frequency intensity distribution of an important part registered beforehand. Item 3. The information processing device according to Item 3. The audio signal is accompanied by a video signal,
2. The information processing apparatus according to claim 1, wherein the extraction unit extracts the important part and the video signal at a time corresponding to the important part. 2. The information processing apparatus according to claim 1, wherein the extraction unit extracts the important part and a signal within a predetermined time before and after the important part. The information processing apparatus according to claim 1, wherein the integration unit integrates the plurality of important parts in a chronological order or an arbitrary order. 3. The information processing apparatus according to claim 2, wherein the transmitting unit transmits the integrated information in response to an external request. 3. The information processing apparatus according to claim 2, wherein the transmitting unit transmits the integrated information to the outside at an arbitrary time. Further comprising storage means for storing the important part,
2. The information processing apparatus according to claim 1, wherein the extraction unit stores a copy of the important part in the storage unit. Further comprising a storage means for storing the extracted important part,
The extraction means stores information of the start point and the end point of the important part in the storage means,
2. The information processing apparatus according to claim 1, wherein the integration unit integrates the important part based on the information on the start point and the end point stored in the storage unit. Information processing for obtaining a characteristic amount of an audio signal for each predetermined time interval, determining importance in the time interval based on the characteristic amount, and extracting and integrating an important part in the audio signal based on the importance; Communication means for communicating with the device;
A portable terminal device comprising: a reproducing unit that reproduces the important part. The communication means receives the list information of the important portion from the information processing device, and transmits to the information processing device designation information specifying a desired portion of the list information,
13. The portable terminal device according to claim 12, wherein the reproducing unit reproduces the desired portion transmitted from the information processing device according to the designation information. The important part is extracted based on the importance determined by comparing the frequency intensity distribution of the audio signal for each time section with the frequency intensity distribution of the important part registered in advance. 13. The information processing apparatus according to claim 12, wherein The audio signal is accompanied by a video signal,
13. The portable terminal device according to claim 12, wherein the reproducing unit reproduces the important part and the video signal at a time corresponding to the important part. In a portable terminal device that extracts and reproduces an important part in an audio signal,
Importance determining means for determining a characteristic amount of the audio signal for each predetermined time interval, and determining importance in the time interval based on the characteristic amount;
Extracting means for extracting the important part based on the importance,
An integration means for integrating at least some of the extracted plurality of important parts,
A portable terminal device comprising: a reproducing unit that reproduces the integrated information.

Images