JP4735413B2 - Content playback apparatus and content playback method - Google Patents

Description

  The present invention relates to a content playback apparatus and content playback method, such as a television broadcast program.

  For example, a recording / reproducing apparatus that records content such as a television broadcast program on a large-capacity recording medium such as a hard disk or a DVD (Digital Versatile Disc) and reproduces the recorded content such as the television broadcast program is widely used. In particular, a hard disk has a very large recording capacity and can store a large amount of content.

  In this way, since there is a sufficient recording capacity, for example, in the case of a television broadcast program, for the time being, a television broadcast program that can be viewed is recorded on a recording medium, and is later viewed. Usage is possible.

  However, when viewing later, it takes a long time to reproduce all of the recorded TV broadcast programs at normal speed. This is a big problem for a user who cannot take a long viewing time, and there is a problem that there are many cases where it is not possible to make many opportunities to view the recorded TV broadcast program.

  For this reason, there is a demand for reproducing only a necessary scene (scene) rather than reproducing and viewing all the recorded television broadcast programs. For example, it is conceivable to search for a scoring scene in a recorded sports program. In such a case, in the conventional technique, the desired scene is searched while sequentially reproducing the desired scene by variable speed reproduction such as 1.5 times speed to 10 times speed reproduction.

  However, in such a search operation, for example, since the screen changes at high speed, there may be a case where a desired searched scene is overlooked. Further, since a desired scene is searched for while viewing a screen that changes at high speed, eye fatigue or the like can be considered for the user.

  As a technique for reducing this problem, a so-called digest playback function has been proposed in which main scene sections are extracted from a television broadcast program and the program is played back in a short time (for example, Patent Document 1). (Refer to Unexamined-Japanese-Patent No. 2002-199333).

  When performing the digest playback, first, a plurality of types of feature amounts, such as silence, black level, cheer, and presence / absence of telop, which are determined in advance for video signals and audio signals of TV broadcast programs, are detected, and the feature amounts are detected. The program is divided into a plurality of scenes by detecting scene change points based on the above. At this time, the feature amount corresponding to each scene is also stored.

  Next, scenes to be digest-reproduced are extracted from the television broadcast program, and what kind of scene is extracted is determined by paying attention to the feature amount according to the genre of the television broadcast program. For example, if it is a TV broadcast program of a sports genre, a scene where the audience is cheering is extracted, and if it is a news program, an announcer extracts the scene shown in the center. A feature quantity to be noticed is determined according to the genre of the program, and a scene having a larger feature quantity is extracted.

  For this reason, the genre of the television broadcast program that is the subject of digest playback is detected, and according to the detected genre, it is set based on which feature amount the scene is extracted. Next, information of a scene section having a larger set feature amount (this section information is referred to as digest information) is detected from a television broadcast program to be digest reproduced. Then, the digest reproduction is executed by reproducing only the scene section indicated by the detected digest information.

The above-mentioned patent documents and patent documents to be referred to are as follows.
JP 2002-199333 A

  However, the digest reproduction method described in Patent Document 1 described above is troublesome because digest information must be generated in advance. In addition, since the digest information is generated using a predetermined feature amount according to the genre, there is a problem that a scene desired by the user is not always extracted.

  Furthermore, since the digest reproduction reproduces only the scene section indicated by the digest information, it is not possible to obtain a reproduction mode in which only the scene section desired by the user is reproduced at the normal reproduction speed while being reproduced at high speed.

  In view of the above points, an object of the present invention is to provide a content playback apparatus and a content playback method that have improved the above problems.

In order to solve the above problems, the invention of claim 1
A storage unit for storing predetermined feature data for each content classification type;
During a predetermined reproduction, the segmentation section feature data acquisition section for acquiring characteristic data of each segment section specified by adjacent ones of the separated data playback-target content,
A classification type detecting unit for detecting the classification type of the content of the reproduction object,
A reading unit that reads out the predetermined feature data from the storage unit for a classification type that is the same as or the same type as the classification type of the content to be reproduced detected by the classification type detection unit ;
The feature data for each segment section acquired by the segment section feature data acquisition unit is compared with the predetermined feature data read from the storage unit , the feature data for each segment section, and the storage unit A determination unit for determining whether or not the predetermined feature data is the same or similar;
When the determination unit determines that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control unit that controls to play back at a playback speed different from other sections;
Equipped with a,
The predetermined feature data for each content category type is the segment segment feature data preferred by the user for each content category type,
The storage unit monitors the user's operation input, and classifies the content data of the segment segment of the content for which the operation input requesting normal reproduction of the content is the predetermined feature data. Store it in association with the type information,
The predetermined playback time is a high-speed playback time, and the control unit provides a content playback device that controls to play back at a normal playback speed in the segment section determined to be the same or similar .
The invention of claim 6
A storage unit for storing predetermined feature data for each content classification type;
A segment segment feature data acquisition unit for acquiring feature data for each segment segment specified by adjacent ones of the data segment of the content to be reproduced at a predetermined playback time;
A classification type detection unit for detecting the classification type of the content to be reproduced;
A reading unit that reads out the predetermined feature data from the storage unit for a classification type that is the same as or the same type as the classification type of the content to be reproduced detected by the classification type detection unit;
The feature data for each segment section acquired by the segment section feature data acquisition unit is compared with the predetermined feature data read from the storage unit, the feature data for each segment section, and the storage unit A determination unit for determining whether or not the predetermined feature data is the same or similar;
When the determination unit determines that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control unit that controls to play back at a playback speed different from other sections;
With
The predetermined feature data for each content category type is feature data of the segment interval that the user does not like for each content category type,
The storage unit monitors the operation input of a user and classifies the content data of the segment segment of the content for which the operation input requesting that the content is not normally reproduced as the predetermined feature data. Store it in association with the type information,
The predetermined reproduction time is normal reproduction time, and the control unit controls to perform high-speed reproduction or skip reproduction in the segment segment determined to be the same or similar.
A content reproduction apparatus is provided.

  According to the first aspect of the present invention, the feature data for each segment section (for example, corresponding to the scene of the video content) is acquired by the segment section feature data acquisition means during predetermined playback, for example, high-speed playback.

  Then, the acquired feature data for each segment section is compared with the predetermined feature data for the classification type that is the same as or the same type as the classification type of the content to be reproduced read from the storage means, and for each segment section When the feature data and the predetermined feature data are determined to be the same or similar, the segment section is played back at a playback speed different from that of the other sections.

  For example, the predetermined playback time is high-speed playback, and control is performed so that normal speed playback is performed in the segment section in which the feature data is determined to be the same or similar to the predetermined feature data. Can do. Therefore, by setting the predetermined feature stored by the storage means as the feature data of the segment interval preferred by the user, the segment interval estimated to be preferred by the user having the same or similar feature as the predetermined feature is usually It is possible to realize a playback mode in which speed playback is performed and others are played back at high speed.

  In addition, for example, the predetermined reproduction time is normal speed reproduction, and high speed reproduction or jump reproduction is performed in the segment segment in which the characteristic data is determined to be the same or similar to the predetermined characteristic data. Can be controlled. Therefore, by setting the predetermined feature stored by the storage means as the feature data of the segment interval that the user does not like, the segment interval estimated that the user having the same or similar feature as the predetermined feature is not preferable is Thus, it is possible to realize a playback mode in which high-speed playback or jump playback is performed and normal speed playback is performed in other sections.

  According to the present invention, a segment section having the same or similar characteristics as a segment section such as a scene desired by a user is played at normal speed, and other sections are played back at high speed, or a segment section such as a scene not desired by the user is selected. Segment segments having the same or similar characteristics can be played back at high speed or jump playback, and other segments can be played back at normal speed.

  Hereinafter, embodiments of a content reproduction apparatus and a content reproduction method according to the present invention will be described with reference to the drawings. The embodiment described below is a case where the present invention is applied to a recording / reproducing apparatus that records and reproduces a TV broadcast program and video / audio content downloaded from the Internet, and the content to be reproduced is recorded on a recording medium. TV broadcast programs and downloaded contents. The following embodiments are examples when the present invention is applied to a recording / reproducing apparatus, and the embodiments of the content reproducing apparatus and the content reproducing method are embodied in the reproducing system of the recording / reproducing apparatus, respectively. .

[First Embodiment]
In the first embodiment, an information signal composed of a video signal and an audio signal of a received television broadcast program is recorded on a built-in recording medium such as a built-in hard disk device, and the information signal recorded on the built-in recording medium is recorded. This is an example in the case where the present invention is applied to a recording / reproducing apparatus having a function of reading and reproducing.

  The recording / reproducing apparatus of this embodiment can use a removable external recording medium such as a DVD as a recording medium, and the present invention can be similarly applied to the external recording medium. However, since the explanation is complicated, the recording / reproducing system for the external recording medium is omitted in the example of FIG. Also in the following description, for convenience, it is assumed that only a built-in recording medium is used as a recording medium, and recording / reproducing processing for an external recording medium is omitted.

  The recording / reproducing apparatus of this example only has a function of recording a video signal and an audio signal such as a TV broadcast program on an internal recording medium and reproducing the video signal and the audio signal recorded on the internal recording medium. In addition, a feature amount (feature data) of a video signal and an audio signal or a reproduced video signal and an audio signal of a TV broadcast program to be recorded is detected, and a scene change point as a feature point is detected from the detection output, It has a function of recording necessary information among detected scene change point information on a recording medium together with an information signal such as a television broadcast program.

  Here, the scene change point corresponds to the delimiter of the information signal, for example, not only the delimiter between the program main part and the commercial (hereinafter abbreviated as CM) but also the start point and the end point of the program advertisement section in the program main part. In addition to the start and end points of program opening and program ending sections, scene change points (so-called scene changes) where the scene changes greatly are included in the main part of the program. In this embodiment, when a plurality of CMs are continuous, the start point and end point of each CM can be detected as a scene change point.

  In the description of this embodiment, a section of an information signal (video signal or audio signal) of a television broadcast program specified by an adjacent scene change point, that is, a section between adjacent scene change points (this is divided into segments). (Referred to as a section) will be referred to as a scene. This scene is a section of a few seconds at the shortest, and a “corner” such as a sports corner or a cooking corner in a program usually consists of a plurality of continuous scenes. However, when the detected scene section is long, the corner may be composed of one scene.

[Hardware Configuration Example of Recording / Reproducing Apparatus of First Embodiment]
FIG. 1 is a block diagram illustrating a hardware configuration example of the recording / reproducing apparatus according to the first embodiment. In FIG. 1, a system controller unit 20 includes a microcomputer, and controls various modes and other operations in the recording / reproducing apparatus of this example.

  For example, operation input information is supplied to the system controller unit 20 through a user input interface unit 21 in accordance with a user operation input using the remote commander 22. The system controller unit 20 determines the input operation input information, and executes processing according to the operation input information.

  A display unit 24 such as an LCD (Liquid Crystal Display) is connected to the system controller unit 20 through a display processing unit 23. The display unit 24 displays display information that serves as a reference when a user inputs an operation. Is done. The user can input various operations while viewing the display on the display unit 24.

<Recording system processing>
First, the recording system of the recording / reproducing apparatus of this example will be described with reference to FIG.
When a user inputs a command for recording instruction using, for example, the remote commander 22, the operation information is supplied to the system controller unit 20 through the user interface unit 21, and the recording / reproducing apparatus is controlled by the system controller unit 20. Performs the following recording process.

  In this example, the broadcast receiving unit 2 includes a TV tuner, a video and audio intermediate frequency circuit, and a video and audio detection circuit for receiving terrestrial analog TV broadcasts.

  Prior to the command input for the recording instruction described above, the user performs a channel selection input operation using the remote commander 22. Then, the operation information is supplied to the system controller unit 20 through the user interface unit 21, and the system controller unit 20 broadcasts channel selection control information for selecting a broadcast channel corresponding to the user's channel selection operation. Supply to the receiver 2. At the time of this channel selection, the system controller unit 20 displays the broadcast channel being selected on the display unit 24 through the display processing unit 23, so that the user can perform the channel selection operation while watching the display on the display unit 24. To do.

  The broadcast receiving unit 2 receives the channel selection control information, selects and extracts a broadcast program of the broadcast channel selected by the user from the television broadcast wave received by the receiving antenna 1, and outputs a video signal from the selected and extracted broadcast program. And output an audio signal.

  The video signal and audio signal of the television broadcast program selected and extracted by the broadcast receiving unit 2 are supplied to the video signal recording and encoding unit 3 and the audio signal recording and encoding unit 4 so as to have a predetermined sampling frequency and a predetermined number of quantization bits. A / D (Analog to Digital) conversion signal processing is performed, and the converted digital video signal and digital audio signal are subjected to recording encoding processing.

  Here, as the recording encoding process, the digital audio signal is subjected to a data compression process using a predetermined band compression method such as MPEG audio or AC-3 audio (Dolby AC-3 or Audio Code Number 3). .

  For digital video signals, data compression processing is performed as a recording encoding process by a predetermined band compression method such as MPEG video or wavelet conversion. The video data subjected to the data compression process is multiplexed with the compressed audio data and recorded on the built-in recording medium 6 through the recording processing unit 5.

  At this time, identification information (recorded program identification information) is given to the broadcast program to be recorded, and the compressed video data and the compressed audio data are recorded on the recording medium 6 with the recorded program identification information added. This recorded program identification information is used for retrieval during reproduction. Here, the built-in recording medium 6 is composed of a hard disk device in this example.

  Further, in the recording / reproducing apparatus of this example, the broadcast receiving unit 2 extracts information related to a broadcast program superimposed in the vertical blanking period, for example, and supplies the extracted information to the genre determination unit 7. The genre determination unit 7 determines the classification type of the broadcast program content, that is, the genre, from the received information on the broadcast program, and inputs the determination result to the system controller unit 20.

  Further, in the recording / reproducing apparatus of this example, the digital video signal from the video signal recording / encoding unit 3 and the digital audio signal from the audio signal recording / encoding unit 4 are supplied to the feature extraction processing unit 8 to determine various predetermined types. Feature data is detected, and the detected feature data is supplied to the scene change point detection unit 9 and also to the system controller unit 20.

  The feature data detection performed by the feature extraction processing unit 8 includes a section between a program main part and a CM, and when a plurality of CMs are continuous, the detection of the start point and end point of each CM is silent. Section detection, black level section detection, and the like are used. Also, since the time length of the CM section is a multiple of 15 seconds, such as 15 seconds, 30 seconds, 45 seconds, 60 seconds, etc., the time length of the detected silent section or black level section is 15 seconds. Is also used to detect the CM section.

  As other feature data detection, scene change detection, telop detection, person detection, skin color detection, talk detection, music detection, climax detection, and the like are used. Here, the swell detection is performed by detecting that there is a sudden change in volume or a large applause from a quiet state.

  That is, in this example, the feature extraction processing unit 8 uses predetermined video data, audio data, and predetermined parameter data to determine predetermined telop feature data (telop section determination data), person feature data, and other image feature data. (Image feature section determination data), and various feature extraction processing of speaker voice feature data (speaker voice determination data), applause cheer feature data (applause cheer determination data), and other voice feature data (speech feature section determination data) Is done.

  The feature extraction processing unit 8 receives video data and audio data obtained from the video signal recording / encoding processing unit 3 and the audio signal recording / encoding unit 4 during the data compression process. In this example, as will be described later, in consideration of performing feature extraction processing on the playback signal and detecting scene change points, feature extraction processing and scenes are obtained using data obtained during the data compression process. The change point detection unit 9 detects a scene change point.

  In this way, when performing feature extraction processing and scene change point detection on the playback signal, it is not necessary to completely compress and decode the playback signal to restore the original digital audio data and digital video data. The feature extraction process and scene change point detection can be performed using the data in the middle of the decoding process, and there is an advantage that the detection process is accelerated.

  The scene change point detection unit 9 detects a scene change point from the feature data extracted by the feature extraction processing unit 8. In this case, as described above, the scene change point detection unit 9 is not limited to, for example, the division between the program main part and the CM, but the start and end points of the program advertisement section in the main part of the program, program opening and program ending In addition to the start and end points of the section, the scene change point where the scene changes greatly in the main part of the program, and when a plurality of CMs continue, the scene change as a break between each CM start point and end point It detects as a point (characteristic point). In this example, the scene change point detection data includes the position information of the start point and end point of the CM, the program main part, the program opening, and the program ending (for example, the frame number based on the start position of the broadcast program including the CM). (Or field number)).

  If the received broadcast program information includes information such as the program title and the program genre, the feature extraction processing unit 8 also detects the program title and genre information as feature data. And sent to the scene change point detector 9. Therefore, the scene change point detection unit 9 detects a scene change point using the program title and genre information.

  Then, the position data of the scene change point from the scene change point detection unit 9 is supplied to the system controller unit 20. The system controller unit 20 generates feature data for each segment section (scene) that is a section between adjacent scene change points detected by the scene change point detection unit 9 and supplies the feature data to the additional information file generation unit 10. To do. At this time, the data supplied from the system controller unit 20 to the additional information file generation unit 10 includes a set of positional information of adjacent scene change points for specifying a scene and feature data of the scene. Further, the genre of the recorded broadcast program determined by the genre determining unit 7 is also supplied to the additional information file generating unit 10 as a part of the additional information.

  The additional information file generation unit 10 includes the data received from the system controller unit 20 in the additional information file and sends the data to the recording processing unit 5. The recording processing unit 5 records the additional information file in a predetermined recording area of the recording medium 6, in this example, the area of the additional information file, in association with the recorded program information by the recorded program identification information.

  In this case, in this embodiment, the position data of the scene change point is, for example, the video data of a lump of the broadcast program to be recorded by using the frame number (or field number) of the broadcast program to be recorded. And the frame position (or field position) of the audio data.

  For the feature data extraction for each scene, for example, the one described in Japanese Patent Application No. 2004-233934 can be used in detail, but the detailed description thereof is omitted here.

  FIG. 2 shows an example of data recorded as an additional information file. In this example, the feature data includes a feature type detected for each scene and a detection ratio as an example of a feature amount of each feature type. Here, the detection ratio is, for example, a ratio at which predetermined feature data for the entire predetermined scene section is detected.

For example, when a certain scene section length is fa, and it is assumed that the detection section of a certain feature data P is a part f0 and f1 of the fa, the detection ratio F of the feature data P is
F = (f0 + f1) / fa
It is represented by

  The feature type is defined as follows, for example. 4 and 5 are diagrams for explaining the feature types. In this example, voice attribute information, color feature information, similar image information, person feature information, telop feature information, camera feature information, and scene change information are used as attribute information of feature data.

  The attribute information of each feature data is divided into a plurality of feature types, and in this example, a feature type identification code consisting of a combination of alphabets and numbers is assigned to each of the feature types. Has been.

  That is, the voice attribute information is divided into three types of features, “speaker voice”, “music”, and “others (cheers, applause)”. In the example, A1, A2, and A3 are assigned as feature type identification codes.

  Further, the color feature information is divided into four types as the feature type indicating in which area on the screen a predetermined color is detected, and for each of them, a combination of alphabet B and number, in this example B1 , B2, B3, B4 are assigned as feature type identification codes. In this example, the color feature detection areas are, as shown in FIG. 5, four areas 1, area 2, area 3, and area 4, which are divided into four in the vertical direction of the screen.

  The similar image information is divided into two types of first and second appearance frequencies of similar images as feature types. For each of them, a combination of alphabet C and number, in this example, C1, C2 is assigned as a feature type identification code.

  In addition, the person feature information is divided into five types as the feature type indicating in which area on the screen the feature detected as a person is detected. For each of them, a combination of alphabet D and number, In the example, D1, D2, D3, D4, and D5 are assigned as feature type identification codes. In this example, as shown in FIG. 6, the human feature detection area is the sum of the area 1, the area 2, the area 3, and the area 4 obtained by dividing the screen vertically and horizontally and the center area 5. There are five areas.

  The telop feature information is divided into four types as the feature type indicating in which area on the screen the telop is detected. For each of them, a combination of alphabet E and number, in this example, E1, E2, E3 , E4 are assigned as feature type identification codes. In this example, the detection area of the telop feature information is the same as the color feature, as shown in FIG. 5, the four areas 1, 2, 3, 4, which are divided into four in the vertical direction of the screen. Has been.

  The camera feature information has three types of feature types, that is, a state where the camera is stationary, a zoom state, and a pan state. For each of them, a combination of alphabet F and number, in this example, F1, F2, F3 Are assigned as feature type identification codes.

  As shown in FIG. 2, the feature types stored in the additional information file are the feature type codes present in the scene section of the above-described feature types and the detection ratio as the feature amount. In this case, not all the feature types that existed in the scene are recorded as additional information, but those that have feature values of a predetermined value or more are recorded.

  Note that the scene change point position data, feature data, and genre information from the scene change point detection unit 9 are not recorded as an additional information file, but supplied to the multiplexing processing unit in the recording processing unit 5 for compression encoding. The processed video data and audio data may be multiplexed and recorded in a predetermined recording area of the recording medium 6.

  In the recording / reproducing apparatus of the example of FIG. 1, the content to be recorded is not limited to the broadcast program received by the broadcast receiving unit 2. That is, the recording / reproducing apparatus of this embodiment is configured to access the Internet through the communication interface 11 and download and record content such as movies, news, dramas, and sports programs from a predetermined content server. Has been.

  That is, the video data and audio data obtained by downloading from the content server are supplied from the communication interface 11 to the video signal recording / encoding unit 3 and the audio signal recording / encoding unit 4, and the same as in the case of the broadcast program content described above. To be recorded on the recording medium 6.

  Also at this time, feature data is extracted from the video data and audio data by the feature extraction processing unit 8, and the scene change point detection unit 9 detects the scene change point in the same manner as in the case of the broadcast program described above. The additional information file is generated and recorded on the recording medium 6 in association with the recorded content data.

  In this case, the content data to be downloaded also includes the genre information of the content, and the genre information is supplied from the communication interface 11 to the genre determination unit 7 to download the genre information of the downloaded content. Is determined. The genre information determined by the genre determination unit 7 is included in the additional information file and recorded through the system controller unit 20.

  When genre information cannot be obtained from the information received by the broadcast receiving unit 2, the Internet is accessed through the communication interface 11, the telegram program guide data of the broadcast program is acquired through the Internet, and the electronic program guide data is obtained. The genre of the broadcast program received and recorded by the genre determination unit 7 can be determined from the inside.

  Note that the processing of the genre determination unit 7, the feature extraction processing unit 8, the scene change point detection unit 9, and the additional information file generation unit 10 can be software processing by a microcomputer of the system controller unit 20.

<Reproduction system processing>
Next, the reproduction system of the recording / reproducing apparatus of this example will be described with reference to FIG.

  When the user inputs a playback instruction in the normal playback mode from the recording medium 6 through, for example, the remote commander 22, it is input to the system controller unit 20 through the user input interface unit 21. Upon receiving this user input, the system controller unit 20 controls the read control unit 12 to perform the normal reproduction mode.

  In response to the control instruction from the system controller unit 20, the read control unit 12 reads out the compressed video data and the compressed audio data of the broadcast program designated for reproduction from the recording medium 6 and supplies them to the reproduction processing unit 13. The reproduction processing unit 13 supplies the compressed video data and the compressed audio data of the broadcast program specified by the user, read from the recording medium 6, to the video signal reproduction decoding output unit 14 and the audio signal decoding output unit 15. .

  In the video signal reproduction decoding output unit 14, the compressed video data is subjected to a predetermined decoding process corresponding to a signal processing system subjected to band compression processing at the time of recording to be converted into a digital video signal, and then a D / A conversion process is performed. Then, it is output as an analog video signal through an output terminal (not shown).

  In the audio signal decoding output unit 15, the compressed audio data is subjected to a predetermined decoding process corresponding to a signal processing system subjected to band compression processing at the time of recording, and the digital audio signal obtained by the decoding process is converted into D / D An A (Digital to Analog) conversion process is performed, and an analog audio signal is output through an output terminal (not shown).

  The recording / reproducing apparatus of this embodiment is configured so that the user can control the change of the reproduction speed in the reproduction mode, and an operation button for that purpose is provided on the remote commander 22, and the operation button is When operated, the system controller unit 20 is configured to reproduce content at a reproduction speed corresponding to the operation button.

  For example, when a pressing operation is performed during playback, the system controller unit 20 controls a fast-forward operation button for controlling the fast-forward playback of the pressing operation section, or when the pressing operation is performed, the system controller unit 20 starts from that point. A skip reproduction instruction operation button for controlling to perform skip or high-speed reproduction up to a reproduction position ahead by a fixed time is provided.

  In addition, the recording / reproducing apparatus of this embodiment is configured with a repeat operation button for controlling the system controller unit 20 to repeat a predetermined scene section operated by a user during reproduction. .

  The recording / reproducing apparatus according to the first embodiment, as will be described later, in addition to a mode in which normal fast-forward playback or rewind playback is performed when a fast-forward operation button or a rewind playback button is operated, Features that are the same as or similar to the scene section (key frame section) that the user is watching and watching at any time when the operation button or the rewind playback button is operated to perform fast forward playback or rewind playback. The key frame detection mode can be set so that the playback speed is automatically controlled to be changed to the normal speed to be used for viewing by the user.

  That is, the recording / reproducing apparatus of this embodiment includes an on / off operation button for the key frame detection mode, and can set whether to turn the key frame detection mode on or off.

  When the key frame detection mode is off, normal fast forward playback and rewind playback are performed when the fast forward operation button or the rewind playback button is operated. In addition, when the fast-forward operation button or the rewind playback button is operated to perform fast-forward playback or rewind playback when the key frame detection mode is on, the user always pays attention to the recording / playback apparatus of this embodiment. The playback speed is automatically controlled to be changed to the normal speed in the scene section having the same or similar characteristics as the scene section being viewed.

  In the recording / playback apparatus of the first embodiment, the number of times of repeat playback, the number of normal playback after search playback, etc., for the scene section in which the user plays back or search playback and then normal playback, etc. Are stored in correspondence with the genre of the content (broadcast program in this example) including the scene and the feature data of the scene. In the first embodiment, a scene with a high user evaluation value in the positive direction is called a key frame (important scene) of the corresponding genre.

  The correspondence information stored between the genre, the key frame feature data, and the user evaluation value of the key frame is referred to as key frame feature information in the first embodiment. In the recording / playback apparatus of FIG. It is stored in the key frame feature information memory unit 25.

  This key frame feature information is not stored for each content, but for each genre. FIG. 7 shows an example of key frame feature information stored in the key frame feature information memory unit 25.

  That is, in this example, feature data and user evaluation values for key frames are stored for each genre, but the feature type and feature amount (detection ratio in this example) are stored as feature data. The In this example, a plurality of key frames are stored for each genre.

  In this embodiment, among a plurality of key frames stored for each genre, for example, a scene section that is the same as or similar to a key frame having an evaluation value equal to or higher than a predetermined value is selected as a key frame detection mode. In the state where is turned on, the scene section is played back at a normal playback speed as a key frame (important scene) that the user always pays attention to.

  In this embodiment, in practice, during playback, information on the operation section of the repeat playback button operation, the fast forward operation button and the normal speed playback operation button is held, and when playback is finished, The key frame section is detected based on the information of the operation section of each operation button held. Then, the additional information file recorded in the recording medium 6 is read out via the additional information file processing unit 16, the feature data of the detected scene section of the key frame is acquired, and detected in the key frame feature information memory unit 25. The key frame feature information of the key frame section is stored.

  At this time, in this embodiment, if the feature data of the detected key frame is the same as or similar to the feature data already stored in the key frame feature information memory unit 25, the key frame feature information has already been obtained. Is stored, the user evaluation value of the stored key frame feature information is updated. In this example, since the user evaluation value is the number of times (the number of reproductions or the number of detections), the number is increased by one.

  In this embodiment, the similar feature data newly detected as the key frame is averaged with the similar feature data stored in the key frame feature information memory unit 25 until then. The new feature data is reflected in the key frame feature information stored.

  When the detected feature data of the key frame is not the same as or similar to the feature data already stored in the key frame feature information memory unit 25 and is detected as a new key frame, the key frame It is additionally stored as new key frame feature information in the corresponding genre in the feature information memory unit 25.

  Thus, in this example, after the reproduction is completed, the stored contents of the key frame feature information memory unit 25 are updated.

  In the example of FIG. 7, the scene number is stored. However, this is for identifying a key frame (important scene), and does not need to be stored. Further, as the feature data, only the feature type may be stored without storing the feature amount (for example, the detection ratio). FIG. 8 shows an example of data stored in the key frame feature information memory unit 25 in that case.

  When the normal playback mode is instructed by the user, and the additional information file is not recorded corresponding to the broadcast program data recorded on the recording medium 6, the recording / playback apparatus of this embodiment Asks "Do you want to generate the additional information file because it does not exist?"

  In response to this inquiry, when the user performs a reply operation of “YES (generates additional information file)”, the system controller unit 20 of the recording / reproducing apparatus reads the recorded broadcast program before executing the reproduction mode. The recorded data is read out, and the video data and the audio data are supplied to the feature extraction processing unit 8 through the playback processing unit 13, the video signal playback decoding output unit 14 and the audio signal playback decoding output unit 15. Control is performed to execute feature data extraction processing and scene change point detection in the scene change point detection unit 9. Then, the additional information file including the feature data extracted by the feature extraction processing unit 8 and the information of the scene change point detected by the scene change point detection unit 9 as shown in FIG. The data is recorded on the recording medium 6 in association with the recording data of the broadcast program.

  Note that, in the broadcast program information recorded on the recording medium 6, a state in which no additional information file including scene change point information and feature data is recorded is obtained from an external recording medium such as a DVD, for example. Occurs when the recording medium 6 is loaded.

  Thus, for example, even if the external recording medium is not recorded by the recording / reproducing apparatus of this embodiment and the additional information file is not recorded, the key frame as described later in the recording / reproducing apparatus of this embodiment is used. The detection mode can be executed.

[Keyframe detection mode]
In the recording / reproducing apparatus of this embodiment, the key frame detection mode can be turned on / off by a user's button operation. When the key frame detection mode is turned off, as described above, when a fast forward operation or a rewind operation is performed by the user, the normal fast forward processing operation and the rewind processing operation similar to the conventional one are performed.

  When the key frame detection mode is on and a fast forward operation or rewind operation is performed by the user, the system controller unit 20 performs playback at the normal playback speed in the key frame section, In the section, a fast forward processing operation and a rewind processing operation are performed. Here, the fast-forward processing operation and the rewind processing operation may be operations that do not involve reproduction, or may involve reproduction operations such as a fast-forward reproduction operation and a rewind reproduction operation.

  The operation when the key frame detection mode is turned on is shown in FIGS. A specific example will be described with reference to FIG.

  For example, FIG. 9 shows an example of an image from a scene n to a scene (n + 5) of a broadcast program whose genre is “News”, and FIG. 10 shows an example of image feature data of each scene n to (n + 5). Is.

  In the example of FIG. 9, in the scene (n + 1) and the scene (n + 2), the key frame section is set such that, for example, the user performs a repeat playback operation or shifts from the fast forward state to the normal playback state. It is assumed that the section of the scene (n + 1) and the scene (n + 2) is a key frame (important scene) section.

  Therefore, when the reproduction of the “news” content in the example of FIG. 9 is completed, the recording / reproducing apparatus of this embodiment in FIG. 10 shows the feature type code in which the circles are added to the scene (n + 1) and the scene (n + 2). The feature amount is stored in the key frame feature information memory unit 25 as shown in FIG.

  When a user performs a fast forward operation or a rewind operation in a state where the key frame detection mode is set to ON during the reproduction of another “news” broadcast program, the recording / reproduction device of this embodiment The system controller unit 20 reads the additional information file for the other “news” broadcast program from the recording medium 6 through the additional information file processing unit 16, acquires the feature data of each scene, and stores the key frame feature information memory The high-speed reproduction of the other “news” broadcast programs is executed while comparing with the characteristics of the key frames for the same genre stored in the unit 25.

  As a result of comparison between the feature data of each scene acquired from the additional information file and the feature data of the key frame for the same genre as the broadcast program being reproduced, read from the key frame feature information memory unit 25, feature data When scenes with the same or similar are detected, as shown in FIG. 11, in the scene section where the feature data is similar, the playback speed is controlled from the high playback speed to the normal playback speed (1 time), and the feature is detected. The image contents of scene sections with similar data are normally reproduced. Then, when the scene section with similar feature data ends, the normal playback speed is returned to the high speed playback speed again.

  Thus, in the key frame detection mode, when the user performs a fast forward operation or a rewind operation, a scene that is watched and watched at any time in a program of the same genre is automatically reproduced at a normal reproduction speed. Therefore, in this embodiment, the user can view the scene being watched in the normal playback state without any special operation.

  In the example of FIG. 11, the playback speed control in the ON state of the key frame detection mode is performed in two stages, such as from a predetermined high speed state to a normal speed and from a normal speed to a high speed state. The two-stage playback speed control may be changed step by step, or may be gradually decreased or gradually increased as in the example of FIG.

  In this case, the key frame to be detected may be the same as or similar to the feature data having the highest user evaluation value in the same genre stored in the key frame feature information memory unit 25. As described above, the user evaluation value may be the same as or similar to feature data higher than a predetermined value.

  Further, the playback speed may be changed in multiple stages according to the user evaluation value. For example, as shown in FIG. 12A, four threshold values of 0, E1, E2, and E3 (0 <E1 <E2 <E3) are set as the threshold values of the user evaluation value, and the detected key frame Depending on the value of the evaluation value E, the playback speed may be changed in multiple stages as shown in FIG. 12 (B) or (C).

  For example, when (1) 0 <E <E1, the playback speed is set to triple speed as shown in FIG. (2) When E1 ≦ E <E2, the playback speed is set to double speed as shown in FIG. (3) When E2 ≦ E <E3, the reproduction speed is set to 1.5 times as shown in FIG. (4) When E3 ≦ E, the playback speed is set to 1 × speed (normal speed) as shown in FIG.

  In the case of FIG. 12B, the playback speed is controlled to change stepwise, and in the case of FIG. 12C, the playback speed is controlled to change gradually and gradually. It is.

  The change gradient of the reproduction speed in the case of FIG. 12C may be changed between deceleration and acceleration as shown in FIG. That is, FIG. 13A shows a case where the reproduction speed is slowed down with a gentle gradient, and the playback speed is accelerated with a steep slope, and FIG. 13B, conversely, the playback speed is slowed down. Is performed with a steep gradient, and the reproduction speed is accelerated with a gentle gradient.

[Description of Main Operation Processing in Recording / Reproducing Apparatus of Embodiment]
Next, main operation processing in the recording / reproducing apparatus of the embodiment configured as described above will be described with reference to the flowcharts of FIGS. The processing of each step in the flowchart described below is mainly executed by the microcomputer that constitutes the system controller unit 20.

  That is, as shown in FIG. 14, the system controller unit 20 monitors whether there is a user operation input by monitoring the output of the user input interface unit 21 (step S1). When it is determined that a user operation input has been made, the system controller unit 20 determines an operation mode corresponding to the user operation input (step S2), and determines whether the determined operation mode is a recording start operation. (Step S3).

  When it is determined in step S3 that the operation is a recording start operation, the system controller unit 20 executes a recording process routine, a feature extraction process, and a scene change point detection process routine in parallel (step S4).

  Then, the system controller unit 20 monitors whether or not a user operation for stopping recording has been performed (step S5). When no user operation for stopping recording is detected, the system controller unit 20 returns to step S4 to perform a recording process routine, a feature extraction process, and a scene. When it is determined that a user operation to stop recording is performed in parallel with the change point detection processing routine, additional information file generation and recording processing are executed as post-recording processing (step S6), and the process returns to step S1. .

  In the post-recording process in step S6, the system controller unit 20 uses the scene change point data (a set of scene change points) detected by the scene change point detection unit 9 and the feature extraction processing unit 8 as described above. Additional information that associates the extracted feature data with each other is generated, and the generated additional information is recorded as an additional information file on the recording medium 6 in association with the recorded data of the content such as the recorded broadcast program. In this case, the additional information file and the recorded data of the recorded broadcast program are associated with each other by identification information of the content of the recorded broadcast program.

  Note that the detection result of the scene change point detection performed in real time in parallel with the recording process is not used as the information of the scene change point used in the post-recording process, but in the post-recording process, the scene change point detection unit 9 In addition, we will further examine the detection results of scene change point detection performed in parallel with the recording process, detect more likely scene change points, and record the more likely scene change points in the additional information file. It may be.

  A parallel processing routine of recording processing, feature extraction processing, and scene change point detection processing executed in step S4 will be described with reference to the flowchart of FIG.

  First, the system controller unit 20 detects the genre of content to be recorded (step S11). Next, the system controller unit 20 takes in the content data (step S12). That is, when the data to be recorded is broadcast program information (video information and audio information) from the broadcast receiving unit 2, the system controller unit 20 converts the broadcast program information selectively received by the broadcast receiving unit 2 into a video signal. An instruction is given to supply to the recording encoding unit 3 and the audio signal recording encoding unit 4. Further, when the downloaded content data is recorded, it is instructed to supply the content data obtained through the communication interface 11 to the video signal recording encoding unit 3 and the audio signal recording encoding unit 4.

  Next, the system controller unit 20 instructs the video signal recording encoding unit 3 and the audio signal recording encoding unit 4 to perform recording encoding processing of the content data (step S13), and controls the recording processing unit 5 to perform recording. The video data and audio data of the recorded and encoded content are recorded on the medium 6 (step S14).

  Then, the system controller unit 20 determines whether or not a recording end instruction has been given by the user (step S15). When it is determined that no recording end instruction has been made, the system controller unit 20 returns to step S11 and continues the above-described recording process. To do.

  Steps S11 to S14 constitute a recording processing routine. In parallel with this recording processing routine, a feature amount detection and a scene change point detection processing routine are performed. That is, the system controller unit 20 instructs the feature extraction processing unit 8 to supply the data to be recorded captured in step S12 and also instructs the feature extraction processing unit 8 to execute the feature extraction processing ( Step S16). As described above, in this example, the data being compressed from the video signal recording / encoding unit 3 and the audio signal recording / encoding unit 4 is supplied to the feature extraction processing unit 8.

  In response to this execution instruction, the feature extraction processing unit 8 detects the various feature amounts described above and supplies the processing results to the scene change point detection unit 9. The scene change point detection unit 9 receives the execution instruction from the system controller unit 20 and executes the above-described scene change point detection process (step S17). Then, the system controller unit 20 associates the feature data detected by the feature extraction processing unit 8 and the data of the scene change point detected by the scene change point detection unit 9 with the genre detected in step S11, It is stored and held in a built-in buffer memory or the like (step S18).

  Then, the system controller unit 20 determines whether or not a recording end instruction has been given by the user (step S19). When it is determined that no recording end instruction has been made, the system controller unit 20 returns to step S16 to perform feature extraction processing and scene change. Continue the point detection process.

  Note that the determination processing in step S15 and the determination processing in step S19 are actually the same determination processing, but not separate determination processing, but here, since two processing routines are described in parallel, FIG. As shown in FIG. 15, it is described separately in two determination steps.

  When the system controller unit 20 determines in step S15 or step S19 that the user has instructed the recording end, the system controller unit 20 instructs the scene change point detection unit 9 to correspond to the genre held in the buffer memory. Using the data and the scene change point data, more likely scene change point information to be recorded is generated (step S20).

  Then, the system controller unit 20 causes the recording processing unit 5 to associate the scene change point information generated in step S20 and the feature data of the corresponding scene section as shown in FIG. 2 with the genre. The additional information file is controlled to be recorded on the recording medium on which the recording data of the broadcast program is recorded in a state in which the additional information file is associated with the recorded content data (step S21).

  Next, when it is determined in step S3 of FIG. 14 that the operation input is not a recording start operation, the system controller unit 20 determines whether or not the operation input is an on operation of the key frame detection mode (FIG. 14). If it is determined in step S31) that the key frame detection mode is not turned on, it is determined whether or not a normal playback mode start operation has been performed (step S32).

  If it is determined in step S32 that the normal playback mode start operation has been performed, the system controller unit 20 reads the recording data of the content designated for playback from the recording medium 6 and if the additional information file can be detected, The additional information file is read and normal reproduction is started (step S33).

  Next, the system controller unit 20 determines whether or not a user operation that is evaluated as a key frame section has been performed (step S34). If it is determined that a user operation has not been performed, the playback end operation has been performed, or the content is It is determined whether or not the reproduction has been completed until the end (step S35). When the system controller unit 20 determines in step S35 that the playback is not finished, the system controller unit 20 returns to step S33 to continue the playback. When the system controller unit 20 determines that the playback is finished, the system controller unit 20 returns to step S1 and returns to step S1. Repeat the following steps.

  If it is determined in step S34 that a user operation that is evaluated as a key frame section, for example, a repeat playback operation has been performed, the system controller unit 20 passes the recording medium 6 through the playback processing unit 13 and the additional information file processing unit 16. From the additional information file acquired from the above, the genre of the reproduced content and the feature data of the target scene of the user operation evaluated as the key frame section are obtained and recognized (step S41 in FIG. 17).

  Next, the system controller unit 20 has already stored in the key frame feature information memory unit 25 the same feature data as the recognized genre, that is, the same or similar feature data as the recognized genre feature data. It is determined whether or not (step S42). Note that the feature data is similar means a state in which, for example, one of a plurality of feature types is different or one is missing. Further, when the feature amount is stored, the case where the feature amount is different is included.

  When it is determined in step S42 that the feature data for the genre recognized in step S41 is already stored in the key frame feature information memory unit 25, the system controller unit 20 counts the number of times for the feature data of the genre. Is added by 1 and the feature data recognized in step S41 is reflected in the stored feature data (step S43). Then, the process proceeds to step S35 in FIG.

  Here, as a process of reflecting the feature data recognized in step S41 in the stored feature data, when the feature data is included in the stored feature data, it is included in the feature data recognized in step S41. As an example, a process of taking an average value of the feature amount to be stored and the feature amount of the stored feature data is given. Further, when the feature data does not include the feature amount, if the number of feature types recognized in step S41 is different from the number of stored feature types, for example, a large number of feature types are stored. You may make it perform processing, such as doing.

  If it is determined in step S42 that the feature data for the genre recognized in step S41 is not stored in the key frame feature information memory unit 25, the system controller unit 20 stores the genre and feature data recognized in step S41. The initial value (“1”) of the user evaluation value is written in the key frame feature information memory unit 25 (step S44). That is, key frame feature information for the genre recognized in step S41 is added. Then, the process proceeds to step S35 in FIG.

  Next, when it is determined in step S32 that the normal playback mode start operation has not been performed, the system controller unit 20 determines whether or not a fast forward operation (FF) or a rewind operation (REW) has been performed (step S36). ), When it is determined that the fast forward operation (FF) or the rewind operation (REW) has not been performed, the processing of another predetermined operation mode corresponding to the operation performed in step S1 is executed (step S37).

  If it is determined in step S36 that a fast forward operation (FF) or a rewind operation (REW) has been performed, the system controller unit 20 performs normal fast forward playback or rewind playback processing (step S38). .

  Then, the system controller unit 20 determines whether or not a user operation that is evaluated as a key frame section has been performed (step S38). When it is determined that the user operation has not been performed, the playback end operation has been performed or the content has been last. It is determined whether or not the reproduction has been completed until the reproduction is completed (step S40). When the system controller unit 20 determines in step S40 that the playback is not finished, the system controller unit 20 returns to step S38 and continues the playback. When the system controller unit 20 determines that the playback is finished, the system controller unit 20 returns to step S1 and returns to step S1. Repeat the following steps.

  If it is determined in step S39 that a user operation that is evaluated as a key frame section, for example, a repeat playback operation has been performed, the system controller unit 20 passes the recording medium 6 through the playback processing unit 13 and the additional information file processing unit 16. From the additional information file acquired from the above, the genre of the reproduced content and the feature data of the target scene of the user operation evaluated as the key frame section are obtained and recognized (step S51 in FIG. 18).

  Next, the system controller unit 20 has already stored in the key frame feature information memory unit 25 the same feature data as the recognized genre, that is, the same or similar feature data as the recognized genre feature data. It is determined whether or not (step S52).

  When it is determined in step S52 that the feature data for the genre recognized in step S51 is already stored in the key frame feature information memory unit 25, the system controller unit 20 counts the number of times for the feature data of the genre. Is added by 1 and the feature data recognized in step S41 is reflected in the stored feature data (step S53). Then, the process proceeds to step S40 in FIG.

  Here, the process of reflecting the feature data recognized in step S51 in the stored feature data in step S53 is the same as in step S43.

  If it is determined in step S52 that the feature data for the genre recognized in step S51 is not stored in the key frame feature information memory unit 25, the system controller unit 20 stores the genre and feature data recognized in step S51. The initial value (“1”) of the user evaluation value is written in the key frame feature information memory unit 25 (step S54). That is, the key frame feature information for the genre recognized in step S51 is added. Then, the process proceeds to step S40 in FIG.

  Next, when it is determined in step S31 that the key frame detection mode is turned on, the system controller unit 20 acquires the genre of the content instructed to be reproduced from the additional information file obtained through the additional information file processing unit 16. Detection is performed (step S61 in FIG. 19).

  Next, the system controller unit 20 checks the genre information stored in the key frame feature information memory unit 25 (step S62), and determines whether or not the same genre as the genre detected in step S61 exists (step S62). Step S63).

  Here, in determining whether or not they are the same genre, when the genre is divided hierarchically, such as major classification, middle classification, and minor classification, for example, the genre of the minor classification or the middle classification is the genre of the reproduction content. When the corresponding genre is not stored in the key frame feature information memory unit 25, if there is a genre of the upper middle category or the higher category, the genre of the middle category or the major category is the same. Detect as genre.

  When it is determined in step S63 that there is a genre that is the same as the genre of the content to be reproduced detected in step S61, the system controller unit 20 determines whether a fast forward operation (FF) or a rewind operation (REW) has been performed. If it is determined that the fast forward operation (FF) or the rewind operation (REW) is not performed, normal speed reproduction is executed (step S65).

  Then, the system controller unit 20 determines whether or not the reproduction of the key frame detection mode of the content has been completed depending on whether the reproduction of the content has been completed or whether the user has performed an end operation (step S66). Is determined (step S67), the processing routine is terminated.

  If it is determined in step S66 that the reproduction has not ended, the process returns to step S64, and the processes after step S64 are repeated.

  When it is determined in step S63 that there is no genre that is the same as the genre of the content to be reproduced detected in step S61, the system controller unit 20 displays, for example, a message indicating that the key frame detection mode cannot be executed. 24 is displayed on the display screen and a warning is notified to the user (step S68).

  Thereafter, the system controller unit 20 determines whether or not an operation for canceling the key frame detection mode has been performed (step S80 in FIG. 20). When it is determined that the operation for canceling the key frame detection mode has been performed, the key frame detection mode is terminated. Then (step S81), the process returns to step S1 in FIG. If it is determined in step S80 that the key frame detection mode release operation has not been performed, the process returns to step S65 in FIG.

  When it is determined in step S64 that a fast forward operation (FF) or a rewind operation (REW) has been performed, the system controller unit 20 acquires feature data of each scene from the additional information file of the playback content (FIG. 20). Step S71), the key frame feature data in the same genre in the key frame feature information memory unit 25 is compared (Step S72).

  Here, the key frame feature data of the same genre to be compared with the feature data of each scene of the reproduction content may be one piece having the maximum user evaluation value as described above, or the user evaluation value is a predetermined threshold. It may be a plurality of higher ranks that are greater than or equal to the value. Further, as in the example of FIG. 12 described above, when a plurality of threshold values are set for the user evaluation value and the playback speed is controlled in a plurality of stages, the feature data of each scene of the playback content Is compared with the feature data of all corresponding key frames.

  Next, as a result of the comparison in step S72, the system controller unit 20 determines whether or not the feature data is the same or similar scene as the key frame feature data (step S73), and is not the same or similar scene. Is determined, normal fast-forward playback or rewind playback processing is performed (step S74). And it returns to step S71 and repeats the process after this step S71.

  If it is determined in step S73 that the feature data is the same as or similar to the feature data of the key frame, the system controller unit 20 reproduces the scene so as to reproduce at normal speed as in the example described above. Speed control is performed (step S75).

  In this case, in practice, the feature data of the scene of the additional information file is prefetched from the actual playback timing, and it is determined in advance whether the scene is the same or similar feature data scene as the key frame, In the scene, playback speed control as in the above-described example is performed.

  Next, the system controller unit 20 determines whether or not the scene section of the feature data that is the same as or similar to the key frame has ended (step S76), and when determining that it has not ended, returns to step S75 to return to the normal speed Continue playback. If it is determined in step S76 that the scene section having the same or similar feature data as the key frame has ended, the system controller unit 20 returns the playback speed to the fast forward playback or rewind playback state (step S77).

  Next, the system controller unit 20 determines whether or not a fast-forward playback or rewind playback stop operation has been performed by the user (step S78), and determines that a fast-forward playback or rewind playback stop operation has not been performed. Sometimes, the process returns to step S71, and the processes after step S71 are repeated.

  If it is determined in step S78 that the fast-forward playback or rewind playback stop operation has been performed, the system controller unit 20 performs a fast-forward playback or rewind playback stop process (step S79).

  Next, the system controller unit 20 determines whether or not an operation of canceling the key frame detection mode, that is, an operation of turning off the key frame detection mode has been performed (step S80), and an operation of turning off the key frame detection mode is performed. If it is determined that the process has not been performed, the process returns to step S65 in FIG. 19 to repeat the processes after step S65.

  If it is determined in step S80 that an operation to turn off the key frame detection mode has been performed, the system controller unit 20 ends the key frame detection mode (step S81), and returns to step S1 in FIG.

  As described above, in the first embodiment, the user stores feature data of an important scene (key frame) in the key frame feature information memory unit 25 for each genre, and the key frame detection mode. , The same or similar scene as the key frame is reproduced at normal speed separately from other sections.

  Therefore, the user can automatically turn on the key frame detection mode and operate the fast-forward operation button or the rewind operation button, and the scene automatically has the same or similar characteristics as the key frame of the same genre as the playback content. Can be viewed at normal playback speed.

[Second Embodiment]
In the first embodiment described above, feature data of a scene (key frame) that is important for the user for each genre is stored in the storage unit, and the key frame section is normally reproduced. In contrast, in the second embodiment, for each genre, scene feature data unnecessary for the user is stored in the storage unit. The recording / playback apparatus is provided with an unnecessary scene removal / playback mode. When the unnecessary scene removal / playback mode is turned on, a scene having the same or similar feature data as the scene stored in the storage unit is normal. Even during playback, control is performed to perform skip playback or jump playback.

  In the second embodiment, when the user operates the fast-forward playback operation button or the skip playback instruction operation button during content playback, the playback signal section in which the operation has been performed is Therefore, it is determined as an unnecessary scene section in which the user evaluation that does not require reproduction is in a negative direction, and the feature data of the unnecessary scene section is stored in the memory unit corresponding to the genre of the content.

  In reproduction, the feature data acquired from the additional information file is compared with the feature data of the unnecessary scene section stored in the memory unit, and when the same or similar scene section is detected, the detected scene section Is controlled to perform skip reproduction or jump reproduction.

  Also in the second embodiment, in practice, information on the operation section of the fast-forward playback operation button and the skip instruction operation button is held during playback, and is held when playback ends. The feature data of the corresponding scene section is acquired based on the information of the operation section of the fast-forward playback operation button and the skip instruction operation button, and the acquired feature data is converted into the feature of the unnecessary scene section corresponding to the genre of the reproduced content. The data is stored in the memory unit.

  As the user evaluation value for the unnecessary scene section having the same or similar feature data, for example, the number of operations of the fast forward playback operation button and the skip instruction operation button (the number of fast forward playback and skip playback) is recorded.

[Modification of the first embodiment and the second embodiment]
In the first and second embodiments described above, the feature data of each scene is recorded as an additional information file in association with the recorded content data on the recording medium, and the key frame detection mode and the unnecessary scene section are detected. In the mode, the feature data acquired from the additional information file and the key frame of the corresponding genre stored in the memory unit or the feature data of the unnecessary scene section are compared.

  However, even if the feature data of each scene of the recorded content data is not extracted and recorded on the recording medium, the scene data is detected and the feature data of the detected scene segment is reproduced while reproducing the content data. May be detected, and the detected feature data may be compared with the feature data of the corresponding genre key frame or unnecessary scene section stored in the memory unit.

  In the first and second embodiments described above, the user evaluation value of a key frame or an unnecessary scene section includes the number of user operations evaluated as a key frame section or a user operation evaluated as an unnecessary scene section. For example, as shown in FIG. 21, a user evaluation value corresponding to a reproduction mode based on a user's operation is set, and a scene in the reproduction mode at the time of reproduction corresponds to a corresponding user. A user evaluation value for each scene may be obtained by assigning an evaluation value.

  In this case, the key frame feature information memory unit 25 and the unnecessary scene section feature information memory unit store only the key frame and unnecessary scene section feature data as in the above-described example in correspondence with the genre. Instead, for each genre, feature data for all appearing scenes and user evaluation values corresponding to the feature data are stored. Each time the content is reproduced, the user evaluation value is cumulatively added to the feature data of each scene for the same genre as the reproduced content.

  In this example, the key frame to be detected and the unnecessary scene section to be detected are determined based on, for example, the user evaluation value from those stored in the memory unit, and the feature data of the determined key frame and the unnecessary scene are determined. Based on the feature data of the section, the key frame detection mode and the unnecessary scene section are executed.

  For example, the key frame detection mode is executed by using the feature data having the largest user evaluation value in the positive direction or the feature data larger in the positive direction than a predetermined threshold value as the key frame feature data. To do. In addition, feature data in which the user evaluation value of a scene segment of a certain genre is the largest in the negative direction, or feature data larger in the negative direction than a predetermined threshold value is used as the unnecessary scene segment detection data. To execute.

  In the above-described embodiment, the key frame feature information memory unit 25 and the unnecessary scene section feature information memory unit store key frame and unnecessary scene section feature data according to user evaluation for each genre. However, in advance, the manufacturer of the recording / playback apparatus sets a characteristic scene section in the content of each genre, and stores the characteristic data (referred to as teacher data) of the set scene section in the memory. It may be stored in the section and used as feature data of key frames or feature data of unnecessary scene sections.

  In this case, the setting of the teacher data may be determined by conducting a questionnaire survey, a viewing state survey, or a practical reproduction operation survey for an unspecified number of users.

  In addition to the teacher data, key frame feature data determined by reflecting the above-described user evaluation, and unnecessary scene section feature data may be additionally stored and used. In such additional storage, when feature data similar to the teacher data is detected as feature data of the key frame or unnecessary scene section, the teacher data and the feature of the detected key frame or unnecessary scene section are detected. The user's preference may be reflected by taking an average with the data.

[Other variations]
The receiving unit 2 of the above-described embodiment is a case of a terrestrial analog TV broadcast receiving unit, a terrestrial digital TV broadcast receiving unit, a satellite digital TV broadcast receiving unit, a cable TV broadcast receiving unit, and distributed over the Internet. The present invention is applicable even to a television broadcast receiving unit.

  The present invention can be applied not only to the content of a television broadcast program but also to the recording and playback of various information signals in addition to the recording and playback of content of a radio broadcast program, for example.

  Further, the scene section divided by the scene change point is not only detected from the feature amount of both the video information and the audio information as in the above-described embodiment, but from the feature amount of only the video information, or the audio It is also possible to detect only from the feature amount of information.

It is a block diagram of an example of the recording / reproducing apparatus to which the embodiment of the content reproducing apparatus according to the present invention is applied. In the example of FIG. 1, it is a figure which shows an example of the data of the additional information file recorded accompanying content data. It is a figure for demonstrating the characteristic data about the specific genre of a television broadcast program. It is a figure for demonstrating the characteristic data about the specific genre of a television broadcast program. It is a figure used in order to explain FIG. 3 and FIG. It is a figure used in order to explain FIG. 3 and FIG. It is a figure for demonstrating an example of the memory content of the key frame characteristic information memory part 25 in the example of FIG. It is a figure for demonstrating an example of the memory content of the key frame characteristic information memory part 25 in the example of FIG. It is a figure for demonstrating the principal part of embodiment of the content reproduction method by this invention. It is a figure for demonstrating the principal part of embodiment of the content reproduction method by this invention. It is a figure for demonstrating the principal part of embodiment of the content reproduction method by this invention. It is a figure for demonstrating the principal part of embodiment of the content reproduction method by this invention. It is a figure for demonstrating the principal part of embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure which shows a part of flowchart for demonstrating the example of a processing operation in embodiment of the content reproduction method by this invention. It is a figure used in order to demonstrate other embodiment of the content reproduction method by this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 6 ... Recording medium, 7 ... Genre determination part, 8 ... Feature extraction process part, 9 ... Scene change point detection part, 20 ... System controller part, 21 ... User input interface, 25 ... Key frame characteristic information memory part

Claims (8)

A storage unit for storing predetermined feature data for each content classification type;
During a predetermined reproduction, the segmentation section feature data acquisition section for acquiring characteristic data of each segment section specified by adjacent ones of the separated data playback-target content,
A classification type detecting unit for detecting the classification type of the content of the reproduction object,
A reading unit that reads out the predetermined feature data from the storage unit for a classification type that is the same as or the same type as the classification type of the content to be reproduced detected by the classification type detection unit ;
The feature data for each segment section acquired by the segment section feature data acquisition unit is compared with the predetermined feature data read from the storage unit , the feature data for each segment section, and the storage unit A determination unit for determining whether or not the predetermined feature data is the same or similar;
When the determination unit determines that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control unit that controls to play back at a playback speed different from other sections;
Equipped with a,
The predetermined feature data for each content category type is the segment segment feature data preferred by the user for each content category type,
The storage unit monitors the user's operation input, and classifies the content data of the segment segment of the content for which the operation input requesting normal reproduction of the content is the predetermined feature data. Store it in association with the type information,
The content playback apparatus that controls the playback to be performed at a normal playback speed in the segment section determined to be the same or similar in the segment playback that is determined to be fast playback during the predetermined playback time . The content playback apparatus according to claim 1 ,
The divided sections, wherein the data acquisition unit, said at predetermined reproduction of the content, by performing the extraction of characteristic amounts for the data of the content, you extracts feature data of each of the segmentation sections
Content playback device. The content playback apparatus according to claim 1 ,
The segmental section feature data acquisition section, you get the characteristic data of each of the segmental section feature data for each segment sections which are recorded along with the content of the reproduction object to the recording medium is read out from said recording medium
Content playback device. The content playback apparatus according to claim 1,
Wherein the control unit that controls to change gradually playback speed between a discriminated the segmentation section to be the same as or similar to play different playback speeds other section, and other sections
Content playback device. A storage step of storing predetermined feature data for each content classification type;
During a predetermined reproduction, the segmentation section feature data acquisition step of acquiring the characteristic data of each segment section specified by adjacent ones of the separated data playback-target content,
A classification type detecting step of detecting the classification type of the content of the reproduction object,
A reading step of reading out the predetermined feature data from the storage unit for a classification type that is the same as or similar to the classification type of the content to be reproduced detected in the classification type detection step;
The feature data for each segment section acquired in the segment section feature data acquisition step is compared with the predetermined feature data read from the storage unit , the feature data for each segment section, and the storage unit A determination step of determining whether or not the predetermined feature data is the same or similar;
In the determination step, when it is determined that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control step for controlling to play back at a playback speed different from other sections;
Equipped with a,
The predetermined feature data for each content category type is the segment segment feature data preferred by the user for each content category type,
In the storage step, the user's operation input is monitored, and the segment segment feature data for which the operation input requesting normal reproduction of the content is used as the predetermined feature data. Are stored in association with the classification type information of
The content playback method for controlling the playback to be performed at a normal playback speed in the segment section in which the predetermined playback time is a high-speed playback time and the processing of the control step is determined to be the same or similar . A storage unit for storing predetermined feature data for each content classification type;
A segment segment feature data acquisition unit for acquiring feature data for each segment segment specified by adjacent ones of the data segment of the content to be reproduced at a predetermined playback time;
A classification type detection unit for detecting the classification type of the content to be reproduced;
A reading unit that reads out the predetermined feature data from the storage unit for a classification type that is the same as or the same type as the classification type of the content to be reproduced detected by the classification type detection unit;
The feature data for each segment section acquired by the segment section feature data acquisition unit is compared with the predetermined feature data read from the storage unit, the feature data for each segment section, and the storage unit A determination unit for determining whether or not the predetermined feature data is the same or similar;
When the determination unit determines that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control unit that controls to play back at a playback speed different from other sections;
With
The predetermined feature data for each content category type is feature data of the segment interval that the user does not like for each content category type,
The storage unit monitors the operation input of a user and classifies the content data of the segment segment of the content for which the operation input requesting that the content is not normally reproduced as the predetermined feature data. Store it in association with the type information,
The predetermined reproduction time is normal reproduction time, and the control unit controls to perform high-speed reproduction or skip reproduction in the segment segment determined to be the same or similar.
Content playback device. The content playback apparatus according to claim 6, wherein
The control unit performs control so that the playback speed is gradually changed between the segment section determined to be the same or similar and played at a playback speed different from that of the other sections and the other sections.
Content playback device. A storage step of storing predetermined feature data for each content classification type;
A segment segment feature data acquisition step for acquiring feature data for each segment segment specified by adjacent ones of the data segment of the content to be reproduced at a predetermined playback time;
A classification type detection step of detecting the classification type of the content to be reproduced;
A reading step of reading out the predetermined feature data from the storage unit for a classification type that is the same as or similar to the classification type of the content to be reproduced detected in the classification type detection step;
The feature data for each segment section acquired in the segment section feature data acquisition step is compared with the predetermined feature data read from the storage unit, the feature data for each segment section, and the storage unit A determination step of determining whether or not the predetermined feature data is the same or similar;
In the determination step, when it is determined that the feature data for each segment section and the predetermined feature data read from the storage unit are the same or similar, it is determined that the same or similar In the segment section, a control step for controlling to play back at a playback speed different from other sections;
With
The predetermined feature data for each content category type is feature data of the segment interval that the user does not like for each content category type,
In the storage step, the user's operation input is monitored, and the segment segment feature data for which the operation input requesting that the content is not normally reproduced is used as the predetermined feature data. Are stored in association with the classification type information of
The predetermined playback time is normal playback time, and the control process is controlled to perform high-speed playback or skip playback in the segment segment determined to be the same or similar.
Content playback method.

Images