JP4351927B2 - Video playback device, playback script generation device, and video cutout device - Google Patents

Description

  The present invention relates to a video playback device for viewing video in a short time, and in particular, a video playback device that changes playback speed between a highlight scene and other scenes, and a playback script used together with the video playback device The present invention relates to a generation device, a video cutout device, and a video storage device.

  In recent years, digital recorders that record video and audio from broadcast signals using a hard disk drive (hereinafter referred to as HDD) or a DVD (Digital Versatile Disk) as a recording medium have become widespread. In particular, a digital recorder using an HDD as a recording medium realizes a recording time of several hundred hours due to the dramatic increase in capacity of the HDD and the development of a high-compression moving image compression technique. On the other hand, the number of broadcast channels is increasing due to the development of digital terrestrial broadcasting, CS (Communication Satellite) broadcasting, cable television, and the like. With such a longer recording time and an increase in the number of channels, it has become easier for individuals to record programs on a large number of channels over a long period of time.

  However, as the recording becomes easier, the amount of recorded programs increases, and there is a problem that the time for viewing the programs becomes insufficient. The reason for recording the program is to see the contents of the program. So, if you have the time, many people will want to watch all the recorded programs. However, there is a limit to the amount of time that humans can do freely. Therefore, there is a demand for a method for efficiently viewing recorded video.

  Patent Document 1 discloses a recording / reproducing apparatus based on a VTR (Video Tape Recorder) that selectively reproduces only a highlight scene at a normal speed and fast-forwards other portions. For example, as one method, the occurrence of a special event during recording is detected and recorded together with the recording. During playback, the section in which the occurrence of the event is recorded (hereinafter referred to as “highlight scene”) is played at normal speed, and the other parts are played at fast forward. Alternatively, a highlight scene is detected from the image during fast-forward playback, and then rewinded from the scene and played back for a predetermined time.

  With this configuration, the highlight scene can be viewed at a normal speed, and the other portions can be viewed in a relatively short time while confirming the contents of the highlight scene by fast-forwarding.

Japanese Patent Laid-Open No. 11-55613

  In the recording / reproducing apparatus disclosed in Patent Document 1, a section between a highlight scene and a highlight scene is fast-forwarded. If the fast-forward speed is high, it is difficult to grasp the contents of the video. Therefore, an important scene may be missed in a portion that is not recorded as a highlight scene. On the other hand, if the fast-forwarding speed is low, the contents can be grasped relatively easily. However, as a result, it takes time to view the video, and the objective of watching as many videos as possible in a short time cannot be achieved.

  In the technique described in Patent Document 1, the highlight scene is merely dependent on the video signal or audio signal recorded on the tape, and is not assumed to be handled independently from the video signal or the like. On the other hand, when telecommunications technology is developed as in the present day, for example, highlight scene information is distributed separately via a network, or after a live broadcast is relayed, another program is being broadcast while the live scene is highlighted. Information distribution such as broadcasting the information will be performed. The technique described in Patent Document 1 cannot cope with such a technique that handles highlight scene information separately from video.

  In particular, when the video and the information indicating the highlight scene are handled separately, there is a possibility that the correct highlight scene cannot be reproduced due to an error between the time information about the highlight scene and the time of the video. is there. However, since the thing described in Patent Document 1 is based on the premise that the video and the information representing the highlight scene are recorded on the same recording medium, Patent Document 1 finds recognition of such a problem. I can't.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide a video playback apparatus that enables a large amount of video to be viewed efficiently and in a short time.

  Another object of the present invention is to provide a video reproduction apparatus that enables a large amount of video to be viewed efficiently and in a short time using information independent of the video.

  Still another object of the present invention is to provide a video playback apparatus that enables a main part of a large amount of video to be viewed efficiently and in a short time while grasping the contents of the parts before and after the main part.

  A video playback apparatus according to a first aspect of the present invention includes a video playback unit capable of playing back an arbitrary section of video in either the first or second playback mode, and a video playback unit A highlight information acquisition unit for acquiring highlight information for defining a highlight region and a video playback unit are controlled to play back the highlight region of the video in the first playback mode. The area includes reproduction control means for reproducing in the second reproduction mode.

  The video can be viewed efficiently based on the highlight information acquired separately from the video.

  Preferably, the video playback unit plays back video in the second playback mode at a higher speed than in the first playback mode.

  Since the second playback mode is played back at a higher speed than the first playback mode, the viewing time can be shortened.

  More preferably, in the second playback mode, the video playback unit plays back the video at a speed that is faster than the first playback mode and faster according to the distance between the highlight area and the playback position.

  Since the second playback mode is played back at a higher speed than the first playback mode, the viewing time can be shortened, and fast-forward playback is performed at a lower speed before and after the highlight area, so that the situation before and after can be understood well. .

  A video playback apparatus according to a second aspect of the present invention controls a video playback unit capable of playing back an arbitrary section of video in either of the first and second playback modes, and controls the video playback unit. The video portion designated by the highlight information for designating the highlight position of the video is in the first playback mode, and the other video portion is in the second playback mode, including playback control means for playback. The control means reproduces the video portion not specified by the highlight information at a speed determined by the distance between the highlight position and the reproduction position.

  In the second playback mode, fast-forward playback is performed at a slow speed before and after the highlight area, and fast-forward playback is performed at a high speed when it is far from the highlight area. Time can be shortened.

  A video playback apparatus according to a third aspect of the present invention stores a video playback unit capable of playback in at least two playback modes of fast-forward playback and normal playback, and highlight information for determining a video highlight area. A highlight information storage means for controlling the video playback unit, and a playback control means for playing back the highlight area in the fast-forward playback mode and playing the other area in the normal playback mode in the video, An instruction input means for receiving a fast-forward instruction from the user, and a fast-forward means for controlling the video playback unit to start fast-forward playback in response to receiving the fast-forward instruction, the playback control means, When fast-forward playback of video by the video playback unit reaches the highlight area specified by the highlight information stored in the highlight information storage means, playback is performed in the normal playback mode. It controls the video reproduction unit as.

  Since the normal playback mode is automatically entered when the highlight area is reached after instructing fast-forwarding, the highlight area of the video can be reliably viewed with a simple operation.

  Preferably, during the fast-forward playback by the video playback unit, the video playback means performs fast-forwarding according to a highlight area determined by highlight information or a distance between the playback position and at least one of the video positions receiving the fast-forward instruction. Means for controlling the video playback unit to perform fast forward playback at a speed is included.

  During fast-forward playback, fast-forward playback is performed at a slower speed before and after the highlight area, or near the position where the user has issued a fast-forward instruction than the part far from the highlight area or the position where the fast-forward instruction is issued. You can clearly see the situation before and after the highlight area.

  More preferably, the video reproduction device further includes a highlight information acquisition unit for acquiring highlight information.

  It is possible to acquire highlight information separately from the video and efficiently view the video.

  The playback control means may control the video playback unit so that a portion of the video where highlight information cannot be acquired is played back at a speed faster than the playback speed in the normal playback mode and at which the audio can be heard.

  Even portions where highlight information is not provided can be viewed efficiently while grasping the contents.

  Preferably, the video reproduction apparatus further includes a video accumulation unit, and the video reproduction unit includes means for reproducing the video accumulated in the video accumulation unit.

The stored video can be efficiently viewed as described above. More preferably, the video storage unit can supply video data to the video playback unit in parallel with the video storage. .

  Playback can be performed while recording, and the playback portion can be viewed efficiently.

  The video playback device may further include video acquisition means for acquiring video data from outside in response to a user instruction, and the video playback unit may play back the video acquired by the video acquisition unit.

  When there is an instruction from the user, the video data is acquired from the outside, so that the video can be viewed on a so-called on-demand and can be efficiently viewed.

  Preferably, the video reproduction apparatus further includes highlight information generation means for analyzing the characteristics of the video and generating highlight information.

  Even when highlight information is not available, highlight information can be automatically generated by analyzing video characteristics. Therefore, such a video can be efficiently viewed.

  A playback script generation device according to a fourth aspect of the present invention instructs a video playback device having script execution means for playing back video in a playback mode and a playback sequence according to the playback script to control video playback. A playback script generation device for generating a playback script of the above-mentioned, wherein highlight information preparation means for preparing highlight information for determining a video highlight area, and highlight information prepared by the highlight information preparation means The playback script generation for generating a playback script for instructing the script execution means of the video playback device to play back the video portion specified by the normal speed, and to play back the video portion not specified in the highlight information by fast-forwarding. Including means.

  According to this playback script generation device, it is possible to automatically generate a script that plays back the video portion specified by the highlight information of the video at a normal speed and plays back the other video portions at a fast forward speed. By executing the playback script with a video playback device having a function of executing the playback script, the user can view the video efficiently as in the case of viewing based on the highlight information.

  Preferably, the script generation unit generates a playback script including a video to be played back, a playback range, and a playback speed.

  By specifying these pieces of information using the playback script, the video playback apparatus can easily play back the video as specified.

  According to a fifth aspect of the present invention, there is provided a video cutting device for preparing highlight information for defining a highlight area in a video of video data in relation to the video data and means for preparing the video data. And a video portion including a video portion specified by the highlight information and a predetermined time before or after the video portion specified by the highlight information or both in accordance with the highlight information. And a video cutout means for cutting out.

  This video cutout device cuts out video based on highlight information. Therefore, the volume of the clipped video can be reduced, and there is little risk of missing important parts. In addition, since the scenes before and after the highlight information are cut out, the user can more securely view the video that interests him.

  A video storage device according to a sixth aspect of the present invention includes video storage means for storing video, video storage time recording means for recording video storage time when the video storage section stores video, Accumulation time accuracy determination means for determining the accuracy of the time when the video is accumulated in the video accumulation time accumulation unit based on the environment when the video accumulation means accumulates the video, and the time determined by the accumulation time accuracy determination unit First accuracy recording means for recording the accuracy.

  When the video is stored with the storage time recorded, the accuracy of the storage time becomes a problem. According to the present video storage device, the recording time accuracy is determined and recorded based on the environment during video storage. As a result, a recording apparatus capable of managing the recording time can be realized.

  Preferably, the time accuracy determination unit determines the accumulation time accuracy based on the video transmission path used when the video is stored in the video storage unit.

  The time accuracy determines the time accuracy according to the transmission path at the time of video accumulation, for example, the channel or format of the broadcast wave. Therefore, the accuracy of the video accumulation time can be managed with a certain degree of reliability.

  More preferably, the video storage device includes a time specification information recording unit for recording time specification information for specifying a predetermined time in the video stored in the video storage unit, and a first unit for recording the accuracy of the time specification information. 2 accuracy recording means, first estimated correction value recording means for recording the estimated correction value of the time designation information, and video recording time estimated correction value recorded by the video accumulation time recording means A second estimated correction value recording means; a relative correction value recording means for calculating and recording a relative correction value between the video accumulation time and the time designation information; and the accuracy of the time designation information, the accuracy of the video accumulation time, And a correction value estimating means for estimating an estimated correction value of the time designation information, an estimated correction value of the video accumulation time, and an indeterminate relative correction value based on the relative correction value.

  When the accumulated video is reproduced based on information including time designation information for designating a predetermined time in the video like highlight information, the accuracy of the video accumulation time and the accuracy of the time designation information become problems. According to this video storage device, the estimated correction value of these times is calculated based on the accuracy of those times, and the relative correction value between them is further estimated. The time can be corrected efficiently, and the video can be correctly reproduced based on the designated time information.

  As described above, according to the present invention, it is possible to view a large amount of video efficiently in a short time while reducing the possibility of missing an important part using highlight information. For parts not specified in the highlight information, fast-forwarding is performed, and the speed of fast-forwarding is relatively reduced near the highlight section, so that the contents before and after the highlight section can be easily confirmed. Accordingly, normal reproduction can be performed. Also, if the user fast-forwards during normal playback, normal playback is automatically performed when the highlight section is reached. Therefore, the user can confirm the important part efficiently and with a simple operation.

  In addition, a playback script for realizing the same processing as when highlight information is used is automatically generated and can be executed by a video playback device, so that advanced control of playback can be performed centrally. Becomes easier. In addition, since the time accuracy can be easily corrected, when controlling video playback according to information that includes time specification information, such as highlight information, control such as playback and fast-forwarding based on the specified correct time Can be performed.

[First Embodiment]
−Configuration−
FIG. 1 is a block diagram showing a video reproduction apparatus according to the first embodiment of the present invention. The video playback device 1 is connected to an antenna 2, a display device 3, and a network (not shown).

  The video reproduction apparatus 1 separates video data, additional information, highlight information, and the like from a receiving unit 100 for selecting a broadcast radio wave received by the antenna 2 and a signal selected by the receiving unit 100. And an additional information separating unit 101. Additional information refers to the broadcast performers of the program information that are multiplexed with the video data of the program, information about the program, public information such as weather information, program schedule information related to broadcasting in general, etc. That means. Although the highlight information can be regarded as a kind of such additional information, the highlight information has a special meaning in the present embodiment, and is described here separately from the additional information.

  The video reproduction apparatus 1 further includes a video encoding unit 102 for compressing and encoding video data, an additional information recording area 111 for recording the separated additional information, highlight information, and compressed and encoded video data, and highlight. When the highlight information is not included in the recording unit 110 having the scene recording area 112 and the video recording area 113 and the broadcast radio wave, the highlight scene is detected from the video data, and the information is highlighted in the recording unit 110. A highlight scene detection unit 103 for recording in the scene recording area 112; and a switch 104 for switching whether the highlight information is acquired from the additional information separation unit 101 or the highlight scene detection unit 103. .

  With the configuration described above, video data in broadcast radio waves, additional information, highlight information separated from broadcast radio waves or detected by the highlight scene detection unit 103 is recorded in the recording unit 110.

  The video reproduction apparatus 1 further controls the video decoding unit 135 that reproduces the video data recorded in the video recording area 113 and the video decoding unit 135 based on the highlight information recorded in the illite scene recording area 112 to control the video. The video decoding unit 135 outputs the reproduction control unit 134 for reproducing the video, the additional information recorded in the additional information recording area 111, the explanation information embedded in the highlight information output from the reproduction control unit 134, and the like. And an information superimposing unit 136 for superimposing on the video to be given to the display device 3. The output of the information superimposing unit 136 is displayed on the display device 3 as the output of the video reproduction device 1.

  The video decoding unit 135 can play back video in two playback modes, a normal playback mode and a fast-forward playback mode. The video decoding unit 135 can further control the playback speed in a plurality of stages even in the fast-forward playback mode.

  Additional information and highlight information can also be obtained from the network. For this purpose, the video reproducing apparatus 1 selects the network interface unit 130, the switch 131 for selecting any one of the outputs from the network interface unit 130 and the additional information storage area 111 and giving it to the information superimposing unit 136, the network interface unit 130, A switch 132 for selecting any output from the highlight scene storage area 112 and supplying the selected output to the reproduction control unit 134. The video playback apparatus 1 further includes a video recording disk playback unit 114 for playing back video recorded on the video recording disk, video data from the video recording disk playback unit 114, and video data output from the video recording area 113. A switch 133 for selecting one of them and giving it to the video decoding unit 135.

  With the above configuration, video data, additional information, and highlight information recorded in the recording unit 110 are used and reproduced.

  As a method for realizing the highlight scene detection unit 103, the method using the volume of the sound or the feature of the object to be displayed and the display timing of the caption appearing on the screen are used as in the method disclosed in Patent Document 1. Or the like can be used. In particular, in the case of sports broadcasts and the like, a method has been proposed in which a highlight scene is detected by detecting the movement of a player after learning the characteristics of a stadium for a certain period of time. If the highlight scene detection unit 103 can access the video recorded in the video recording area 113, such multi-pass highlight scene detection processing can also be used. When the commercial message included in the program (hereinafter referred to as “CM”) and the video mode of the main part of the program are different, the CM part may be recognized as a non-highlight scene and the other part as a highlight scene. . The video mode can be determined based on information such as the number of audio channels, audio language, video bit rate, video copy protection setting, and copyright holder.

  Broadcast radio waves received by the antenna 2 are selected by the receiving unit 100 and input to the additional information separating unit 101. The additional information separation unit 101 separates video data, additional information, and highlight information. The separated additional information is recorded in the additional information recording area 111 of the recording unit 110 as necessary. Highlight information is also recorded in the highlight scene recording area 112 of the recording unit 110. The video data is compressed and encoded by the video encoding unit 102 and recorded in the video recording area 113 of the recording unit 110.

  If the broadcast radio wave includes highlight information, the switch 104 selects the highlight information output from the additional information separation unit 101 and records it in the highlight scene recording area 112. When the broadcast radio wave does not include highlight information, the highlight scene detection unit 103 detects a highlight scene from the video data, and the switch 104 selects the information and records it in the highlight scene recording area 112. . Through the above operation, video data in the broadcast radio wave, additional information, highlight information separated from the broadcast radio wave, or highlight information detected by the highlight scene detection unit 103 is recorded in the recording unit 110.

  The reproduction control unit 134 reproduces the video data recorded in the video recording area 113 using the video decoding unit 135 based on the highlight information recorded in the highlight scene recording area 112. The reproduction control unit 134 further superimposes the additional information recorded in the additional information recording area 111 or the description information embedded in the highlight information by the information superimposing unit 136 and outputs it. The output of the information superimposing unit 136 is displayed on the display device 3 as the output of the video reproduction device 1. Additional information and highlight information can also be acquired from the network via the network interface 130. The video data from the video recording disk playback unit 114 can also be played back.

  Through the above operation, video data, additional information, and highlight information recorded in the recording unit 110 are used and reproduced.

-Details of control of reproduction control unit 134-
Next, details of the control by the reproduction control unit 134 will be described. The playback control unit 134 according to the present embodiment controls the playback so that the highlight scene is played back slowly, and the other parts are played back by fast-forwarding to shorten the time required for overall viewing. There are two types of highlight information.

  The first type of highlight information is highlight information (hereinafter referred to as “section information”) as a section in which the start point and end point of the scene are designated. The second type of highlight information is highlight information (hereinafter referred to as “point information”) as a point where only the start point of the scene is designated.

  FIG. 2 is a diagram showing an outline of the operation of the video reproduction apparatus 1 according to the present embodiment. In the video 180, sections 184, 188, and 192 indicated by diagonal lines are sections designated as highlight scenes by section information, and the other sections 182, 186, 190, and 194 are sections other than the highlight scene. The recording start point section 182 is not designated as a highlight scene. Therefore, fast-forward playback is started immediately after starting playback. When the section 184 is reached, normal playback is performed. When the end point of the section 184 is exceeded and the section 186 is entered, the fast-forward playback is resumed. When the section 188 is reached, normal playback is resumed. The same applies thereafter. Although this operation itself is the same as the operation disclosed in Patent Document 1, the video reproduction apparatus 1 according to the present embodiment can cope with a more complicated situation than that disclosed in Patent Document 1. The processing procedure will be described in detail below.

  First, a word is defined using FIG. The start time of the section information is referred to as a start point, the end time is referred to as an end point, and a section specified as a highlight scene in the section information is referred to as a highlight section. Sections other than the highlight section are called gaps. The time given as point information is called a highlight point.

  FIG. 4 is a flowchart of a program for realizing processing during playback of the playback apparatus. Referring to FIG. 4, in step (hereinafter abbreviated as “S”) 100, normalization processing of highlight information is performed. The highlight information normalization process refers to a process of converting highlight information given as point information into section information. Details of this processing will be described later. Based on the highlight information normalized in S101, fast-playing is performed. In S102, the part that has not been played immediately is caught up and played back.

  FIG. 5 is a flowchart showing details of the highlight information normalization process of S100. In S110, point information is converted into section information. In this embodiment, the times α and β given as constants are used, and the highlight point −α is the start point and the highlight point + β is the end point. Of course, other processes are possible. Here, a fixed time of 20 seconds as α and 1 minute as beta is given. Instead of this, an average value γ of the highlight section given as the section information is obtained, and α = 0.2γ and β = 0.8γ may be considered. When the start point or the end point exceeds the recorded range, the recording start point and the recording end point are respectively replaced.

  In S111, the section information obtained from the original highlight information and the section information obtained in S110 are sorted by the value of the starting point to obtain an ordered list of highlight sections. In S112, the highlight section overlap is deleted. That is, video portions that appear multiple times in the highlight section list are combined into one.

Also, a gap that is too short gives an uncomfortable feeling when viewed. If there is such a gap, the two highlight sections sandwiching the gap are integrated into one in S113. In the present embodiment, gaps shorter than 20 seconds are deleted. Of course, various values other than this can be adopted as the value of this time, and it can also be calculated by the ratio to the total time. Depending on the embodiment, it may be considered that the processing from S111 to S113 is not performed.
FIG. 6 is a flowchart showing details of a program for realizing the quick-play process in S101. In S120, the playback pointer is set to the recording start point and playback is started. This playback pointer is automatically updated as playback progresses. The processes of S122, S123, and S124 surrounded by S121s and S121e are repeated until the playback pointer reaches the end point of the last highlight section in the highlight section list obtained in S100.

  In S122, the playback pointer is compared with the highlight section list to determine whether or not the playback pointer is within the highlight section. If the playback pointer is within the highlight section, the playback state is set to the normal speed in S123. If the playback pointer is outside the highlight section, the playback state is set to fast forward.

  When the playback for all highlight sections is completed by the above processing, the processing moves to S102 in FIG. 4, and the playback state is set to fast forward.

  FIG. 7 shows an example of the playback state transition realized by the above processing. In FIG. 7, the shaded portion indicates the highlight section. In the present embodiment, the fast-forward reproduction in the gap realized in S124 in FIG. 6 is fast-forward that gradually accelerates as shown in FIG. If such acceleration is difficult to achieve, it is possible to determine the fast-forwarding speed according to the length of the gap, such as relatively fast fast-forwarding if short and fast fast-forwarding if long. The same applies to the catch-up reproduction in S102.

  In the highlight information normalization process of S100, the process after S110 may be started after moving the start point and end point of the section information forward or backward according to the user's preference. For example, by moving the start point forward 10 seconds and the end point backward 30 seconds, the user's request to watch slowly can be answered. On the other hand, by moving the start point backward for 5 seconds and the end point forward for 20 seconds, the user's request for viewing in as short a time as possible can be answered.

  FIG. 8 shows a mechanism for receiving instructions from two types of users, that is, a fast-forward postponement and a fast-forward hold, and an operation of the video playback apparatus 1 when information specifying a section in which highlight information has already been created is obtained. FIG. Referring to FIG. 8, consider a case where highlight reproduction is performed on a section 222 with highlight information in the video 220. In the example illustrated in FIG. 8, the section 222 with highlight information includes gaps 224, 228, 238, and 242 and highlight sections 226, 234, and 240.

  For example, when a fast-forward postponement instruction is given from the user in the gap 228, normal playback is resumed for a certain period of time (for example, 30 seconds) from that point (lattice portion 230 in the figure). Also, when a fast-forward postponement instruction is given from the user in the highlight section, even if the playback pointer reaches the end point for a certain period (for example, 30 seconds), fast-forward playback does not start.

  Also, for example, when a fast-forward hold instruction is given from the user in the gap 236, the normal playback is resumed from that point to the next start point (section 238 in the figure). When a fast-forward hold instruction is given from the user in the highlight section, the end point of the highlight section is ignored and normal playback is continued until the next start point.

  In addition, for example, when a live broadcast is recorded and the recording is quickly reproduced, highlight information is not always given for all recorded portions. Therefore, if the entire catch-up playback portion is fast-forwarded in the same way as the gap playback as shown in FIG. 7, a scene that satisfies the conditions as a highlight scene but is not provided with highlight information will be missed. If information about how far the highlight information has been created is obtained, normal playback is resumed upon exiting that section, or relatively slow forward playback as indicated by section 244 in FIG. It is possible to move to It is desirable that this relatively slow fast-forward playback be accompanied by audio. Such a playback method is a viewing mode that is a further development of a viewing mode called time-shifted viewing, and is referred to as time-shift catch-up playback in this specification. Such a method is particularly effective in combination with the above-described highlight information generation technology in which highlight information is generated using the learning result after learning the characteristics of the stadium.

  These fast-forward postponement instructions and fast-forward hold instructions are particularly effective when used in combination with the aforementioned fast-accelerate fast-forward. This is because the user can hear the sound and grasp the contents, but can know that the playback pointer has exited the highlight section by switching to playback faster than normal playback. If the user gives an instruction at that time, the user can grasp the content without interruption. When such accelerated fast-forwarding cannot be used, for example, when the playback pointer reaches the range of 10 seconds before the end point, vibration provided on the display screen, sound, display unit of the playback device casing, or remote control device An indication may be given to the user by a section or the like. By receiving this indication, the user can give an instruction before the fast forward starts. It is more preferable that a thumbnail display showing the contents of the next highlight section can be used as an indication on the screen of the display device. In addition to this, when a fast-forward postponement instruction or a fast-forward hold instruction is given during fast-forwarding, an operation of returning to the end point of the immediately preceding highlight section and performing normal playback is also conceivable. There is a possibility that the flow of viewing is interrupted, but it is also conceivable to perform a display in which the user temporarily stops at the end point and selects the fast-forward postponement or fast-forward hold.

  In fast forward hold, acceleration will start again when the next highlight section ends. However, instead of this, it may be possible to shift to a state in which only normal reproduction is performed with an instruction to prohibit fast-forwarding. Fast-forwarding instruction for forcibly starting fast-forwarding during fast-forward postponement, fast-forwarding hold, and normal playback, and the overall playback speed regardless of the gap / highlight section N times the playback speed by the original control (for example, 1 (5 times, 2 times, etc.) may be given an overall acceleration instruction.

  Generally, it is conceivable that the fast-forward postponement instruction and the fast-forward hold instruction are performed by a remote controller using infrared rays or radio waves. Of course, the present invention is not limited to this, and an instruction may be given by a sensor that detects sound or user movement. It is also conceivable to give an instruction via an Internet connection, for example, an instruction from a mobile phone having an Internet connection function. When using a sensor for detecting sound or user movement, it is desirable to take measures such as accepting an instruction only for 5 seconds before and after the end point in order to prevent malfunction. When the playback pointer passes the highlight section and fast-forward playback starts, once you tap it, it is detected by the sound sensor and regarded as a fast-forward postponement instruction. Such a thing can be considered. It may be considered as a fast-forwarding instruction when a hand is clapped during postponement, hold, and prohibition.

  Note that the normal reproduction does not necessarily have to be a normal reproduction, and may be a reproduction slightly faster than the normal reproduction or a reproduction slightly slower than the normal reproduction. If slightly faster playback is used, the overall viewing time can be shortened. Also, if a slightly slower playback is used, the playback is suitable for users who have difficulty in grasping the content at the same magnification playback due to abnormal hearing. As for fast-forwarding, if the gap is too long, it may be possible to control to skip playback to a certain time before the start point of the next highlight section after gradually accelerating and reaching the highest speed. It is done.

  FIG. 9 is a diagram showing a display example by the user interface of the playback apparatus. The screen shown in FIG. 9 shows a state after the user has selected which program recording is to be reproduced. When information about the selected program is shown in area 1000 and highlight information is given, options for highlight playback are displayed as in bar displays 1002 to 1005. The bar display 1001 is an option for reproducing the entire image. The time required for playback is displayed to the left of each option. This example shows a situation where four pieces of highlight information are given. A frame 1006 is a frame for selecting an option, and the user moves this to instruct which reproduction is to be performed. When the user moves the frame 1006, thumbnails 1007 to 1010 representing the respective sections are displayed to help the user confirm the contents.

  FIG. 10 shows an example of the highlight information selected in FIG. Referring to FIG. 10, the first line is a title of highlight information. The third and fourth lines specify the broadcasting station and the broadcasting date. The fifth and subsequent lines are highlight section information, which lists the playback order of highlight sections, a title indicating the contents of highlights, and sets of start and end points. The recording to be reproduced is uniquely determined from the information on the third and fourth lines and the information on the start and end points.

  A state of reproduction based on the highlight information is shown in FIG. The state of reproduction is basically the same as in FIGS. 7 and 8, but a screen for displaying a highlight information title is inserted immediately after the start of reproduction, making it easier to grasp the contents.

  In addition to this, the following display can be considered. For example, in the case of live broadcast recording such as a baseball broadcast, the time can be calculated backward when the scene designated as the highlight actually occurred. Already at this time, there is a service on the Internet that can obtain information about the baseball broadcast at what time, which attack, which attack, and which batter or pitcher was playing from the back-calculated time. Is provided. It is also conceivable to display such information in combination with the highlight information title.

  The highlight information shown in FIG. 10 is a very simple format. In addition to this, various formats can be considered. For example, a format that provides highlight information according to several viewing times as one file is conceivable. Further, by using the procedure of converting point information into section information shown in S110 of FIG. 3, information that is not originally highlight information, for example, chapter information included in DVD package software such as a movie is used as highlight information. It can also be diverted. As a method of obtaining thumbnails that represent highlight scenes, a method of directly giving a thumbnail image as highlight information, a method of specifying a specific time as a thumbnail image, a vicinity of the start point or the end point A method of using an image near the middle of the start point and the end point as a thumbnail can be considered.

  In FIG. 9, all the highlight information for the recorded program information is displayed. However, an interface that selectively displays only the highlight information that can be viewed within 50 minutes, for example, according to a user instruction is also conceivable. It is also possible to finely adjust the playback time by slowing down or increasing the acceleration at the start of fast-forward playback. For example, if the viewing time specified by the user is 50 minutes and highlight information that can be viewed in 52 minutes is prepared, if the playback time is shortened to 50 minutes by abrupt acceleration, the user's Can be tailored to your requirements.

  Similarly, an interface that displays a highlight that has been viewed by a specified time is also conceivable. For example, the remaining time can be calculated from the designation “until 8:30” or the designation “until attendance” in which the time is registered in advance and the current time, and selectable highlight information can be selected.

  Combining these selection methods with various variations, such as selecting a playback pattern that meets the conditions from the sum of two or more highlight information and displaying preferentially from unviewed programs, an interface that is easier to use is realized. it can.

  FIG. 12 is a diagram for explaining the screen during playback in more detail. On the screen, a time display 1100 indicating the entire playback time and the time when playback has already ended is displayed. This information may be a ratio with respect to the entire reproduction time or a time required for reproduction of the remaining part. In addition, a bar 1102 indicating which part of the entire recording is being played is displayed on the screen. This bar 1102 indicates a highlight section (indicated by hatching) and other sections. In the example of FIG. 12, the bar 1102 indicates that the highlight section 1101 is currently being reproduced. The playback screen further displays a thumbnail 1103 representing the next highlight section. You may use this thumbnail 1103 as an indicator which shows that it is near the end point of the above-mentioned highlight area.

  FIG. 13 shows highlight information that spans a plurality of programs and in which the broadcast order is different from the playback order of the highlight section in the quick-view playback. The meaning of each line is basically the same as in FIG. However, the example shown in FIG. 13 differs from FIG. 10 in that highlight information of a plurality of programs is given. Highlight information for each program is separated by blank lines.

  FIG. 14 shows an example of reproduction control when such highlight information is given. Referring to FIG. 14, highlight information 250 of the first program includes gaps 260, 264, 268 and 272 and highlight sections 262, 266 and 270. Similarly, the second highlight information 252 includes gaps 280, 284, 288 and 292 and highlight sections 282, 286 and 290.

  In this case, by dividing the recording at the center point of each gap 264, 268, 284 and 288 indicated by the one-point difference line, and reproducing it in the order specified by the highlight information as indicated by the arrows, Quick playback across multiple programs without contradiction. Of course, a format of highlight information that can explicitly specify the dividing point may be adopted. The method as shown here can be regarded as converting a plurality of recordings into one video and applying highlight information thereto. For a single video, not only forward playback but also backward rewind playback can be performed without contradiction.

  This embodiment can also be applied for the purpose of improving the efficiency of the second and third viewing. For example, a method may be considered in which the whole is regarded as a highlight section before the start of the first viewing, and a section in which the user has instructed fast-forward playback is recognized as a gap sequentially. Although it is the same to consider the whole as a highlight section before the start of the first viewing, a method of recognizing a section viewed by the user once in normal playback as a gap section can be considered. The former is suitable for a fast-forwarded part at the first viewing, for example, a fast-forwarding of the CM at the second viewing. The latter is suitable for an application in which a part whose contents are confirmed in the first viewing is fast-forwarded and skipped in the second viewing. A mode may be provided in which the highlight section and the gap are interchanged with each other, the portion designated in the highlight section is fast-forwarded, and the gap is normally reproduced.

  As described above, in the video playback apparatus 1 according to the present embodiment, the program can be viewed in a short time by performing normal playback for highlights and fast-forward playback for other than highlights. Furthermore, by skipping the gaps instead of simply skipping them, the entire program flow is not overlooked. Note that the digital recorder can control its reproduction very flexibly and can take various variations in addition to the control given here, so it is impossible to list all possible variations. The essence of this is to enable normal viewing of highlight scenes and fast-forward playback of other than highlight scenes, thereby enabling short-term overlooked program viewing.

-Video distribution device-
FIG. 15 is a block diagram showing a configuration of a video distribution device 4 that is paired with the video playback device 1 shown in FIG. Referring to FIG. 15, the video distribution device 4 has a function of distributing video input from the imaging device 6 as a broadcast wave from the antenna 5 and distributing related information via a network. Instead of the photographing device 6, an editing device for editing the photographed video may be connected.

  The video distribution device 4 includes a video recording unit 410 for storing the input video, a highlight scene detection unit 401 for adding highlight information to the video, and a program added to the video And an additional information input unit 400 for inputting additional information such as a name. The video distribution device 4 further includes a highlight scene recording area 413 for storing the added highlight information and an additional information recording area 412 for storing the additional information input by the additional information input unit 400. Additional information for reading the video from the video recording unit 410 and the additional information or highlight information from the additional information recording area 412 or the highlight scene recording area 413 as necessary when the video is recorded with the recording unit 411. A multiplexing unit 420 and a transmission unit 423 for supplying the multiplexed video signal to the antenna 5 are included.

  In the case of live broadcasting, generation of additional information or highlight information is delayed from video broadcasting. Even in this case, additional information or highlight information may be multiplexed with the broadcast radio wave, but may be distributed through a network such as the Internet. For this purpose, the video distribution device 4 is further connected to a network, reads appropriate additional information or highlight information from the recording unit 411 in response to a request from the video playback device 1, and sends the request to the video playback device 1 that has transmitted the request. Network interface unit 421 for returning the data.

  When the highlight information is automatically generated by the video distribution device 4 intensively generating the highlight information, a powerful processing device can be used. When highlight information is generated by an operator, a service by a skilled operator can be provided. The highlight scene detection unit 401 has the same function as the highlight scene detection unit 103 of the video reproduction apparatus 1 shown in FIG. 1, but if the operator provides highlight information as a business, the operator can watch the video while watching the video. It is also possible to create light information.

-Operation of video distribution device 4-
The video distribution device 4 operates as follows. The input video is once stored in the video recording unit 410, and highlight information is added to the video in the highlight scene 401. The added highlight information is accumulated in the highlight scene recording area 413. The additional information is given from the additional information input unit 400 and stored in the additional information recording area 412.

  At the time of broadcasting, video is read from the video recording unit 410, and additional information or highlight information is multiplexed by the additional information multiplexing unit 420 as necessary, and sent from the transmission unit 423 to the antenna 5. In the case of live broadcasting, the network interface unit 421 reads and returns appropriate additional information and highlight information in response to a request from the video reproduction device 1.

  Note that if the network is effectively used, it is conceivable that the video itself is distributed over the network, and highlight information manually generated by the user is collected via the network, appropriately processed, and distributed as highlight information. Furthermore, it is also conceivable that the video distribution device 4 does not distribute the video itself but provides only highlight information. For example, an application may be considered in which a tuner is connected in place of the photographing device 6 and only highlight information relating to the video of a program broadcast by a broadcaster is provided. In this case, the additional information multiplexing unit 420, the transmission unit 423, and the antenna 5 are not necessary.

-Fast forward instruction-
It is also conceivable that point information is used as it is without being converted into section information. FIG. 16 shows the state of reproduction in this case. Assume that the highlight information 300 includes highlight point information 302, 304, and 306. Fast-forward playback is performed from the recording start point to the first highlight point information 302, and normal playback is performed after the time specified by the highlight point information 302. For example, when the user gives a fast-forward instruction at time 308 during normal playback, the playback speed is gradually accelerated, decelerated before the next highlight point information 304, and normal playback is started. Thereafter, the same applies when there is a fast-forward instruction at times 310, 312 and the like.

  In this case, it is desirable to be able to return to normal playback immediately upon user instruction even during fast forward playback. Alternatively, it is desirable to take into consideration the fast-forwarding speed at the time when the normal reproduction instruction is given by the user, and to perform normal reproduction by returning to the time estimated to have gone too fast by fast-forwarding. By controlling in this way, it is possible to shorten and view from the point where the user is no longer interested to the next highlight point information.

  In general program recording, if the time at which the CM ends and the program resumes is given as point information, the CM can be played back fast forward, and when the program resumes, the normal playback can be resumed. In addition, if an interesting CM is found without overlooking the outline of the fast-forwarding CM, the CM can also be viewed in normal playback.

-Modification-
Several modifications relating to the configuration of the video reproduction apparatus 1 according to the present embodiment will be described.
The receiving apparatus 100 is not limited to a broadcast radio wave receiving apparatus, and various types of broadcast receivers such as cable television and optical fiber broadcasting can be used. If a VOD (Video On Demand) configuration that supplies video through a network in response to a user request is used, the video recording area 113 is not necessary. The video supply source is not limited to the server of the VOD provider, and may be another video playback device in the same residence.

  Many implementation examples have been proposed for compression encoding processing by the video encoding unit 102. As long as the video data can be converted into data recordable in the video recording area 113, any compression encoding process including a process without compression may be adopted.

  Additional information, highlight information, or video data need not be acquired from broadcast radio waves. The configuration may be such that these are acquired from the network via the network interface unit 130 and recorded in the recording unit 110. In this case, it is also possible to take an on-demand form in which various types of information are acquired when the user needs them.

  Furthermore, the video recorded in the video recording area 113 may be analyzed by the highlight information provider or another video playback device in the same residence, and the resulting highlight scene detection output may be used. It is done. In this case, the highlight scene detection unit 103 is unnecessary, but a function for receiving the result of highlight scene detection is required.

  As a highlight scene detection technique by the highlight scene detection unit 103, the method described in Patent Document 1 can also be used. There are many other proposals. Highlight information may be acquired using a user interface that directly designates a scene that the user thinks is a highlight scene. Highlight information multiplexed on broadcast radio waves, highlight information created by the highlight scene detection unit 103, and highlight information specified by the user may be arbitrarily combined and provided to the playback control device 134.

  Currently, an HDD is generally used as the recording device 110, but a semiconductor memory such as a flash memory or a memory card in which it is stored in a cartridge may be used. As the network interface unit 130, a connection interface to the Internet or a connection interface to a mobile phone network can be used. The network interface 130 may perform various kinds of information acquisition and charge processing for the information.

  When the disc identification information or the disc identification information recorded on the disc is recorded on the disc itself, the identification information is acquired, and the corresponding additional information or highlight information is obtained on the network by the network interface unit 130. You may make it acquire automatically from a predetermined address. Additional information or highlight information may be recorded on the disc itself and acquired by the video recording disc playback unit 114. Information that is not originally highlight information, such as chapter information recorded on a recording medium, can also be used as highlight information. Of course, the recording medium is not limited to a disk, and may be another recording medium such as a memory card.

  There are various highlight scenes, and depending on the user's preference, sports scoring scenes or favorable play scenes, the introduction part of each corner of the information program, the scene immediately after the CM, the scene of the CM itself, and the scene of a specific character are highlighted. It can also be regarded as a scene.

  In the above embodiment, it has been described that one or a plurality of video data is reproduced based on one highlight information. On the contrary, it is also conceivable to designate one piece of video data, and search and reproduce highlight point information or section information included in the video data across a plurality of highlight information. Furthermore, it is also conceivable to use the point information or section information included in the highlight information after filtering it by keyword search for explanation. In this way, for example, it is possible to normally reproduce only the highlight video relating to the player who wants to watch using general highlight information for a baseball game.

  The configuration of the device is not limited to the block diagrams of FIGS. 1 and 15, and as described above, the video distribution device refers to the video recorded in the video recording area of the video playback device via the network to obtain highlight information. The structure which produces | generates may be sufficient. Similarly, the video distribution function of the video distribution device and the highlight information distribution function may be realized as independent devices.

  Levels may be set for the point information and the section information of the highlight information. For example, if the highlight with the highest importance level is set to level 5 and the level is lowered when the importance level decreases, the function equivalent to providing multiple highlight information as shown in FIG. 9 is realized. it can. Furthermore, if the highlight information is section information, level 0 is skipped, level 1 is accelerated fast-forwarding up to 100 times, level 2 is accelerated fast-forwarding up to 32 times, level 3 is playback at quadruple speed, level 4 is 1. Controls such as playback with 5 times audio and normal playback at level 5 are also conceivable.

  There may be filtering using the level as a keyword, or conversion from a word to a level included in the description of section information or point information. In this case, it is desirable to perform processing such that a section to which no level is given is regarded as level 0 and a section information or point information level for which no level is designated is regarded as level 5. If the name of the player that the user is paying attention is included in the description, level 5 is unconditionally, and if the keyword indicating that the video is in the middle of another game is included, it is unconditionally level 0 Operation such as deeming becomes possible.

  Contrary to highlight information, a portion that is not a highlight may be specified. The video playback device performs fast-forward playback of a portion designated as not a highlight from the video, and normally plays back a portion not designated.

  As described above, according to the first embodiment described above, the highlight information is given from the video distribution device to the video playback device, or the highlight information is generated by the video playback device, so that the program content is not overlooked. It becomes possible to watch in time.

-Modification-
In the above description, the configuration in which highlight information is prepared in advance is shown, but the playback device disclosed in the present invention is not limited to this. You may rely on the instruction | indication from a user for the standard of highlight information. For example, when the user presses the CM skip button, it may be controlled to gradually accelerate and return to normal playback at a point about 15 seconds or 30 seconds after the CM break. This is considered to set the highlight point information after 15 seconds or 30 seconds according to an instruction from the user. Furthermore, when the skip button is repeatedly hit, the fast-forward period may be sequentially increased to 15 seconds, 30 seconds, and 45 seconds. Moreover, the pattern at the time of acceleration and the time of deceleration may be different, the maximum speed is reached in a short time during acceleration, and the deceleration may start earlier during deceleration. For applications such as CM skip, a fast-forward pattern that repeats acceleration / deceleration at a cycle of 15 seconds is also effective.

[Second Embodiment]
-Configuration of video playback device-
In the first embodiment, the video playback apparatus 1 can receive a highlight for a short time by receiving highlight information. However, the same effect can be obtained by receiving information instructing reproduction control.

  FIG. 17 is a block diagram of the video reproduction device 7 adopting this method, and FIG. 18 is a block diagram of the video distribution device 8 combined therewith. In the following description, information for instructing reproduction control is referred to as a reproduction script. The reproduction script provides information for designating a portion to be reproduced and a reproduction speed, or information for generating an image for explanation. The playback script is a kind of program for controlling the video, and more various video expressions are possible as compared with a configuration that provides only simple highlight information.

  Referring to FIG. 17, video playback device 7 is connected to antenna 2 that receives broadcast radio waves and display device 3 that outputs the played video. The video playback device 7 includes a receiving unit 700 for selecting a broadcast radio wave received by the antenna 2 and a playback script separation for separating video data and a playback script from the broadcast radio wave selected by the receiving unit 700. 701, a video encoding unit 702 for compressing and encoding the video data separated by the reproduction script separation unit 701, a reproduction script recording area 711 for recording the reproduction script separated by the reproduction script separation unit 701, and a video And a recording unit 710 having a video recording area 712 for recording the video data encoded by the encoding unit 702.

  The video playback device 7 further uses the video decoding unit 722 to decode video data recorded in the video recording area 712 and a video decoding unit 722 based on the playback script recorded in the playback script recording area 711. The playback control unit 721 for playing back the video data recorded in the recording area 712 and outputting the character information embedded in the playback script, and the video decoding unit 722 for the character information embedded in the playback script. And an information superimposing unit 723 for superimposing and outputting on the reproduced video. The output of the information superimposing unit 723 is displayed on the display device 3 as the output of the video reproduction device 7.

  For simplicity, the network interface is not shown in FIG. However, as with the video playback device 1 of FIG. 1, it is naturally possible to receive a playback script or video via a network. For example, it is conceivable that a reproduction script corresponding to a program that has been reserved and recorded is retrieved via a network, downloaded, presented to the user, and reproduced based on the reproduction script selected by the user.

-Operation-
Broadcast radio waves received by the antenna 2 are selected by the receiving unit 700 and input to the reproduction script separating unit 701. The reproduction script separation unit 701 separates the video data and the reproduction script. The separated reproduction script is recorded in the reproduction script recording area 711 of the recording unit 710. The video data is compressed and encoded by the video encoding unit 702 and recorded in the video recording area 712 of the recording unit 710.

  The reproduction control unit 721 reproduces the video data recorded in the video recording area 712 using the video decoding unit 722 based on the reproduction script recorded in the reproduction script recording area 711 (that is, executes the reproduction script). The information superimposing unit 723 superimposes and outputs the character information embedded in the reproduction script. The output of the information superimposing unit 723 is displayed on the display device 3 as the output of the video reproduction device 7.

-Configuration of video distribution device-
Next, the configuration of the video distribution apparatus 8 shown in the block diagram of FIG. 18 will be described. The video distribution device 8 has a function of distributing the video input from the photographing device 6 as a broadcast wave from the antenna 5 and multiplexing and distributing the reproduction script. An editing device that edits the captured video may be connected instead of the imaging device 6.

  The video distribution device 8 includes a video recording unit 810 for storing the input video, a highlight scene detection unit 801 for generating highlight information for the video, and additional information such as a description for the video. An additional information input unit 800 for inputting and a reproduction script editing unit 802 for generating a reproduction script by combining the additional information and the highlight information are included.

  The video distribution device 8 further includes a playback script recording unit 811 for recording the script generated by the playback script editing unit 802, and video recording when the video recorded in the video recording unit 810 is distributed by broadcast radio waves. The playback script multiplexing unit 820 reads the video from the unit 810, the corresponding playback script from the playback script recording unit 811, and multiplexes the playback script with the video, and the playback script multiplexing unit 820 outputs the video. And a transmission unit 821 for transmitting the video on which the reproduction script is multiplexed to the antenna 5.

  As described above, when a playback script is distributed via a network, a network interface corresponding to the script is required, but is not shown in FIG. 18 for simplicity.

  The reproduction script generated by the reproduction script 802 gives an instruction equivalent to the reproduction control realized by the reproduction control unit 134 shown in FIG. 1 of the first embodiment. An example is shown in FIG.

  Referring to FIG. 19, the script is divided into blocks B1 to B12 by blank lines. The first block B1 shows the title of the playback script, and the second and subsequent blocks B2 to B12 show playback control. Each block B2 to B12 indicating playback control includes information (in this example, “broadcast station”) for specifying a video to be played back, a playback range (“broadcast time”), and a playback speed.

  After the opening video is normally played back in block B2, it is accelerated and decelerated to 1.5x speed (block B3), 8.0x speed (block B4), and 1.5x speed (block B5), and a kick-off scene (block B6). ) To return to normal playback.

  A section (blocks B2, B6 to B8, and B12) in which 1.0-times speed playback is specified in the script is regarded as a highlight section in the first embodiment, and if a high-speed playback instruction is ignored, fast forward postponement or fast forward is performed. A hold function can also be realized. Of course, an instruction to return to normal playback may be given explicitly. In addition, it is possible to reproduce a combination of a part of scenes of other programs as in block B8.

-Operation-
The input video is once stored in the video recording unit 810, and highlight information is generated in the highlight scene 801 for this video. Additional information for the video is input through the additional information input unit 800 and provided to the reproduction script editing unit 802. The reproduction script editing unit 802 generates a reproduction script by combining the additional information and the highlight information output from the highlight scene detection unit 801. The generated script is recorded in the reproduction script 811.

  When the video is distributed by broadcast radio waves, or when another video is distributed, the playback script multiplexing unit 820 reads the video from the video recording unit 810 and reads the corresponding playback script from the playback script recording unit 811 to make the video. Multiplex. After multiplexing, the video is sent to the antenna 5 through the transmission unit 821.

  If the reproduction script as described above is generated in the reproduction script editing unit 802, the program can be viewed in a short time without overlooking the program content. In addition, since the distribution apparatus 8 side specifies control intensively, the order on the distribution side is more accurately reproduced, such as by switching the order from the time of broadcasting or by accelerating the playback to be 4x or less in the CM portion. The reflected control can be performed. It is also conceivable to provide a playback script that matches the user's preference by exchanging information with the video playback device 7 shown in FIG. In this case, when the playback script is not recorded in advance but only the highlight scene information and the additional information are prepared in advance and the video playback device 7 requests to add user preference information. A configuration in which the playback script editing unit 802 generates a script is suitable.

[Third Embodiment]
-Configuration of image cutting device-
It may be possible to cut out and use a part of the program recording by using the highlight information. The video cutting device 9 shown in FIG. 20 achieves such an object. Of the components shown in FIG. 20, many of the components are the same as those of the video playback apparatus shown in FIG. 1, and therefore, the description of the overlapping components will not be repeated here.

  Referring to FIG. 20, the image cutout device 9 includes the same constituent elements 100, 101, 102, 103, 104, 110, 114, 130, 131, 132, and 133 as those shown in FIG. A video transcoding unit 901 for transcoding video data recorded in the video recording region 113 and a video recording region using the video transcoding unit 901 based on highlight information recorded in the highlight scene recording region 112 113, transcoding a predetermined section determined by highlight information in the video data recorded in 113, and a cutout control unit 900 for outputting a highlight section required at the time of reproduction, transcoded video, and addition Additional information extracted from the information storage area 111 and the cut-out system The highlight information part 900 is taken out and a memory card interface 902 for writing to the memory card 903. By mounting the memory card 903 on a playback device (not shown), video can be played back.

-Operation-
Based on the highlight information recorded in the highlight scene recording area 112, the clipping control section 900 uses the video transcoding section 901 to highlight information as described below in the video data recorded in the video recording area 113. Transcodes a predetermined section determined by the above and extracts highlight information necessary for reproduction. The video transcoded by the video transcoding unit 901, the additional information read from the additional information storage region 111 via the switch 131, and the highlight information extracted from the highlight scene storage region 112 by the cutout control unit 900 are: Data is written to the memory card 903 via the memory card interface 902.

  FIG. 21 is a diagram for explaining extraction of video information by the extraction control unit 900. Referring to FIG. 21, cutout control section 900 cuts out the highlight section and the images before and after the highlight section based on the highlight information, causes video transcoding section 901 to transcode, and records the output to memory card 903. . In general, it is assumed that the capacity of the memory card 903 is smaller than the capacity of the recording unit 110, and the decoding capability of a playback device that plays back video recorded on the memory card 903 is low. Therefore, the video to be recorded on the memory card 903 is converted to a low bit rate by the video transcoding unit 901. If the capacity of the memory card 903 and the decoding capability of the video playback device are sufficient, transcoding is unnecessary.

  Only necessary parts are extracted based on the highlight information. The capacity of the extracted video information is reduced, and the time required for transcoding or the writing time to the memory card 903 is shortened. Further, in this embodiment, not only the highlight section is cut out, but the images before and after the highlight section are left. Thereby, the user's request to know the continuation of the highlight or the state before the highlight can be answered. Such a request is often seen in, for example, sports games. The time of the front and rear images varies depending on the application. For example, for a baseball game, 30 seconds is appropriate for the previous video, and about 1 minute is appropriate for the subsequent video.

  It may be possible to add information for cutting out separately to the highlight information. In the playback device, the recorded video can be played back as it is, or the program recording can be played back in a short time by analyzing the highlight information and performing the same control as the playback control device 134 of FIG.

  When video information is recorded on the memory card 903, it can be recorded as a single video, or can be recorded as separate video for each part as shown in FIG. The method of recording in a single video is suitable for playback on a playback device that does not support playback using highlight information. In this case, it may be possible to transcode the fast forward video before and after the highlight section. On the other hand, if the playback apparatus can use the highlight information, even if the divided information is recorded as shown in FIG. By leaving the information, it is possible to perform fast playback using highlight information equivalent to the playback device of FIG.

  Note that the memory card 903 is an example of a removable recording medium. In addition to this, it is also possible to use a removable hard disk device or a writable optical recording medium. A configuration is also conceivable in which data is written to a storage device fixed inside the playback device via the network interface 130 instead of the memory card interface 902.

  If the video recorded in the video recording area 113 is a video for which copy once is designated, the video information in the video recording area 113 is erased after writing to the memory card 903 or the information written in the memory card 903 is changed. It must be controlled so that it cannot be accessed until it is erased. If a mechanism that can invalidate the information written in the memory card 903 with a time limit can be prepared separately, it may be possible to make the video information in the video recording area 113 inaccessible for a certain period.

[Fourth Embodiment]
−Configuration−
In order to realize the operations shown in the first to third embodiments, the recording and the time information embedded in the highlight information must match. For example, the clock used by the video playback device 1 in FIG. 1 for recording a program is advanced. On the other hand, if highlight information created by the video distribution device 4 in FIG. Normal playback starts earlier than the start point of the video to be displayed as light, and accelerated playback starts earlier than the end point. That is, reproduction is redundant before the start point and insufficient after the end point. The same applies to a situation where the clock of the video playback device 1 is accurate and the clock of the video distribution device 4 is incorrect.

  As a reference for knowing the time when the video was recorded, external video input such as a clock built in the device used in a conventional analog VTR (Video Tape Recorder), time information embedded in a digital broadcast wave, digital video input, etc. Time information embedded in is assumed. In some cases, the original recording time is completely unknown, such as when video is dubbed using analog input. Here, the accuracy of time is defined as in the table shown in FIG.

  FIG. 23 is a block diagram showing the configuration of the video recording apparatus 10 according to the fourth embodiment of the present invention. Since the video recording apparatus 10 shown in FIG. 23 performs a function of receiving video input and recording it on a recording medium, a part of the video playback apparatus 1 or 7 or video cutting apparatus 9 shown in FIG. 1, FIG. 17, or FIG. Are generally included in these. However, it is shown here as an independent device for the sake of simplicity. If a detachable recording medium is used as the video recording unit 151, it can be configured as an independent device as shown in FIG.

  Referring to FIG. 23, video recording apparatus 10 is for receiving video input from antenna 2 or an input terminal and recording it in video recording unit 151. The video recording unit 151 records an accuracy recording area 152 for recording accuracy described later, a recording start time recording area 153 for recording a recording start time calculated based on time information, and video data. A video data recording area 154 for recording.

  The video recording apparatus 10 receives a broadcast radio wave received by the antenna 2 and a reception unit 141 for receiving the broadcast radio wave selected by the reception unit 141, and a time for separating video data and time information. Information separator 142, time information separator 143 for separating video data and time information from the video signal received from the external input terminal, and accuracy determination for determining and outputting the accuracy as described later Part 140.

  The video recording device 10 further includes a clock unit 145 for outputting the current time information of the video recording device 10, a clock correction unit 144 for correcting the clock unit 145, timing of the reproduction time of the video, or as will be described later. And a timer unit 146 for reading information (analog video camera counter or the like) indicating the playback time of the apparatus that is externally input.

  The video recording apparatus 10 further receives the video data and time information from the time information separation unit 142, the video data and time information from the time information separation unit 143, the time information from the clock unit 145, and the time measurement information from the clock unit 146. In response to the accuracy determined by the accuracy determination unit 140, any one of the video data output from the time information separation unit 142 and the time information separation unit 143, the time information separation unit 142, the time information separation unit 143, A switch 147 for selecting and outputting either the output of the clock unit 145 or the time measuring unit 146, and the video data output from the switch 147 are compressed and encoded and recorded in the video data recording area 154 of the video recording unit 151. A video encoding unit 148 for calculating the offset and an offset for calculating and outputting an offset with respect to time information Includes a detecting section 149, an adder 150 for adding the offset, write the recording start time recording area 153 for outputting the offset calculation unit 149 with respect to the time information output from the switch 147. Details of the operation of the offset calculation unit 149 will be described later.

  The accuracy determined by the accuracy determination unit 140 is used for selecting video data and time information by the switch 147 and is also recorded in the accuracy recording area 152. The video recording unit 151 normally records a plurality of videos. For each video, a set of accuracy, recording start time, and video data is recorded.

  In addition to the time information separated from the broadcast radio wave and the input video, the time information can also be obtained from the clock unit 145 and the clock unit 146. It is assumed that the clock unit 145 is appropriately corrected by an NTP (Network Time Protocol), a time signal sound included in the sound of a broadcast radio wave, or a time signal sound provided as a telephone service. Although this correction is realized by the clock correction unit 144, its mechanism is known and will not be described.

  Details of the operation of the accuracy determination unit 140 are shown in the table of FIG. If time information is included in broadcast radio waves such as when receiving digital broadcasts, the time information separated as time information with accuracy 4 is used. If the time information is not included in the broadcast radio wave, such as when receiving an analog broadcast, the time information output by the clock unit 145 is used as the time information of accuracy 2. If the time information is included in the video input from the external input terminal such as a digital video input, the time information separated as the time information of accuracy 1 is used. This is based on the assumption that the time is recorded by a self-propelled clock that does not have a correction means such as a digital video camera. If the time information is not included in the video input from the external terminal such as an analog video input, the time information output from the time measuring unit 146 is used as the time information with zero accuracy. This assumes the case of recording an image without time information such as an analog video camera. As described above, the accuracy determination unit 140 determines the accuracy based on the environment of the transmission path for video acquisition when the video is accumulated.

  The time measuring unit 146 shown in FIG. 23 may output only 0 as time information. However, for example, if the tape counter of the analog video player connected to the external input terminal can read, the value may be output. When accuracy can be predicted in advance, such as when a digital broadcast tuner is connected to the external input terminal, the accuracy may be determined by other methods without relying on the table of FIG.

  FIG. 25 is a table showing the operation of the offset calculation unit 149 shown in FIG. The offset calculation unit 149 has a function of giving correction values for time information and accurate time.

  When the accuracy is 0, the offset cannot be calculated, and the offset calculation unit 149 outputs 0.

  When the accuracy is 1, the offset calculation unit 149 gives an offset value depending on the device connected to the external input terminal. For example, 0 is output when the digital video camera 1 is connected, and 5 seconds is output when the digital video camera 2 is connected. Such an operation realizes a function of correcting the offset of the built-in clock of each digital video camera when one subject is photographed by a plurality of digital video cameras. In the above example, the situation in which the internal clock of the digital video camera 2 is delayed by 5 seconds as compared with the internal clock of the digital video camera 1 is corrected. The offset value corresponding to each device is specified by the user.

  When the accuracy is 2, the offset calculation unit 149 outputs a value determined by the channel selected by the reception unit 141. This operation can be performed, for example, by correcting the time required for conversion when analog broadcast or digital broadcast is transmitted as one channel of cable television, or by converting digital broadcast wave to analog broadcast wave for reception. This is effective when correcting the time required. Since the time required for conversion is considered to be constant for each channel, the offset can be uniquely calculated when the channel is determined.

  When the accuracy is 3, the offset calculation unit 149 outputs 0 because correction is considered unnecessary. If the time information output from the adder 150 is used to control recording start and recording end when performing scheduled recording, the video recording apparatus 10 is not easily affected by the difference in conversion time depending on the channel. Reservation recording operation can be realized.

  With the configuration described above, it is possible to obtain the recording start time for each video data.

  Next, a method for managing the relative time between highlight information and video data will be described.

  Like the video data recording start time, the accuracy can be defined for the highlight information. The accuracy of the video data referred to when generating the highlight information is regarded as the accuracy of the highlight information. For example, when highlight information is generated with reference to an image with accuracy 2, the time included in the highlight information is considered to be accuracy 2 as with the referenced image. Then, it is considered that the relative accuracy between the highlight information and the video data matches the lower accuracy of the highlight information and the video data. This is because, for example, when video data with an accuracy of 4 and highlight information with an accuracy of 2 are combined, a relative time shift is considered to be substantially the same as an error in the time information with an accuracy of 2. However, when the highlight information generated by the highlight scene detection unit 103 in FIG. 1 and the video data recorded in the video recording area 113 are complete in the same apparatus, relative accuracy is obtained. Is considered four.

  When the relative accuracy of the time information between the video data and the highlight information is defined as described above, an appropriate time information correction process can be performed using this accuracy. When the relative accuracy is 4, since it is considered that there is almost no error, it is not necessary to correct the time information. When the relative accuracy is 2, it is basically unnecessary to correct, but if the user feels uncomfortable, the correction is performed. When the relative accuracy is 0 or 1, correction is performed before the quick-playing is started.

  Management of correction values is performed using a management table as shown in FIG. Each highlight information has its accuracy and correction value. Similarly, video data has accuracy and correction values. In the example shown in FIG. 26, the highlight information 4 is in a state where there is no information yet. In the column of the intersection between each highlight information column and each video data row, a relative correction value and accuracy of the highlight information and video data are stored. These fields further have status information indicating whether the correction value is an actually measured value or an indirectly calculated value. If the value is actually measured, the state is fixed, and if the value is indirectly calculated, the state is undefined.

  In the following description, when a certain column is “column x”, video data in the same row is expressed as “video data x”, and highlight information in the same column is expressed as “highlight information x”. This table is updated according to the flowcharts shown in FIGS. The details of these procedures will be described later, and an outline thereof will be described using an example shown in FIG.

  The table shown in FIG. 30 indicates that, for example, for video data 1, the time that should originally be 10:23:42 is recorded as time 0:00. Similarly, the video at the time designated as 10:30 in the highlight information 1 is precisely the video at 10:31:23 (the difference from 10:30 is +0: 01: 23). It is shown that. Therefore, the relative error between the video data 1 and the highlight information 1 is +10: 22: 19, and the video of the video data 1 specified as 10:30:30 in the highlight information 1 is reproduced. Therefore, the video data 1 must be reproduced by designating 0:07:41, the time obtained by subtracting the correction value +10: 22: 19 from 10:30. Since the information in FIG. 30 cannot actually be known, it is necessary to estimate a value as close as possible to the value shown in FIG. 30 using the table in FIG. 26 based on the given information. The time correction process will be described later.

  FIG. 26 shows the initial state of the management table. For each column x, the accuracy is the lesser of the accuracy of the video data x and the accuracy of the highlight information x, and the correction value is 0:00. 0:00, the state is initialized to “indeterminate”. Information given for estimation is an approximate value of a relative correction value between video data and highlight information. A method for obtaining the approximate value will be described later.

  The time correction process will be described with reference to FIG. S200 in FIG. 27 is a step of obtaining an approximate value of the correction value described above. In S201, the acquired correction value is recorded as a correction value in a column A (indicated by an underline in FIG. 31) corresponding to the intersection of the video data 1 and the highlight information 2. The state of the column A is “confirmed”.

  Next, in S202, it is determined whether or not the accuracy of the video data A is inconsistent with the accuracy of the highlight information A. If not, the process ends in S203. Otherwise, the process ends. In the present example, since the accuracy of the video data 1 is smaller than the accuracy of the highlight information 2, the determination result in S202 is Yes.

  In S203, it is determined whether or not the accuracy of the video data A is less than the accuracy of the highlight information A. If the determination result is YES, the process proceeds to S204, otherwise proceeds to S207.

  In S204, the accuracy of the highlight information A is substituted into the accuracy column of the column A. In subsequent S205, the accuracy of the column A is substituted for the accuracy of the video data A, and a value obtained by adding the correction value of the highlight information A and the correction value of the column A is substituted for the correction value of the video data A. Further, a row update process is executed in S206. Details of the row update process will be described later. Here, the argument is (column A, no truncation). The first argument indicates a column to be processed, and the second argument is an argument for designating whether recursive activation of this process is performed without being terminated or is terminated at a predetermined hierarchy as will be described later.

  On the other hand, in S207, the accuracy value of the video data A is substituted for the accuracy of the column A. In subsequent S208, the accuracy value of the column A is substituted for the accuracy value of the highlight information A, and the correction value of the video data A minus the correction value of the column A is used as the correction value of the highlight information A. Substitute in the field. Furthermore, a column update process is executed in S209. Details thereof will be described later. Here, the argument is (column A, no truncation).

  The row update process and the column update process will be described with reference to FIGS. 28 and 29, respectively. The row update process and the column update process are processes for updating a column that can be estimated by obtaining information about the column A.

  Referring to FIG. 28, first, the first argument is substituted into column B in S210. That is, the contents of the field specified by the first argument are regarded as the contents of the field B, and the following processing is executed. It should be noted that when the accuracy of the column to be substituted is the accuracy 4 and only in that case, the accuracy is converted to 3 and assigned.

  As described below, the processing between S211s and S211e is repeated for each column of the video data 1 excluding the column B. In the following description, a target column is a column C.

  Among the repetitions, in S212, it is determined whether or not the accuracy of the video data C is less than or equal to the accuracy of the highlight information C. If the determination result is YES, the process proceeds to S213, otherwise proceeds to S216.

  In S213, the accuracy of the video data C is substituted into the accuracy of the column C. In S214, it is determined whether or not the state of the column C is “confirmed”. If the determination result is YES, the process for the column C is finished. If NO, a value obtained by subtracting the correction value of the highlight information C from the correction value of the video data C is set as the correction value of the column C in S215, and the processing of the column C is ended.

  On the other hand, when the process proceeds from S212 to S216, it is determined in S216 whether or not the state of the column C is “confirmed”. If the determination result is YES, the process proceeds to S217, otherwise proceeds to S221.

  In S217, it is determined whether or not the second argument is “no abort”. If the determination result is YES, the process proceeds to S218, otherwise the process for the column C is terminated.

  In S218, the accuracy of the video data C is substituted for the accuracy of the column C. In S219, the accuracy of the column C is substituted for the accuracy of the highlight information C, and the value obtained by subtracting the correction value of the column C from the correction value of the video data C is substituted for the correction value of the highlight information C. In S220, a column update process is executed. The argument is (column C, with truncation). After completion of S220, the process for column C is terminated.

  When the process proceeds from S216 to S221, a value obtained by subtracting the correction value of the highlight information C from the correction value of the video data C is substituted for the correction value in the column C in S221. Thereafter, the process for column C is terminated.

  The column update processing executed in S209 of FIG. 27 and S220 of FIG. 28 will be described with reference to FIG. First, in S230, the first argument is substituted into the column B. Thereafter, the processing of S231s to S231e is repeatedly executed for all columns except column B in column B. Note that when the accuracy of the column to be substituted is 4, and only in that case, the accuracy is converted to 3 and assigned. Hereinafter, the column to be processed is referred to as column C.

  In S232, it is determined whether or not the accuracy of the video data C is equal to or higher than the accuracy of the highlight information C. If the determination result is YES, the process proceeds to S233, otherwise the process proceeds to S236.

  In S233, the accuracy of the highlight information C is substituted for the accuracy of the column C. In S234, it is determined whether or not the accuracy of the column C is “confirmed”. If a determination result is YES, the process with respect to the column C will be complete | finished. If the determination result is NO, the value obtained by subtracting the correction value of the highlight information C from the correction value of the video data C is substituted into the correction value of the column C in S235, and the processing of the column C is ended.

  On the other hand, if the determination result in S232 is NO, it is determined in S236 whether the state of the column C is “confirmed”. If the determination result is YES, the process proceeds to S237, otherwise proceeds to S241.

  In S237, it is determined whether or not the second argument is “no abort”. If the determination result is YES, the process proceeds to S238, otherwise the process for the column C is terminated.

  In S238, the accuracy of the highlight information C is substituted for the accuracy of the column C. In S239, the accuracy of the column C is substituted for the accuracy of the video data C, and the correction value of the highlight information C plus the correction value of the column C is substituted for the correction value of the video data C. In S240, the line update process is executed with argument = (column C, with truncation), and the process for column C is terminated.

  The configuration of the correction value update process has been described above with reference to FIGS.

-Operation-
The video recording apparatus 10 receives video input from the antenna 2 or the input terminal and records it in the video recording unit 151. When recording the video received by the antenna 2, the received broadcast radio wave is selected by the receiving unit 141 and input to the time information separating unit 142. In the time information separation unit 142, the video data and the time information are separated. The separated video data passes through the switch 147, is compressed and encoded by the video encoding unit 148, and is recorded in the video data recording area 154 of the video recording unit 151. The time information separated from the broadcast radio wave by the time information separation unit 142 is added to the offset calculated by the offset calculation unit 149 by the adder 150 through the switch 147 and written in the recording start time recording area 153.

  Similarly, the video input from the input terminal is also separated into video data and time information by the time information separation unit 143, and each is selected by the switch 147. In addition to the time information separated from the broadcast radio wave and the input video, the time information can also be obtained from the clock unit 145 and the clock unit 146.

  Hereinafter, a specific example of the time correction process will be described assuming that an approximate value +10: 23: 47 of a relative correction value between the video data 1 and the highlight information 2 is given. Referring to FIG. 27, since the accuracy of video data 1 is smaller than the accuracy of highlight information 2, the determination result is YES in both S202 and S203, and the result processing branches to S204. In S204, the accuracy of the highlight information 2 (accuracy 2) is set to the accuracy of the column A. Thus, the update for the column A is completed. Next, in S205, the accuracy in column A (accuracy 2) is the accuracy of video data 1, and the correction value of video data 1 is +10: 23: 47 (= + 10: 23: 47 + 00: 00). Each is set, and the update for the video data 1 is completed. Further, in S206, the information in each column of the row of the video data 1 is updated, and a series of update processing is completed.

  With reference to FIG. 28, the operation | movement in the row update process in S206 of FIG. 27 is demonstrated. The processing is started in a state where the column A and “no truncation” are given as arguments of the row update processing. In S210, it is instructed to consider column A as column B, and the processing between S211s and S211e is repeated for each column except column A in the row of video data 1. In the column of the intersection of the video data 1 and the highlight information 1 (hereinafter referred to as the column 1-1), since the video data 1 accuracy> highlight information 1 accuracy, the determination result in S212 is NO and the process branches to S216. To do.

  Since the state of the column 1-1 is unconfirmed, the determination result in S216 is NO. As a result, in S221, the correction value in the column 1-1 is set to +10: 23: 47 (= + 10: 23: 47-0: 00: 00).

  Next, in the column of the intersection of the video data 1 and the highlight information 3 (hereinafter referred to as the column 1-3), the accuracy of the video data 1 <the accuracy of the highlight information 2 is satisfied. Therefore, the determination result in S212 is YES. Control branches to S213. In S213, the accuracy (accuracy 2) of the video data 1 is set to the accuracy in the column 1-3. Since the state of the column 1-3 is “indeterminate”, the determination result in S214 is NO, and in S215, the correction value of the column 1-3 is +10: 23: 47 (= + 10: 23: 47-00: 00: 00). This completes the row update process.

  The operation when the column update process is included is the same. Here, those details are omitted for the sake of brevity.

  FIG. 31 shows the state of the management table after the above processing is performed. The part shown in italics is the item updated from the state shown in FIG.

  Similarly, FIG. 32 shows an update result when the approximate value of the correction value of the video data 3 and the highlight information 1 is given as −0: 01: 18. Further, FIG. 33 shows an update result when the approximate value of the correction value of the video data 3 and the highlight information 3 is given as +0: 00: 03.

  At the time of the row update process to the table of FIG. 33, the correction value of the intersection (hereinafter, column 3-1) between the video data 3 and the highlight information 1 is fixed. Therefore, the determination result in S216 of FIG. 28 is YES, and control branches to S217. Since the second argument at that time is “no abort”, the determination result in S217 is also YES, and the process branches to S218. As a result, the accuracy of the column 3-1, the accuracy of the highlight information 1, and the correction value of the highlight information 1 are updated, respectively, and the column update processing of the highlight information 1 is also performed recursively.

  There is no particular restriction on how recursively the row or column update process is called. However, in order to prevent the influence of the accumulated error of the approximate value of the correction value acquired originally, here, the recursive call is processed in the second update process. The reason why the accuracy value 4 is converted to the accuracy value 3 when substituting the accuracy value 4 is that the accuracy corresponding to the accuracy level 4 cannot be maintained due to an error in obtaining the correction value in S200 of FIG. This is because it is considered.

  FIG. 34 shows the state of the management table after the highlight information 4 with accuracy 2 is newly given. The accuracy of each column is set to the accuracy of the video data and the accuracy of the highlight information, and the correction value is set to a value obtained by subtracting the correction value of the highlight information from the correction value of the video data. All states are “indeterminate”.

  As described above, by estimating the correction value by the processing as described above, it is possible to efficiently update the table for managing the time lag between the video data and the highlight information. The estimation results are shown in FIGS. It is highly accurate as can be seen from the comparison.

  The usage of this table is as follows. For example, when the video data 2 is quickly played back based on the highlight information 1, for the video in the highlight section from the time T1 to T2 given by the highlight information, the intersection of the video data 2 and the highlight information 1 is displayed. It is obtained by reproducing the video data 2 from T1-0: 01: 21 to T2-0: 01: 21 using the correction value −0: 01: 21 in the column.

  Finally, acquisition of correction values in S200 will be described. The timing for acquiring the correction value is considered to be acquisition by mechanical means and designation by the user as acquisition means before and during reproduction.

  Among these, when it is estimated that the error is obviously large with respect to the acquisition timing, it is desirable to acquire the correction value before reproduction so as not to prevent viewing by the correction value acquisition process. The magnitude of the error can be estimated by referring to the accuracy of the correction value management table. For correction values with accuracy 0 and unconfirmed, accuracy 1 and unconfirmed, correction values for accuracy 2 and unconfirmed are always acquired before reproduction depending on the situation. Whether or not to obtain a correction value for an accuracy value of 2 and an indeterminate correction value, for example, the length of the shortest highlight section is 20 seconds or less, or the content of video data (can be estimated from program information) It is desirable to take into account information such as sports that are moving rapidly, such as sports.

  Since the fixed correction value or the correction values of the accuracy 3 and the accuracy 4 are estimated to have a small error, the correction value before the reproduction is not acquired. Normally, it is considered sufficient to obtain the correction value before reproduction. However, if the user feels that there is an error during fast-playing, the reproduction is interrupted once and the correction value is obtained.

  Acquisition of correction values is realized by video and audio matching.

  FIG. 35 shows an example of information for acquiring a correction value. This information includes blocks B21 to B23, which provide information for acquiring correction values for different times. The information of these blocks B21 to B23 may be distributed independently, but it is desirable to distribute them by embedding in the highlight information. For example, the description of FIG. 35 may be embedded before or after the information of FIG.

  Block B21 shows how to give information when requesting matching from the user. When the playback device needs to obtain a correction value, it displays the contents shown in “Description” (a character string “Please specify the moment when the characters of“ Brazilian VS Germany ”shine”) on the screen, The video broadcasted by the TV station “TV Higashihan” is played once or repeatedly from a little before and after 13:00 on November 11, 2003, and waits for the user to specify the moment indicated in the description. If the user's designation indicates a time point recognized as 13:00:10 in the recording device, the correction value in that case is +00: 00: 10 (= 13: 00: 10-13: 00: 00) It becomes.

  Block B22 shows how to give information when matching mechanically. When it is necessary to acquire a correction value, the playback apparatus acquires a still image indicated by “image”, and displays a video broadcasted by the television station “TV Higashihan” from slightly before 13:00 on November 11, 2003 until a little later. A range is searched, and a correction value is obtained by detecting the moment when the video and the acquired still image are the best match. Various methods have been proposed for image coincidence detection, and any method may be adopted.

  A block B23 shows how to give information that can respond to either a user instruction or mechanical matching. The reproduction or search range for matching can be determined from the accuracy of the management table described above. If the accuracy is 0, the entire recording must be in the range, but if the accuracy is 1, 2, 3, 4, then 10 minutes before and after the specified time, 10 seconds before and after, 2 seconds before and after, 1 second before and after If it is within the range, it is expected that sufficient results will be obtained. Depending on the highlight information creation environment, it is possible to narrow the search range for highlight information with accuracy of 0 by assuming that the recording start point of each video data is regarded as time 0:00. There is a possibility. The target of matching is not limited to video, but may be audio. The correction value acquisition method described here can also be applied to the setting of the offset value for each channel provided in the offset calculation unit 149 shown in FIG.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim in the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are intended. Including.

It is a block diagram which shows the structure of the video reproduction apparatus in the 1st Embodiment of this invention. It is a figure which shows the outline | summary of the reproduction | regeneration operation | movement of this invention. It is a figure for defining a term. It is a flowchart which shows operation | movement of the reproduction | regeneration control part of this invention. It is a flowchart which shows the detail of the highlight information normalization process of this invention. It is a flowchart which shows the detail of the quick-reproduction process of this invention. It is a figure which shows an example of the reproduction | regeneration operation | movement of this invention. It is a figure which shows an example of another reproduction | regeneration operation | movement of this invention. It is a figure which shows an example of the screen displayed in order to operate the reproducing | regenerating apparatus of this invention. It is a figure which shows an example of highlight information. It is a figure which shows an example of the screen displayed by the reproducing operation of this invention. It is a figure which shows an example of the detail of the screen displayed by the reproduction | regeneration operation | movement of this invention. It is a figure which shows another example of highlight information. It is a figure which shows an example of the reproduction | regeneration operation | movement over several video data of this invention. It is a block diagram which shows the structure of the video delivery apparatus in the 1st Embodiment of this invention. It is a figure which shows an example of another reproduction | regeneration operation | movement of this invention. It is a block diagram which shows the structure of the video reproduction apparatus in the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the video delivery apparatus in the 2nd Embodiment of this invention. It is a figure which shows an example of a reproduction | regeneration script. It is a block diagram which shows the structure of the image | video cutting-out apparatus in the 3rd Embodiment of this invention. It is a figure which shows an example of the image | video cutting-out operation | movement of this invention. It is a figure which shows the information which defines an accuracy in tabular form. It is a block diagram which shows the structure of the video recording apparatus in the 4th Embodiment of this invention. It is a figure which shows operation | movement of the accuracy determination part of this invention in a table | surface form. It is a figure which shows operation | movement of the offset calculation part of this invention in a table format. It is an example of the time correction table of the present invention in the form of a table. It is a flowchart which shows the time correction process of this invention. It is a flowchart which shows the detail of a row update process. It is a flowchart which shows the detail of a column update process. It is a figure which shows the example of a process of a time correction process in a table format. It is a figure which shows another example of a process of a time correction process in a table format. It is a figure which shows another example of the process of a time correction process in a table format. It is a figure which shows another example of the process of a time correction process in a table format. It is a figure which shows another example of the process of a time correction process in a table format. It is a figure which shows the example of the information given for time correction.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,7 Video reproduction apparatus, 2,5 Antenna, 3 Display apparatus, 4,8 Video distribution apparatus, 6 Shooting apparatus, 9 Video extraction apparatus, 10 Video recording apparatus, 100, 141,700 Reception part, 101 Additional information separation part 102, 148, 702 Video encoding unit, 103, 401, 801 Highlight scene detection unit, 104, 131, 132, 133, 147 switch, 110, 411, 710 recording unit, 111, 412 Additional information recording area, 112, 413 Highlight scene recording area, 113,712 video recording area, 114 video recording disk playback section, 130,421 network interface section, 134,721 playback control section, 135,722 video decoding section, 136 information overlay section, 140 Degree determination unit, 142 Time information separation unit, 143 Time information separation unit, 144 Clock correction unit, 145 Clock unit, 146 Timekeeping unit, 149 Offset calculation unit, 150 Adder, 151, 410, 810 Video recording unit, 152 Accuracy recording area, 153 Recording start time recording area, 154 Video data recording area, 400 additional information input section, 420 additional information multiplexing section, 423, 821 transmission section, 701 playback script separation section, 711, 811 playback script recording area, 723 information superposition section, 800 additional information input section, 802 Reproduction script editing unit, 820 Reproduction script multiplexing unit, 900 Extraction control device, 901 Video transcoding unit, 902 Memory card interface, 903 Memory card

Claims (27)

A video playback unit capable of playing back an arbitrary section of video in either the first or second playback mode;
The video playback unit controls the video playback unit to specify the highlight position in the video, the video part specified by the highlight information is the first playback mode, the other video part is the second playback mode, Including playback control means for playback,
In the second playback mode, the playback control means plays back video at a speed that is faster than the first playback mode and faster according to the distance between the highlight area and the playback position. apparatus. A video playback unit capable of playback in at least two playback modes of fast-forward playback and normal playback;
Highlight information storage means for storing highlight information for defining a highlight area of the video;
Controlling the video playback unit, of the video, the highlight area is played back in the normal playback mode, and other areas are played back in the fast-forward playback mode, playback control means,
An instruction input means for receiving a fast-forward instruction from the user;
In response to receiving the fast-forward instruction, fast-forward means for controlling the video playback unit to start fast-forward playback,
The playback control means plays back in the normal playback mode when fast-forward playback of video by the video playback section reaches the highlight area designated by the highlight information stored in the highlight information storage means. A video playback apparatus that controls the video playback unit and plays back video in the fast-forward playback mode at a speed that is faster than the normal playback mode and slower as the playback position approaches the highlight area. During the fast-forward playback by the video playback unit, the playback control means is a fast-forward speed corresponding to a highlight area determined by highlight information, or a distance between at least one of the video positions receiving the fast-forward instruction and the playback position. The video playback apparatus according to claim 2, further comprising means for controlling the video playback unit to perform fast-forward playback. The video reproduction device according to claim 1, further comprising a highlight information acquisition unit for acquiring the highlight information from outside. The playback control means controls the video playback unit so that a portion of the video where highlight information cannot be acquired is played back at a speed faster than the playback speed in the normal playback mode and at which audio can be heard. The video reproduction device according to claim 1. A video storage unit,
6. The video playback apparatus according to claim 1, wherein the video playback unit includes means for playing back video stored in the video storage unit. The video playback apparatus according to claim 6, wherein the video storage unit is capable of supplying video to the video playback unit in parallel with video storage. A video acquisition means for acquiring video from outside in response to a user's instruction;
The video playback device according to claim 1, wherein the video playback unit plays back the video acquired by the video acquisition unit. The video reproduction apparatus according to claim 1, further comprising highlight information generation means for analyzing video characteristics to generate highlight information. A playback script generation device that generates a playback script for instructing playback control of video to a video playback device having script execution means for playing back video in a playback mode and playback sequence according to the playback script,
Highlight information preparation means for preparing highlight information for defining a highlight area of the video;
The video portion specified by the highlight information prepared by the highlight information preparation means is played back at a normal speed, and the video portion not specified in the highlight information is at a distance between the highlight area and the playback position. A reproduction script generation device including a reproduction script generation unit for generating a reproduction script for instructing the script execution unit of the video reproduction device to reproduce a video at a fast speed in response. The reproduction script generation device according to claim 10, wherein the script generation unit generates a reproduction script including a video to be reproduced, a reproduction range, and a reproduction speed. A video playback device that plays video at a speed that increases according to the distance between the highlight area and the playback position and skips video that is more than a predetermined distance away from the highlight area is required for playback. A video cutout device for cutting out a video portion, means for preparing a video,
Means for preparing, in association with the video, highlight information defining the highlight area of the video;
In accordance with the highlight information, a video portion including the video portion specified by the highlight information and a predetermined time before or after the video portion specified by the highlight information or both is cut out. And a video cutting device. Video storage means for storing video;
Instruction input means for use by the user to select one of the videos stored in the video storage means;
Means for preparing, in association with the video, highlight information defining a highlight area of the video;
Information screen generating means for generating an information screen for presenting highlight information relating to the video selected by the instruction input means;
Video playback means for playing back video stored in the video storage means;
Based on the highlight information, the video in the highlight area is selected and played at the normal playback speed, and the video portion not specified in the highlight information is faster according to the distance between the highlight area and the playback position. Playback control means for controlling the video playback means so as to play back the video at a speed as fast as possible,
When the user further selects specific highlight information from the information screen by the instruction input unit, the reproduction control unit selects and reproduces a video in a highlight area defined by the selected highlight information. A video playback device. The information screen generating means includes
Means for displaying a bar indicating the entire playback time of the video selected by the instruction input means;
14. The video reproduction apparatus according to claim 13, further comprising means for displaying an area corresponding to the highlight area and other areas in the bar so as to be distinguishable from each other.   The video playback device, when playing back video based on the highlight information, for the video played by the video playback means and the information screen generating means for the video played by the video playback means 15. The video reproducing apparatus according to claim 14, further comprising video superimposing means for superimposing the information screen generated by the computer.   The information screen generation unit is configured to display highlight information about the video selected by the instruction input unit when the video in the highlight area corresponding to the highlight information is reproduced by the video reproduction unit and the reproduction control unit. The video playback device according to claim 13, wherein an information screen to be presented together with a time required for playback is generated.   The information screen generating means only includes highlight information such that the time required for the video to be played based on the highlight information by the video playback means and the playback control means is less than or equal to a preset viewing time. 14. The video reproduction apparatus according to claim 13, further comprising means for selecting an information screen to generate an information screen.   The video playback apparatus according to claim 17, wherein the preset viewing time is a time from a current time to a preset time.   The reproduction control unit highlights a video part specified by the highlight information and a video part including a predetermined time before or after a video part specified by the highlight area information or both. The video playback apparatus according to claim 13, wherein the video playback apparatus operates as an area. Video storage means for storing video;
Video playback means for playing back the video stored in the video storage means, and means for preparing highlight information defining a highlight area of the video in relation to the video;
Instruction input means for the user to instruct the video playback state;
The video in the highlight area is always selected based on the highlight information and played at the normal playback speed, and the video portion not specified in the highlight information depends on the distance between the highlight area and the playback position. A playback control means for controlling the video playback means to play back the video at a speed that is faster and to quickly switch to the video playback state based on the input when there is an input from the instruction input means. Including a video playback device.   The reproduction control unit highlights a video part including the video part specified by the highlight information and a predetermined time before or after the video part specified by the highlight area information. 21. The video playback apparatus according to claim 20, wherein the video playback means is controlled as an area. Video storage means for storing video; video storage time recording means for recording video storage time when the video storage means stores video; and
Video playback means for playing back video stored in the video storage means;
In relation to the video, highlight information acquisition means for acquiring highlight information for defining a highlight area of the video according to time;
Based on the highlight information and the video storage time of the video stored in the video playback means, a video corresponding to the highlight area is selected from the videos stored in the video storage means at a normal playback speed. Playback for controlling the video playback means to play back a video portion that is not specified in the highlight information and plays back the video at a speed that increases according to the distance between the highlight area and the playback position. And a video reproduction apparatus including control means. The video storage means includes means for acquiring and storing video from a digital broadcast;
23. The video reproduction apparatus according to claim 22, wherein the video accumulation time recording means includes means for acquiring the video accumulation time from time information embedded in a digital broadcast signal. The video playback device
An offset calculating means for calculating an offset value, which is a correction value between the video storage time recorded by the video storage time recording means and the standard time, in accordance with the path through which the video storage means has acquired the video;
Offset recording means for accumulating the offset value,
The reproduction control unit corrects the time information included in the highlight information by the offset value, and based on the corrected highlight information and the video accumulation time of the video accumulated in the video reproduction unit, 23. The apparatus according to claim 22, further comprising means for controlling the video reproduction means to select a video corresponding to a highlight area from the videos stored in the video storage means and reproduce the video at a normal reproduction speed. The video playback device described in 1. Video storage means for storing video;
Video playback means for playing back the video stored in the video storage means, and means for preparing highlight information defining a highlight area of the video in relation to the video;
Based on the highlight information, the video in the highlight area is selected and played at the normal playback speed, and the video portion not specified in the highlight information is faster according to the distance between the highlight area and the playback position. Playback control means for controlling the video playback means so as to play back the video at a speed as fast as possible,
The reproduction control means can select and reproduce the video in the highlight area corresponding to the highlight information based on the highlight information for the portion where the highlight information is prepared for the video, and the highlight information can be prepared. A video playback apparatus characterized in that the missing part is played back at a predetermined playback speed.   26. The video playback apparatus according to claim 25, wherein the predetermined playback speed is a normal playback speed. 26. The video playback apparatus according to claim 25, wherein the predetermined playback speed is higher than a normal playback speed and is a playback speed at which audio can be played back.

Images