JP2005191826A - Video editing device, video reproducing device, angle video display data, recording medium with the same data recorded thereon, video editing method and video reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video editing device and a video reproducing device for reflecting the intention of an editor related with the display configuration of an angle video, especially, a display position at the time of simultaneously displaying a plurality of angle videos. <P>SOLUTION: A video editing device is configured by arranging display definition data for defining the display configurations of an angle video in a multi-angle period in the unused region of the DSI data part of the DSI packet of a navigation pack NV of DVD specification. A video reproducing device acquires the display definition data from the used area Un_USE, and execute video composition according to the display definition data, and displays a composite video at a video display part. Thus, it is possible to reproduce a video such that the display position and size of each angle video is defined by the editor. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a video editing device, a video playback device, angle video display data, a recording medium on which the angle video display data is recorded, a video editing method, and a video playback method. The present invention relates to a technique for recording information defining a display mode of an angle video during an angle period and reproducing the video based on the information.

  As one of DVD (Digital Versatile Disc) standards, “multi-angle function” is well known. The multi-angle function is a function capable of acquiring and switching and displaying an arbitrary angle video from a DVD in which a plurality of angle videos and management information thereof are recorded. By using the multi-angle function, up to nine camera-captured images and computer graphic images can be multiplexed and recorded simultaneously, and each multiplexed image (also simply referred to as “angle image”) can be displayed.

  In the present specification, a period during which the multi-angle function operates is particularly referred to as a “multi-angle period”. The “period other than the multi-angle period” is simply referred to as “normal period”. The angle video displayed in the normal period is particularly referred to as “basic angle video”, but the basic angle video is included in the “angle video”. Therefore, the expression “angle video” is used when they are collectively referred to, or when it is not particularly necessary to emphasize the basic angle video.

  The most basic function among the multi-angle functions is a function for switching and displaying an angle video as shown in FIG. For example, in the multi-angle block playback system (video playback device) disclosed in Patent Document 1, the angle video 1 is displayed in the normal period, but when the multi-angle period is reached, the angle video 1 → After the angle video 2 → angle video 3 →... Are sequentially switched and displayed, the angle video 1 is displayed when returning to the normal period.

  However, in the example of Patent Document 1, even if the multi-angle function is implemented, only (1) basic angle video or (2) a single angle video selected by the viewer is displayed. For this reason, even if the multi-angle function is implemented, the viewer can actually watch at the same time at the same time only in a single angle video.

  Therefore, as disclosed in Patent Document 2, a video optical disk reproducing apparatus capable of simultaneously displaying a plurality of angle videos has been proposed. According to the apparatus of Patent Document 2, during a multi-angle period, as shown in FIG. 18, dance scenes of idol groups (with back dancers) of a pair of men and women photographed from different angles with three cameras are displayed simultaneously. In the normal period, the basic angle video 1 is displayed.

The apparatus of Patent Document 2 does not only display (1) a plurality of angle videos during playback in a multi-angle period, but also (2) displays only angle videos selected by the viewer, or (3) It is possible to perform display control such that only the angle video selected by the viewer is displayed in a state where the image quality is improved.
Japanese Patent Laid-Open No. 10-155138 JP 2000-156845 A

  However, although the device (video playback device) of Patent Document 2 can simultaneously display a plurality of angle videos, the display position of the angle video is on the convenience of the video playback device (for example, the arrangement of the video buffer for the angle video). The display position may differ depending on what type of video playback device is used. Therefore, the intention of the editor cannot be reflected on the display position of the angle video.

  This problem will be specifically described. 18 (a) and 18 (b) show display examples in a multi-angle period of dancers with 6 pairs of men and women. Angle video 1 is an image showing the entire 6 pairs of men and women. 2 is a video showing a male idol of a main gender pair, and angle video 3 is a video showing a female idol of a main gender pair.

  FIG. 6A shows a display example before the men and women in the six pairs of men and women are switched. FIG. 10B shows a display example after the men and women in the six pairs of men and women are switched. In the angle image 1, the change of men and women is realized on the screen as shown in FIGS. 5A and 5B. However, the angle image 2 and the angle image 3 are compared with FIGS. As can be seen, the display positions of the angle images 2 and 3 are displayed without being switched. This is because in the conventional apparatus, the display position of the angle video is automatically determined by the arrangement method of the video buffer for the angle video provided in the video reproduction device, and the intention of the editor cannot be reflected.

  For this reason, there has been a demand for a video playback apparatus capable of displaying the display mode in accordance with the editor's intention in the sense of including the display position and other sizes.

  The present invention has been made in view of such circumstances, and a first object thereof is to provide a video editing apparatus and a video editing method capable of reflecting an editor's intention regarding the display mode of an angle video. There is.

  A second object of the present invention is to provide a video playback apparatus and a video playback method capable of reflecting an editor's intention regarding the display mode of an angle video.

  A third object of the present invention is to provide angle video display data that can reflect the intention of the editor and a recording medium that records the angle video display data.

  (A) In order to solve the above-described problem, the video editing apparatus according to the present invention can acquire and display an arbitrary angle video from an editing information storage unit that records a plurality of angle videos. A display mode setting means for setting display definition data for defining a display mode of an angle video in a multi-angle period in which the display operates, and a multiplexing means for arranging the display definition data in a predetermined area. It is.

  In this case, the multiplexing means arranges the display definition data in an unused area in the DSI data part of the DSI packet of the navigation pack in the DVD standard. Alternatively, the multiplexing means may arrange the display definition data in the user data area of the picture layer in the MPEG2 video stream.

  The display definition data includes a frame arrangement position or a coordinate arrangement position that defines the display position of the angle video. Further, the display definition data may include a reduction ratio that defines the size of the angle video and a group number that defines a group of the angle video.

  As described above, according to the video editing apparatus of the present invention, the display mode of the angle video is set by the display mode setting means, so that the multi-angle video reflecting the editor's intention can be edited. Further, since the display control data is arranged in an unused area of the data area, a DVD edited by the video editing apparatus according to the present invention can be reproduced even by a video reproducing apparatus not compatible with the video editing apparatus according to the present invention. . In addition, since the navigation pack is referenced every 0.4 to 1.2 seconds as the playback time and the user data area is referenced for each image, display control at fine timing can be realized.

  (B) In order to solve the above problem, the video playback apparatus according to the present invention has a multi-angle function capable of acquiring and displaying an arbitrary angle video from the playback information storage means in which a plurality of angle videos are recorded. In the operating multi-angle period, display definition data reflecting the intention of the editor is obtained from the reproduction information storage means and output as display control data; and based on the display control data And video synthesizing means for synthesizing the angle video.

  In this case, the display mode control means acquires the data recorded in the unused area in the DSI data part of the DSI packet of the navigation pack in the DVD standard as the display definition data. Alternatively, the display mode control means may acquire data recorded in the user data area of the picture layer in the MPEG2 video stream as the display definition data.

  In this case, the display mode control means acquires the display definition data as a frame arrangement position or a coordinate arrangement position that defines a display position of an angle video, and the video composition means outputs the frame arrangement position or The angle video is synthesized so that the angle video is displayed at the coordinate arrangement position.

  Further, the display mode control means obtains the display definition data as a reduction ratio that defines the size of the angle video, and the video composition means displays the angle video at the reduction ratio. The angle image is synthesized.

  Further, the display mode control means acquires the display definition data as a group number that defines a group of angle videos, and the video composition means displays an angle video belonging to the group number. The angle image is synthesized.

  In this case, the display mode control means includes an operation for switching the angle video, an operation for changing the display position of the angle video, an operation for changing the reduction ratio of the angle video, and an operation for changing the group number of the angle video. When the display input data based on at least one operation selected from among the selection operations for selecting some of the angle images when there are a plurality of the angle images is input, based on the display input data, Outputs display control data.

  When the operation is an angle video selection operation, the display mode control means obtains an optimum division type based on the number of divisions determined by the total number of selected angle videos, and outputs the display control data. .

  As described above, according to the video playback apparatus of the present invention, the multi-angle function that can acquire and display an arbitrary angle video from the playback information storage unit that records a plurality of angle videos is operated. During the period, display definition data reflecting the editor's intention acquired from the reproduction information storage unit is output as display control data by the display mode control unit. Then, the video image synthesizing unit can synthesize the angle video acquired from the reproduction information storage unit based on the display control data.

  (C) In order to solve the above problem, the angle video display data according to the present invention is a multi-angle function capable of acquiring and switching and displaying an arbitrary angle video from an information storage means in which a plurality of angle videos are recorded. The display definition data reflecting the editor's intention to define the display mode of the angle video used in the multi-angle period in which is operated is recorded in the unused area in the DSI data portion of the DSI packet of the navigation pack in the DVD standard. It is characterized by that.

  In order to solve the above-mentioned problem, the angle video display data according to the present invention is a multi-angle function capable of acquiring and switching and displaying an arbitrary angle video from an information storage means in which a plurality of angle videos are recorded. The display definition data reflecting the intention of the editor who defines the display mode of the angle video used in the multi-angle period in which is operated is recorded in the user data area of the picture layer in the MPEG2 video stream.

  (D) In order to solve the above problems, a recording medium on which angle video display data according to the present invention is recorded is characterized in that the angle video display data according to the present invention is recorded.

  In the video editing apparatus according to the present invention, the display mode of the angle video in the multi-angle period is set by the display mode setting unit, and the display definition data defining the display mode is arranged in the predetermined area by the multiplexing unit. There is an effect that the intention of the editor can be reflected on the display mode of the video.

  In the video reproduction apparatus according to the present invention, the video is synthesized by the video synthesizing unit based on the display definition data obtained by the display mode control unit and reflecting the intention of the editor who defines the display mode of the angle video. There is an effect that the intention of the editor can be reflected on the display mode of the angle video.

  The angle video display data according to the present invention and the recording medium on which the angle video display data is recorded have an effect that the intention of the editor can be reflected on the display mode of the angle video in video playback.

  Embodiments of the present invention will be described below with reference to the drawings.

1. Video Editing Device The video editing device 100 shown in FIG. 1 includes a video encoding unit 120, a display mode setting unit 140, and a multiplexing unit 160. The video encoding unit 120 encodes source data 1 to n related to angle videos 1 to n (n is a natural number from 1 to 9; hereinafter the same) in a multi-angle period using the MPEG2 system. 1 to n are output to the multiplexing unit 160. Here, n is assumed to be “1” to “9”, but this is based on the fact that the number of multiplexed angle videos is nine. Therefore, the value of “n” can be increased as the number of angle videos increases.

  As illustrated in FIG. 2, the display mode setting unit 140 includes a control unit 142, a display unit 144, and an input operation unit 146. The display mode setting unit 140 allows the editor to input and set display definition data 1 to n related to the angle videos 1 to n in the multi-angle period by operating the input operation unit 146 while looking at the display unit 144. It is configured. The control unit 142 displays an interactive screen that prompts the editor to input the display definition data 1 to n on the display unit 144 via the editing video composition unit 142a, and the source data 1 to n to the editing video composition unit 142a. To display on the display unit 144 via the control.

  That is, the control unit 142 receives the supply of the source data 1 to n in units of one video object unit VOBU shown in FIG. 3A in the DVD standard, and sends them to the display unit 144. A dialog screen is displayed on the display unit 144 so that the display definition data 1 to n can be input and set. As shown in the figure, one video object unit VOBU is composed of a navigation pack NV and image data of an angle video AGL_NO. The image data of the angle video AGL_NO is about 12 to 36 pieces of video data corresponding to a playback time of 0.4 to 1.2 seconds (in the case of the NTSC system), which is a so-called one group of picture GOP. . The navigation pack NV is data for managing the group of pictures GOP and is arranged at the head thereof.

  The control unit 142 is display definition data input using a keyboard or mouse provided in the input operation unit 146, and defines the display mode of the angle video in the multi-angle period reflecting the editor's intention. Based on the display definition data, control is performed to reflect the display mode on the display unit 144. In addition, the control unit 142 generates the display definition data 1 to n by the setting information generation unit 142 b and outputs the display definition data 1 to n to the multiplexing unit 160.

  Returning to FIG. 1, the multiplexing unit 160 multiplexes the encoded video data 1 to n and the display definition data 1 to n related to the angle videos 1 to n to thereby display the video shown in FIG. These data are arranged so as to constitute the object unit VOBU, and multiplexed video data of the DVD standard is created. The multiplexed video data is written on the recording medium M by a writing processing unit (not shown). Thereby, for example, a DVD is obtained.

  Here, the multiplexing process will be described in detail. The multiplexing unit 160 converts the display definition data 1 to n defining the display mode of the angle video in the multi-angle period in which the editor's intention is reflected into the DSI of the DSI packet of the navigation pack NV shown in FIG. It arrange | positions to the unused area | region Un_USE of a data part. Therefore, with respect to the display mode of the angle video, multiplexed video data reflecting the editor's intention is obtained. Here, “unused area Un_USE” means “unused area in the DVD standard”.

2. Video Playback Device The video playback device 200 shown in FIG. 4 includes at least a demultiplexing unit 210, a video decoding unit 220, video buffers 231 to 23n (n is as described above), and a display mode control unit. 240 and a video composition unit 250. The video display unit 260 may be provided in the video playback device 200 or may be configured as an external device. The demultiplexing unit 210 demultiplexes the multiplexed video data and outputs the encoded video data 1 to n related to the angle videos 1 to n in the multi-angle period to the video decoding unit 220 and the angle videos 1 to n. Display definition data 1 to n that define the display mode of the encoded video data 1 to n according to the above are obtained from the unused area Un_USE of the DSI data part of the DSI packet of the navigation pack NV for each video object unit VOBU, It outputs to the display mode control part 240 as display control data 1-n.

  The video decoding unit 220 decodes the encoded video data 1 to n encoded by the MPEG2 method, and outputs them to the video buffers 231 to 23n as angle videos 1 to n, respectively. The video buffers 231 to 23n temporarily hold the angle videos 1 to n, respectively, and the angle videos 1 to n are read by the video composition unit 250 at a predetermined timing.

  The display mode control unit 240 acquires the display definition data 1 to n from the demultiplexing unit 210, and (1) if there is no operation by the viewer, the display definition data 1 to n is set as the display control data 1 to n. (2) Display control data 1 to n in which display input data 1 to n (see FIG. 5) based on the operation is reflected in display definition data 1 to n if there is an operation by the viewer. Is output to the video composition unit 250.

  The video synthesis unit 250 synthesizes the angle videos 1 to n based on the display control data 1 to n output from the display mode control unit 240 in the multi-angle period, and outputs the synthesized video to the video display unit 260 as video synthesis data. To do. The video display unit 260 displays video composite data. Thus, the viewer can enjoy the DVD playback video and audio.

  Next, the configuration of the display mode control unit 240 will be described in detail with reference to FIG. The display mode control unit 240 includes a setting information acquisition unit 2421, a control information extraction unit 2422, a control information output unit 2423, an input information acquisition unit 2424, and an input operation unit 244. The setting information acquisition unit 2421 is provided with a setting information storage unit 2421a for storing display definition data 1 to n, and the control information output unit 2423 is provided with a control information storage unit 2423a for storing display control data 1 to n. The input information acquisition unit 2424 is provided with an input information storage unit 2424a that stores display input data 1 to n.

  The setting information acquisition unit 2421 acquires the display definition data 1 to n, stores them in the setting information storage unit 2421a, and outputs them to the control information extraction unit 2422 at a predetermined timing. When the viewer operates the input operation unit 244, the input information acquisition unit 2424 acquires display input data 1 to n related to the operation, stores the display input data 1 to n in the input information storage unit 2424a, and at a predetermined timing. This is output to the control information extraction unit 2422.

  If there is no operation by the viewer, the control information extraction unit 2422 extracts the display definition data 1 to n set based on the operation of the editor from the setting information acquisition unit 2421 and directly displays the control information as the display control data 1 to n. Output to the output unit 2423.

  When there is an operation by the viewer, that is, the control information extraction unit 2422 performs some operation on the display mode of the angle video displayed on the video synthesis unit 260 by the viewer, and the display input data 1 to n are input. The display input data 1 to n are extracted from the input information acquisition unit 2424 and the display definition data 1 to n are also extracted from the setting information acquisition unit 2421. Then, the control information extraction unit 2422 outputs data obtained by reflecting the display input data 1 to n to the display definition data 1 to n to the control information output unit 2423 as display control data 1 to n. The control information output unit 2423 stores the display control data 1 to n in the control information storage unit 2423a, and then outputs them to the video composition unit 250 at a predetermined timing.

3. Procedure of Video Editing Process An angle video editing process procedure in a multi-angle period according to an embodiment of the present invention will be described with reference to FIG. In step S <b> 801, the video editing apparatus 100 displays the angle videos 1 to n on the frame arrangement positions 1 to n of the display unit 144 on a nine-divided screen, although illustration is omitted.

  In step S802, the video editing apparatus 100 starts setting the angle video display mode in the multi-angle period. Based on the operation by the viewer, the video editing apparatus 100 uses the numbers “1”, “2”,... “N” (angle video AGL_NO to be described later) in the angle videos 1 to n and the video display unit 260. A division number that defines the number of divisions (a division number DIV_CNT described later) and a division type that defines a display method on the video display unit 260 (a division type DIV_TP described later) are set.

  In S803, one of the angle videos 1 to n to be edited is designated by the editor in units of one video object unit, and the video editing apparatus 100 performs an editing operation for one video object unit in which each part of the apparatus is designated. Make it ready for use.

  In step S804, the video editing apparatus 100 sets a display ratio (frame arrangement position) and a reduction ratio that defines the frame size of the angle videos 1 to n specified in step S803 based on an operation by the editor. To do.

  In step S805, the video editing apparatus 100 performs other settings such as a group number based on an operation by the editor. In step S806, the video editing apparatus 100 determines whether or not to proceed to the next editing based on an operation by the editor. The video editing apparatus 100 repeats the processes of S803 to S806 until it is determined that the end of the angle video editing operation is designated by the editor.

  The editing process procedure will be specifically described with reference to FIGS. In the processing in S801 to S806, the division number is set to “3” and the division type is set to “1” in S802, and the frame arrangement positions of the angle videos 1 to 3 are set to “1”, “2”, and “S” in S803 and S804, respectively. When “3” is set, the display unit 144 displays as shown in FIG. If it is determined by the editor that this setting is acceptable for a while, the processing of S803 to S806 is directly performed, and the display definition data 1 to n are written in the unused area Un_USE of the corresponding video object unit.

  Meanwhile, it is assumed that the positions of the male in the angle video 2 and the female in the angle video 3 in FIG. In that case, if the settings of the display definition data 1 to n are left as they are, the display positions of the angle videos 2 and 3 remain the same even if the positions of the men and women are switched in the angle video 1. It is displayed with a positional relationship opposite to the positional relationship.

  Therefore, in order to change the display positions of the angle video 2 and the angle video 3 by the editor in S804, for example, the frame arrangement position of the angle video 2 is changed from “2” to “3”, and the frame arrangement position of the angle video 3 is changed. Is changed from “3” to “2”. When S805 and S806 are completed, the image is displayed on the display unit 144 in the manner shown in FIG.

  Then, when the selection of the end of the multi-angle period by the editor is detected, the process proceeds to S807, where the multiplexing unit 160 performs multiplexing. Thereby, the display definition data 1 to n in which the display positions (frame arrangement positions) of the angle videos 2 and 3 reflecting the intentions of the editor are written are arranged in the unused area Un_USE. Although the multiplexing process in S807 has been described as being performed when a series of editing processes has been completed, the multiplexing process may be executed in an appropriate processing unit during the editing process.

  In S808, when the editor cancels the multi-angle period, the process returns to S801.

4). Display Definition Data Structure Display definition data 1 to n arranged in the unused area Un_USE shown in FIG. As shown in the figure, the display definition data 1 to n include, for example, an angle video AGL_NO, a division number DIV_CNT, a division type DIV_TP, a display method selection flag D_flg, a frame arrangement position L_PSN, a coordinate arrangement position P_PSN, and a reduction ratio RSZ_RT. , Group number GRP_NO and the like.

  The angle video AGL_NO refers to each multiplexed video, but the angle videos 1 to n as the display definition data 1 to n are represented by numbers for identifying the angle videos corresponding to the source data. , Angle video 1, angle video 2,..., Angle video n. Therefore, the angle video AGL_NO is used to specify image data displayed on the video display unit. For example, it is represented by an angle video number physically determined corresponding to the external terminal number, and the angle video 1 means a basic angle video corresponding to the source data 1 supplied from the external terminal 1, and the angle video 2 is external. An angle image corresponding to the source data 2 supplied from the terminal 2 is meant.

  Next, the division number DIV_CNT and the division type DIV_TP will be described with reference to FIG. The division number DIV_CNT defines the number of angle videos to be displayed on one screen. The division number DIV_CNT is defined by numerical values from “1” to “9”. The division number 1 defines a display mode in which one angle video is displayed on the entire video display unit.

  The division type DIV_TP is a parameter that defines the arrangement method of each angle video. According to the division type DIV_TP, depending on the division number DIV_CNT, it is possible to display in various display modes (that is, frame arrangement modes), so “1” to “m” (m is a natural number) which display mode is displayed. It can be defined by the numerical value of Further, by setting the value to “0”, it is possible to define that the display is not performed in accordance with the division type DIV_TP. For example, when the division type DIV_TP is set to “0”, the video playback apparatus can automatically arrange the frames.

  As shown in FIG. 8, the division type DIV_TP can be defined as “1” when the division number is 1, and can be defined as “1” to “4” when the division number is 2. When the number of divisions is 3, “1” to “6” can be defined as the division type DIV_TP.

  The display method selection flag D_flg defines whether the angle video indicated by the angle video AGL_NO is displayed based on the frame layout position L_PSN or the coordinate layout position P_PSN. For example, the value can be defined as “0” when based on the frame arrangement position L_PSN, and the value can be defined as “1” when based on the coordinate arrangement position P_PSN.

  The frame arrangement position L_PSN defines a frame number for displaying an angle video indicated by the angle video AGL_NO, and can be defined by a numerical value assigned to each frame. For example, the number written in each frame shown in FIG. 8 is a numerical value assigned to each frame.

  The coordinate arrangement position P_PSN is used to define at which coordinate the angle video indicated by the angle video AGL_NO is displayed as a coordinate value. For example, in the case of the NTSC system, (0, 0) to (639, 479). FIGS. 9A and 9B show an example.

  The reduction ratio RSZ_RT defines the size of the angle video indicated by the angle video AGL_NO, and it can be defined by a numerical value “0” to “1” how much the video is reduced and displayed. That is, the reduction rate RSZ_RT is a relative size when the size displayed on the entire video display unit 260 is the reduction rate “1”. FIGS. 9A and 9B show an example. For example, the size when displaying four angle images without a gap is a reduction ratio of 0.5. In the present embodiment, the aspect ratio is constant, but the aspect ratio may be defined.

  The group GRP_NO indicates whether or not the editor has selected several angle videos from a plurality of angle videos at the time of editing and grouped them (hereinafter also simply referred to as “grouping”), and the group GRP_NO. Define the group number.

  For example, when the editor intends to display a group of a plurality of angle videos from the first base, “1” is set as the group number. Similarly, a plurality of angle videos from the third base side are set to the group number “2”, and an angle video from the back of the back net is set to the group number “3”. At the time of reproduction, a group number can be designated by the operation of the viewer, or when an angle video included in each group is designated, it can be switched to an angle video common to the group and displayed. Note that “0” is set as the group number when the editor displays without grouping.

  Since the display control data 1 to n have the same data structure as the display definition data 1 to n, the description thereof is omitted.

5). Structure of Display Input Data Display input data 1 to n has a data structure in which parameters of selection number SEL_NO and input information reference flag I_flg are added to display definition data 1 to n. The description of the same parameters as the display definition data 1 to n is omitted.

  The selection number SEL_NO stores, for example, what number the angle video indicated by the angle video AGL_NO is selected by the viewer, and whether the display input data 1 to n is input by the viewer to the input information reference flag I_flg Whether or not is stored.

  The order is set by the selection number SEL_NO, for example, when the number of divisions is 9, and when the viewer selects three angle videos, the three angle videos are displayed. If “1”, “2”, and “3” are set in the order of selection, the control for setting “3” to the division number DIV_CNT is performed next from the selection number SEL_NO related to the angle video selected last. Because you can.

  That is, the selection number SEL_NO is configured to store a value incremented by 1 each time the viewer selects the selection number SEL_NO. Since the angle video displayed on the video display unit 260 is a selection target, a larger number of angle videos than the number of divisions DIV_CNT being displayed are not selected. The selection number SEL_NO is set to a value equal to or less than the total number of angle videos being displayed.

  Instead of controlling the selection number in this way, it is also possible to manage only whether or not the selection number is selected by the viewer as a flag. In this case, the number of divisions is counted separately.

  When the input information reference flag I_flg is set to “0”, it means that there is no operation by the viewer. When the input information reference flag I_flg is set to “1”, it means that there is an operation by the viewer. It can be set to mean. Then, the display mode control unit 240 can determine whether to refer to the display input data 1 to n by looking at this flag.

6). Configuration of DVD as a recording medium In a DVD, a multimedia bit stream is recorded in a file data area. That is, a multimedia bit stream composed of video object units VOBU or the like in which display definition data 1 to n are arranged in the unused area Un_USE of the DSI data part of the DSI packet of the navigation pack NV is recorded in the file data area of the DVD. The Thus, the recording medium according to the embodiment of the present invention is configured.

7). Procedure for Video Reproduction Process With reference to FIG. 10, a description will be given of a reproduction processing procedure in video reproduction apparatus 200 for an angle video during a multi-angle period according to an embodiment of the present invention.

(1) During normal period In S1001, the demultiplexer 210 determines whether or not it is a multi-angle period. When it is determined that it is not the multi-angle period (S1001: NO), the process proceeds to S1005. The video synthesizing unit 250 synthesizes the video that has undergone the demultiplexing process and the video decoding process, and outputs the video synthesized data to the video display unit 260. The video display unit 260 displays video composite data. Until the multi-angle period starts, the processing from S1001 to S1005 is repeated.

(2) During a multi-angle period (when there is no operation by the viewer)
In S1001, when the demultiplexing unit 210 determines that it is a multi-angle period (S1001: YES), the process proceeds to S1002. In S1002, the display mode control unit 240 determines whether or not the viewer has operated the multi-angle video. If it is determined that there is no operation by the viewer (S1002: NO), the process proceeds to S1004.

  In S1004, the display mode control unit 240 uses the unused DSI data portion of the DSI packet of the navigation pack in the DVD standard as the display definition data 1 to n reflecting the editor's intention from the demultiplexing unit 210. Data recorded in the area Un_USE is acquired, and control is performed to output the data as display control data 1 to n to the video composition unit 250 as it is. The operation of the display mode control unit 240 will be described in detail as follows. First, the setting information acquisition unit 2421 acquires the display definition data 1 to n, and stores the display definition data 1 to n in the setting information storage unit 2421a. Next, the control information extraction unit 2422 extracts the display definition data 1 to n from the setting information acquisition unit 2421 and outputs the display definition data 1 to n to the control information output unit 2423 as display control data 1 to n. The control information output unit 2423 stores the display control data 1 to n in the control information storage unit 2423a, and outputs the display control data 1 to n to the video composition unit 250 at a predetermined timing.

  In step S1005, the video synthesis unit 250 performs video synthesis that has undergone the demultiplexing process and the video decoding process based on the display control data 1 to n. The video display unit 260 displays the video composite data.

  For example, the display definition data of the angle video 1 is that the angle video AGL_NO is “1”, the division number DIV_CNT is “3”, the division type DIV_TP is “1”, the display method selection flag D_flg is “0”, and the frame arrangement position L_PSN is “1”, the reduction ratio RSZ_RT is set to “0.5”, the group number GRP_NO is set to “0”, and the display control data of the angle videos 2 and 3 are respectively “2” and “3” for the angle video AGL_NO. When the arrangement position L_PSN is set to the same value as the angle video 1 except that the arrangement position L_PSN is set to “2” and “3”, for example, it is synthesized and displayed as shown in FIG. Further, when the positions of the persons shown in the angle videos 2 and 3 are changed by dance, the frame arrangement position L_PSN of the display control data of the angle videos 2 and 3 after the timing at which the positional relationship is changed is “3”, respectively. If it is edited to “2”, it is synthesized and displayed as shown in FIG.

  In order to enable the display position and display size (reduction ratio) of each angle video for the specified division type DIV_TP to be played back by the video playback device as intended by the editor, the information is stored in the video editing device. It is necessary to share with the video playback device. This is realized by having the information in both apparatuses in advance. Specifically, for each division number and division type, the display position of each angle video is defined by coordinates and the size is defined by a reduction ratio.

(3) During a multi-angle period (when an operation is performed by the viewer)
In S1001, when the demultiplexing unit 210 determines that it is a multi-angle period (S1001: YES), the process proceeds to S1002. In S1002, the display mode control unit 240 determines whether or not the viewer has operated the multi-angle video. If it is determined that there is an operation by the viewer (S1002: YES), the process proceeds to S1003.

  In S1003, the input information acquisition unit 2424 acquires the display input data 1 to n output from the input operation unit 244 based on the operation by the viewer, and stores them in the input information storage unit 2424a.

  In S1004, the display mode control unit 240 uses the unused DSI data portion of the DSI packet of the navigation pack in the DVD standard as the display definition data 1 to n reflecting the editor's intention from the demultiplexing unit 210. Data recorded in the area Un_USE is acquired, updated based on the display input data 1 to n, and controlled to be output to the video composition unit 250 as display control data 1 to n. The operation of the display mode control unit 240 will be described in detail as follows. First, the setting information acquisition unit 2421 acquires the display definition data 1 to n, and stores the display definition data 1 to n in the setting information storage unit 2421a. Next, the control information extraction unit 2422 extracts the display definition data 1 to n from the setting information acquisition unit 2421. Then, the control information extraction unit 2422 updates the display definition data 1 to n extracted from the setting information storage unit 2421a based on the display input data 1 to n extracted from the input information acquisition unit 2424, and displays the display control data 1 to n. n is output to the control information output unit 2423. The control information output unit 2423 stores the display control data 1 to n in the control information storage unit 2423a, and outputs the display control data 1 to n to the video composition unit 250 at a predetermined timing.

  In step S1005, the video synthesis unit 250 performs video synthesis that has undergone the demultiplexing process and the video decoding process based on the display control data 1 to n. The video display unit 260 displays the video composite data.

  Hereinafter, various cases of the process in S1003 will be described.

(3-1) Switching of Angle Video by Viewer For example, it is assumed that angle videos 1, 3, 4, 6, and 8 are displayed at frame arrangement positions 1 to 5 as shown in FIG. In S1003, the angle video 1 displayed at the frame placement position 1 as a switching target by the viewer is selected by a selection button (not shown), and the switching button for switching to the angle video 2 as the angle video to be displayed at the frame placement position 1 is displayed. Assume that (not shown) is pressed.

  Then, in S1003, the input information acquisition unit 2424 writes “2” in the frame arrangement position L_PSN of the angle video 1 related to the display input data 1, and the frame arrangement position L_PSN of the angle video 2 related to the display input data 2 Write “1”. Further, “1” is written in the frame arrangement position L_PSN of the angle videos 1 and 2 related to the display input data 1 and 2. Further, the frame arrangement position 1 is highlighted (the highlighting may not be performed; the same applies hereinafter).

  In step S1004, if the input information reference flag I_flg is “1”, the display mode control unit 240 uses the display definition data extracted from the setting information storage unit of the setting information acquisition unit 2421 as input information of the input information acquisition unit 2424. Updating is performed based on the display input data extracted from the storage unit 2424a, and display control data is output. The control information output unit 2423 stores the display control data and then outputs the display control data to the video composition unit 250. In step S1005, the video display unit 260 switches the angle video 1 and the angle video 2 as shown in FIG.

(3-2) Change of Frame Arrangement Position L_PSN and Reduction Ratio RSZ_RT For example, assume that angle videos 1 to 3 are displayed at frame arrangement positions 1 to 3 as shown in FIG. In S1003, when the viewer selects the angle video 1 as a selection target by using a selection button (not shown), the display mode control unit 240 highlights the frame arrangement position 1 as shown in FIG. When the frame is dragged by the viewer using a mouse or the like, the display mode control unit 240 sets the value of the input information reference flag I_flg in the input information storage unit 2424a of the input information acquisition unit 2424 to “1”. In addition, the value of the display method selection flag D_flg is set to “1”, and the coordinates (X, Y) indicating the dragged position shown in FIG. 12B are written as the value of the coordinate arrangement position P_PSN.

  In step S1004, the control information extraction unit 2422 extracts the display definition data 1 to n from the setting information acquisition unit 2421 and extracts the display input data 1 to n from the input information acquisition unit 2424, and converts them into these data. Based on this, display control data 1 to n are output. The control information output unit 2423 stores the display control data 1 to n in the control information storage unit 2423a and outputs it to the video composition unit 250 at a predetermined timing. In step S1005, the video image display unit 260 displays the angle video 1 at the coordinate arrangement position (X, Y) as shown in FIG. Then, the process returns to S1001, and proceeds to S1003 via S1002.

  In S1003, the viewer selects the angle video 1 and inputs a numerical value “0.75” as the value of the reduction ratio RSZ_RT using the size input button (not shown), and then presses the execution button. Then, the input information acquisition unit 2424 writes “0.75” corresponding to the size shown in FIG. 12C as the value of the reduction ratio RSZ_RT, and sets the value of the input information reference flag I_flg to “1”.

  The viewer does not directly input the value of the reduction ratio, but operates the corner of the angle video with a mouse or the like to change the reduction ratio, and obtains and processes the value of the reduction ratio by the input information acquisition unit 2424. It may be.

  In step S1004, the control information extraction unit 2422 extracts the display definition data 1 to n from the setting information acquisition unit 2421 and also extracts the display input data 1 to n from the input information acquisition unit 2424, based on these. Display control data 1 to n are output. The control information output unit 2423 stores the display control data 1 to n in the control information storage unit 2423a, and outputs them to the video composition unit 250 at a predetermined timing. In step S1005, the size of the angle video 1 is changed as shown in FIG.

(3-3) Automatic resize of angle video When the viewer performs an angle video selection operation, the display mode control unit 240 performs optimal division based on the number of divisions determined by the total number of selected angle videos. The type can be obtained and the display control data 1 to n can be output. That is, when the selected angle video is displayed as it is, when the video display unit 260 has a free space, it is possible to perform control for automatically obtaining an optimal arrangement method.

  For example, when only one angle video is selected by the viewer when the number of divisions is 9, the video display unit 260 displays the angle video. Also, when the number of divisions is 9, and the viewer selects two angle images that are in the vertical or horizontal positional relationship, the video is displayed in the maximum size that can be accommodated in the video display unit 260 while maintaining the positional relationship. It is displayed in the center of the part 260. In addition, when the viewer selects two angle videos having an oblique positional relationship when the number of divisions is 9, the angle videos are displayed at the upper left and lower right (lower left or upper right) positions of the four division sizes. .

  For example, as shown in FIGS. 13A and 13A, it is assumed that the angle videos 1 to 3 are displayed at the frame arrangement positions 2, 7, and 9 (see the division number 9 and division type 1 in FIG. 8). . In S1003, it is assumed that the viewers select the angle videos 2 and 3 as selection targets in order of selection by a selection button (not shown). The display mode control unit 240 highlights the frame as shown in the figure, and sets “1” and “2” to the selection numbers SEL_NO of the angle images 2 and 3 of the input information acquisition unit 2424 (normally Is set to “0”), and “2”, which is the total number of selected angle videos, is set in the division number DIV_CNT based on the selection number SEL_NO of the angle video selected last. When a display button (not shown) is pressed, “1” is set to the input information reference flag I_flg.

  In step S1004, the display mode control unit 240 recognizes the positional relationship between the selected angle videos 2 and 3 based on the frame arrangement positions 7 and 9 of the angle videos 2 and 3, and performs the division corresponding to the division number 2. Display control data 1 to n in which “1” is set as the type DIV_TP, “1” is set as the frame arrangement position L_PSN of the angle video 2 and “2” is set as the frame arrangement position L_PSN of the angle video 3 Output to 250. In step S1005, the angle images 2 and 3 are displayed as shown in FIGS. When the angle images 1 and 3 are selected as shown in FIGS. 13B and 13A, they are displayed as shown in FIGS. 13B and 2B based on the positional relationship. The frame arrangement position L_PSN can also be set according to the selection number SEL_NO.

  In addition, it is possible to perform control such that only the angle video of the selection number SEL_NO “1” is enlarged until there is no useless empty area without using the division type. That is, this is an example in which the selection number SEL_NO is handled as the priority of the angle video.

  As described above, when the angle video selected by the viewer is displayed as it is, when an empty area is created in the video display unit 260, the optimal screen layout is automatically performed while reflecting the positional relationship.

(3-4) Setting of Division Number DIV_CNT and Division Type DIV_TP It is assumed that the division number DIV_CNT and division type DIV_TP are input by the viewer in S1003. The input information acquisition unit 2424 writes the values in the division number DIV_CNT and the division type DIV_TP of the input information storage unit 2424a.

  When the execute button is pressed by the viewer, the input information acquisition unit 2424 writes “1” in the input information reference flag I_flg of the input information storage unit 2424a. The control information extraction unit 2422 outputs display control data 1 to n based on the display setting data 1 to n and the display input data 1 to n. The control information output unit 2423 stores it in the control information storage unit 2423a, and then outputs it to the video composition unit 250 at a predetermined timing.

  In step S1005, the video display unit 260 displays an angle video. When only the division number DIV_CNT is set by the viewer and the execute button is pressed, “1” is automatically set as the division type DIV_TP, and the frame is based on the display definition data 1 to n at that time. The arrangement position L_PSN and the angle video AGL_NO are set.

(3-5) Selection of subtitles For example, as shown in FIG. 14A, it is assumed that the angle videos 1 and 2 are displayed at the frame arrangement positions 1 and 2, respectively (division number 2, division type in FIG. 1). When the subtitle display is selected by the viewer in S1003 and the process proceeds to S1004, the display mode control unit 240 validates the subtitle video and increases the division number DIV_CNT. When the processing proceeds to S1005, an angle video corresponding to the caption is displayed as shown in FIG. The subtitle video is not limited to the division type DIV_TP, and can be configured to be arranged at an arbitrary display position according to the editor's intention. For example, subtitle videos 1 and 2 are arranged immediately below the angle video 1 and the angle video 2, respectively, and the words spoken by the person in the angle video 1 are displayed in the subtitle video 1 and the angle video 2 is displayed in the subtitle video 2. You can also.

  On the other hand, the caption video can be arranged at a predetermined display position regardless of the division type DIV_TP. In addition, when the division number DIV_CNT reaches the upper limit, it is possible to display a caption video without displaying an arbitrary angle video. Further, the caption video may be limited to a specific angle video AGL_NO, or may be limited to a specific frame arrangement position L_PSN.

(3-6) Designation of Group Number Entering the multi-angle period, an input operation for designating a group selection screen is performed by the viewer in S1002. In S1003, an internal setting for displaying the group selection screen is performed. In S1004, display control data 1 to n are output based on the internal setting. In S1005, for example, the group selection screen shown in FIG. As shown in the figure, group 1 includes angle images 1 and 2 on the first base side, group 2 includes angle images 3, 4, and 5 on the third base side, and group 3 includes angle images 6 on the back of the back net. , 7 are included. If the group name can be defined as display definition data at the time of editing, the group name can be displayed at the same time during reproduction. For example, if the group name of group 1 in the display definition data is defined as “1 side”, group 2 is defined as “3 side”, and group 3 is defined as “the back of the back net”, it is displayed as shown in FIG. Can do.

  In the next loop, when group 2 is designated by the viewer in S1003, the display mode for display is set in S1003 as shown in FIG. 5B. In S1004, display control data 1 to n are video. The data is output to the combining unit 250. In step S1005, video composition is performed, and the video is displayed on the video display unit 260 as shown in FIG. Also at this time, the group name of the designated group 2 can be displayed.

8). Other Modifications Although one embodiment of the present invention has been described above, the present invention is not limited to the above embodiment. For example, in the above-described embodiment, the example in which the angle video display mode in the multi-angle period is arranged in the unused area Un_USE of the DSI information part of the DSI packet of the navigation pack NV has been described. However, as shown in FIG. Such information may be arranged in the user data portion of the picture layer. In this case, as shown in FIG. 16, the user data portion is configured in the same manner as that shown in the unused area Un_USE in FIG. As described above, if the display mode of the angle video is set for each picture data, the display mode of the angle video can be set for each image, so that control at a very fine timing is possible.

  Furthermore, although an example in which multiplexed video data is recorded on a DVD has been described in the present embodiment, it can be recorded on a medium such as an optical disk such as a Blu-ray disk, a hard disk, or a memory. The multiplexed video data may be recorded on the hard disk, magnetic tape, or internal memory of the video editing device or video playback device.

  In the present embodiment, the MPEG2 system is adopted as an angle video encoding system, but other encoding systems are also applicable.

  In the present embodiment, since the display definition data 1 to n are stored in a predetermined area such as the unused area Un_USE, the DVD according to the present embodiment is “other than the video reproduction apparatus according to the present embodiment. It is of course possible to reproduce the image by the “video reproduction apparatus”.

  The video editing apparatus and video editing method according to the present invention are useful as a video editing apparatus for DVD because display definition data that defines the display mode of angle video can be arranged in a predetermined area.

  The video playback apparatus and video playback method according to the present invention obtain display definition data that defines the display mode of an angle video reflecting the editor's intention, generate display control data based on the display definition data, and display the display definition data. Since the video is played back based on the control data, it is useful as a video playback device for DVD.

  The angle video display data and the recording medium on which the angle video display data according to the present invention are recorded are useful as a medium for recording an angle video display mode in a multi-angle period for DVD.

Block diagram of a video editing apparatus in an embodiment of the present invention The block block diagram of the display mode setting part in embodiment of this invention (A) Diagram showing data structure of video object unit VOBU (b) Diagram showing data structure of navigation pack NV in the embodiment of the present invention Block diagram of a video playback apparatus in an embodiment of the present invention The block block diagram of the display mode control part in embodiment of this invention The flowchart which showed the edit process procedure of the angle image | video in the multi-angle period in embodiment of this invention Diagram showing a display example when editing / playing an angle video The figure which showed the example of a setting of division | segmentation number DIV_CNT and division | segmentation type DIV_TP The figure which showed the example of a display of the angle image | video based on coordinate arrangement position P_PSN and reduction rate RSZ_RT The flowchart which showed the reproduction | regeneration processing procedure of the angle image | video in the multi-angle period in embodiment of this invention The figure which showed the example of a change display at the time of reproduction of an angle picture The figure which showed the example of a display at the time of changing the frame arrangement position and reduction ratio at the time of reproduction of an angle picture The figure which showed the example of a display at the time of changing automatically the reduction rate at the time of playback of an angle picture The figure which showed the example of a subtitle picture display at the time of angle picture reproduction The figure which showed the example of a group selection display at the time of reproduction of an angle picture The figure which showed the data structure of the picture layer in embodiment of this invention A diagram showing reproduction of multi-angle video according to Japanese Patent Laid-Open No. 10-155138. A diagram showing reproduction of multi-angle video according to conventional Japanese Patent Laid-Open No. 2000-156845

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Video editing apparatus 140 Display aspect setting part 160 Multiplexing part 200 Video reproduction apparatus 240 Display aspect control part 250 Video composition part Un_USE Unused area M Recording medium

Claims (19)

Set display definition data that defines the display mode of the angle video in the multi-angle period in which the multi-angle function that can acquire and display any angle video from the editing information storage means that records multiple angle videos Display mode setting means,
A video editing apparatus comprising: multiplexing means for arranging the display definition data in a predetermined area. 2. The video editing apparatus according to claim 1, wherein the multiplexing unit arranges the display definition data in an unused area in a DSI data part of a DSI packet of a navigation pack in the DVD standard. 2. The video editing apparatus according to claim 1, wherein the multiplexing unit arranges the display definition data in a user data area of a picture layer in an MPEG2 video stream. 4. The video editing apparatus according to claim 1, wherein the display definition data includes a frame arrangement position or a coordinate arrangement position that defines a display position of an angle video. 5. The video editing apparatus according to claim 1, wherein the display definition data includes a reduction ratio that defines a size of an angle video. 6. The video editing apparatus according to claim 1, wherein the display definition data includes a group number that defines a group of angle videos. In a multi-angle period in which a multi-angle function that can acquire and display an arbitrary angle video from the reproduction information storage means that records a plurality of angle videos is operated,
Display mode control means for acquiring display definition data reflecting the intention of the editor from the reproduction information storage means and outputting as display control data;
A video reproducing apparatus comprising: video synthesizing means for synthesizing the angle video based on the display control data. The said display mode control means acquires the data recorded on the unused area | region among the DSI data parts of the DSI packet of the navigation pack in DVD specification as said display definition data. Video playback device. 8. The video reproduction apparatus according to claim 7, wherein the display mode control means acquires data recorded in a user data area of a picture layer in an MPEG2 video stream as the display definition data. The display mode control means acquires the display definition data as a frame arrangement position or a coordinate arrangement position that defines a display position of an angle video,
10. The video according to claim 7, wherein the video synthesizing unit synthesizes the angle video so that the angle video is displayed at the frame arrangement position or the coordinate arrangement position. Playback device. The display mode control means acquires the display definition data as a reduction ratio that defines the size of an angle video,
11. The video reproducing apparatus according to claim 7, wherein the video synthesizing unit synthesizes the angle video so that the angle video is displayed at the reduction ratio. The display mode control means acquires the display definition data as a group number that defines a group of angle videos,
12. The video reproducing apparatus according to claim 7, wherein the video synthesizing unit synthesizes the angle video so that the angle video belonging to the group number is displayed. The display mode control means includes a viewer switching operation of the angle video, an operation of changing the display position of the angle video, a change operation of the reduction rate of the angle video, an operation of changing the group number of the angle video, the angle video When display input data based on at least one operation selected from among the selection operations for selecting some of them is input, the display control data is further converted based on the display input data. The video reproduction apparatus according to claim 7, wherein the video reproduction apparatus outputs the video reproduction apparatus. When the operation is an angle video selection operation, the display mode control means obtains an optimal division type based on the number of divisions determined by the total number of selected angle videos, and outputs the display control data. 14. The video playback apparatus according to claim 13, wherein An editor's intention to define the display mode of an angle video used in a multi-angle period in which a multi-angle function is activated that can acquire and switch between arbitrary angle videos from an information storage means that records a plurality of angle videos. Display definition data reflecting the above is recorded in an unused area in the DSI data part of the DSI packet of the navigation pack in the DVD standard. An editor's intention to define the display mode of an angle video used in a multi-angle period in which a multi-angle function is activated that can acquire and switch between arbitrary angle videos from an information storage means that records a plurality of angle videos. Angle definition video display data, wherein display definition data reflecting the above is recorded in a user data area of a picture layer in an MPEG2 video stream. The recording medium which recorded the data for angle video display of Claim 15 or 16. Set display definition data that defines the display mode of the angle video in the multi-angle period in which the multi-angle function that can acquire and display any angle video from the editing information storage means that records multiple angle videos Display mode setting procedure to be performed;
A video editing method comprising: a multiplexing procedure for arranging the display definition data in a predetermined area. In a multi-angle period in which a multi-angle function that can acquire and display an arbitrary angle video from the reproduction information storage means that records a plurality of angle videos is displayed,
A display mode control procedure for acquiring display definition data reflecting the editor's intention from the reproduction information storage means and outputting it as display control data;
A video reproduction method comprising: a video composition procedure for compositing the angle video based on the display control data.

Images