JP4393425B2 - Video equipment, video recording method and video playback method - Google Patents

Description

  The present invention relates to a video device, a video recording method, and a video playback method that handle a video stream having a data structure in which a plurality of types of videos are coordinated on a single video.

  In video equipment that handles video streams containing multiple videos, such as moving images, menu buttons, subtitles, etc., the user or content viewer can arbitrarily record the intended video stream by arbitrarily operating multiple videos, A technology that can be reproduced is required.

Conventionally, as a technique for displaying and operating a plurality of moving images, for example, for moving images of a plurality of video data source units, a moving image to be fetched into a frame buffer is controlled using a moving image identification number register, an identification number comparator, or the like. Thus, there is a technique for displaying a plurality of moving images that enables display of a plurality of moving images. Further, as a technique for operating a plurality of videos in a video stream, there is a video operation technique for separating and extracting a foreground object and a background image from a moving image.
JP-A-8-123401 JP 2002-118843 A

  However, in the above-described multi-moving image display technology, data must be supplied / read from the information recording medium for each video, and therefore the overhead of data reading time increases in proportion to the number of videos. At the same time, there is a problem that the same number of decoders as the number of videos to be reproduced is required, and the mechanism for synchronizing the frames of a plurality of videos is complicated. In addition, the above-described video operation technique has a problem that complicated processing is required to cut out the video.

  The present invention provides a video device that handles a video stream including a plurality of videos such as moving images, menu buttons, subtitles, etc., and efficiently operates a video stream intended by a user or content viewer by arbitrarily operating a plurality of videos. It is an object of the present invention to provide a video device, a video recording method and a video playback method capable of recording and playing back.

According to the present invention, video restoration information for individually extracting the plurality of types of video from the video stream is added to a video stream in which a plurality of types of video are arranged so as not to overlap each other, and the information is stored in a predetermined information storage medium. Recording means for recording , wherein the recording means generates a source video by arranging a plurality of types of video on a single video so as not to overlap each other, and generates the plurality of types of video from the source video. A video recording processing means for generating video restoration information for individually cutting out the source video, the source video generated by the video recording processing means is encoded, and the encoded video of the source video is encoded by the video recording processing means. A video unit data generation processing unit for generating video unit data by adding the generated video restoration information and predetermined video output information. When a video in which the said set of image unit data generated by the video unit data generating means comprises a recording processing means for recording on the information storage medium, and can generate a plurality of video streams from one video stream Features equipment.

  The present invention is also a method for recording a video stream having a plurality of types of videos, wherein the plurality of types of videos are coordinated on a single video so as not to overlap each other, and a source video is generated; A step of generating video restoration information for individually cutting out the plurality of types of videos from the source video as the source video is generated, a step of encoding the generated source video, and the encoding of the encoded video Adding video restoration data and predetermined video output information to source video data to generate video unit data; and recording the set of video unit data in a predetermined information storage medium. It is characterized by that.

  In video equipment that handles video streams that include multiple videos, such as moving images, menu buttons, and subtitles, the user or content viewer can arbitrarily record and play the intended video stream by arbitrarily operating multiple videos. can do.

  Embodiments of the present invention will be described below with reference to the drawings.

  A video recording method and video equipment according to an embodiment of the present invention will be described with reference to FIG.

  The video equipment according to the embodiment of the present invention realizes a plurality of video recording means as shown in FIG. This recording means individually cuts out the images 101 to 103 from the source image (A) in which a plurality of types of images 101 to 103 are coordinate-arranged on one image so as not to overlap each other, and the source image (A). Processing means for generating video unit information (C) by generating video restoration information 105, encoding the source video, adding video restoration information and predetermined video output information (B) And processing means (S12) for recording the video stream (D) composed of the set of the video unit data on the information storage medium (E). The above processing means (S11) generates a source video by coordinating a plurality of types of video on a single video so that they do not overlap each other, and separately cuts out the plurality of types of video from this source video. Video recording processing means for generating the video restoration information, and the source video generated by the video recording processing means are encoded, and the video restoration information generated by the video recording processing means is encoded into the encoded source video data and A video unit data generation processing unit for generating video unit data by adding predetermined video output information is realized. Further, the processing means (S12) realizes a recording processing means for recording a set of video unit data generated by the video unit data generation processing means on an information storage medium.

  The plurality of images 101 to 103 are different images. Rotate the plurality of images 101 to 103 and perform coordinate arrangement processing on one image so as not to overlap each other, thereby generating the source image 104 and image restoration information 105 for the source image 104 To do. This process is called a video recording process. The source video 104 is a video corresponding to one frame.

  The video composition information 106 is information for combining a plurality of videos 101 to 103 into a single video, and a video composition process using the video composition information 106 will be described later with reference to FIG.

  The video display information 107 includes information for setting the time for outputting the synthesized video and the resolution of the display screen.

  Video unit data 108 is generated by adding the video restoration information 105, video composition information 106, and video display information 107 to the encoded source video data obtained by encoding the source video 104. .

  The set 109 of the video unit data 108 is recorded on the information storage medium 110. A set 109 of video unit data recorded in the information storage medium 110 is a video stream of encoded multiple videos generated by coordinately arranging a plurality of types of videos on one video so as not to overlap each other. Here, an optical medium is taken as an example of the information storage medium 110, but the information storage medium assumed by the present invention is not limited to this.

  A series of procedures of the above-described multiple video recording process will be described later with reference to FIG. The multiple video recording method according to the present invention is characterized in that the video recording process and the video unit data generation process are performed in the processing flow described above.

  The video equipment according to the above embodiment realizes a plurality of video playback means as shown in FIG. The reproduction means decodes the video unit data (A), which is one component of the video stream, to generate a source video (B), and from the decoded source video (B), the processing means (S21) Processing means (S22) for cutting out and restoring the plurality of videos 203 to 205 with reference to the video restoration information included in the video unit data (A).

  The source video 202 is generated by decoding the video unit data 201 read from the information storage medium 110 shown in FIG.

  A plurality of videos 203 to 205 are restored from the source video 202 while referring to the video restoration information included in the decoded video unit data 201.

  Of the restored video, the video displayed on the entire display screen is called a main video, and the video displayed on the main video is called a secondary video. An image for performing mask processing (transmission processing) on the secondary image is called a mask. However, the image transmission process assumed by the present invention is not limited to the mask process. A series of procedures of the above-described multiple video reproduction process will be described later with reference to FIG.

  The video equipment according to the embodiment of the present invention realizes a plurality of video synthesizing means as shown in FIG. The synthesizing unit includes a processing unit (S31a) that performs rotation and arrangement of coordinates on the main video (A), a processing unit (S31b) that performs mask (C) processing on the secondary video (B), and A processing means (S32b) that performs rotation and coordinate arrangement on the masked secondary image (E), and a main video (D) and secondary video (F) that have undergone the rotation and coordinate arrangement are synthesized. And processing means (S33) for generating a composite video (G).

  The composition of a plurality of images refers to performing rotation processing and transmission processing on a plurality of images, and performing coordinate arrangement processing with allowance for overlapping, and combining them into one image. The main video plane 301 is a video plane for drawing the main video. The secondary video plane 302 is a video plane for drawing the masked secondary video.

  The main video 303 is rotated and drawn on the main video plane 301 while referring to the video composition information. Further, the secondary image 304 is masked using the mask 305 to generate a masked secondary image 306. Further, the masked secondary image 306 is rotated, and the coordinates are arranged on the secondary image plane 302 and drawn. A composite video 307 is generated by superimposing the main video plane 301 and the secondary video plane 302.

  The layer structure of the two video planes is shown in FIG. A secondary video plane 402 overlaps the main video plane 401.

  A series of procedures for the above-described synthesis / restoration processing of a plurality of videos will be described later with reference to FIG. The multiple video playback method according to the present invention is characterized in that the above-described video restoration processing and video synthesis processing are performed in the flow of this processing.

  Here, the data structure of the video unit data will be described with reference to FIG.

  The video unit data 501 is data generated in the video unit data generation process (see the video unit data generation process (C) of the processing means (S12) shown in FIG. 1). In the header information 502, parameters related to video reproduction are set. In the composite video display time 503, a time for displaying the composite video on the screen is set. In the main video ID number 504, a video ID number (to be described later) of a video that is the main video in the initial state is set. In the main video rectangle 505, a video rectangle designated by the main video ID number is set. This is used to set the resolution of the video displayed on the screen. The total number of videos 506 describes the total number of videos included in the source video.

  The video information 507 is composed of N pieces of video information (video information # 1 to N) 508,. N represents the maximum number of videos recorded in the source video. The data structure of one video information (#n) 508 will be described later with reference to FIG.

  The mask information 509 is composed of M pieces of mask information (mask information # 1 to M) 510,. Here, M indicates the maximum number of masks recorded in the source video. The data structure of one mask information (#k) 510 will be described later with reference to FIG.

  The encoded source video 511 indicates data obtained by encoding a source video in which a plurality of videos are recorded using an arbitrary encoding method.

  The data structure of the video information (#n) 508 will be described with reference to FIG.

The video ID number 601 is a unique ID number assigned to each video recorded in the source video.
The video restoration information 602 is information necessary for restoring a video from the source video.
In the video cut-out source coordinates 603, the coordinates of the video on the source video are stored. The X coordinate is stored in the clipping source X coordinate 604, and the Y coordinate is stored in the clipping source Y coordinate 605.

  The video rectangle 606 stores a video rectangle recorded on the source video. However, when the video is rotated and arranged, the rotated rectangle is stored. The video height information is stored in the video height 607, and the video width information is stored in the video width 608.

  Video composition information 609 is information necessary for performing composition processing on a video restored from the source video.

  The video rotation angle 610 stores rotation angle information when recording video on the source video.

  The video arrangement destination coordinates 611 store coordinates for arranging the video on the synthesized video. The X coordinate of the placement destination is stored in the 612 placement destination X coordinate, and the Y coordinate is stored in the 613 placement destination Y coordinate.

  The display ON / OFF flag 614 is a flag for setting whether or not to synthesize a video. When the value is true (True), the video is synthesized, and when it is false (false), the synthesis is not performed. .

  The mask application flag 615 is a flag for setting whether or not to perform mask processing on the video #n. In the case of True, mask processing is performed on the video, and in the case of False, mask processing is not performed.

  The applied mask ID number 616 stores a mask ID number (described later) of a mask to be applied to the video.

The data structure of mask information #n 510 will be described with reference to FIG.
The mask ID number 701 is an ID number unique to each mask.
The mask cut-out source coordinates 702 store the coordinates of the mask on the source video. The X coordinate is stored in the clipping source X coordinate 703, and the Y coordinate is stored in the clipping source Y coordinate 704.

  A mask rectangle 705 stores a mask rectangle recorded on the source video. However, when the mask is rotated and arranged, the rotated rectangle is stored. The mask height information is stored in the mask height 706, and the mask width information is stored in the mask width 707.

  The mask rotation angle 708 stores the rotation angle when the mask is recorded on the source video.

  Here, a flow of processing for recording / reproducing a plurality of videos in the embodiment of the present invention will be described with reference to FIG.

  FIG. 8 shows a flow of a recording process of a plurality of videos in the embodiment of the present invention.

  In the multiple image recording process (step 801), N images for one frame and M masks are arranged on one image so as not to overlap, and a source image is generated. At the same time, image restoration information for N images and mask restoration information for M masks are generated. When this multiple video recording process is completed, the process proceeds to a video encoding process (step 802).

  In the video encoding process (step 802), the source video generated in the multiple video recording process (step 801) is encoded in an arbitrary encoding format to generate an encoded source video. When the generation process of the encoded source video is completed, the process proceeds to the video composition information / mask information generation process (step 803).

  In the video synthesis information and mask information generation process (step 803), video synthesis information for synthesizing a plurality of videos into one video and mask synthesis information necessary for performing transmission processing on the video are generated. . When this mask information generation process ends, the process proceeds to the video unit data generation process (step 804).

  In the video unit data generation process (step 804), header information is generated. Also, video information # 1 to N is generated from the video restoration information and the video composition information, and video information is generated from the set thereof. Further, mask information # 1 to M is generated from the mask restoration information and the mask synthesis information, and mask information is generated from the set. Video unit data is generated by bundling header information, video information, mask information, and encoded source video. When this video unit data generation process is completed, the process proceeds to a conditional branch (step 805) for confirming the end of the recording process for all frames.

  In this conditional branch (step 805), if it is confirmed that the recording process for all the frames has been completed, the video recording process is terminated. If the recording process for all the frames has not been completed, the process proceeds to the multiple video recording process (step 801) and the above-described process is repeatedly executed.

  Through the above processing, a plurality of video streams can be stored in one video stream. In the series of multiple video recording processes described above, a program having the processing routine shown in FIG. 8 is stored in, for example, a program memory unit of a multiple video playback processing apparatus described later, and processed by the MPU, whereby multiple videos are recorded. A recording / reproducing apparatus is realized. Alternatively, by storing a program having the processing routine shown in FIG. 8 in the personal computer as, for example, a graphic editing tool, a user can arbitrarily operate a plurality of videos such as moving images, menu buttons, subtitles, etc. Can be well created and recorded.

Next, the flow of processing for reproducing a plurality of videos will be described with reference to the flowchart of FIG.
In the video unit data acquisition process (step 901), video unit data is read, and header information, video information, mask information, and encoded source video are acquired. When this video unit data acquisition process is completed, the process proceeds to a video plane generation process (step 902).

  In the video plane generation process (step 902), a main video plane, a secondary video plane, and a mask plane are generated according to the main video rectangle of the header information. When this video plane generation process ends, the process proceeds to a decoding process (step 903).

  In the decoding process (step 903), the encoded source video data is decoded and the source video is acquired. When this decoding process ends, the process proceeds to a multiple video restoration / combination process (step 904).

  In the multiple video restoration / combination process (step 904), the multiple videos / masks are restored from the source video with reference to the video restoration information. The restored image / mask is rotated / coordinated with reference to the image composition information to generate a main image, a secondary image, and a mask, respectively. Further, the secondary image is masked using a mask to generate a masked secondary image. Then, the generated main image and the masked secondary image are combined to generate a combined image.

  Details of the multiple image restoration / combination processing will be described later with reference to the flowchart of FIG. When the restoration / combination process of the plurality of videos is completed, the process proceeds to a synthesized video output process (step 905).

  In the composite video output process (step 905), the composite video generated in the multiple video restoration / combination process (step 904) is converted into a video in accordance with the composite video display time included in the header information of the video unit data. Output to the display device. When this composite video output process is completed, the process proceeds to a conditional branch (step 906) for confirming that the final frame display process has been completed.

  In this conditional branch (step 906), it is determined whether or not the video has been displayed up to the final frame. If the video has been displayed up to the final frame, the process is terminated. If the final frame has not been displayed, the process proceeds to the video unit data acquisition process (step 901) and the above process is repeatedly executed.

  With the above processing, a plurality of videos can be reproduced from the data stream for one video.

  Here, the flow of the multiple video restoration / combination process (step 904) in FIG. 9 will be described with reference to the flowchart of FIG.

  The video restoration loop (step 1001) is a loop that restores a video and arranges it on the main video plane and the secondary video plane. Every time a loop is made, the video information acquisition counter i is incremented by 1, and all video information is processed.

  In the acquisition of the video information #i (step 1002), the video information #i included in the video unit data is acquired. When the process is completed, the process proceeds to a conditional branch (step 1003).

  In this conditional branch (step 1003), the display ON / OFF flag included in the video composition information is determined, and if it is True, the transition is made to video clipping (step 1004), and if it is False, the loop end (step 100). 1013).

  In the video cutout (step 1004), the video is cut out according to the video cutout source coordinates (603) and the video rectangle (606) of the video restoration information (602). When the process is completed, the process proceeds to a conditional branch (step 1005).

  In this conditional branch (step 1005), the main video ID number (504) included in the header information (502) is compared with the video ID number (701) included in the video information #i (508). If so, the process proceeds to rotation / coordinate arrangement (step 1006) of the main video. If they do not match, the process proceeds to the rotation of the secondary video (step 1007).

  In the rotation / coordinate arrangement (step 1006) of the main image, the main image is rotated and arranged on the main image plane with reference to the image composition information (609). When this process is completed, the process proceeds to the loop end (step 1013).

  In the rotation of the secondary video (step 1007), the secondary video clipped in the video clipping (step 1004) is rotated while referring to the video composition information. When this process is completed, a transition is made to a conditional branch (step 1008).

  In this conditional branch (step 1008), the mask application flag included in the video composition information is referred to. If True, the process proceeds to mask clipping (step 1009). If it is False, transition is made to the secondary video coordinate arrangement (step 1012).

In mask clipping (step 1009), mask information having a mask ID number that matches the applicable mask ID number (616) of the video composition information (609) is acquired. Further, the mask is cut out from the source video with reference to the video restoration information (602). When this processing is completed, the process proceeds to mask binarization processing (step 1010).

  In this mask binarization process (step 1010), the mask obtained by the mask clipping (step 1009) is binarized to generate a binarized mask. When this processing is completed, the process proceeds to mask processing (step 1011).

  In this mask process (step 1011), the binarized mask binarized in the mask binarization process (step 1010) with reference to the video composition information (609) is rotated. Further, a masked secondary image is generated by performing a mask process on the rotated image using the rotated binarized mask. When this process is completed, the transition is made to the coordinate arrangement of the secondary video (step 1012).

  In the coordinate arrangement of the secondary video (step 1012), the masked secondary video is arranged on the secondary video plane with reference to the video composition information (609). When this process is completed, the process proceeds to the playback process loop end (step 1013).

  At this loop end (step 1013), the total number of videos (506) in the header information (502) is compared with the video information acquisition counter i. If the total number of videos is large, the counter i is incremented by 1 and the loop starts. Transition to the end (step 1001). Otherwise, the loop is terminated and the process proceeds to the video plane synthesis process (step 1014).

  In the video plane synthesis process (step 1014), the main video plane and the secondary video plane are superimposed to generate a synthesized video. When this process is completed, the restoration / combination process for a plurality of videos ends.

  With the above processing, generation of a composite image for one frame is completed.

  Here, a reproduction processing apparatus for a plurality of videos in the embodiment of the present invention will be described.

  The system configuration of the multiple video playback processing apparatus will be described with reference to FIG.

  The MPU unit 1101 is a processing unit that performs arithmetic processing in the reproduction processing apparatus according to the embodiment of the present invention. The memory unit 1102 is a device for developing a program that the MPU unit 1101 performs processing. The ROM unit 1103 stores a reproduction processing apparatus activation program according to the embodiment of the present invention. This program is read into the memory unit 1102 immediately after the playback processing apparatus according to the embodiment of the present invention is turned on. The bus bridge 1104 is a device that controls data flowing on the bus.

  The optical disk 1105, the HDD 1106, the flash memory 1111 and the network storage 1107 are information recording media. However, the information recording medium assumed by the present invention is not limited to this.

  The data processor unit 1109 inputs the video stream input from each module to the video decoder unit 1115.

  The disk drive unit 1110 is a device that reads a video stream from the optical disk 1105 and supplies the video stream to the data processor unit 1109.

  A flash memory 1111 is a storage medium that supplies a video stream to the data processor unit 1109. The HDD 1106 is a device that supplies a video stream to the data processor unit 1109.

  The network controller 1112 is a device that reads a video stream from the network and supplies the video stream to the data processor unit 1109.

  The video decoder unit 1113 decodes the input video stream to generate a video, and outputs the video to the video restoration / combination processing unit 1114.

  The video restoration / combination processing unit 1114 reads a video from the video memory unit 1115 and restores a plurality of videos from the video. Further, the restored plurality of videos are combined into one video and output to the video processor unit 1116. The internal configuration of the video restoration / combination processing unit 1114 will be described later with reference to FIG.

  The video processor unit 1116 displays the input video on the screen of the video display device. The external input signal processing unit 1117 receives a remote control input signal from the user and inputs the signal to a UI (User Interface) processing unit 1118.

  The UI processing unit 1118 interprets the input from the external input signal processing unit 1117 and inputs a user event to the video restoration / combination processing unit 1114. A display panel 1119 displays various information such as a reproduction time and a device state.

  The module configuration of the video restoration / combination processing unit 1114 in FIG. 11 will be described with reference to FIG.

  The video related information analysis unit 1201 analyzes header information, video information, and mask information input from the video decoder unit 1113 and provides the analysis results to modules 1202 to 1212 described later.

  The video segmentation unit 1202 performs a process of restoring the video from the source video with reference to the video restoration information of the video information and a process of restoring the mask from the source video with reference to the mask information. Further, the main video is output to the main video rotation / coordinate arrangement unit 1203, the secondary video is output to the secondary video rotation unit 1204, and the mask is output to the mask binarization unit 1205.

  The main image rotation / coordinate arrangement processing unit 1203 rotates the main image with reference to the image composition information, and arranges the result on the main image plane. Data drawn on the main video plane is stored in the main video plane buffer 1206.

  The secondary video rotation unit 1204 rotates the secondary video with reference to the video composition information and stores the result in the secondary video temporary buffer 1207.

  The mask binarization processing unit 1205 binarizes the input mask and stores the binarized mask in the binarized mask buffer 1208.

  The mask rotation processing unit 1209 rotates the binarized mask stored in the binarized mask buffer 1208 according to the mask information, and stores it in the mask buffer 1210.

  The mask processing unit 1211 performs mask processing on the secondary video plane using the input mask plane, and generates a masked secondary video. Further, the secondary video is rotated with reference to the video information, and the coordinates are arranged on the secondary video plane. Data drawn on the secondary video is stored in the secondary video plane buffer 1212.

  The mixer 1213 synthesizes the main video plane stored in the main video plane buffer 1206 and the secondary video plane stored in the secondary video plane buffer 1212 and outputs a composite video.

  With the above-described multiple video playback processing device, the user can operate the video using the input device. FIG. 13 shows video operations that can be performed by the user and processing performed in the video playback processing apparatus. Here, the video operations performed by the user include multi-angle playback, video (secondary video) display / non-display, parental lock playback, video (secondary video) masking on / off, video (secondary video) ) Shape change, subtitle (secondary video) display / hide, subtitle language selection, subtitle (secondary video) masking on / off, menu display, menu button shape change, etc. Make it feasible.

  In the above-described multiple video playback processing apparatus, a program having the processing routines shown in FIGS. 8 to 10 is stored in the memory unit 1102 that stores a program executed by the MPU unit 1101, and this program is stored in the MPU unit 1102. When executed by the unit 1101, the video stream can be realized not only in the above-described multi-image playback process but also in the multi-video recording process, whereby a plurality of types of video are coordinate-arranged on a single video. Recording / playback system can be realized.

  According to the embodiment of the present invention described above, a plurality of video streams can be stored in one video stream. In this process, since it is not necessary to read a plurality of video streams, the overhead of data reading is small. In addition, frame synchronization of a plurality of videos can be easily achieved as compared with a case where a plurality of videos are individually decoded. As a result, a video device with a simplified internal configuration can be realized.

  Next, a video apparatus that further embodies the present invention when the above-described video processing technique of the present invention is realized in light of the actual configuration will be described. Here, a specific example of a combination of video resolutions arranged in a source video having a resolution of 1080i / p (interlace / progressive) is shown.

  A source video having a resolution of 1080i / p is recorded with a video of a resolution (720i / p, 480i / p) that can be displayed on the current television system, and a secondary video of an arbitrary resolution. Consider playback on a playback processor. FIG. 14 shows combinations of resolutions of videos to be arranged and usage applications of secondary videos to be arranged at the same time. Here, four examples of combinations of resolutions (combinations 1 to 4) are shown.

  An example of the source video of the combination 1 video is shown in FIG. 15, and an example of the composite video is shown in FIG.

  FIG. 15 shows a source video 1301 in the case of the combination 1. The source video 1301 has a main video (moving image) 1302 having a resolution of 720 i / p and a secondary video (moving image) 1303 having a resolution of 480 i / p. Further, the source video 1301 includes a subtitle video 1304 having an arbitrary resolution, a mask of the subtitle video 1304 (mask for subtitle video) 1305, a button video 1306 having an arbitrary resolution, and a mask of the button video 1306 ( Button image mask) 1307 as secondary images.

  FIG. 16 shows an example of the combined video of the combination 1 in the source video 1301 having the videos 1302 to 1307 shown in FIG. Here, a secondary video (moving image) having a resolution of 480 i / p is arranged starting from the upper left corner of the main video (moving image) having a resolution of 720 i / p, and a subtitle is added to the main video and a button is added to the secondary video. An example of the arranged composite video 1401 is shown.

  FIG. 17 shows a source video 1501 in the case of the combination 2. The source video 1501 includes a main video (moving image) 1502 having a resolution of 720 i / p, subtitle videos 1503 to 1505 having an arbitrary resolution, and a mask (mask for subtitle video) 1506 of these subtitle videos 1503 to 1505. ˜1508 as secondary images.

  FIG. 18 shows an example of the combined video of the combination 2 in the source video 1501 having the videos 1502 to 1508 shown in FIG. Here, a composite video 1601 in which a plurality of subtitles are arranged on a main video (moving image) having a resolution of 720 i / p is illustrated.

  FIG. 19 shows a source video 1701 in the case of the combination 3. The source video 1701 has four types of videos (moving images 1 to 4) 1702 to 1705 each having a resolution of 480 i / p. FIG. 20 shows an example of a composite video of the combination 3 in the source video 1701 having the videos 1702 to 1705 shown in FIG. Here, an example of multi-angle playback using four videos 1702-1705 is shown.

  FIG. 21 shows a source video 1901 in the case of the combination 4. The source video 1901 includes three types of videos (moving images 1 to 3) 1902 to 1904 each having a resolution of 480 i / p, a subtitle video 1905 having an arbitrary resolution, and a mask of the subtitle video 1905 (for subtitle video). ), Two button images 1907 and 1908, and masks (button image masks) 1909 and 1910 for the button images 1907 and 1908. FIG. 22 shows an example of the combined video of the combination 4 in the source video 1901 having the videos 1902 to 1910 shown in FIG. In this example, the mask applied to the button image can be dynamically changed.

Explanatory drawing of the video recording method and video equipment which concern on embodiment of this invention. Explanatory drawing of the several image | video reproduction | regeneration means which concerns on the said embodiment. Explanatory drawing of the several image | video synthetic | combination means which concerns on the said embodiment. The figure which shows the layer structure of the video plane which concerns on the said embodiment. The figure which shows the data structure of the video unit data which concern on the said embodiment. The figure which shows the data structure of the video information which concerns on the said embodiment. The figure which shows the data structure of the mask information which concerns on the said embodiment. The flowchart which shows the procedure of the several video recording process which concerns on the said embodiment. The flowchart which shows the procedure of the multi video reproduction | regeneration processing which concerns on the said embodiment. The flowchart which shows the synthetic | combination / decompression | restoration process procedure of the several image | video which concerns on the said embodiment. The block diagram which shows the structure of the several video reproduction | regeneration processing apparatus which concerns on the said embodiment. The block diagram which shows the structure of the image | video restoration | reconstruction process part shown in the said FIG. The figure which matches and shows the video operation which a user can implement in the said multiple video reproduction processing apparatus, and the process performed inside an apparatus. The figure which shows the example of a combination of the resolution of the image | video in the synthetic | combination / decompression | restoration process of the several image | video which concerns on the said embodiment. The figure which shows the example of a source image in the case of the combination 1 in the said FIG. The figure which shows the example of a synthetic | combination image | video of the said FIG. The figure which shows the example of a source image in the case of the combination 2 in the said FIG. The figure which shows the example of a synthetic | combination image | video of the said FIG. The figure which shows the example of a source image in the case of the combination 3 in the said FIG. The figure which shows the example of a synthetic | combination image | video of the said FIG. The figure which shows the example of a source image in the case of the combination 4 in the said FIG. The figure which shows the example of a synthetic | combination image | video of the said FIG.

Explanation of symbols

  101-103, 203-205 ... video, 104,202 ... source video, 105 ... video restoration information, 106 ... video synthesis information, 107 ... video display information, 108,201 ... video unit data, 109 ... video unit Data set (video stream), 110 ... information storage medium, 301, 403 ... main video plane, 302, 402 ... secondary video plane, 303 ... main video, 305 ... mask, 306 ... masked secondary video, 307 ... Composite video, 1101 ... MPU part, 1102 ... Memory part, 1103 ... ROM part, 1105 ... Optical disk, 1106 ... HDD, 1107 ... Network storage, 1108 ... Network storage, 1109 ... Data processor part, 1110 ... Disk drive part, 1111 ... Flash memory (Flash Me ory), 1112 ... network controller, 1113 ... video decoder unit, 1114 ... video restoration / composition processing unit, 1115 ... video decoder unit, 1116 ... video processor unit, 1117 ... external input signal processing unit, 1201 ... video related information analysis unit 1202 ... Video segmentation unit, 1203 ... Main video rotation / coordinate arrangement unit, 1204 ... Secondary video rotation unit, 1205 ... Mask binarization unit, 1206 ... Main video plane buffer, 1207 ... Secondary video temporary buffer, 1208 ... Binarized mask buffer, 1209... Mask rotation processing unit, 1210... Mask buffer, 1211... Mask processing unit, 1212.

Claims (9)

Recording means for adding video restoration information for individually cutting out the plurality of types of video from the video stream to a video stream in which a plurality of types of video are arranged so as not to overlap each other and recording the information on a predetermined information storage medium Comprising
The recording means includes
A source video is generated by arranging a plurality of types of video on a single video so that they do not overlap with each other, and video restoration information for individually cutting out the plurality of types of video from the source video is generated. Video recording processing means;
The source video generated by the video recording processing means is encoded, and the video restoration information and predetermined video output information generated by the video recording processing means are added to the encoded source video data. Video unit data generation processing means for generating video unit data;
And recording processing means for recording the set of video unit data generated by the video unit data generation processing means on the information storage medium, so that a plurality of video streams can be generated from one video stream. Video equipment.   The predetermined video output information includes video composition information that indicates the coordinates and rotation angle when the video clipped using the video restoration information is combined and arranged in one output video, and transmission processing. The video equipment according to claim 1, further comprising:   3. The video apparatus according to claim 2, wherein the predetermined video output information includes video display information for giving an instruction to display each of the plurality of types of videos.   The plurality of types of video processed by the video recording processing means is a source video corresponding to one frame of a display screen having a main video and a secondary video, and the recording processing means uses the set of source videos 4. The video equipment according to claim 3, wherein the video equipment is recorded on an information storage medium.   5. The secondary video is a video by any of moving images, subtitles, menus, masks, or any combination of moving images, subtitles, menus, masks, or moving images, subtitles, menus. Video equipment.   The video recording processing means includes processing means for arranging at least one main video having a display resolution lower than the display resolution and at least one secondary video having an arbitrary display resolution on a source video having a predetermined display resolution. The video equipment according to claim 5.   The video recording processing means includes processing means for arranging a plurality of moving images having a display resolution lower than the display resolution and at least one secondary video having an arbitrary display resolution in a source video having a predetermined display resolution. 5. The video device according to 5. A method of recording a video stream having a plurality of types of video,
Generating a source video by arranging the plurality of types of video on a single video so as not to overlap each other;
Generating video restoration information for individually cutting out the plurality of types of video from the source video as the source video is generated;
Encoding the generated source video;
Adding the video restoration information and predetermined video output information to the encoded source video data to generate video unit data;
Recording a set of the video unit data on a predetermined information storage medium.   The video output information includes video synthesis information for instructing a coordinate and a rotation angle when a video clipped using the video restoration information is combined and arranged in one output video, and a transmission process. The video recording method according to claim 8.

Images