WO2007072870A1

WO2007072870A1 - Video content recording device, video content recording method, video content recording program, video content reproduction device, video content reproduction method, video content reproduction program, video content edition device, and information recording medium

Info

Publication number: WO2007072870A1
Application number: PCT/JP2006/325397
Authority: WO
Inventors: Takaaki Namba; Yusuke Mizuno
Original assignee: Matsushita Electric Industrial Co., Ltd.
Priority date: 2005-12-22
Filing date: 2006-12-20
Publication date: 2007-06-28
Also published as: JP2009060154A

Abstract

A video content is general-purposely used for a device capable of displaying various 3-dimensional images and the information format for displaying the 3-dimensional video is standardized. A first video input processing unit (121) and a second video input processing unit (123) image an object from a plurality of different viewpoints. They capture video data, respectively. A static device information management unit (146) acquires static device information as information unique to a video content recording device (100). A dynamic device information management unit (129) acquires dynamic device information as information changing according to the state when the video data is acquired. A content processing unit (142) correlates at least one video data, static device information, and dynamic device information into a video content and records it into an information recording medium (167).

Description

Video content recording device, video content recording method, video content recording program, video content playback device, video content playback method, video content playback program, video content editing device, and information recording medium

Technical field

The present invention relates to a video content recording apparatus, a video content recording method, and a video content recording program for recording video content, particularly three-dimensional video content, on an information recording medium. The present invention also relates to an information recording medium on which video content is recorded. The present invention also relates to a video content playback apparatus, a video content playback method, and a video content playback program for playing back video content recorded on an information recording medium. The present invention also relates to a video content editing apparatus for editing video content recorded on an information recording medium. Background art

[0002] As a conventional device for reproducing video content recorded on an information recording medium, particularly a device for reproducing three-dimensional video content, there is a stereo image display device described in Patent Document 1, for example.

FIG. 17 is a block diagram showing a configuration of a main part of a conventional stereo image display device 900.

[0004] This conventional stereo image display apparatus 900 can display a plurality of stereo images in a general-purpose order without requiring the user to input an image file name including a pair of left and right stereo images each time.

[0005] The overall control unit 901 operates in close cooperation with an OS (Operating System), thereby starting and ending the stereo image display program, controlling the cooperative operation of other modules, and controlling the entire program. Executes memorization, storage, and reading of the set values. The modules directly controlled by the overall control unit 901 are a data processing unit 902 and a display control unit 903.

[0006] The data processing unit 902 responds to requests from the overall control unit 901 and the display control unit 903, and performs various processes. Aisle reading, stereo image data processing, etc. are executed. The data processing unit 902 has three submodules: an image file processing unit 904, a display correction setting file processing unit 905, and a stereo image data processing unit 906. By controlling these modules, the data processing unit 902 It functions as the processing unit 902.

[0007] The image file processing unit 904 reads various types of image files, deciphers their contents, decodes the compressed data as necessary, and converts them into image data in a predetermined standard format. .

[0008] The display correction setting file processing unit 905 receives a request from the display control unit 903 via the data processing unit 902, and saves a setting value related to the display correction of the stereo image in a file, or reads out the reverse. To do.

The stereo image data processing unit 906 combines the image data in a pair of left and right standard formats received from the image file processing unit 904 based on the display correction setting data received from the display correction setting file processing unit 905 and performs direct viewing. Create stereo image data in a format suitable for display on a type display (not shown).

The display control unit 903 receives the stereo image data created by the stereo image data processing unit 906 via the data processing unit 902, and displays it on the direct view display. In addition, the display control unit 903 receives a user instruction regarding display control in which a keyboard (not shown) or mouse (not shown) force is input via the OS or the overall control unit 901, and receives these instructions. Display control corresponding to.

However, in the conventional stereo image display device as described above, a plurality of stereo images are arranged in a general order without the user having to input the image file names of a pair of left and right stereo images each time. Force that can be displayed This stereo image must have been prepared in advance so that it can be displayed in stereo.

[0012] Also, based on the display correction setting data within a certain range! /, The power that can be corrected This is the data that can be displayed according to the specifications of various direct view displays and other 3D displays. It is a correction that does not generate a stereo image itself, but the stereo image must have been prepared in advance so that it can be displayed in stereo. [0013] Further, since the stereo image is limited to the prepared one so that the stereo display can be performed in advance, the displayed stereo image is also limited to the prepared one. It is impossible to display various deformations such as changing them.

[0014] Furthermore, the prepared stereo image has a data structure and a file structure that are unique to the device, and other devices that can display various stereo images and can be used for general purposes. There wasn't.

Patent Document 1: Japanese Patent Laid-Open No. 2001-215947

Disclosure of the invention

[0015] The present invention has been made to solve the above-described problem, and a video content recording apparatus and a video content recording device that can be used universally in a device capable of displaying various 3D videos. It is an object of the present invention to provide a method, a video content recording program, a video content playback device, a video content playback method, a video content playback program, a video content editing device, and an information recording medium.

[0016] A video content recording apparatus according to one aspect of the present invention is a video content recording apparatus that records video content on an information recording medium, and at least one video data obtained by photographing a subject with a plurality of different viewpoint powers. A video data acquisition unit to acquire, a static parameter information acquisition unit to acquire static parameter information, which is information unique to the video content recording device, and information that changes according to the situation when the video data is acquired. Dynamic parameter information acquisition unit that acquires dynamic parameter information that is information, the at least one video data acquired by the video data acquisition unit, and acquired by the static parameter information acquisition unit Associating the static parameter information with the dynamic parameter information acquired by the dynamic parameter information acquisition unit And a recording section for recording on the information recording medium as the image co Nten'.

According to this configuration, the subject is photographed from a plurality of different viewpoints, and at least one video data is acquired. Then, static parameter information that is information unique to the video content recording apparatus is acquired, and dynamic parameter information that is information that changes according to the situation when the video data is acquired is acquired. Then at least one movie acquired The image data, the acquired static parameter information, and the acquired dynamic parameter information are associated with each other and recorded on the information recording medium as video content.

[0018] Therefore, depending on at least one video data obtained by photographing a plurality of different viewpoints of the subject, static parameter information that is unique to the video content recording device, and the situation when the video data is acquired Dynamic parameter information, which is information that changes, is recorded on the information recording medium as video content, so that it can be displayed in 3D using static parameter information and dynamic parameter information. Video data can be covered, and it can be used universally for devices that can display various 3D video content.

[0019] In addition, since the video content for displaying the 3D video recorded by the video content recording device can be used for various 3D display devices, the 3D video can be displayed. It will be possible to contribute to the promotion of the distribution of 3D video information while standardizing the information format.

Brief Description of Drawings

FIG. 1 is a block diagram showing a configuration of a main part of a video content recording apparatus according to a first embodiment.

FIG. 2 is a diagram showing a video shooting state and a schematic configuration of an information recording medium in the video content recording apparatus according to the first embodiment.

FIG. 3 is a diagram showing in detail the directory and file structure of the information recording medium.

FIG. 4 is a flowchart for explaining video content recording processing by the video content recording apparatus shown in FIG.

FIG. 5 is a block diagram showing a configuration of a main part of the video content reproduction / editing device according to the second embodiment.

FIG. 6 is a diagram schematically showing an example when video content is reproduced while changing the distance between lenses.

FIG. 7 is a flowchart for explaining video content playback processing by the video content playback / editing apparatus shown in FIG. 5.

[Fig.8] For video content editing and playback processing by the video content playback and editing device shown in Fig.5 It is a flowchart for demonstrating about it.

FIG. 9 is a block diagram showing a schematic configuration of a video content recording apparatus according to the third embodiment.

FIG. 10 is a schematic diagram for explaining a video content recording apparatus according to Embodiment 3.

[Figure 11] For video content recording processing by the video content recording device shown in Figure 9! It is a flowchart for urgent explanation.

FIG. 12 is a block diagram showing a configuration of a main part of a video content recording apparatus according to Embodiment 4.

FIG. 13 is a diagram showing a schematic configuration of a video input processing unit of the video content recording apparatus according to the fourth embodiment.

[Fig.14] Video content recording processing by the video content recording device shown in Fig. 12! It is a flowchart for urgent explanation.

FIG. 15 is a block diagram showing a configuration of a main part of a video content editing apparatus according to Embodiment 5.

[Fig.16] Video content editing processing by the video content editing device shown in Fig.15! It is a flowchart for explaining.

FIG. 17 is a block diagram showing a configuration of a main part of a conventional stereo image display device. BEST MODE FOR CARRYING OUT THE INVENTION

[0021] (Embodiment 1)

Embodiment 1 of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of a main part of video content recording apparatus 100 according to Embodiment 1. This video content recording device 100 is used for video cameras, digital cameras, still cameras, and video shootings used for various purposes such as industrial, consumer, surveillance, robot, medical, analysis, measurement and measurement, entertainment, and various other purposes. Equivalent to the camera.

[0023] The video content recording apparatus 100 includes a first video input processing unit 121, a second video input processing unit 123, an AV control buffer processing unit 125, a CODEC processing unit 127, and dynamic device information management. Unit 129, content processing unit 142, content attached information processing unit 144, static device information management unit 146, media access processing unit 161, menu processing unit 163, and user interface processing unit 165.

The video content recording device 100 has two parts for acquiring video data, that is, a first video input processing unit 121 and a second video input processing unit 123. The first video input processing unit 121 and the second video input processing unit 123 are also a camera unit corresponding to the right eye and a camera unit corresponding to the left eye, for example, for three-dimensionalizing the input video. As will be described later, the video input processing unit corresponding to the camera unit for acquiring the video data is not necessarily limited to two, and may have three, four, or more. Absent. Alternatively, one video input processing unit is subdivided, and there is only one image sensor and video signal processing circuit, and only a part (the center of which is a lens) that forms an object image on the image sensor. It does not matter. Alternatively, it is possible to use one video input processing unit as if it were two or more video input processing units while moving one video input processing unit. Embodiments obtained by variously modifying some of these will be described in detail later.

[0025] Note that the image pickup element referred to in the present specification means that phototransistors, photodiodes, and other photoelectric elements of various materials' configurations have various structures in a two-dimensional planar shape, such as lattice matrix, staggered A two-dimensional planar imaging device arranged in a child or Hercam structure. For example, one CCD area image sensor chip or a CMOS planar image sensor corresponds to this.

In the first embodiment, the first subject image 102 is incident on the first video input processing unit 121, the first video data 103 is acquired, and the second video input processing unit 123 receives the first video data 103. Then, the second object image 104 is incident, and the second video data 105 is acquired. The first video data 103 and the second video data 105 have the same subject viewed from different viewpoints, that is, the lens positions of the first video input processing unit 121 and the second video input processing unit 123, respectively. This is a captured image (still image or moving image). Further, the first video data 103 and the second video data 105 are not necessarily the same subject, and only a part of them may be the same subject. This part of the subject is the same subject as a part of the shooting scene (shooting area). This is equivalent to overlapping the parts.

The first video data 103 and the second video data 105 captured by the first video input processing unit 121 and the second video input processing unit 123 are sent to the AV control buffer processing unit 125, Accumulated there. The AV control buffer processing unit 125 stores the first video data 103 and the second video data 105 captured by the first video input processing unit 121 and the second video input processing unit 123, and the user interface processing unit Based on the operation information output by 165, various processes are performed on the first video data 103 and the second video data 105. The user interface processing unit 165 receives a user operation and outputs the received operation content to the AV control buffer processing unit 125 as operation information. For example, the operation performed by the user includes designation of a codec method such as MPEG2 and H.264, and operation information indicating the codec method designated by the user is also sent to the user interface processing unit 165 to the AV control buffer processing unit 125. It is done. The AV control buffer processing unit 125 executes codec control based on the operation information output by the user interface processing unit 165 with respect to the CODEC processing unit 127.

[0028] For example, assume that the operation information is for performing three-dimensional video recording. At this time, the first video data 103 and the second video data 105 stored in the AV control buffer processing unit 125 are sent to the CODEC processing unit 127. The CODEC processing unit 127 performs a predetermined encoding process on the first video data 103 and the second video data 105. The predetermined encoding process executed here is, for example, a video compression code in a format such as MPEG2, MPEG4, and H.264 when the video data is video data. In the case of still image data, it is still image compression encoding in a format such as JPEG, PNG, GIF and BMP.

The first video data 103 and the second video data 105 that have been subjected to a predetermined encoding process by the CODEC processing unit 127 are sent to the content processing unit 142. The content processing unit 142 performs a streaming process on the first video data 103 and the second video data 105 that have been subjected to the encoding process by the CODEC processing unit 127. The stream processing here is, for example, processing for performing partial 'transport' stream (hereinafter referred to as “partial TS”). Note that, for example, encoding processing is performed on the partial TS here. Audio data that consists of only moving images and still image data, various attribute data that will be described later, management data, and other various content ancillary information may be included. It does not matter. Examples of various content ancillary information will be described in detail later.

For example, the first video data 103 and the second video data 105 that have been converted to a partial TS are output to the media access processing unit 161. The media access processing unit 161 records the first video data 103 and the second video data 105 streamed by the content processing unit 142 on the information recording medium 167. The information recording medium 167 is, for example, a removable card type recording medium using a non-volatile semiconductor memory such as an SD memory card, a removable recording medium using a semiconductor memory backed up by a battery, D Optically removable recording media using VD (digital versatile disc), optically removable recording media using BD (blue ray disc), HDD (hard disk drive) ) Is a magnetic and non-detachable (fixed) recording medium. However, these recording media are merely examples, and any other recording media may be used. In addition, the media access processing unit 161 builds a device system for accessing various recording media as described above, and a file system for building, controlling, and using a file system on these various recording media. Includes system processing unit.

On the other hand, the first video input processing unit 121 and the second video input processing unit 123 are motions representing various states when the first video data 103 and the second video data 105 are acquired. Device information is output to the dynamic device information management unit 129. For example, the dynamic device information indicates the direction in which the first video input processing unit 121 and the second video input processing unit 123 face when the first video data 103 and the second video data 105 are captured. Shooting direction information, device position information indicating the position where the video content recording device exists, lens direction information indicating the directions of the lenses provided in the first video input processing unit 121 and the second video input processing unit 123 Lens position information indicating the position of each lens, and various other information. The lens position information includes position information indicating the position of the lens in the apparatus and the height from the ground to the lens. Each of these pieces of information may be a value expressed with an absolute coordinate axis with the latitude and longitude of the earth as the coordinate axis, or with various other local coordinate axes. It may be a relative value expressed. The dynamic device information is temporarily stored in the dynamic device information management unit 129, and may be selected as necessary. The necessary information is sent to the content-attached information processing unit 144. .

[0032] The content-attached information processing unit 144 executes a process necessary for recording the dynamic device information output by the dynamic device information management unit 129 in the information recording medium 167, for example, in a partial TS. In addition, the dynamic device information may be recorded in the information recording medium 167 separately from the partial TS that is not necessarily included in the partial TS.

The static device information management unit 146 stores and manages various pieces of static device information related to shooting the first video data 103 and the second video data 105 in the video content recording apparatus 100. The static device information includes, for example, the distance between the lenses of the photographing lenses provided in the first video input processing unit 121 and the second video input processing unit 123, the focal length of each lens, the distortion value of each lens, and Includes various other information. The static device information management unit 146 outputs the static device information to the content-attached information processing unit 144. The content ancillary information processing unit 144 executes processing necessary to record the static device information output by the static device information management unit 146 in the information recording medium 167, for example, in a partial TS.

The static device information may be recorded on the information recording medium 167 separately from the partial TS that is not necessarily included in the partial TS. In the embodiment in which the dynamic device information and the static device information are recorded separately from the partial TS, the partial TS, the dynamic device information, and the static device information are recorded on the information recording medium 167 as one file. Or some of these may be recorded on the information recording medium 167 as separate files, or may be recorded on a single directory. It may be an embodiment recorded in a different directory, an embodiment recorded in one information recording medium 167, or another information. The embodiment may be recorded on the recording medium 167.

[0035] In addition, the static device information captures the first video data 103 and the second video data 105. This is various static parameter information related to shadowing and does not change during normal shooting. For this reason, the static device information is not necessarily recorded on the information recording medium 167 at the same time as or simultaneously with the partial TS or dynamic device information, but is recorded on the information recording medium 167 in advance. It may be a form, or an embodiment in which information is recorded on the information recording medium 167 later.

[0036] The dynamic device information and the static device information are also information that associates a video stream included in the video content with a viewpoint when the video stream is captured.

[0037] The dynamic device information and the static device information processed by the content-attached information processing unit 144 are sent to the content processing unit 142. The content processing unit 142 embeds dynamic device information and static device information in the partial TS as a part of the partial TS, or as a separate file without being embedded in the partial TS. Output to processing unit 161. The media access processing unit 161 records the dynamic device information and the static device information in the information recording medium 167 as a part of the partial TS or as a file different from the partial TS. The contents and format of the partial TS recorded on the information recording medium 167 will be described in detail later.

[0038] When the user of the video content recording apparatus 100 performs an operation using the user interface processing unit 165, the menu processing unit 163 displays a menu or a guide for assisting the operation and a process associated therewith. .

FIG. 2 is a diagram showing a video shooting state and a schematic configuration of the information recording medium 167 in the video content recording apparatus 100 according to the first embodiment.

[0040] As described above, the video content recording apparatus 100 includes the two video input processing units, the first video input processing unit 121 and the second video input processing unit 123, and these two video input processing units. The image of the subject 201 is taken by the force processing unit.

[0041] The first video input processing unit 121 and the second video input processing unit 123 are not necessarily two video input processing units. One video input processing unit is moved in time division, that is, moved. However, the embodiment may be used as if the power is two video input processing units! / 映像. In this embodiment, the time information for moving one video input processing unit, that is, the time used as the first video input processing unit 121 and the second video input processing unit 123 are used. It is necessary to record the time used as. This time information is also information that associates each image of the captured video stream with the captured position (viewpoint). In such an embodiment, the inter-lens distance d is not necessarily constant, and the inter-lens distance d can be changed by changing the distance to be moved.

The first video input processing unit 121 includes a lens 221, an image sensor 225, and some parts not shown. The second video input processing unit 123 includes a lens 223, an image sensor 227, and some parts not shown. In the other embodiments, one image sensor is not necessarily provided with two image sensors 225 and 227, and the area of the one image sensor is divided and used. You can do it. The lenses 221 and 223 collect light from the subject 201 and form an image. The image of the subject 201 is formed on the image sensor 225 and the image sensor 227 in this embodiment. The image sensors 225 and 227 convert the image of the subject 201 into an electric signal, and the video content recording apparatus 100 electrically processes and stores the image of the subject 201 converted into the electric signal.

[0043] At this time, since the lens 221 and the lens 223 are arranged with a distance d between the lenses, the video input from the first video input processing unit 121 and the second video input processing unit 123 are arranged. From the video input from, the viewpoint position is different by the distance d and the viewing angle is also different. Therefore, by using these two images, a three-dimensional image of the subject 201 can be reproduced.

[0044] The video content recording apparatus 100 is related to the fact that the first video input processing unit 121 and the second video input processing unit 123 that capture only the distance d between lenses capture an image of the subject 201. Has a lot of parameter information. This parameter information is information specific to the device, and includes parameter data that does not change at each shooting and parameter data that changes at each shooting. This information is unique to this device, and does not change during each shooting V, parameter data is called static device information, and parameter data that changes during each shooting is called dynamic device information.

[0045] The static device information includes, for example, the distance between lenses when video content is shot, the focal length of each lens, the distortion value of each lens, and other information. The dynamic device information includes, for example, 1st video input process when shooting 1 video data 103 and 2nd video data 105 Angle information indicating the direction in which the processing unit 121 and the second video input processing unit 123 are facing, position information indicating the positions of the first video input processing unit 121 and the second video input processing unit 123, Includes angle information indicating the direction of the lens provided in the first video input processing unit 121 and the second video input processing unit 123, position information indicating the position of each lens, and various other information. . However, the static device information and the dynamic device information are not necessarily fixed. For example, the video content recording apparatus 100 has a lens distance d, a lens focal length, a distortion value, and the like. When various parameters related to image capturing can be arbitrarily changed at the time of capturing, the values may be dynamic device information instead of static device information.

[0046] Then, the static device information and the dynamic device information constitute one partial TS together with the video stream, or individually, or some of them together. Others are individually recorded in the information recording media 167 as a single video content.

[0047] The partial TS including the video information of the subject 201 taken by the first video input processing unit 121 and the second video input processing unit 123, the static device information, and the dynamic device information are recorded on an information recording medium. It is recorded in 167.

In the information recording medium 167, a file system having a directory structure as shown in FIG. Note that this file system and directory structure are merely examples of the embodiment, and the present invention is not limited to the configuration of such an embodiment (the other embodiments and their Same for all explanations).

[0049] For example, if the video content obtained by photographing the subject 201 is named content 1, this video content is recorded in the hierarchy below the content 1 folder, and the video data is content 1 video file 1 and content 1 video file. Recorded as 2. The static device information and dynamic device information when this video content is shot are recorded as a content 1 management information file, a content 1 ancillary information file 1 and a content 1 ancillary information file 2. Such file names, file formats, information recording methods, and the like are merely examples of embodiments, and the present invention is not limited to such embodiments. It is not limited.

FIG. 3 is a diagram showing the directory and file structure of the information recording medium 167 in detail. The directory and file structure shown in FIG. 3 is also an example, and the present invention is not limited to such a directory and file structure.

[0051] When the information recording medium 167 is, for example, an SD memory card, the directory and file structure shown in FIG. This SD memory card is also an example, and is not limited to an SD memory card.

[0052] As a folder including the entire SD memory card, for example, there is one folder named ROOT. This ROOT folder corresponds to a directory that covers the entire recording area of one SD memory card. In this embodiment, what is called a folder is a folder structure or folder structure that is not substantially different from what is sometimes called a directory, and what is called a directory structure or directory structure is also sometimes called a directory structure or directory structure. There is virtually no change.

[0053] A media standard folder exists in a hierarchy below the ROOT folder. SD memory capability has a standard that defines its folder structure (directory structure) and file system. There are a method for recording information in accordance with this standard, a method for recording information in a unique method that does not comply with this standard, and a method for recording information. Can be considered.

[0054] The media standard folder indicates that the folders and files in the lower layers comply with the standard of the SD memory card. In Fig. 3, only one media standard folder is shown, but in the hierarchy below the ROOT folder, there are multiple media standard folders and folders that do not conform to multiple SD memory card standards. It does n’t matter.

[0055] In the hierarchy below this media standard folder, for example, there are a management information folder, a content 1 folder, a content 2 folder, a content 3 folder, ..., and a content n folder. Note that these folders do not necessarily exist. In FIG. 3, only the management information folder, the content 1 folder, and the content 2 folder are shown. Such content folders and the like may exist in any number of layers below one media standard folder.

[0056] In the management information folder, information in the entire media standard folder is collectively managed. Management information files and other files are recorded. In this management information file, the number of contents stored in the media standard folder, version information of the media standard, etc. are recorded. Note that all or part of this management information file and other files do not necessarily have to exist in this management information folder, and may or may not exist in other folders. It may exist in the hierarchy immediately below the folder.

[0057] Each content folder stores one content, such as video content and audio content, and multimedia content including both. Usually, one content folder contains one content, and one content folder is contained in one SD memory card. It is not necessarily limited to this, and other formats may be used. .

[0058] For example, there is one content folder, in which a plurality of content files are stored, and there is a separate folder for storing content ancillary information files. This folder contains content ancillary information for all content. The file may be stored. Alternatively, for example, a content folder may exist for each content, each content file may be stored in the content folder, and the content attached information file may be stored in a common folder or a media standard folder. Or, conversely, a content ancillary information folder exists for each content, each content ancillary information file may be stored in the content ancillary information folder, and the content file may be stored in a common folder or a media standard folder. . Alternatively, there may be a content folder that stores several content files and content-attached information files in a group. Alternatively, for example, neither a content folder nor a content attached information folder exists, and a plurality of content files and content attached information files may be stored immediately below the media standard folder. Alternatively, other formats may be used.

[0059] For example, in the case of television broadcasting such as analog terrestrial broadcasting, digital terrestrial broadcasting, and satellite broadcasting, one content corresponds to one program. In addition, in the case of video shot with a video camera, one content is a single shot. Is equivalent to

[0060] As shown in FIG. 3, in this example, for example, in the hierarchy below the content 1 folder, the content 1 management information file, the content 1 auxiliary information file 1, the content 1 video file 1, and the content 1 auxiliary information file 2 and content 1 video file 2 exist.

[0061] The content 1 management information file contains various management information related to content 1, particularly information common to the two video data included in content 1, data representing the relationship between these two video data, and these 2 Data that associates two pieces of video data, for example, all or part of static device information, dynamic device information, and other information representing the relationship between the video input processing units when content 1 is input Out.

[0062] Content 1 video file 1 includes a stream (partial TS) obtained by encoding first video data 103 input from first video input processing unit 121. Content 1 ancillary information file 1 includes This includes static device information and dynamic device information when the first video input processing unit 121 captures the first video data 103.

[0063] The content 1 video file 2 includes a stream (partial TS) obtained by encoding the second video data 105 input from the second video input processing unit 123. The content 1 ancillary information file 2 includes The second video input processing unit 123 includes static device information and dynamic device information when the second video data 105 is captured.

[0064] Each of these files may include information other than these. Each file of content 1 management information file, content 1 ancillary information file 1, content 1 video file 1, content 1 ancillary information file 2, and content 1 video file 2 is actually composed of multiple files. It may be, or in fact, some of these may be organized as a single file.

[0065] As described above, content 1 video file 1 corresponds to a video stream when viewing subject 201 with lens 221 as a viewpoint, and content 1 video file 2 viewed subject 201 with lens 223 as a viewpoint. Corresponds to the video stream of the hour.

[0066] In an embodiment in which there are three or more video input processing units, there must be three or more pairs of content 1 video files and content 1 ancillary information files under the content 1 folder. There is no problem. [0067] Content 2 Honoreda, Content 3 Honoreda,..., And Content n Honoreda have substantially the same configuration except that the content is changed, and illustration and description thereof are omitted.

[0068] Thus, if the information recording medium 167 using an SD memory card is shown as an example, the folder for recording video content and the structure of the file system are defined in the hierarchy below the media standard folder. Therefore, it is possible to propose standardization of the recording format of video content, and to promote the expansion of the distribution of video content. This also leads to the creation of new industrial fields for video content.

[0069] In the directory and file structure shown in FIG. 3, the static device information and the dynamic device information are divided into one file, a content 1 management information file, a content ancillary information file 1, or a content ancillary information file 2. However, the static device information and the dynamic device information are recorded in different files, for example, the static device information is recorded in the content ancillary information file 1 S and the content ancillary information file 2-S. Dynamic device information may be recorded in content ancillary information file 1M and content ancillary information file 2—M.

[0070] Alternatively, static device information may be recorded together in a content 1 management information file, and dynamic device information may be recorded separately in content attached information file 1 and content attached information file 2.

[0071] Alternatively, any number of these forces, for example, a file for recording dynamic device information in which a file for recording static device information and a file for recording dynamic device information may be used as one file A file that records video information can be a single file. A file that records information and a file that records video information can be combined into a single file. It doesn't matter. For example, the embodiment in which the partial TS is created by the content processing unit 144 is an example of an embodiment in which all of these are streamed and recorded as one file (partial TS).

Furthermore, in the directory and file structure shown in FIG. 3, a content 1 management information file and content 1 ancillary information file 1 and content 1 ancillary information file 2 for recording static device information and dynamic device information, Content that records a video stream encoded with the first video data 103 1 Video file 1 and the second video data 105 are encoded The ability to record content 1 video file 2 in the same folder on the same information recording medium 167 even in an embodiment in which some of these are recorded in different folders or different recording media I do not care. Further, in the embodiment in which some are recorded in different folders or different recording media, an embodiment in which management information common to these is recorded in any one folder or recording medium is also possible. However, an embodiment of recording in all folders and recording media is possible, and an embodiment of recording on the video content recording apparatus side is also possible.

[0073] Further, the static device information is information unique to the video content recording apparatus 100 and does not change depending on the state when the subject 201 is photographed. When the 167 was set in the video content recording apparatus 100, the information recording medium 167 was formatted and initialized from when the information recording medium 167 was set to the video content recording apparatus 100 until the subject 201 was shot. The embodiment may be recorded in advance at the time and other free times.

[0074] Alternatively, in the directory and file structure shown in FIG. 3, the content 1 video file 1 for recording the video stream encoded with the first video data 103 and the second video data 105 are encoded. Content that records the recorded video stream 1 Video file 2 is recorded on the information recording medium 167 as a separate file, but these multiple video streams are encoded as one video stream, and one content An embodiment in which the information is recorded on the information recording medium 167 as one video file may be used.

[0075] For example, one image sensor is divided into a plurality of areas, for example, two or more, and an imaging unit centered on a lens is provided for each image sensor in each area, and each has a different viewpoint ( An embodiment in which a plurality of images photographed at the lens position) are formed on a plurality of regions of one image sensor can also be considered. In such an embodiment, since only one image sensor is used, there is only one video stream, and this single video stream includes image information that also looks at multiple viewpoints. . This one video stream, static device information, and dynamic device information may be recorded as separate files in the same folder on the same information recording medium 167, and the same information recording may be performed. Media 16 The embodiment may be recorded in seven different folders, or may be recorded in different information recording media 167.

[0076] Alternatively, some of this one video stream, static device information, and dynamic device information are recorded in one file, and the others are recorded in another file. It may be an embodiment for recording in a folder, an embodiment for recording in a different folder on the same information recording medium 167, or an embodiment for recording on a different information recording medium 167. It may be a form. Alternatively, an embodiment in which all of this one video stream, static device information, and dynamic device information are recorded as one file in one folder of one information recording medium 167 may be possible. .

[0077] In this way, one image sensor is divided into a plurality of regions, and an image forming unit centered on the lens is provided for each image sensor in each region, so that a plurality of images taken from different viewpoints are combined into one image. You may form an image in the several area | region of an image pick-up element. In this case, images with multiple viewpoints shot with one image sensor are divided into video streams with different viewpoints so that one video stream includes images with one viewpoint. To do. In such an embodiment, each video stream includes an image viewed from one viewpoint, and since there are a plurality of such video streams, there are a plurality of video input processing units. Detailed description that does not substantially change will be omitted.

Here, the video content recording process by the video content recording apparatus according to the first embodiment will be described. FIG. 4 is a flowchart for explaining video content recording processing by the video content recording apparatus shown in FIG.

First, in step S1, the static device information management unit 146 reads out static device information stored in advance therein. The static device information management unit 146 outputs the read static device information to the content-attached information processing unit 144.

[0080] As described above, the static device information includes the distance between lenses of the lenses provided in the first video input processing unit 121 and the second video input processing unit 123, the focal length of each lens, and Position information indicating the position of each lens in the video content recording apparatus is included. Since these pieces of information are unique information at the time of shooting with the video content recording device that does not change according to the shooting situation, they are stored in advance in the internal memory of the static device information management unit 146. Yes.

[0081] Next, in step S2, the content-attached information processing unit 144 performs data conversion processing necessary for recording the static device information on the information recording medium 167. In other words, the content-attached information processing unit 144 converts the data structure format of the static device information into a data structure format corresponding to the type of the information recording medium 167. The content ancillary information processing unit 144 outputs the static device information after the data conversion to the content processing unit 142. The content processing unit 142 outputs the static device information to the media access processing unit 161. The media access processing unit 161 records the static device information output by the content processing unit 142 on the information recording medium 167.

Next, in step S 3, the first video input processing unit 121 acquires the first video data obtained by photographing the subject and outputs the first video data to the AV control buffer processing unit 125. Further, the second video input processing unit 123 acquires second video data obtained by photographing the subject from a different viewpoint from that of the first video input processing unit 121 and outputs the second video data to the AV control buffer processing unit 125. Further, the dynamic device information management unit 129 acquires dynamic device information from the first video input processing unit 121 and also acquires dynamic device information from the second video input processing unit 123. The first video input processing unit 121 outputs the dynamic device information to the dynamic device information management unit 129. Also, the second video input processing unit 123 outputs the dynamic device information to the dynamic device information management unit 129. The dynamic device information management unit 129 outputs the acquired dynamic device information to the content-attached information processing unit 144.

[0083] As described above, the dynamic device information includes shooting direction information indicating the direction in which the first video input processing unit 121 and the second video input processing unit 123 are facing, and the first video input processing. Shooting position information indicating the positions of the unit 121 and the second video input processing unit 123, and subject focus information indicating the subject focus are included.

The shooting direction information can be obtained by a gyroscope provided in at least one of the first video input processing unit 121 and the second video input processing unit 123. The shooting position information can be obtained by GPS provided in at least one of the first video input processing unit 121 and the second video input processing unit 123. Note that a video container is provided by providing a GPS in one of the first video input processing unit 121 and the second video input processing unit 123. The position of each video input processing unit can be obtained by providing GPS in both the first video input processing unit 121 and the second video input processing unit 123. Subject focus information can be obtained by triangulation based on the focal length of the lens and the distance between the lenses.

[0085] Note that the shooting position information includes the first video input processing unit 121 and the second video input processing acquired by the three-axis angle measurement of the gyroscope that is acquired only by the position on the earth acquired by GPS. Information indicating the orientation of the unit 123 with respect to the ground axis, and relative movement distance information calculated based on the acceleration sensor and time information may be included. When the video content recording apparatus is used in outer space, the shooting position information may be acquired by a star sensor that grasps the relative position based on the light of the star and its position.

Next, in step S 4, the AV control buffer processing unit 125 temporarily stores the first video data output by the first video input processing unit 121 and performs the second video input processing. The second video data output by the unit 123 is temporarily stored.

Next, in step S 5, the CODEC processing unit 127 encodes the first video data stored in the AV control buffer processing unit 125 and stores it in the AV control buffer processing unit 125. The second video data is encoded. At this time, the CODEC processing unit 127 encodes the first video data and the second video data in the format accepted by the user interface processing unit 165.

[0088] In the present embodiment, the power received by the user interface processing unit 165 in the encoding format is not particularly limited to this, and the first video is in a predetermined format. You can automatically sign the data and the second video data!

[0089] Next, in step S6, the content processing unit 142 streams the first video data encoded by the CODEC processing unit 127, and also encodes the first video data encoded by the CODEC processing unit 127. Stream the second video data.

Next, in step S7, the content-attached information processing unit 144 performs data conversion processing necessary for recording the dynamic device information on the information recording medium 167. In other words, the content-attached information processing unit 144 converts the data structure format of the dynamic device information into a data structure format corresponding to the type of the information recording medium 167. Content ancillary information office The processing unit 144 outputs the converted dynamic device information to the content processing unit 142. The content processing unit 142 outputs the first video stream, the second video stream, and the dynamic device information to the media access processing unit 161. The media access processing unit 161 records the first video stream, the second video stream, and the dynamic device information output by the content processing unit 142 on the information recording medium 167. At this time, the first video stream, the second video stream, the static device information, and the dynamic device information are recorded on the information recording medium 167 as video content.

[0091] The video content recording apparatus 100 described above is an embodiment of the video content recording apparatus according to the present invention. The video content recording method executed by the video content recording apparatus 100 is an embodiment of the video content recording method according to the present invention. The information recording medium 167 is an embodiment of the information recording medium according to the present invention.

[Embodiment 2]

Next, a video content reproduction / editing apparatus according to Embodiment 2 will be described. The video content recording apparatus according to the first embodiment records the video content on the information recording medium. The video content playback / editing apparatus according to the second embodiment is the video content recorded on the information recording medium. Play and edit the.

In Embodiment 2, for example, static device information that is recorded in the information recording medium 167 and is the contents of the content 1 management information file, the content 1 attached information file 1 and the content 1 attached information file 2 The dynamic device information can be read from the information recording medium 167 and changed. The video content playback / editing device then plays back the video content recorded in Content 1 Video File 1 or Content 1 Video File 2 using the newly changed static device information and dynamic device information values. It can be displayed. Also, the video content playback / editing apparatus can record the changed static device information and dynamic device information values in the information recording medium 167 again.

[0094] Static device information and dynamic device information are usually numeric data or text data because of their nature, for example, text format, HTML (hypertext markup language) format, XML (extensible markup language) ) Format or binary format Recorded on information recording media 167. These data are recorded in a binary format using, for example, a word processing software if it is recorded in a text format, and a tool or software such as a browser if it is recorded in an HTML format or XML format. Can be changed using dedicated software for handling the data format, and the changed data can be recorded again.

FIG. 5 is a block diagram showing a configuration of a main part of video content reproduction / editing apparatus 500 according to Embodiment 2. 5 includes a media access processing unit 501, a menu processing unit 503, a user interface processing unit 505, a content attached information processing unit 507, a content processing unit 509, and a video output processing unit 522.

[0096] In video content playback / editing apparatus 500, menu processing section 503 displays a menu screen for guiding the operation of the operator on a menu display section constituted by, for example, a liquid crystal display or a CRT display device. A user interface processing unit 505 controls a menu display unit and an input unit configured by a touch switch, a button switch, or the like. The user interface processing unit 505 receives an operation input from an operator (user) and executes processing contents according to the instruction.

[0097] For example, the content of a user 1 operation information file, content 1 attached information file 1 or content 1 attached information file 2 recorded in the information recording medium 167 is updated (edited). ), The content-attached information processing unit 507 receives the specified content 1 management information file, content 1 attached information file 1 or content 1 attached information from the information recording medium 167 via the media access processing unit 501. Read the contents of file 2. Next, the content-attached information processing unit 507 changes the content using tool software such as word processing software or a browser, or other methods. The content-attached information processing unit 507 records the changed content on the information recording medium 167 via the media access processing unit 501 again.

[0098] For example, the content of the user 1 operation information file, content 1 attached information file 1 or content 1 attached information file 2 recorded on the information recording medium 167 is changed, and Changed content and content If video content 1 and content 1 video file 2 are to be used to display 3D video, content The attached information processing unit 507 reads the contents of the specified content 1 management information file, content 1 attached information file 1 or content 1 attached information file 2 from the information recording medium 167 via the media access processing unit 501. Next, the content ancillary information processing unit 507 changes the content using tool software such as word processing software or a browser, or other methods.

Then, the content-attached information processing unit 507 sends the contents of the changed content 1 management information file, content 1 attached information file 1 or content 1 attached information file 2 to the video output processing unit 522. Further, the content processing unit 509 reads the content 1 video file 1 and the content 1 video file 2 from the information recording medium 167 via the media access processing unit 501. The content processing unit 509 sends the content 1 video file 1 and the content 1 video file 2 read from the information recording medium 167 to the video output processing unit 522.

[0100] The video output processing unit 522 reads the content 1 video file 1 and content 1 video file 2 read from the information recording medium 167, the changed content 1 management information file, content 1 attached information file 1 and content. 1 Attached information file 2 or content before change 1 Management information file, content 1 Attached information file 1 and content 1 Attached information file 2 Execute.

[0101] Based on two video streams corresponding to the video stream viewed with the right eye and the video stream viewed with the left eye, and two attached information corresponding to the position and angle of the right eye and the left eye, etc. The content of the image processing necessary for displaying the three-dimensional image on the body image display unit 524 varies depending on the principle of the stereoscopic image display unit 524.

[0102] The principle and method of displaying images in three dimensions from two video streams and their associated information are as follows: Anaglyph (rear-colored three-dimensional) method, volatilizer (polarization) method, Norralux Noria System, Integral Photography System, Lenticular System, Norwegical Mirror System, Auto Stereogram System, Chroma Depth (Spectral Parallax) System, RDS Type Stereogram System, WTD System (Home TV), CID Method, Brightness Ratio Multiplex Display A lot of things such as a system, a phantomgram (flat display) system, and a thin-film hologram memory system Has been known historically, and has been published in recent years.

[0103] The content of the image processing executed in the video output processing unit 522 to display the video three-dimensionally from the two video streams and their attached information and to view them corresponds to these various principles' methods. And it is various.

[0104] The following is a principle that does not depend on the principle for displaying these three-dimensional stereoscopic images. It is a three-dimensional stereoscopic image that can be seen when the attached information corresponding to the positions and angles of the right and left eyes is changed. The state of change will be described. This is shown schematically. FIG. 6 is a diagram schematically showing an example in which the distance between lenses is taken as an example of static device information and dynamic device information, and video content is reproduced by changing the distance between lenses.

FIG. 6 (A) is a schematic diagram showing a state when the subject 401 is photographed by the video content recording apparatus 100, and FIG. 6 (B) shows that the video content is reproduced by changing the distance between the lenses. It is a schematic diagram which shows the state of time.

FIGS. 6 (A) and 6 (B) show a state when the image is taken and a state when the image is reproduced as viewed from above. The subject 401 is, for example, a quadrangular prism whose bottom surface is a square. In FIG. 6A, the video power obtained by photographing the subject 401 is input to the first video input processing unit 121 and the second video input processing unit 123 of the video content recording apparatus 100. The input images are a first subject image 102 and a second subject image 104, respectively. The image power taken by the first video input processing unit 121 and the second video input processing unit 123 corresponds to the first video 421 and the second video 423.

[0107] The first video input processing unit 121 corresponds to, for example, the left eye, and the second video input processing unit 123 corresponds to, for example, the right eye. It is assumed that the distance between lenses at this time was dl. This distance between lenses is recorded on the information recording medium 167 by the static device information management unit 146, for example. The file in which the distance between the lenses is recorded is, for example, a content 1 management information file, a content 1 attached information file 1 or a content 1 attached information file 2. Alternatively, the inter-lens distance may be recorded in some other file by the dynamic device information management unit 129, and is stored in the content 1 management information file, content 1 attached information file 1 or content 1 attached information file 2. It can be recorded, or it can be recorded in the same file as the video stream! /. [0108] As described above, the static device information and dynamic device information recorded in the content 1 management information file, content 1 ancillary information file 1 or content 1 ancillary information file 2 can be changed and updated. . Therefore, in the second embodiment, for example, it is assumed that the distance between lenses is changed to dl force as well. Also assume that dl <d2 as an example.

[0109] Content 1 video file 1 and content 1 video file 2 recorded on information recording medium 167, changed content 1 management information file, content 1 ancillary information file 1 and content 1 ancillary information file 2 is used to assume that the first video data 103 and the second video data 105 have been reproduced. The state at this time is shown in Fig. 6 (B).

[0110] Since the video stream data used for playback is the content 1 video file 1 and content 1 video file 2 recorded and recorded as they are, for example, the first video 421 and the second video 423 at the time of shooting are used. Is used for playback without change.

[0111] Since only the inter-lens distance dl is changed to the inter-lens distance d2, the reproduction process is executed on the assumption of the inter-lens distance d2. It is assumed that other parameters have not been changed. Thus, the virtual subject 431 reproduced is reproduced as a quadrangular prism having a shape different from that of the actually photographed subject 401, for example, a bottom surface thereof having a diamond shape.

[0112] Here, only one example of changing the inter-lens distance is shown, but when changing other static device information and dynamic device information, the content 1 management information file, content 1 Change the static device information and dynamic device information recorded in Attached Information File 1 or Contents 1 Attached Information File 2 to create 3D images based on Content 1 Video File 1 and Content 1 Video File 2. It is possible to play. In addition, the static device information and dynamic device information recorded in the content 1 management information file, content 1 attached information file 1 or content 1 attached information file 2 can be changed and recorded (updated) again. It is. As a result, video content different from the original video content or video content with editing and deformation can be reproduced and displayed, and the user can view these video content.

[0113] Furthermore, here, the static device information and the dynamic device recorded in the content 1 management information file, the content 1 attached information file 1 or the content 1 attached information file 2 Power that only shows an example of changing information For example, using static device information and dynamic device information for video information recorded and saved in content 1 video file 1 and content 1 video file 2. By performing interpolative calculation or predictive calculation, it is possible to generate video information based on the viewpoint power between the two captured viewpoints, or from the outer viewpoint between the two captured viewpoints. It is also possible to generate video information. In this way, an embodiment is also provided in which video information is generated by calculation as if a visual power different from the actually shot viewpoint was shot, and 3D video is generated using this video information. Is possible.

Here, the video content playback processing by the video content playback editing apparatus according to the second embodiment will be described. FIG. 7 is a flowchart for explaining video content playback processing by the video content playback editing apparatus shown in FIG.

[0115] First, in step S21, the content-attached information processing unit 507 records the dynamic device information and static device information (content-attached information) recorded in the information recording medium 167 with respect to the media access processing unit 501. Is to be read. At this time, the content-attached information processing unit 507 designates the dynamic device information and static device information associated with the video content to be reproduced. The media access processing unit 501 reads the specified dynamic device information and static device information from the information recording medium 167 and outputs the information to the content-attached information processing unit 507. The content-attached information processing unit 507 outputs the dynamic device information and the static device information output by the media access processing unit 501 to the video output processing unit 522.

[0116] Next, in step S22, the content processing unit 509 instructs the media access processing unit 501 to read the first video stream recorded on the information recording medium 167. At this time, the content processing unit 509 designates the first video stream associated with the video content to be reproduced. The media access processing unit 501 reads the designated first video stream from the information recording medium 167 and outputs it to the content processing unit 509. The content processing unit 509 outputs the first video stream output by the media access processing unit 501 to the video output processing unit 522.

[0117] Next, in step S23, the content processing unit 509 reads out the second video stream recorded on the information recording medium 167 from the media access processing unit 501. To instruct. At this time, the content processing unit 509 designates the second video stream associated with the video content to be reproduced. The media access processing unit 501 reads the designated second video stream from the information recording medium 167 and outputs it to the content processing unit 509. The content processing unit 509 outputs the second video stream output by the media access processing unit 501 to the video output processing unit 522.

[0118] Next, in step S24, the video output processing unit 522, the first video stream output by the content processing unit 509, the second video stream output by the content processing unit 509, and the content A three-dimensional stereoscopic image is created using the dynamic device information and static device information output by the attached information processing unit 507. For example, the video output processing unit 522 creates a three-dimensional stereoscopic image in which a first video stream and a second video stream are shifted according to the distance between lenses.

[0119] Next, in step S25, the video output processing unit 522 outputs the created three-dimensional stereoscopic image to the stereoscopic image display unit 524. The stereoscopic image display unit 524 displays the 3D stereoscopic image created by the video output processing unit 522.

[0120] Next, video content editing / playback processing in which video content is edited and played back by the video content playback / editing apparatus according to Embodiment 2 will be described. Figure 8 shows the video content editing / playback process using the video content playback / editing device shown in Figure 5! It is a flowchart for urgent explanation.

[0121] First, in step S31, the content-attached information processing unit 507 records the dynamic device information and static device information (content-attached information) recorded on the information recording medium 167 with respect to the media access processing unit 501. Is to be read. At this time, the content-attached information processing unit 507 designates the dynamic device information and static device information associated with the video content to be reproduced. The media access processing unit 501 reads the specified dynamic device information and static device information from the information recording medium 167 and outputs the information to the content-attached information processing unit 507.

[0122] Next, in step S32, the user interface processing unit 505 includes the information to be changed and the change including the change contents among the dynamic device information and the static device information output by the media access processing unit 501. Accept instructions. User interface processor 505 outputs the received change instruction to content-attached information processing unit 507.

[0123] Next, in step S33, the content-attached information processing unit 507 changes the dynamic device information and the static device information based on the change instruction output by the user interface processing unit 505. That is, the content-attached information processing unit 507 changes the contents of the dynamic device information and the static device information to the contents according to the change instruction. The content ancillary information processing unit 507 outputs the dynamic device information and the static device information whose contents have been changed to the video output processing unit 522.

[0124] Next, in step S34, the content-attached information processing unit 507 outputs the changed dynamic device information and static device information to the media access processing unit 161. The media access processing unit 161 records the dynamic device information and the static device information output by the content attached information processing unit 507 on the information recording medium 167.

[0125] The processing in step S35 and step S36 is the same as the processing in step S22 and step S23 shown in FIG.

[0126] Next, in step S37, the video output processing unit 522, the first video stream output by the content processing unit 509, the second video stream output by the content processing unit 509, and the content A three-dimensional stereoscopic image is created using the dynamic device information and static device information changed by the attached information processing unit 507. For example, when the lens focal length corresponding to the first video stream and the lens focal length corresponding to the second video stream are changed, the video output processing unit 522 performs blurring according to the changed lens focal length. Create a 3D stereoscopic image.

[0127] Next, in step S38, the video output processing unit 522 outputs the created three-dimensional stereoscopic image to the stereoscopic image display unit 524. The stereoscopic image display unit 524 displays the 3D stereoscopic image created by the video output processing unit 522.

As described above, the video content playback / editing apparatus 500 is an embodiment of the video content playback apparatus according to the present invention. The video content playback method and video content editing method executed by the video content playback / editing apparatus 500 are one embodiment of the video content playback method and video content editing method according to the present invention.

[0129] Note that at least one of the first video input processing unit 121 and the second video input processing unit 123 is used. The shooting direction information can be obtained with the gyroscope provided on the other side, but this gyroscope is provided for camera shake correction and can be used with a gyroscope. The video content recording apparatus and the video content playback / editing apparatus may further include a camera shake correction execution unit that performs camera shake correction and a switching unit that switches on and off the camera shake correction function. In this case, the video content recording apparatus records video data with the camera shake correction function turned off, and the video content playback / editing apparatus plays with the camera shake correction function turned on. By recording video data with the image stabilization function turned off, it is possible to record the natural information that the video is shaking during an earthquake or when shooting on a vehicle. Further, at the time of playback, the camera shake correction function may be turned off and this information may be played back as it is, or the camera shake correction function may be turned on and the camera shake may be corrected and played back.

[0130] Further, in the present embodiment, information to be changed among dynamic device information and static device information and a change instruction including the change contents are received, and dynamic device information and static device are received based on the change instruction. The ability to change information and record the changed dynamic device information and static device information in the media access processing unit 161 The present invention is not particularly limited to this. The process of step S34 shown in FIG. 8 is omitted, and the first and second video streams are recorded without recording the changed dynamic device information and static device information in the media access processing unit 161. Then, a three-dimensional stereoscopic image may be created using the changed dynamic device information and static device information. In this case, the recorded contents of the media access processing unit 161 are not changed, the dynamic device information and the static device information are changed only during playback, and the changed dynamic device information and static device information are used. A dimensional image is displayed.

[0131] (Embodiment 3)

Next, a video content recording apparatus according to Embodiment 3 will be described.

FIG. 9 is a block diagram showing a schematic configuration of a video content recording apparatus 600 according to the third embodiment of the present invention. The video content recording apparatus 600 according to the third embodiment of the present invention is the same as the video content recording apparatus 100 according to the first embodiment of the present invention since many parts thereof are the same as those in the first embodiment of the present invention. The description of the same parts as those in FIG. 1 will be omitted, and only the parts different from the first embodiment will be described.

[0133] The video content recording apparatus 100 according to the first embodiment of the present invention includes a video input processing unit. Has 2 (or more). However, the video content recording apparatus 600 according to the third embodiment of the present invention has only one video input processing unit 621 and does not have any more video input processing units. Instead, it has a drive unit 622 that moves the single video input processing unit 621. This is the most different feature between the video content recording apparatus 600 according to the third embodiment of the present invention and the video content recording apparatus 100 according to the first embodiment of the present invention. For the drive unit 622, various well-known methods such as a method of mounting the video input processing unit 621 on the belt and a method of using a spring and a cam can be used.

FIG. 10 is a schematic diagram for explaining the video content recording apparatus according to the third embodiment. In FIG. 10, a first position 651 represents a position before the video input processing unit 621 has moved, and a second position 652 represents a position after the video input processing unit 621 has moved. The distance traveled from the first position 651 to the second position 652 is represented by d2. The moving distance d2 corresponds to the distance between lenses.

[0135] The video input processing unit 621 includes a lens 641 and an image sensor 625, which are substantially the same as in the first embodiment of the present invention.

At the first position (position before moving) 651 shown in FIG. 10, the video input processing unit 621 receives the subject image 602 from the subject 601 with the lens 641 and connects the image to the image sensor 625. Image. This image is substantially the same as the image photographed by the first video input processing unit 121 in the video content recording apparatus 100 according to Embodiment 1. In addition, this image is electrically recorded, for example, on the information recording medium 167, as with the video content recording apparatus 100 according to the first embodiment of the present invention. Since the recording method and format are substantially the same as those of the video content recording apparatus 100 according to the first embodiment of the present invention, the description thereof is omitted.

Next, the drive unit 622 moves the video input processing unit 621 to the second position (position after the movement) 652. Then, at the second position 652, the video input processing unit 621 receives the subject image 604 of the subject 601 force by the lens 641 at the second position 652, and receives the image at the second position (movement). The image is formed on the image sensor 625 at the position after This image is displayed in the second video input process in the video content recording apparatus 100 according to the first embodiment of the present invention. This is substantially the same as the image photographed by the physical unit 123.

This image is also electrically recorded, for example, on the information recording medium 167, like the video content recording apparatus 100 according to the first embodiment of the present invention. Since the recording method and format are substantially the same as those of the video content recording apparatus 100 according to the first embodiment of the present invention, the description thereof is omitted.

That is, video content recording apparatus 100 according to Embodiment 1 of the present invention has two (or two or more) video input processing units, and two (or two or more) in parallel. Images taken from the viewpoint are taken and recorded in parallel on, for example, the information recording medium 167. However, the video content recording apparatus 600 according to the third embodiment of the present invention has only one video input processing unit, and two (or two or more) video input processing units. ) Shoot the video viewed from two (or more) viewpoints in a time-sharing manner. The video viewed from these two (or more) viewpoints is recorded on, for example, the information recording medium 167, and the recording method is the same as that of the video content recording apparatus 100 according to the first embodiment of the present invention. It is.

[0140] If necessary, the shooting at the first position and the shooting at the second position are repeatedly executed, and the video information shot at each position is set as a separate video stream or one video stream. For example, it is recorded on the information recording medium 167 as a video stream.

[0141] The movement distance d2, the time required for movement, the time information photographed at the first position, the time information photographed at the second position, and the like as management information, for example, the content 1 management information file content. 1 Attached information file 1 Nya contents 1 Attached information file 2 is recorded and saved.

[0142] And when playing back these video information, it is as if the video was shot from two (or more) viewpoints in a time-sharing manner and obtained at the same time from multiple viewpoints. In addition, it can be played back as 3D video.

[0143] As described above, in the video content recording apparatus 600 according to the third embodiment of the present invention, this single video input processing unit is moved even though it has only one video input processing unit. As a result, it is possible to shoot video information viewed from multiple viewpoints, record the video information, read the video information, and play back 3D video. Here, the video content recording process by the video content recording apparatus according to the third embodiment will be described. FIG. 11 is a flowchart for explaining video content recording processing by the video content recording apparatus shown in FIG.

[0145] First, in step S41, the static device information management unit 146 reads out static device information stored in advance therein. The static device information management unit 146 outputs the read static device information to the content-attached information processing unit 144.

[0146] Next, in step S42, the content-attached information processing unit 144 performs data conversion processing necessary for recording the static device information on the information recording medium 167. The content-attached information processing unit 144 outputs the static device information obtained by data conversion to the content processing unit 142. The content processing unit 142 outputs the static device information to the media access processing unit 161. The media access processing unit 161 records the static device information output by the content processing unit 142 on the information recording medium 167.

Next, in step S 43, the video input processing unit 621 acquires first video data obtained by photographing the subject at the first position, and outputs the first video data to the AV control buffer processing unit 125. The dynamic device information management unit 129 acquires dynamic device information from the video input processing unit 621. The video input processing unit 621 outputs the dynamic device information at the time of shooting at the first position to the dynamic device information management unit 129. The dynamic device information management unit 129 outputs the acquired dynamic device information to the content-attached information processing unit 144.

[0148] As described above, the dynamic device information further includes time information at the time of shooting at the first position. The video input processing unit 621 includes a timer, a clock, or an oscillator. The video input processing unit 621 outputs the shooting start time and the shooting end time as time information for a moving image, and outputs the shooting time as time information for a still image.

[0149] Next, in step S44, the AV control buffer processing unit 125 temporarily stores the first video data output by the video input processing unit 621. Next, in step S45, the CODEC processing unit 127 encodes the first video data stored in the AV control buffer processing unit 125. Next, in step S46, the content processing unit 142 streams the first video data encoded by the CODEC processing unit 127.

[0150] Next, in step S47, the content-attached information processing unit 144 is moved to the first position. The dynamic device information acquired in this way is subjected to data conversion processing necessary for recording on the information recording medium 167. The content-attached information processing unit 144 outputs the data-converted dynamic device information to the content processing unit 142. The content processing unit 142 outputs the first video stream and the dynamic device information to the media access processing unit 161. The media access processing unit 161 records the first video stream and dynamic device information output by the content processing unit 142 on the information recording medium 167.

[0151] Next, in step S48, the drive unit 622 moves the video input processing unit 621 to a second position different from the first position. The first position corresponds to the position of the human right eye, and the second position corresponds to the position of the human left eye. Therefore, the movement distance is the same as the distance between the human eyes. In addition, by setting the distance between both eyes of a specific user who views 3D video as the movement distance in advance, 3D video suitable for the user can be played back.

[0152] Next, in step S49, the video input processing unit 621 acquires second video data obtained by photographing the subject at the second position, and outputs the second video data to the AV control buffer processing unit 125. The dynamic device information management unit 129 acquires dynamic device information from the video input processing unit 621. The video input processing unit 621 outputs the dynamic device information at the time of shooting at the second position to the dynamic device information management unit 129. The dynamic device information management unit 129 outputs the acquired dynamic device information to the content-attached information processing unit 144.

[0153] The dynamic device information further includes time information at the time of shooting at the second position.

In this embodiment, the shooting start time, the shooting end time, and the shooting time at the first position and the second position are used as time information, but the shooting start time and the second time at the first position are used. The difference value between the shooting start time at the position and the difference value between the shooting time at the first position and the shooting time at the second position may be used as time information.

[0154] Next, in step S50, the AV control buffer processing unit 125 temporarily stores the second video data output by the video input processing unit 621. Next, in step S51, the CODEC processing unit 127 encodes the second video data stored in the AV control buffer processing unit 125. Next, in step S52, the content processing unit 142 streams the second video data encoded by the CODEC processing unit 127. [0155] Next, in step S53, the content-attached information processing unit 144 is necessary to record the dynamic device information acquired at the second position V on the information recording medium 167. Perform data conversion processing. The content-attached information processing unit 144 outputs the data-converted dynamic device information to the content processing unit 142. The content processing unit 142 outputs the second video stream and the dynamic device information to the media access processing unit 161. The media access processing unit 161 records the second video stream and dynamic device information output by the content processing unit 142 on the information recording medium 167. At this time, the first video stream, the second video stream, static device information, and dynamic device information are recorded on the information recording medium 167 as video content.

[0156] It should be noted that in Embodiment 3, a force that moves one video input processing unit to the first position force second position in the video content recording apparatus is an image including one video input processing unit. The content recording apparatus may be moved to the first position force and the second position. In this case, the moving distance of the video content recording device is recorded as dynamic device information.

[0157] (Embodiment 4)

Since many parts of the video content recording apparatus according to the fourth embodiment of the present invention are the same as the video content recording apparatus 100 according to the first embodiment of the present invention, the video content recording apparatus according to the first embodiment of the present invention and Explanation of similar parts is omitted, and only different parts from the first embodiment are explained.

FIG. 12 is a block diagram showing a configuration of main parts of video content recording apparatus 700 according to Embodiment 4. The configuration of the video content recording apparatus 700 according to the fourth embodiment is the same as the configuration of the video content recording apparatus 100 according to the first embodiment, except that the video content recording apparatus 700 includes one video input processing unit 721. Therefore, explanation is omitted.

[0159] The video input processing unit 721 includes a plurality of lenses and a single imaging device, and subject images 711-716 are incident on the plurality of lenses, and the subject images 711 to 716 are connected to the imaging devices. Imaged. The video input processing unit 721 acquires one video data 717 including a plurality of videos taken from a plurality of viewpoints.

FIG. 13 is a diagram showing a schematic configuration of the video input processing unit of the video content recording apparatus according to the fourth embodiment of the present invention. In Embodiment 4 of the present invention, for simplicity, the video content is The entire tenth recording device and the entire video input processing unit are not shown, but instead, an outline of a more detailed configuration of the compound eye lens 741 that is the greatest feature of the embodiment 4 of the present invention, and imaging by the compound eye lens 741. An outline of the state of an image formed on the element 725 is shown.

[0161] The video content recording apparatus 100 according to the first embodiment of the present invention has two (or two or more) video input processing units. In addition, the video content recording apparatus 600 according to the third embodiment of the present invention has only one video input processing unit, but it is located at two (or two or more) positions in a time division manner. Moving and shooting. However, the video content recording apparatus 700 according to the fourth embodiment of the present invention has only one video input processing unit and does not move it. On the other hand, a compound eye lens 741 in which a plurality of these single lenses are arranged in a plane is used instead of a convex lens and a concave lens that are usually used as lenses. This is because the video content recording apparatus according to the fourth embodiment of the present invention is compared with the video content recording apparatus 100 according to the first embodiment of the present invention and the video content recording apparatus 600 according to the third embodiment of the present invention. It is the most different feature.

The video input processing unit 721 shown in FIG. 13 includes a compound eye lens 741 and an image sensor 725. In FIG. 13, only six microlenses 751, microlens 752, microlens 753, microlens 754, microlens 755, and microlens 756 are depicted as the microlenses constituting the compound-eye lens 741. Are shown as if they were arranged in a row. However, the compound eye lens 741 shown in FIG. 13 is an example, and more or less fine lenses may be arranged in a row or in a plane. In addition, each microlens is illustrated with a force that only one convex lens is configured. This is an example for simplification, and each microlens is composed of a plurality of convex lenses, concave lenses, aspheric lenses, and other lenses. It may be configured by combining various lenses.

[0163] With these six microlenses, six images of the subject 701 are formed on the image sensor 725, and an image 771, an image 772, an image 773, an image 774, an image 775, and an image 776 are formed, respectively. .

[0164] This subject photography method is a method used in the integral photography method known as the 3D stereoscopic image display method without glasses. In the integral photography method, an inverted image is distributed with a refractive index distribution. Conversion to an upright image using a lens or other technique is performed. However, in the fourth embodiment of the present invention, the inverted image is electrically upright. Since it can be converted into an image, it is not always necessary to convert it into an upright image by an optical method.

[0165] Video information captured by the compound eye lens 741 and the image sensor 725 is electrically recorded, for example, on the information recording medium 167, as in the video content recording apparatus 100 according to the first embodiment of the present invention. . Since the recording method and format are substantially the same as those of the video content recording apparatus 100 according to the first embodiment of the present invention, the description thereof is omitted.

[0166] All or part of the video information captured by these six micro lenses may be recorded on the information recording medium 167 as separate video streams, or as a single video stream. For example, it may be recorded on the information recording medium 167! /.

[0167] In addition, various types of information regarding the shooting of the video stream, for example, the position, direction, interval, focal length, and other information of each microlens are management information such as a content 1 management information file and a content 1 ancillary information file. 1 or content 1 Recorded in attached information file 2. These content 1 management information file, content 1 ancillary information file 1 or content 1 ancillary information file 2 are also recorded on the information recording medium 167 together with the video stream or individually.

[0168] Then, the video content playback / editing apparatus can read out the video information and the attached information from the information recording medium 167 and play back the three-dimensional video.

[0169] For example, in the integral photography system, a plurality of images formed on the image sensor 725 and recorded on the information recording medium 167 are read as they are, and each inverted image is electrically converted to an upright image. For example, when the image is displayed on a liquid crystal display device and the displayed image is viewed again through a lens having the same structure as the compound eye lens 741, a three-dimensional stereoscopic image can be reproduced without glasses.

[0170] Here, a video content recording process by the video content recording apparatus according to the fourth embodiment will be described. FIG. 14 is a flowchart for explaining video content recording processing by the video content recording apparatus shown in FIG.

[0171] First, in step S61, the static device information management unit 146 reads out static device information stored in advance therein. The static device information management unit 146 outputs the read static device information to the content-attached information processing unit 144. [0172] As described above, the imaging element is divided into a plurality of regions, and subject images taken from different viewpoints are formed in the respective regions. In this case, the static device information includes the position of the area corresponding to each lens in the image sensor, area information indicating the area into which the image sensor is divided, and the number of area divisions of the image sensor. included. When playing back 3D video, based on this information, the first video data and the second video data are also cut out and the 3D video is created.

[0173] It should be noted that one video data force at the time of reproduction is not cut out, and a plurality of video data may be cut out from one video data camera at the time of recording. In this case, the content processing unit 142 refers to the static device information, and the video data force encoded by the CODEC processing unit 127 also cuts out the first video data and the second video data, and erects the image data. Is converted to a stream.

[0174] Next, in step S62, the content-attached information processing unit 144 performs data conversion processing necessary for recording the static device information on the information recording medium 167. The content-attached information processing unit 144 outputs the static device information obtained by data conversion to the content processing unit 142. The content processing unit 142 outputs the static device information to the media access processing unit 161. The media access processing unit 161 records the static device information output by the content processing unit 142 on the information recording medium 167.

Next, in step S 63, the video input processing unit 721 acquires video data obtained by photographing the subject from a plurality of viewpoints, and outputs the video data to the AV control buffer processing unit 125. The dynamic device information management unit 129 acquires dynamic device information from the video input processing unit 721. The video input processing unit 721 outputs the dynamic device information to the dynamic device information management unit 129.

[0176] Next, in step S64, the AV control buffer processing unit 125 temporarily stores the video data output by the video input processing unit 721. Next, in step S65, the CODEC processing unit 127 encodes the video data stored in the AV control buffer processing unit 125. Next, in step S66, the content processing unit 142 streams the video data encoded by the CODEC processing unit 127.

[0177] Next, in step S67, the content-attached information processing unit 144 performs data conversion processing necessary for recording the dynamic device information on the information recording medium 167. Con The number-attached information processing unit 144 outputs the dynamic device information obtained by data conversion to the content processing unit 142. The content processing unit 142 outputs the video stream and the dynamic device information to the media access processing unit 161. The media access processing unit 161 records the video stream and dynamic device information output by the content processing unit 142 on the information recording medium 167. At this time, a video stream, static device information, and dynamic device information are recorded on the information recording medium 167 as video content.

[0178] In the fourth embodiment, the static device information may include lens size information indicating the size of the lens. The lens size information is information indicating the lens diameter and thickness of each lens. For example, when multiple lenses are arranged in the central part and the outer part of the light incident range, the brightness of the video data changes according to the size of the lens arranged in the central part and the lens arranged in the outer part. . The incident light range is a range of light incident on a compound eye lens composed of a plurality of lenses. If the size of the lens placed in the center part is larger than the size of the lens placed in the outside part, the image data will not become white. If it is smaller than the size, the video data is less likely to be dark. Image quality can be improved by using this lens size information for brightness correction during playback.

[0179] Also, the video content recording apparatus may record lens arrangement information representing how a plurality of lenses are arranged as static device information. In this case, the video content playback / editing device accepts selection of video data shot by a predetermined lens among a plurality of lenses, and plays back 3D video using the video data shot by the selected lens. To do. Further, when the video content playback / editing apparatus is a projector, playback can be performed with the same lens arrangement as during recording.

[0180] (Embodiment 5)

Next, a video content editing apparatus according to Embodiment 5 will be described. The video content playback / editing apparatus according to Embodiment 2 plays back the 3D video after editing the video content recorded on the information recording medium, but the video content according to Embodiment 5 The content editing device only edits video content recorded on information recording media. FIG. 15 is a block diagram showing the configuration of the main part of video content editing apparatus 800 according to Embodiment 5. A video content editing apparatus 800 shown in FIG. 15 includes a media access processing unit 801, a menu processing unit 803, a user interface processing unit 805, and a content-attached information processing unit 807. The configuration of video content editing apparatus 800 in the fifth embodiment is almost the same as the configuration of video content reproduction / editing apparatus 500 in the second embodiment, and thus detailed description thereof is omitted.

[0182] The information recording medium 167 acquires at least one video data obtained by shooting a plurality of different viewpoints of the subject, static device information that is unique to the video content recording device, and video data. Dynamic device information, which is information that changes according to the situation, is recorded as video content.

The user interface processing unit 805 specifies one or both of static device information and dynamic device information, and accepts a change instruction for changing the contents. The media access processing unit 501 reads out one or both of static device information and dynamic device information corresponding to the change instruction received by the user interface processing unit 805 from the information recording medium 167.

[0184] The content-attached information processing unit 807 changes the contents of one or both of the static device information and the dynamic device information read by the media access processing unit 501 in accordance with the change instruction. The content-attached information processing unit 807 records either or both of the changed static device information and dynamic device information on the information recording medium 167.

[0185] Next, video content editing processing for editing video content by the video content editing apparatus according to the fifth embodiment will be described. FIG. 16 is a flowchart for explaining video content editing processing by the video content editing apparatus shown in FIG.

[0186] First, in step S71, the user interface processing unit 505 issues a change instruction including information to be changed and the change contents among the dynamic device information and static device information recorded in the information recording medium 167. Accept. The user interface processing unit 505 outputs the received change instruction to the content-attached information processing unit 507. [0187] Next, in step S72, the content-attached information processing unit 807 instructs the media access processing unit 801 to read out the dynamic device information and static device information specified by the user interface processing unit 505. To do. The media access processing unit 801 reads the specified dynamic device information and static device information from the information recording medium 167 and outputs them to the content-attached information processing unit 807.

[0188] Next, in step S73, the content-attached information processing unit 507 changes the dynamic device information and the static device information based on the content of the change instruction output by the user interface processing unit 505. To do. That is, the content-attached information processing unit 507 changes the contents of the dynamic device information and the static device information to the contents according to the change instruction. The content-attached information processing unit 507 outputs the dynamic device information and the static device information whose contents have been changed to the media access processing unit 801.

Next, in step S 74, the media access processing unit 801 records the dynamic device information and the static device information output by the content attached information processing unit 807 in the information recording medium 167.

[0190] According to the present invention, it can be used not only as a recorded video but also as a 3D video (moving image 'still image) as an original video for a photo frame, and in combination with a 3D display device, It is possible to obtain and store information unique to 3D beyond the viewpoint of Such information acquisition and storage can also be applied to a robot.

[0191] In addition, it can also be used as a visual sensor for corner ranging of automobiles, etc. It can also be used for staircase perception for visually impaired people, and it can also be used for monitoring to ensure security. Can do.

[0192] Furthermore, in the use of medical microscope images, etc., in the conventional visual inspection of the chromosome (fluorescence confirmation), etc., conventionally, since the two-dimensional display was seen, Judgment was difficult. According to the present invention, the viewing angle can be changed to various viewpoints, and another angle force can avoid the overlap of cells and check the inside, so that it greatly contributes to the improvement of inspection accuracy. Is possible.

[0193] The specific embodiments described above mainly include inventions having the following configurations. [0194] A video content recording apparatus according to an aspect of the present invention is a video content recording apparatus that records video content on an information recording medium, and has at least one video data obtained by photographing a subject with a plurality of different viewpoint powers. A video data acquisition unit to acquire, a static parameter information acquisition unit to acquire static parameter information, which is information unique to the video content recording device, and information that changes according to the situation when the video data is acquired. Dynamic parameter information acquisition unit that acquires dynamic parameter information that is information, the at least one video data acquired by the video data acquisition unit, and acquired by the static parameter information acquisition unit Associating the static parameter information with the dynamic parameter information acquired by the dynamic parameter information acquisition unit And a recording section for recording on the information recording medium as the image co Nten'.

[0195] A video content recording method according to another aspect of the present invention is a video content recording method for recording video content on an information recording medium, and includes at least one video data obtained by photographing a subject with a plurality of different viewpoint powers. A video data acquisition step to acquire, a static parameter information acquisition step to acquire static parameter information, which is information unique to the video content recording device, and information that changes depending on the situation when the video data is acquired The dynamic parameter information acquisition step for acquiring dynamic parameter information, the at least one video data acquired in the video data acquisition step, and the static parameter information acquisition step Static parameter information and acquired in the dynamic parameter information acquisition step. A recording step of associating the dynamic parameter information and recording the information as the video content on the information recording medium.

[0196] A video content recording program according to another aspect of the present invention is a video content recording program for recording video content on an information recording medium, and is photographed from a plurality of different viewpoints. A video data acquisition unit that acquires at least one video data, a static parameter information acquisition unit that acquires static parameter information that is information unique to the video content recording device, and a situation when the video data is acquired A dynamic parameter information acquisition unit that acquires dynamic parameter information that is information that changes in accordance with the at least one video data acquired by the video data acquisition unit And the static parameter information acquired by the static parameter information acquisition unit and the dynamic parameter information acquired by the dynamic parameter information acquisition unit in association with the information recording medium as the video content Makes the computer function as a recording unit for recording in

[0197] According to these configurations, a subject is photographed from a plurality of different viewpoints, and at least one video data is acquired. Then, static parameter information that is information unique to the video content recording apparatus is acquired, and dynamic parameter information that is information that changes according to the situation when the video data is acquired is acquired. Thereafter, the acquired at least one video data, the acquired static parameter information, and the acquired dynamic parameter information are associated with each other and recorded on the information recording medium as video content.

[0198] Therefore, depending on at least one video data obtained by photographing a plurality of different viewpoints of the subject, static parameter information that is unique to the video content recording device, and the situation when the video data is acquired Dynamic parameter information, which is information that changes, is recorded on the information recording medium as video content, so that it can be displayed in 3D using static parameter information and dynamic parameter information. Video data can be covered, and it can be used universally for devices that can display various 3D video content.

[0199] In addition, since the video content for displaying the 3D video recorded by the video content recording device can be used for various 3D display devices, it is possible to display the 3D video. It will be possible to contribute to the promotion of the distribution of 3D video information while standardizing the information format.

[0200] In addition, in the video content recording apparatus, the video data acquisition unit includes a photographing unit including at least one image sensor and a plurality of lenses that form a subject image on the image sensor. Preferably, the static parameter information includes at least one of a distance between lenses when the subject is photographed, a focal length of the lens, and a distortion value of the lens.

[0201] According to this configuration, the video data is processed so that it can be displayed in three dimensions using the distance between the lenses of the photographing unit, the focal distance of the lens, and the distortion value of the lens when the video data is acquired. be able to. In addition, it is possible to reproduce 3D images by changing these values to various values just by using them as they are.

[0202] In addition, in the video content recording apparatus, the video data acquisition unit includes an imaging unit including at least one image sensor and a plurality of lenses that form a subject image on the image sensor. The dynamic parameter information includes a direction angle of the photographing unit when photographing the subject, photographing unit position information representing a position of the photographing unit, a direction angle of the lens, and a lens position representing the position of the lens. Preferably it contains at least one of the information.

[0203] According to this configuration, using the direction angle of the image capturing unit, the position information of the image capturing unit, the direction angle of the lens, and the position information of the lens when the image data is acquired, the image can be displayed in three dimensions. Data can be processed. In addition, it is possible to reproduce 3D images by changing these values to various values just by using them as they are.

[0204] Also, in the video content recording apparatus, the video data acquisition unit may include one shooting unit and a moving unit that moves the one shooting unit to positions corresponding to the plurality of viewpoints. preferable.

[0205] According to this configuration, since a single imaging unit is moved to a position corresponding to a plurality of viewpoints, the configuration can be made at a lower cost and with a simpler configuration than providing an imaging unit at a position corresponding to a plurality of viewpoints. Dimensional images can be recorded.

[0206] Also, in the video content recording apparatus, the dynamic parameter information acquisition unit acquires time information for specifying the shooting time at each viewpoint of the shooting unit moved by the moving unit. I prefer to do that.

[0207] According to this configuration, time information for specifying the shooting time at each viewpoint of the moving shooting unit is acquired, and this time information is recorded on the information recording medium together with the video data. 3D video can be combined as if it were an image of time and power, as well as images taken with multiple viewpoints simultaneously using time information. It becomes possible to do.

[0208] Further, in the above video content recording device, the video data acquisition unit includes one imaging unit having one imaging device and a plurality of lenses that form subject images on the one imaging device. The one photographing unit is different for each of the plurality of lenses. It is preferable to acquire video data shot from a viewpoint.

[0209] According to this configuration, since video data captured from different viewpoints is acquired by a plurality of lenses, a plurality of imaging units and a plurality of imaging elements are not necessarily required for each viewpoint, and one imaging unit is not necessarily required. Video data viewed from multiple viewpoints can be recorded on information recording media.

[0210] In addition, in the video content recording apparatus described above, it is preferable that the shooting unit acquires a plurality of video data shot from different viewpoints.

[0211] According to this configuration, only video data that has been shot with the necessary viewpoint power is extracted from a plurality of video data that has been shot from different viewpoints, and copied, moved, edited, played back, etc. This makes it possible to reduce the processing load and capacity for recording video data.

[0212] In addition, in the video content recording device, the dynamic parameter information acquisition unit is configured to obtain the plurality of video data acquired by the photographing unit and the viewpoint when the plurality of video data are acquired. It is preferable to acquire information that associates the position.

[0213] According to this configuration, it is possible to reproduce a 3D video as if it were video data shot at the same time, even if the time taken from a plurality of viewpoints was not exactly the same. Also, even if the video data is not necessarily recorded in the exact order of the time when the video data was shot, the video data is accurately reconstructed in the order of the shot time, and the video data is used for 3D Video can be played back.

[0214] The video content recording apparatus further includes a storage unit that stores the static parameter information in advance, and the static parameter information acquisition unit receives the static parameter from the storage unit. It is preferable to read the information.

[0215] According to this configuration, since it is not necessary to record static parameter information that is normally fixed and does not change at the time of shooting, the processing load at the time of shooting can be reduced, and it is simpler and less expensive. Even the function processing unit can record video data viewed from multiple viewpoints.

[0216] In addition, in the video content recording apparatus, the recording unit receives at least one of the video data, the static parameter information, and the dynamic parameter information. It is preferable to record on the information recording medium as a file different from the above.

[0217] According to this configuration, since at least one of video data, static parameter information, and dynamic parameter information is recorded separately as a separate file, the file is individually managed. This makes it possible to reduce the processing load and capacity for recording information. It is also possible to standardize the information format required to select and distribute only the necessary information for smooth distribution.

[0218] Also, in the video content recording apparatus, the recording unit may store at least one of the video data, the static parameter information, and the dynamic parameter information in a directory different from the rest. I prefer to record it.

[0219] According to this configuration, at least one of video data, static parameter information, and dynamic parameter information is recorded in a different directory, so that this directory can be managed individually. become. It is also possible to standardize the recording and storage format of information necessary for selecting and disseminating only the necessary information.

[0220] In addition, in the video content recording apparatus, the recording unit records the information as at least two of the video data, the static parameter information, and the dynamic parameter information as one file. It is preferable to record on a medium.

[0221] According to this configuration, since at least two of the video data, static parameter information, and dynamic parameter information are recorded together in one file, a plurality of information can be managed collectively. Become. In addition, since multiple pieces of information are combined into a single file, it is possible to reduce the number of recording and management tasks, and to standardize the record storage format necessary for smoothly distributing such information.

[0222] Also, in the video content recording apparatus, the video data acquisition unit acquires a plurality of video data, and the recording unit corresponds to each of the plurality of video data. It is preferable to record one or both of the dynamic parameter information and the dynamic parameter information as one file on the information recording medium.

[0223] According to this configuration, since the static parameter information and the dynamic parameter information are recorded together in one file, a plurality of information can be managed collectively. In addition, it reduces the number of records management efforts, and further, it is necessary to record such information smoothly. It is also possible to standardize the recording storage format.

[0224] Further, in the video content recording apparatus, the recording unit records at least two of the video data, the static parameter information, and the dynamic parameter information in one directory. Preferred.

[0225] According to this configuration, since at least two of the video data, static parameter information, and dynamic parameter information are recorded together in one directory, a plurality of pieces of information can be managed together. It becomes possible. In addition, since the information can be collected in a plurality of directories, it is possible to reduce the number of records and management, and to standardize the record storage format necessary for smoothly distributing such information.

[0226] Also, in the video content recording apparatus, the video data acquisition unit acquires a plurality of video data, and the recording unit corresponds to each of the plurality of video data. It is preferable to record one or both of parameter information and the dynamic parameter information in one directory.

[0227] According to this configuration, since the static parameter information and the dynamic parameter information are recorded together in one directory, a plurality of information can be managed collectively. In addition, since multiple information capabilities can be combined into one directory, it is possible to reduce the number of recording and management tasks, and to standardize the record storage format necessary for smoothly distributing such information. .

[0228] In addition, in the video content recording apparatus, the recording unit receives at least one of the video data, the static parameter information, and the dynamic parameter information as information different from the rest. I prefer to record on recording media.

[0229] According to this configuration, since at least one of video data, static parameter information, and dynamic parameter information is recorded on another information recording medium, a plurality of pieces of information are individually managed. It becomes possible to do. In addition, since information is distributed and recorded on a plurality of information recording media, the recording capacity of each information recording medium required for recording information can be reduced, and only necessary information can be selected and smoothly selected. It is also possible to standardize the information format required for distribution.

[0230] An information recording medium according to another aspect of the present invention is information capable of recording video content. A recording medium, wherein the video content is recorded by the video content recording device described above.

[0231] According to this configuration, at least one video data obtained by photographing a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and video data are acquired. Since dynamic parameter information, which is information that changes according to the situation at the time, is associated and recorded on the information recording medium as video content, three-dimensional display is performed using static parameter information and dynamic parameter information. Video data can be processed as much as possible, and it can be used universally for devices that can display video content in various 3D formats. It will also be possible to standardize the recording format necessary for the smooth distribution of this information and to promote and expand the distribution of this information recording medium.

[0232] A video content playback apparatus according to another aspect of the present invention is a video content playback apparatus that plays back 3D video from video content recorded on an information recording medium by the video content recording apparatus, wherein the information recording The media includes at least one video data obtained by photographing a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and a situation when the video data is acquired. Dynamic parameter information, which is information that changes in response, is recorded as video content, and the at least one video data, the static parameter information, and the dynamic parameter information are recorded in the information recording medium capability. A reading unit for reading, the at least one video data read by the reading unit, and the static parameter; It comprises a chromatography data information, and a reproduction unit for reproducing a three-dimensional image by using the said dynamic parameter information.

[0233] A video content playback method according to another aspect of the present invention is a video content playback method for playing back 3D video from video content recorded on an information recording medium by a video content recording device, wherein the information recording The media includes at least one video data obtained by photographing a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and a situation when the video data is acquired. Dynamic parameter information, which is information that changes in response, is recorded as video content, the at least one video data, the static parameter information, and the dynamic parameter. 3D using the reading step for reading out the data information, the at least one video data read in the reading step, the static parameter information, and the dynamic parameter information. A playback step of playing back the video.

[0234] A video content playback program according to another aspect of the present invention is a video content playback program for playing back 3D video from video content recorded on an information recording medium by a video content recording device. The information recording medium includes at least one video data obtained by photographing a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and the situation when the video data is acquired. Dynamic parameter information, which is information that changes in accordance with the video content, is recorded as video content, and the at least one video data, the static parameter information, and the dynamic parameter information are read from the information recording medium. A reading unit and the at least one video data read by the reading unit; When the static parameter information to function the computer a three-dimensional image by using the said dynamic parameter information as a reproduction unit for reproducing.

[0235] According to these configurations, the information recording medium includes at least one video data obtained by shooting the subject from a plurality of different viewpoints, and static parameter information that is information unique to the video content recording device. In addition, dynamic parameter information, which is information that changes depending on the situation when video data is acquired, is recorded as video content. Then, at least one video data, static parameter information, and dynamic parameter information are also read out as information recording media power, and at least one read video data, static parameter information, and dynamic information are read out. 3D video is reproduced using the target parameter information.

[0236] Therefore, depending on at least one video data obtained by shooting a plurality of different viewpoint powers of the subject, static parameter information that is unique to the video content recording device, and the situation when the video data is acquired 3D video can be played back using dynamic parameter information, which is information that changes, and can be used universally for various 3D display devices.

[0237] In addition, in the above video content playback apparatus, the video data includes a plurality of video data shot from different viewpoints, and the playback unit includes the plurality of video data. It is preferable to change the viewpoint when playing back 3D video by changing the video data to be used. According to this configuration, it is possible to read video data viewed from a plurality of viewpoints and reproduce a 3D video with various viewpoints.

[0238] Further, the video content reproduction apparatus further includes a changing unit that changes contents of either or both of the static parameter information and the dynamic parameter information read by the reading unit. The reproducing unit, when the contents of both the static parameter information and the dynamic parameter information are changed by the changing unit, and at least one video data read by the reading unit, A three-dimensional image is reproduced using the static parameter information whose content has been changed by the changing unit and the dynamic parameter information whose content has been changed by the changing unit, and the changing unit includes the static parameter information. When the contents are changed, at least one video data read by the reading unit and the contents are changed by the changing unit. The three-dimensional video is reproduced using the updated static parameter information and the dynamic parameter information read by the reading unit, and the content of the dynamic parameter information is changed by the changing unit. The at least one video data read by the reading unit, the static parameter information read by the reading unit, and the dynamic parameter information whose content has been changed by the changing unit It is preferable to play 3D images using

[0239] According to this configuration, the contents of one or both of the static parameter information and the dynamic parameter information are changed. If the contents of both the static parameter information and the dynamic parameter information are changed, the read at least one video data, the static parameter information whose contents are changed, and the contents 3D video is played back using the dynamic parameter information that has been changed. In addition, when only the static parameter information content is changed, the read at least one video data, the static parameter information whose content is changed, and the read dynamic parameter information are used. 3D video is played back. Furthermore, when only the contents of the dynamic parameter information are changed, at least one read video data, the read static parameter information, and the changed dynamic parameter information are used. 3D video is played. [0240] Therefore, either static parameter information or dynamic parameter information that can be obtained by simply reading video data viewed from a plurality of viewpoints and reproducing the actually captured video data as 3D video, or By changing both contents, it is possible to play back 3D video with various modifications to the video data.

[0241] Also, in the video content playback apparatus, the playback unit may perform the static parameter information and the dynamic parameter information with respect to at least one video data read by the read unit. It is preferable to play back a 3D video imaged from a different viewpoint from the at least one video data recorded on the information recording medium by performing an interpolation calculation using.

[0242] With this configuration, at least one video data is subjected to interpolation calculation using static parameter information and dynamic parameter information, so that at least one video data is recorded on the information recording medium. A 3D video shot from a different viewpoint than the video data is played back.

[0243] Therefore, video data viewed from multiple viewpoints can be recorded just by reading out the video data actually captured and playing it back as 3D video! Can be played back as 3D video.

[0244] Also, in the video content reproduction apparatus, either or both of the static parameter information and the dynamic parameter information whose contents have been changed by the changing unit are stored in the information recording medium. It is preferable to further include an update unit for recording.

[0245] According to this configuration, one or both of the static parameter information and the dynamic parameter information whose contents have been changed are recorded on the information recording medium. It is possible to re-record 3D video with various modifications to the video data.

[0246] A video content editing apparatus according to another aspect of the present invention is a video content editing apparatus that changes the content of video content recorded on an information recording medium by the video content recording apparatus, wherein the information recording medium Is based on at least one video data obtained by shooting a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and the situation when the video data is acquired. Dynamic parameter information, which is changing information, is recorded as video content, and either one or both of the static parameter information and the dynamic parameter information is designated and changed to change the content A receiving unit that receives an instruction; a reading unit that reads from the information recording medium one or both of the static parameter information and the dynamic parameter information corresponding to the change instruction received by the receiving unit; A changing unit that changes the contents of either or both of the static parameter information and the dynamic parameter information read by the reading unit according to the change instruction, and the change unit changed by the change unit Either or both of static parameter information and dynamic parameter information are stored in the information. And a recording section for recording MED IA §.

[0247] According to this configuration, the information recording medium includes at least one video data obtained by shooting the subject from a plurality of different viewpoints, static parameter information that is information unique to the video content recording device, and video. Dynamic parameter information, which is information that changes according to the situation when data is acquired, is recorded as video content. Then, one or both of static parameter information and dynamic parameter information is designated, and a change instruction for changing the contents is accepted. One or both of static parameter information and dynamic parameter information corresponding to the accepted change instruction is read out from the information recording medium, and out of the read static parameter information and dynamic parameter information The contents of either or both are changed according to the change instruction

. Thereafter, one or both of the changed static parameter information and dynamic parameter information is recorded on the information recording medium.

[0248] Accordingly, the content of either or both of the static parameter information and the dynamic parameter information is changed, and either the changed static parameter information or the dynamic parameter information or Since both are recorded on the information recording medium, it is possible to record information for playing back 3D video with various modifications to the video data just by recording the actual captured video data. It can be used universally for devices that can display various 3D contents.

Industrial applicability According to the present invention, it is possible to display a 3D image by making various modifications to the 3D image prepared in advance, such as changing the viewpoint of the 3D image prepared in advance. Furthermore, the information for displaying this 3D image can be used universally for various 3D display devices, and at the same time as standardizing the information format for displaying 3D images, It can contribute to the promotion of the distribution of video information, and its industrial applicability is extremely high.

Claims

The scope of the claims

[1] A video content recording apparatus for recording video content on an information recording medium, wherein the video data acquisition unit acquires at least one video data obtained by photographing a subject from a plurality of different viewpoints;

A static parameter information acquisition unit that acquires static parameter information that is information unique to the video content recording device;

A dynamic parameter information acquisition unit that acquires dynamic parameter information that is information that changes according to a situation when the video data is acquired;

The at least one video data acquired by the video data acquisition unit, the static parameter information acquired by the static parameter information acquisition unit, and the dynamic parameter acquired by the dynamic parameter information acquisition unit A video content recording apparatus comprising: a recording unit that records parameter information in association with parameter information on the information recording medium.

[2] The video data acquisition unit includes an imaging unit having at least one image sensor and a plurality of lenses that form a subject image on the image sensor,

The video content according to claim 1, wherein the static parameter information includes at least one of a distance between lenses when the subject is photographed, a focal length of the lens, and a distortion value of the lens. Recording device.

[3] The video data acquisition unit includes an imaging unit having at least one imaging device and a plurality of lenses that form a subject image on the imaging device,

The dynamic parameter information includes a direction angle of the photographing unit when photographing the subject, photographing unit position information indicating the position of the photographing unit, direction angle of the lens, and lens position information indicating the position of the lens. 1 or 2 comprising at least one of

2. The video content recording device according to 2.

[4] The video data acquisition unit according to any one of claims 1 to 3, wherein the video data acquisition unit includes one photographing unit and a moving unit that moves the one photographing unit to a position corresponding to the plurality of viewpoints. The video content recording apparatus according to claim 1.

[5] The dynamic parameter information acquisition unit includes: the imaging unit that is moved by the moving unit. 5. The video content recording apparatus according to claim 4, wherein time information for specifying a shooting time at each viewpoint is acquired.

[6] The video data acquisition unit includes one imaging unit having one imaging device and a plurality of lenses that form a subject image on the one imaging device,

4. The video content recording apparatus according to claim 1, wherein the one photographing unit acquires video data obtained by photographing with different viewpoint powers using the plurality of lenses.

7. The video content recording apparatus according to any one of claims 4 to 6, wherein the photographing unit acquires a plurality of pieces of video data taken with different viewpoint powers.

[8] The dynamic parameter information acquisition unit acquires information associating the plurality of video data acquired by the photographing unit with a viewpoint position when the plurality of video data is acquired. The video content recording apparatus according to claim 7.

[9] The storage device further includes a storage unit that stores the static parameter information in advance,

9. The video content recording apparatus according to claim 1, wherein the static parameter information acquisition unit reads the static parameter information from the storage unit.

[10] The recording unit records at least one of the video data, the static parameter information, and the dynamic parameter information as a separate file on the information recording medium. The video content recording device according to claim 1.

11. The recording unit according to claim 1, wherein the recording unit records at least one of the video data, the static parameter information, and the dynamic parameter information in a different directory. ~: The video content recording apparatus according to any one of LOs.

12. The recording unit records at least two of the video data, the static parameter information, and the dynamic parameter information as one file on the information recording medium. The video content recording device according to any one of 1 to 11.

[13] The video data acquisition unit acquires a plurality of video data,

The recording unit has one or both of the static parameter information and the dynamic parameter information corresponding to each of the plurality of video data as one file. 12. The video content recording apparatus according to claim 1, wherein the video content recording apparatus records on the information recording medium.

14. The recording unit according to claim 1, wherein the recording unit records at least two of the video data, the static parameter information, and the dynamic parameter information in one directory. The video content recording apparatus according to claim 1.

[15] The video data acquisition unit acquires a plurality of video data,

The recording unit records one or both of the static parameter information and the dynamic parameter information corresponding to each of the plurality of video data in one directory. 14. The video content recording device according to any one of 1 to 13.

[16] The recording unit may record at least one of the video data, the static parameter information, and the dynamic parameter information on another information recording medium. Item 16. The video content recording device according to any one of Items 1 to 15.

[17] An information recording medium capable of recording video content,

17. An information recording medium in which the video content is recorded by the video content recording device according to claim 1.

[18] A video content recording method for recording video content on an information recording medium, wherein the video data acquisition step acquires at least one video data obtained by photographing a subject from a plurality of different viewpoints;

Static parameter information acquisition step of acquiring static parameter information that is information unique to the video content recording device;

A dynamic parameter information acquisition step for acquiring dynamic parameter information, which is information that changes according to the situation when the video data is acquired;

The at least one video data acquired in the video data acquisition step, the static parameter information acquired in the static parameter information acquisition step, and the dynamic parameter information acquisition step A recording step of associating the acquired dynamic parameter information with the acquired dynamic parameter information and recording the information as the video content on the information recording medium.

[19] A video content recording program for recording video content on an information recording medium,

A video data acquisition unit for acquiring at least one video data obtained by shooting a plurality of different subjects from different viewpoints;

The at least one video data acquired by the video data acquisition unit, the static parameter information acquired by the static parameter information acquisition unit, and the dynamic parameter acquired by the dynamic parameter information acquisition unit A video content recording program that causes a computer to function as a recording unit that records parameter information in association with parameter information on the information recording medium.

[20] A video content playback device for playing back 3D video from video content recorded on an information recording medium by a video content recording device,

The information recording medium acquires at least one video data obtained by photographing a subject from a plurality of different viewpoints, static parameter information that is unique to the video content recording device, and the video data. Dynamic parameter information, which is information that changes according to the situation at the time, is recorded as video content,

A reading unit for reading the at least one video data, the static parameter information, and the dynamic parameter information from the information recording medium power;

A video unit comprising: a playback unit that plays back 3D video using the at least one video data read by the read unit, the static parameter information, and the dynamic parameter information Content playback device.

[21] The video data includes a plurality of video data shot from different viewpoints, and the playback unit changes the video data to be used from the plurality of video data, thereby 21. The video content playback apparatus according to claim 20, wherein a viewpoint when the video is played is changed.

[22] The information processing apparatus further includes a changing unit that changes contents of either or both of the static parameter information and the dynamic parameter information read by the reading unit,

When the contents of both the static parameter information and the dynamic parameter information are changed by the changing unit, the contents are changed by at least one video data read by the reading unit and the changing unit. 3D video is reproduced using the static parameter information and the dynamic parameter information whose contents have been changed by the changing unit,

When the content of the static parameter information is changed by the changing unit, at least one video data read by the reading unit, the static parameter information whose content is changed by the changing unit, and the reading 3D video is reproduced using the dynamic meter information read out by the

When the content of the dynamic parameter information is changed by the changing unit, at least one video data read by the reading unit, the static parameter information read by the reading unit, and the changing unit The video content playback apparatus according to claim 20 or 21, wherein a 3D video is played back using the dynamic parameter information whose contents are changed by the method.

[23] The reproduction unit performs the interpolation calculation on the at least one video data read by the reading unit using the static parameter information and the dynamic parameter information, thereby obtaining the information. 21. The video content playback apparatus according to claim 20, wherein the video content playback device plays back a 3D video shot with a viewpoint power different from that of the at least one video data recorded on a recording medium.

[24] The method further comprises an updating unit that records either or both of the static parameter information and the dynamic parameter information whose contents are changed by the changing unit on the information recording medium. The video content reproduction apparatus according to claim 22.

[25] A video content playback method for playing back 3D video from video content recorded on an information recording medium by a video content recording device,

The information recording medium can be obtained by photographing a subject from a plurality of different viewpoints. Video content includes video data, static parameter information that is unique to the video content recording device, and dynamic parameter information that is information that changes according to the situation when the video data is acquired. Recorded as

A step of reading out the information recording medium power of the at least one video data, the static parameter information, and the dynamic parameter information;

A video comprising: a reproduction step of reproducing a 3D video using the at least one video data read in the reading step, the static parameter information, and the dynamic parameter information Content playback method.

[26] A video content playback program for playing back 3D video from video content recorded on an information recording medium by a video content recording device,

Using the at least one video data read by the reading unit, the static parameter information, and the dynamic parameter information to cause a computer to function as a playback unit that plays back a 3D video. A video content playback program.

[27] A video content editing apparatus for changing the content of video content recorded on an information recording medium by the video content recording apparatus,

One of or both of the static parameter information and the dynamic parameter information is designated, and a reception unit that receives a change instruction for changing the contents thereof, and the change instruction received by the reception unit Corresponding static parameter A reading unit for reading one or both of information and the dynamic parameter information from the information recording medium;

A changing unit that changes the contents of one or both of the static parameter information and the dynamic parameter information read by the reading unit according to the change instruction;

A video content editing apparatus comprising: a recording unit that records either or both of the static parameter information and the dynamic parameter information changed by the changing unit on the information recording medium.