JP4249187B2 - 3D image processing apparatus and program thereof - Google Patents

Description

  The present invention relates to a stereoscopic image processing apparatus that processes real stereoscopic images captured by two cameras and a program thereof.

Conventionally, various stereoscopic display devices have been invented, and a method of reproducing stereoscopic data with a stereoscopic display device has been tried. When displaying 3D data on a 3D display using glasses such as a barrier 3D display or polarized glasses / shutter glasses, two viewpoint images corresponding to the left and right eyes are prepared in advance. Humans can perceive three-dimensionally by compositing on the display. In order to create an image to be displayed on these displays, as shown in FIG. 7, two cameras are photographed in parallel, and the left camera image and the right camera image according to the position of the target, It is necessary to perform a process of cutting out the image of the cut-out area from the cut-out position where the left and right angles of view intersect so that the positions of the objects to be photographed are the same.
In the prior art, the distance from the camera to the object to be photographed is measured in advance, the images photographed by the two cameras are taken into a computer or memory, and the size of the cut-out area where the angle of view of the left and right cameras overlaps based on the measured distance A 3D live-action video is created by cutting out the captured video and displaying it on a 3D display. For this reason, even in a scene where the subject to be photographed changes dynamically, it is a three-dimensional live-action image targeted at a certain distance. Further, in Patent Document 1, a cut-out region is obtained so that the difference is minimized from the correlation between left and right videos. Patent Documents 2 to 5 are known as other conventional techniques.
JP 2002-223458 A JP 2002-330552 A JP 09-081786 A Japanese Patent Laid-Open No. 06-284445 Japanese Patent Laid-Open No. 06-034343

  However, in the conventional stereoscopic image creation device that measures the distance from the camera to the shooting target in advance, the shooting target is dynamically changed because it is a three-dimensional live-action video for a certain distance. In a scene that changes, the position of the subject to be photographed may be separated between the left-eye and right-eye images. Further, in the stereoscopic image creating apparatus shown in Patent Document 1, since the background correlation is high in a scene in which the background occupies a large amount, the position of the background is the same in the left-eye and right-eye images. The position of the object may be separated. Therefore, when viewing this object in the stereoscopic video generated by these stereoscopic video creation devices, the viewpoint of the left eye and the viewpoint of the right eye may be separated, which is a burden on the viewer and is tiring. .

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a stereoscopic video processing apparatus that generates a stereoscopic image with less burden on the viewer and a program thereof.

  The present invention has been made to solve the above-described problems. The invention according to claim 1, the left image photographing means for photographing the subject and outputting the image for the left eye, and photographing the subject, the right eye Right image capturing means for outputting a video for use, stereoscopic image output means for displaying a stereoscopic image, and gaze position measurement for successively measuring the coordinates of the gazing point of the left and right eyes of the user viewing the stereoscopic image output means A left video data input unit that receives an input of a left-eye video output from the left video photographing unit, and outputs a left image separated by one frame; Right video data input means for accepting input of right eye video output by the right video photographing means and separating and outputting the right image for each frame; and for the left eye gazing point measured by the gaze position measuring means Coordinates and right eye Based on the gaze position data input means that sequentially receives the coordinates of the gazing point, the coordinates of the gazing point of the left eye and the coordinates of the gazing point of the right eye received by the gaze position data input means, and the image extraction width calculated last time, A cutout width calculating unit that sequentially calculates a cutout width of the image, and a cutout width calculated by the cutout width calculation unit, and a left image cut out from the right end of the left image output by the left video data input unit Image cutout means for outputting a cutout image and a right cutout image obtained by cutting out an image corresponding to the cutout width from the left end of the right image output by the right video data input means, and the left cutout image and the right cut out by the image cutout means A stereoscopic video processing apparatus comprising: a stereoscopic video synthesizing unit that generates and outputs a stereoscopic video from a cut-out image.

  The invention described in claim 2 is the stereoscopic image processing apparatus according to claim 1, wherein the cut-out width calculating means is configured to accept the cut-out width calculated last time as Wc, and the left eye received by the line-of-sight position data input means. A value obtained by subtracting the x-coordinate of the right-eye gazing point from the x-coordinate of the right gazing point is Wu, and the current cutting width Wcnew = Wc−Wu is used to calculate the current cutting width Wcnew.

  The invention described in claim 3 is the stereoscopic image processing apparatus according to claim 1 or 2, wherein the left image capturing unit and the right image capturing unit focus on the input distance. The left eye gazing point coordinates and the right eye gazing point coordinates received by the line-of-sight position data input means, and the arrangement relationship between the left video photographing means and the right video photographing means, It is characterized by comprising gaze target distance calculating means for calculating the distance to the subject at the gazing point and outputting it to the left image capturing means and the right image capturing means.

  The invention described in claim 4 is the stereoscopic image processing device according to claim 3, wherein the left image capturing unit and the right image capturing unit are installed in parallel at an installation interval Bc, and The number of pixels in the horizontal direction is Wd, the focal length is f, and the gaze target distance calculation unit calculates the right-eye from the x coordinate of the left gaze point received by the gaze position data input unit by Wc The value obtained by subtracting the x-coordinate of the gazing point is Wu, and the distance to the subject at the gazing point is Dc = Bc · f / {Q · (Wd−Wc + Wu)} (Q is a unit adjustment factor). The distance Dc to a certain subject is calculated.

According to a fifth aspect of the present invention, there is provided a left video photographing means for photographing a subject and outputting a left eye video, a right video photographing means for photographing the subject and outputting a right eye video, and a stereoscopic video. The left video photographing means outputs a computer connected to a stereoscopic video output means for displaying the image and a gaze position measuring means for successively measuring the coordinates of the gazing point of the left and right eyes of the user viewing the stereoscopic video output means. Left video data input means for receiving the input of the left-eye video and separating and outputting the left image for each frame, and receiving the input of the right-eye video output by the right video photographing means for each frame Right image data input means for separating and outputting to the right image, gaze position data input means for successively receiving the left eye gaze coordinates and the right eye gaze coordinates measured by the gaze position measurement means, and the gaze Coordinates of the location data input means received left coordinates and right eye of the gaze point of the gazing point and, based on the cut-out width of the image previously calculated, cutout width calculating means for sequentially calculating the cut width of the image, the cutout width calculation means The left cut-out image obtained by cutting out the image corresponding to the cut-out width from the right end of the left image output by the left video data input means and the left end of the right image output by the right video data input means In order to function as an image cutout unit that outputs a right cutout image obtained by cutting out an image of a width, and as a 3D video composition unit that generates and outputs a 3D video from the left cutout image and the right cutout image cut out by the image cutout unit. It is a program.

  According to the present invention, the cropping width calculation means sequentially calculates the cropping width of the image based on the coordinates of the gazing point of the left eye, the coordinates of the gazing point of the right eye, and the cropping width of the image calculated last time. The subject in question is the same place for the left-eye video and the right-eye video, and it is possible to generate a stereoscopic image with less burden on the viewer.

  Further, according to the present invention, the cut-out width calculating unit is configured to determine the subject at the gazing point based on the coordinates of the gazing point of the left eye and the coordinates of the gazing point of the right eye and the arrangement relationship between the left image capturing unit and the right image capturing unit. Therefore, it is possible to obtain a stereoscopic image focused on the subject being watched by the user.

  First, the outline of the embodiment of the present invention shown in FIG. 1 will be described. The stereoscopic video processing apparatus according to the present embodiment 3D composites video captured by two cameras by 3D composite processing, and outputs the composite video to a three-dimensional display that displays a stereoscopic video. At this time, based on the gaze point coordinates of the left and right eyes of the user measured by the gaze measuring device, the gaze position conversion process performs the distance to the object being watched by the user and the image for the left eye on the three-dimensional display. And a cut-out width of 3D synthesis based on the object so that the object is displayed at the same place in the video for the right eye. In the line-of-sight position conversion process, the obtained distance is fed back to the camera, and the cut-out width is fed back to the 3D synthesis process. Based on this distance, the camera automatically focuses the camera on the object that the user is gazing at, and the 3D composition process performs 3D composition based on the object to be viewed and displays it on a 3D display. It is a device that generates video.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 2 is a schematic block diagram showing the configuration of the stereoscopic video processing apparatus 100 according to one embodiment of the present invention. The stereoscopic image processing apparatus 100 includes a 3D composition process 20 and a line-of-sight position conversion process 30, and includes a left camera 10 (left image capturing unit), a right camera 11 (right image capturing unit), and a 3D display 12 (stereoscopic image output unit). ) And the line-of-sight position measuring device 13 are connected.

  The left camera 10 has a focal length of f (FIG. 5), focuses on the distance input from the stereoscopic image processing apparatus 100, shoots a subject, and has the horizontal pixel count Wd (FIG. 4). For example, a TV camera or a video camera that outputs left video data. Similarly, the right camera 11 has a focal length of f, photographs a subject focused on the distance input from the stereoscopic image processing apparatus 100, and is a right image that is a right-eye image having a horizontal pixel count of Wd. A television camera, a video camera, or the like that outputs data is installed in parallel with the left camera 10 at an installation interval Bc (FIG. 5). The three-dimensional display 12 is a barrier type three-dimensional display that receives stereoscopic video data from the stereoscopic video processing apparatus 100 and displays a stereoscopic video, or a three-dimensional display using glasses such as polarized glasses and shutter type glasses. The line-of-sight position measurement device 13 is an eye mark recorder or the like based on a pupil / corneal reflection method or the like, and sequentially measures the coordinates of the gazing points of the left and right eyes of the user who is looking at the three-dimensional display 12. In the coordinate system on the screen of the stereoscopic image display processing device 12, the upper left corner of the screen is the origin, the right direction is the x coordinate, and the lower direction is the y coordinate.

  The 3D composition process 20 includes a left image data input unit 21, a right image data input unit 22, an image cutout process 23, and a stereoscopic image composition process 24. The left video data input unit 21 receives input of left video data output from the left camera 10 and separates it into left image data for each frame. The right video data input unit 22 receives the input of the right video data output from the right camera 11, and separates and outputs the right image data for each frame. The image cutout process 23 receives the cutout width from the line-of-sight position conversion process 30 and inputs left cutout image data obtained by cutting out an image corresponding to the cutout width from the right end of the left image data output by the left video data input unit 21 and the right video data input. The right cut-out image data obtained by cutting out the image corresponding to the cut-out width from the left end of the right image data output by the unit 22 is output. The stereoscopic video composition process 24 generates and outputs stereoscopic video data from the left cut-out image data and right cut-out image data output by the image cut-out process 23.

The line-of-sight position conversion process 30 includes a line-of-sight position data input unit 31, a cutout width calculation process 32, and a gaze target object distance calculation process 33. The line-of-sight position data input unit 31 sequentially receives the coordinates of the gazing point of the left eye and the coordinates of the gazing point of the right eye measured by the line-of-sight position measurement device 13. The cut-out width calculation processing 32 is the line-of-sight obtained by subtracting the x-coordinate of the right-eye gazing point from the x-coordinate of the left-eye gazing point received by the sight-line position data input unit 31 in Wc. The current cutout width (number of pixels) Wcnew is calculated according to the equation (1), where the width (number of pixels) is Wu. As a result, the cutout width is changed so that the x coordinate of the left eye point and the right eye point is the same. Formula (1) will be described in detail later.
Wcnew = Wc-Wu (1)

The gaze target distance calculation processing 33 calculates the gaze width, which is a value obtained by subtracting the x coordinate of the right eye gaze from the x coordinate of the left eye gaze received by the gaze position data input unit 31 from the previously calculated cutout width Wc. As Wu, the distance Dc to the object at the point of gaze is calculated by the equation (2), and is output to the left camera 10 and the right camera 11. Formula (2) will be described in detail later.
Dc = Bc · f / {Q · (Wd−Wc + Wu)} (Q is the length per pixel [m / pixel] on the imaging surface of the left camera 10 and the right camera 11) (2)

  Hereinafter, the expression (1) used when the cutout width is calculated in the cutout width calculation process 32 will be described. As shown in FIG. 3, the case where the left camera 10 and the right camera 11 are photographing still subjects O1, O2 is taken as an example. First, the left-eye screen P1 and the right-eye screen (previous) P2 shown in FIG. 4 are displayed with a cut-out width Wc on the three-dimensional display 12, and the user displays the subject O1 displayed on the three-dimensional display 12. Suppose you are gazing. In this state, the subject O1 is displayed in the same place on the left-eye screen P1 and the right-eye screen (previous) P2 on the three-dimensional display 12, but the subject O2 on the near side of the subject O1 is the left-eye screen. P1 and the right-eye screen (previous) P2 are displayed at different places. At this time, when the user moves his / her line of sight to the subject O2, the line of sight of the left eye looking at the left-eye screen P1 and the line of sight of the right eye looking at the right-eye screen (previous) P2 cross each other before the screen. The gazing point is left by the number of pixels Wu. Here, in order to make the gaze point coincide on the screen of the three-dimensional display 12 so that the line of sight of the right eye and the left eye does not intersect, the display position of the right eye screen (previous) P2 is moved to the right by the number of pixels Wu. The right eye screen (current) P3 may be set. The cutout width Wcnew at this time is represented by Wcnew = Wc−Wu, that is, Expression (1) because the number of pixels Wu that has moved the right-eye screen (previous) P2 is decreased from the previous cutout width Wc.

Hereinafter, Formula (2) used when calculating the distance to the gaze target in the gaze target distance calculation process will be described with reference to FIG. The length per pixel on the imaging surface L2 of the left camera 10 and the right camera 11 is Q, and the current cutout width calculated by the cutout width calculation process 32 is Wcnew. As shown in FIG. 5, the distance between the lens surface L1 and the imaging surface L2 is a focal length f. In addition, at the position of the subject O2, the width of the region cut out by the image cutting process 23 is Bc, and the width of the region on the imaging surface L2 corresponding to the region is QWd−QWcnew. From these, the formula (3) is established.
Dc: Bc = f: QWd-QWcnew (3)
Here, since the inner product and outer product of Expression (3) are equal, Expression (4) is established.
Dc · (QWd−QWcnew) = Bc · f (4)
When formula (1) is substituted into Wcnew of formula (4) and rearranged, formula (5), that is, formula (2) is obtained.
Dc = Bc · f / {Q · (Wd−Wc + Wu)} (5)

  Next, the operation of the stereoscopic image processing apparatus 100 will be described with reference to FIG. First, the image cutout process 23, the cutout width calculation process 32, and the gaze target distance calculation process 33 obtain a common value Wc0 as an initial value of the cutout width (S1). This value may be individually held in advance for each process, or only one of the three processes or another process is held, and a process not held is notified. May be. Next, the left video data input unit 21 captures the left video data output from the left camera 10, and the right video data input unit 22 captures the right video data output from the right camera 11 (S2) into image data for each frame. The left image data and the right image data are output separately. When the image cut-out process 23 receives the left image data from the left video data input unit 21 and the right image data from the right video data input unit 22, the image cut-out process 23 sets these images at the initial value Wc0 of the cut-out width obtained in step S1. Extraction is performed from the data, and left-extraction image data and right-extraction image data are obtained and output to the stereoscopic video composition process 24 (S3). Upon receiving the left cut-out image data and the right cut-out image data, the 3D video composition process 24 generates and outputs 3D video data for display on the 3D display 12 from these (S4).

  If the process is not completed, the process continues (S5), and the line-of-sight position data input unit 31 receives the gaze point of the user's left eye and right eye on the screen of the three-dimensional display 12 from the line-of-sight position measurement device 13. Are output to the gaze target distance calculation process 33 and the cutout width calculation process 32 (S6). When the gaze target distance calculation process 33 receives the coordinates of the left eye and right eye gaze points from the gaze position data input unit 31, the gaze width Wu is obtained by subtracting the x coordinates of the right eye gaze points from the x coordinates of the left eye gaze points. calculate. Next, the gaze target distance calculation processing 33 calculates the distance Dc to the target at the gaze point using the initial value Wc0 of the cutout width as the previous cutout width Wc according to the equation (2), It outputs to the left camera 10 and the right camera 11 (S7). When receiving the distance Dc, the left camera 10 and the right camera 11 are focused on the distance Dc. Thereby, the left camera 10 and the right camera 11 are focused on the object being watched by the user.

  Next, when the cutout width calculation processing 32 receives the coordinates of the left eye and right eye gazing point from the sight line position data input unit 31, the line width Wu is obtained by subtracting the x coordinate of the right eye gazing point from the x coordinate of the left eye gazing point. Is calculated. Next, the cut-out width calculation process 32 calculates the current cut-out width Wcnew according to Expression (2) using the initial value Wc0 of the cut-out width as the previous cut-out width Wc, and outputs this to the image cut-out process 23. (S8).

  Next, the process returns to step S2, and as with the first time, the left video data input unit 21 outputs the left video data output from the left camera 10, and the right video data input unit 22 outputs the right video data output from the right camera 11. Is taken (S2), and is divided into image data for each frame, and left image data and right image data are output, respectively. When the image cutout process 23 receives the left image data from the left video data input unit 21 and receives the right image data from the right video data input unit 22, here, the cutout width Wcnew received from the cutout width calculation process 32 is used. Then, the image data is cut out from the image data, and the left cut-out image data and the right cut-out image data are obtained and output to the stereoscopic video composition process 24 (S3). Upon receiving the left cut-out image data and the right cut-out image data, the 3D video composition process 24 generates and outputs 3D video data for display on the 3D display 12 from these (S4).

  If the process is not completed, the process continues (S5), and the line-of-sight position data input unit 31 receives the gaze point of the user's left eye and right eye on the screen of the three-dimensional display 12 from the line-of-sight position measurement device 13. Are output to the gaze target distance calculation process 33 and the cutout width calculation process 32 (S6). When the gaze target distance calculation process 33 receives the coordinates of the left eye and right eye gaze points from the gaze position data input unit 31, the gaze width Wu is obtained by subtracting the x coordinates of the right eye gaze points from the x coordinates of the left eye gaze points. calculate. Next, the gaze target distance calculation processing 33 uses the cutout width previously calculated by the cutout width calculation processing 32 as the previous cutout width Wc, and calculates the distance Dc to the target at the gaze point by the equation (2). This is calculated and output to the left camera 10 and the right camera 11 (S7). When receiving the distance Dc, the left camera 10 and the right camera 11 are focused on the distance Dc. Thereby, the left camera 10 and the right camera 11 are focused on the object being watched by the user.

Next, when the cutout width calculation processing 32 receives the coordinates of the left eye and right eye gazing point from the sight line position data input unit 31, the line width Wu is obtained by subtracting the x coordinate of the right eye gazing point from the x coordinate of the left eye gazing point. Is calculated. Next, the cutout width calculation process 32 calculates the current cutout width Wcnew according to the expression (2) using the previously calculated cutout width as the previous cutout width Wc, and outputs this to the image cutout process 23 ( S8).
Thereafter, the process is continued in the same manner until the process ends in step S5.

  As a result, the position of the object can be freely changed, and the user can take a video while changing any object in the video to the target object, so that the value of the stereoscopic video image content can be expanded. . In particular, flat-type 3D displays such as the barrier-type 3D display in the prior art have a limited range width that allows you to feel a sense of depth due to the limitations of the device, but this method is limited. By dynamically changing the position of the target in the depth direction, the range width limit can be greatly expanded. In addition, this method is particularly effective in scenes such as a WEB camera that shoots images with different things (objects) to be noticed by viewers who photograph tourist spots or street corners.

  In addition, the left video data input unit 21, the right video data input unit 22, the image cutout process 23, the stereoscopic video composition process 24, the line-of-sight position data input unit 31, the cutout width calculation process 32, and the gaze target distance calculation process 33 in FIG. A program for realizing the above function is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed, whereby the left video data input unit 21 and the right video data input The unit 22, the image cutout process 23, the stereoscopic video composition process 24, the line-of-sight position data input unit 31, the cutout width calculation process 32, and the gaze target distance calculation process 33 may be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes a design and the like within the scope not departing from the gist of the present invention.

It is a figure explaining the outline | summary of the three-dimensional-video processing apparatus by one Embodiment of this invention. It is a block diagram which shows the structure of the stereoscopic video imaging device 100 by the same embodiment. It is a figure explaining the relationship between the imaging | photography area | region of the left camera 10 and the right camera 11, and the to-be-photographed object O1 and the to-be-photographed object O2 in the embodiment. It is a figure explaining Formula (1) in the embodiment. It is a figure explaining Formula (2) in the embodiment. It is a flowchart explaining operation | movement of the stereoscopic video imaging device in the same embodiment. It is a figure explaining the prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Left camera 11 ... Right camera 12 ... Three-dimensional display 13 ... Gaze position measuring device 20 ... 3D composition process 21 ... Left image data input part 22 ... Right image data input part 23 ... Image extraction process 24 ... Three-dimensional image composition process 30 Gaze position conversion processing 31 Gaze position data input unit 32 Cutout width calculation processing 33 Gaze target distance calculation processing 100 Stereoscopic image processing apparatus

Claims (5)

Left video photographing means for photographing a subject and outputting a left-eye video, right video photographing means for photographing the subject and outputting a right-eye video, stereoscopic video output means for displaying a stereoscopic video, and the stereoscopic In the stereoscopic image processing apparatus connected to the gaze position measuring means for successively measuring the coordinates of the gazing point of the left and right eyes of the user watching the video output means,
Left video data input means for receiving an input of a left-eye video output by the left video photographing means and separating and outputting a left image frame by frame;
Right video data input means for receiving an input of a right-eye video output by the right video photographing means and separating and outputting the right image frame by frame;
Gaze position data input means for sequentially receiving the left eye gaze coordinates and the right eye gaze coordinates measured by the gaze position measurement means,
Extraction width calculation means for sequentially calculating the image extraction width based on the coordinates of the left eye fixation point and the right eye fixation point received by the line-of-sight position data input means, and the image extraction width calculated last time;
A left cut-out image obtained by cutting out the image corresponding to the cut-out width from the right end of the left image output by the left video data input means and receiving the cut width calculated by the cut-out width calculation means, and the right output from the right video data input means Image cutting means for outputting a right cut image obtained by cutting an image corresponding to the cut width from the left end of the image;
A stereoscopic video processing apparatus comprising: a stereoscopic video composition unit that generates and outputs a stereoscopic video from a left cut image and a right cut image cut out by the image cutout unit.   The cut-out width calculation means uses Wc as the cut-out width calculated last time and Wu as a value obtained by subtracting the x-coordinate of the right-eye gazing point from the x-coordinate of the left-eye gazing point received by the line-of-sight position data input means. The stereoscopic video processing apparatus according to claim 1, wherein the current cutout width Wcnew is calculated from the width Wcnew = Wc−Wu. The left video photographing means and the right video photographing means focus on the input distance and photograph the subject,
The distance to the subject at the gazing point based on the coordinates of the gazing point of the left eye and the coordinates of the gazing point of the right eye received by the line-of-sight position data input unit and the arrangement relationship between the left image capturing unit and the right image capturing unit The stereoscopic image processing apparatus according to claim 1, further comprising: a gaze target distance calculating unit that calculates and outputs to the left image capturing unit and the right image capturing unit. The left image capturing means and the right image capturing means are installed in parallel at an installation interval Bc, the number of pixels in the horizontal direction of the captured image is Wd, and the focal length is f.
The gaze target distance calculating means is Wc, where Wc is a previously calculated cutout width, and Wu is a value obtained by subtracting the x coordinate of the right eye gaze point from the x coordinate of the left eye gaze point received by the gaze position data input means. The distance Dc to the subject at the gazing point is calculated from the distance Dc = Bc · f / {Q · (Wd−Wc + Wu)} (Q is a unit adjustment factor). Item 4. The stereoscopic image processing apparatus according to Item 3. Left video photographing means for photographing a subject and outputting a left-eye video, right video photographing means for photographing the subject and outputting a right-eye video, stereoscopic video output means for displaying a stereoscopic video, and the stereoscopic A computer connected to a line-of-sight position measuring unit that sequentially measures the coordinates of the gazing point of the left and right eyes of a user who views the video output unit;
Left video data input means for accepting input of left-eye video output by the left video photographing means and separating and outputting the left image frame by frame;
Right video data input means for receiving an input of a right-eye video output from the right video photographing means and separating and outputting the right image for each frame;
Gaze position data input means for successively receiving the left eye gaze coordinates and the right eye gaze coordinates measured by the gaze position measurement means,
Extraction width calculation means for sequentially calculating the image extraction width based on the coordinates of the left eye fixation point and the right eye fixation point received by the line-of-sight position data input means, and the image extraction width calculated last time ;
A left cut-out image obtained by cutting out the image corresponding to the cut-out width from the right end of the left image output by the left video data input means and receiving the cut width calculated by the cut-out width calculation means, and the right output from the right video data input means Image cutting means for outputting a right cut image obtained by cutting an image for the cut width from the left end of the image,
A program for functioning as a stereoscopic video composition unit for generating and outputting a stereoscopic video from a left cut image and a right cut image cut out by the image cut out unit.

Images