JP2012100015A - Three-dimensional video reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To realize effective 3D sickness prevention measures by taking the 3D sickness measures to a 3D video when a viewpoint of a viewer moves.SOLUTION: A three-dimensional video reproducing device includes: a video acquiring unit obtaining and reproducing a recording video obtained by adding moving speed of a camera position capturing the video to the video of a three-dimensional moving image; a storage unit which previously stores a threshold on the moving speed of the camera position; a video separating unit comparing the moving speed of the camera position and the threshold while the obtained recording video is reproduced and separating the video into a time zone where the moving speed exceeds the threshold and a time zone of the threshold or below; a video correcting unit correcting the video in the time zone where the moving speed exceeds the threshold; and a display control unit controlling to display the video corrected by the video correcting unit in the time zone where the speed exceeds the threshold and to display the video which is not corrected by the video correcting unit in the time zone where the speed is the threshold or below.

Description

  The present invention relates to a 3D video playback apparatus in which a 3D moving image video is added with a position change amount with time of a photographing apparatus that captures the video.

  In general, it is said that when observing a stereoscopic image (3D image), eyes are more likely to be fatigued than when observing a normal two-dimensional image (2D image). In addition, the viewer may have a headache or nausea when the displayed object has a violent movement or a violent movement on the side of the camera that captures the video. This is the so-called “3D sickness”. There was no fundamental countermeasure for this symptom, and devices and facilities that provided 3D images had to be limited to measures that advised viewers to avoid using them for a long time.

  However, even if the precautions are described so as to avoid watching for a long time, for example, on a DVD or BlueRay player or a movie media manual, the viewer remembers that while watching the content and follows the precautions. Not necessarily. Even if the viewer is not conscious, a mechanism that avoids viewing 3D video or does not display 3D video with a high moving speed is desired as an effective measure.

  As an invention in consideration of such “3D sickness”, a sensor for detecting the skin temperature of the forehead and a sensor for detecting the skin temperature of the nose are provided on the stereoscopic video viewing glasses, and the stereoscopic video viewing glasses are further blinked. A sensor provided with a detection sensor has been proposed. The detection result of the skin temperature of the forehead and nose is guided to the excitement level data transformer to obtain the excitement level. The blink detection result is guided to a fatigue level data converter to obtain the fatigue level. Based on the excitement level and fatigue level acquired in this way, the 3D enhancement level of the 3D image is adjusted. More specifically, the delay amount of the field memory of a stereoscopic television receiver that performs two-dimensional and three-dimensional conversion is controlled according to the degree of stereoscopic enhancement (for example, see Patent Document 1).

Further, a video system has been proposed in which the degree of influence on the observer is evaluated from the input video signal, and the stereoscopic degree of the stereoscopic video is adjusted based on the evaluation result of the degree of influence or the stereoscopic video is switched to the two-dimensional video. (For example, refer to Patent Document 2). The video system includes a 3D video player that transmits a 3D video signal, a parallax amount detector that detects a parallax amount of the 3D video signal from the 3D video player, and a fatigue level based on the detected parallax amount. A fatigue evaluation unit that outputs a video switching signal corresponding to the fatigue evaluation amount, and a 3D video / 2D video switching unit that switches between 3D video and 2D video based on the video switching signal, and It is comprised with the video display part which displays a three-dimensional image or a two-dimensional image.
According to this video system, it is possible to adjust and switch the video without performing the physiological measurement of the observer so as not to give the observer excessive fatigue.

Japanese Patent Laid-Open No. 9-23451 JP 11-355808 A

  As in Patent Document 1, in the method of controlling the solid intensity based on the physiological measurement value of the observer, there is a measurement error or individual difference in the relationship between the obtained measurement value and the fatigue level, which is appropriate for all observers. It is not easy to adjust the three-dimensionality to a certain degree and appropriately control the observer's fatigue level. Furthermore, it is complicated to obtain measurement values individually for each observer.

In addition, as in Patent Document 2, the method for evaluating the degree of influence on the fatigue level based on the solidity and moving speed on the video data is not sufficiently accurate in the following points. One of the causes of sickness is the difference between the movement vector assumed by the viewer and the actual 3D image on the screen. In other words, even if the same stereoscopic degree and moving speed are the same on the video data, the viewer's viewpoint is fixed and some of the objects in the field of view move, and the viewer's viewpoint itself moves. There is a difference in the effect of 3D sickness on the viewer when all objects in the field of view move. Naturally, the latter is considered to have a greater effect of 3D sickness. Therefore, it can be said that the evaluation based on the movement of the viewer's viewpoint rather than the three-dimensionality and moving speed of the object in the screen is preferable.
The present invention has been made in consideration of the above-described circumstances, and provides an effective 3D sickness prevention measure by taking measures against 3D sickness on 3D images when the viewer's viewpoint itself moves. It provides a method to realize.

  The present invention relates to a video acquisition unit that acquires and reproduces a recorded video in which a moving speed of a camera position where the video is captured is added to a video of a three-dimensional video, and a storage unit that stores in advance a threshold value related to the moving speed of the camera position And a video separation unit that compares the moving speed of the camera position with the threshold during reproduction of the acquired recorded video and separates the video into a time zone where the moving speed exceeds the threshold and a time zone below the threshold; A video correction unit that corrects a video to be reproduced in a time zone exceeding the threshold, and a video corrected by the video correction unit is displayed in a time zone that exceeds the threshold, and the video correction unit is not corrected in a time zone below the threshold. Provided is a 3D video reproduction device comprising a display control unit that controls to display video.

  That is, in order to solve the above-mentioned problems, the movement amount (movement, rotation, etc.) of the camera that captured the video at the time of 3D video creation is recorded. When playing back the created 3D video, moving the camera is equivalent to moving the viewer's viewpoint. The playback apparatus acquires a threshold value relating to the speed of movement. The threshold value is preferably set for each viewer. For the portion of the 3D video to be played whose recorded movement exceeds the threshold, processing such as turning off the screen display, reducing the playback speed of the 3D video, or switching to 2D video is performed.

The playback apparatus according to the present invention corrects a video to be played back in a time zone exceeding a threshold, and a video acquisition unit that acquires and plays back a recorded video in which the moving speed of the camera position that captured the video is added to the video of the 3D video A display control unit that controls to display a video that has been corrected by the video correction unit during a time period that exceeds the threshold value, and display a video that is not corrected by the video correction unit during a time period that is less than or equal to the threshold value. Therefore, it is possible to implement 3D sickness countermeasures for 3D images when the viewer's viewpoint itself moves, and to realize effective 3D sickness prevention measures.
That is, it is possible to prevent the occurrence of 3D sickness and suppress the influence on the health of the viewer without the viewer being aware of it.
In the present invention, the three-dimensional moving image makes the viewer feel a depth or a three-dimensional feeling in the image displayed on the flat display device by displaying different images for the parallax in the viewer's left eye and right eye. It is the picture made.
Such a device for reproducing a three-dimensional moving image includes a device that is already on the market as a so-called 3D television. One characteristic aspect of the present invention, which is different from the conventional one, is based on the premise that the camera is provided with the speed of movement (straight line movement, rotation, etc.) of the camera that captured the image at the time of 3D image creation. It is to take measures to prevent 3D sickness based on the moving speed.
The video acquisition unit of the present invention acquires and reproduces the 3D video to which the moving speed of the camera position is added as described above. The 3D image may be provided by being recorded on a recording medium such as a DVD, a Blu-ray disc, or a memory card. Or you may provide in the state accessible via communication means, such as the internet. In the former case, the video acquisition unit reads out video stored in a recording medium such as a Blu-ray disc drive, and in the latter case, the video acquisition unit corresponds to a device that plays the video on demand or downloaded.
The storage unit is a non-volatile memory that stores at least a set threshold value. Furthermore, all or part of the video data to be reproduced may be stored. As a specific aspect thereof, it corresponds to hardware such as a hard disk device or a flash memory.
The video separation unit compares the moving speed information of the camera position at each time point included in the acquired recorded video with the threshold stored in the storage unit, and separates the video with the moving speed exceeding the threshold from the video that is not so It performs the process to do. As a concrete mode, it is realized by a computer, a digital signal processor or a dedicated processing circuit. For video separation, for example, a video in a time zone in which the moving speed of the camera position exceeds a threshold is at least one packet, a video in a time zone below the threshold is another packet, and whether or not each packet exceeds the threshold The process of adding the attribute may be performed.
The video correction unit performs a process of correcting display of a video in which the moving speed of the camera position exceeds a threshold value. A specific aspect of the video correction unit is realized by a computer, a digital signal processor, or a dedicated processing circuit. In an embodiment described later, the video correction unit corresponds to a 2D video generation unit, a message display generation unit, and a low-speed video generation unit.
The display control unit controls the operation of the display device and the contents displayed on the display device. Specific embodiments thereof include, for example, a liquid crystal display device drive circuit, a display control circuit including a circuit such as a video RAM, a circuit for switching video data input to the video RAM in the preceding stage, and control of these circuits. CPU or the like.

FIG. 2 is a block diagram illustrating a configuration example of a 3D video imaging apparatus according to the present invention. FIG. 2 is a block diagram showing a configuration example of a 3D video playback device according to the present invention. It is explanatory drawing which shows the example which the imaging device which concerns on this invention changes an imaging position with respect to imaging | photography object. It is explanatory drawing which shows the image | video corresponding to the movement of (a)-(d) of FIG. It is explanatory drawing which shows the example which performs 3D sickness response to 3D video based on this invention. It is a flowchart which shows the procedure of the process which the speed data generation part which concerns on this invention performs at the time of video data capture. It is a flowchart which shows the procedure of the process which the menu control part of a reproducing | regenerating apparatus performs when setting the threshold value data based on this invention. It is a 1st flowchart which shows the procedure of the process which CPU of the reproducing | regenerating apparatus concerning this invention performs at the time of reproduction | regeneration. It is a 2nd flowchart which shows the procedure of the process which CPU of the reproducing | regenerating apparatus concerning this invention performs at the time of reproduction | regeneration.

Hereinafter, preferred embodiments of the present invention will be described.
Alternatively, the video correction unit may slow down the playback speed of the acquired video. In this way, 3D sickness of the viewer can be prevented by correcting the moving speed of the viewpoint so as not to exceed the threshold by slowing down the video playback speed.

  Furthermore, the video correction unit may correct the frame advance by thinning out the frames of the video. In this way, it is possible to prevent viewers from getting 3D sickness by making corrections that weaken the reality of viewpoint movement by frame-by-frame.

  The video correction unit may correct the video so that the viewer does not see the video acquired during a time period exceeding the threshold. In this way, when the viewpoint moves at a speed exceeding the threshold, the viewer can be prevented from seeing the 3D motion by correcting so that the viewer does not see the 3D video.

  Further, the video correction unit may correct the display so as to display a predetermined message. In this way, it is possible to notify the viewer that the 3D video is not intentionally viewed so that the viewer does not mistake the playback device for example.

  The video correction unit may correct a three-dimensional video into a two-dimensional video. In this way, when the viewpoint moves at a speed exceeding the threshold, it is possible to prevent 3D sickness of the viewer by performing correction that eliminates the stereoscopic effect from the 3D video.

  Further, the three-dimensional video image includes a right-eye video and a left-eye video that are different from each other by the amount of parallax, and the video correction unit allows the viewer's eyes to view only the right-eye video. Or you may correct | amend so that only video data for left eyes can be seen. In this way, for example, it is possible to perform a correction that eliminates the stereoscopic effect from the three-dimensional video without a complicated process such as compositing the video for the left eye and the video for the right eye. .

The storage unit may store in advance a threshold setting video in which the moving speed of the camera position changes in order for the user to set the threshold. By doing this, it is possible to individually set the moving speed at which the 3D sickness is felt by showing the viewer the threshold setting video whose moving speed changes.
The various preferable aspects shown here can also be combined.

Hereinafter, the present invention will be described in more detail with reference to the drawings. In addition, the following description is an illustration in all the points, Comprising: It should not be interpreted as limiting this invention.
≪Association of 3D video creation and speed data≫
Processing when creating a 3D video according to the present invention will be described.

  FIG. 1 is a block diagram showing a configuration example of a 3D video photographing apparatus according to the present invention. As shown in FIG. 1, the photographing apparatus 11 includes an imaging unit 13, a video data generation unit 15, an auxiliary storage unit 17, an acceleration sensor 21, an angular velocity sensor 23, a distance detection device 25, an angular velocity → speed conversion unit 27, and velocity data generation. Part 29.

  The 3D video imaging unit 13 captures video. Since the 3D video is generated from video captured from a plurality of viewpoints, the imaging unit 13 is a plurality of lenses or a plurality of cameras at different positions. The video data generation unit 15 generates a 3D video by integrating videos captured by the cameras. The auxiliary storage unit 17 stores the video data generated by the video data generation unit 15 (video data 41). Further, speed data described later is stored as a speed table 43.

  The acceleration sensor 21, the angular velocity sensor 23, and the distance detection device 25 detect movement information of the photographing apparatus 11 when photographing a 3D video. The acceleration sensor 21 detects linear movement, the angular velocity sensor 23 detects rotation, and the distance detection device 25 detects change in lens focal length. The movement information detected by these sensors when the viewer views the captured 3D video provides movement information of the viewer's viewpoint.

The angular velocity → velocity conversion unit 27 generates information on the moving speed of the imaging target based on the detection results of the angular velocity sensor 23 and the distance detection device 25. The velocity data generation unit 29 synthesizes the movement in the linear direction detected by the acceleration sensor 21 and the velocity information generated by the angular velocity → velocity conversion unit 27, that is, the velocity information of the movement accompanying rotation, about the subject to be imaged. Generate speed data. This speed data is speed data when the subject of 3D video moves relatively as the viewer's viewpoint moves.
As a modification, a mode in which the 3D video imaging unit 13 includes a plurality of independent cameras and is configured as a system is conceivable. In this case, the acceleration sensor 21, the angular velocity sensor 23, and the distance detection device 25 may be attached to each camera, but may be attached only to the camera representing the viewpoint.

The speed data generation unit 29 generates speed data corresponding to each time of the video data 41 and stores the speed data at each time in the speed table 43 in the auxiliary storage unit 17. The sampling interval of the speed data processed by the speed data generation unit 29 may be a predetermined constant interval, or the photographer may set the interval. Alternatively, sampling may be performed when there is a change in speed data that exceeds a threshold value. The sampling interval may be constant, but the sampling interval may change according to the magnitude of change in the speed data.
Note that the function of the speed data generation unit 29 may be realized by a CPU or a microcomputer executing a control program.

In this embodiment, the speed data generation unit 29 generates speed data as three-dimensional coordinate components orthogonal to each other in the X, Y, and Z directions. These are, for example, left and right, up and down, and front and back (ie, depth) directions with respect to the viewer. Of course, the mode of the speed data is not limited to this. For example, information in the polar coordinate format may be used instead of the information in the left and right and up and down directions. In principle, it is preferable for the viewer to deal with components that are sensitive to movement. As a unit of speed data, the speed data may be represented by “pixel / second” where a pixel pitch of a predetermined screen size is a unit of moving distance and a unit of time is second. For example, in a full high-definition moving image, one frame of video is composed of pixels of vertical 1080 × horizontal 1920, and the pixel pitch in a 40-inch screen size is 0.648 mm. This is the unit of distance. Alternatively, the speed data may be expressed in “/ milliseconds” where the unit from the left end to the right end of the screen is the unit of moving distance and the unit of time is milliseconds. Of course, it is not limited to these examples, and may be expressed by other methods.
As described above, the 3D video data 41 is generated in association with the speed data representing the movement of the viewer's viewpoint at each time, and is stored in the auxiliary storage unit 17.

≪Processing when playing 3D video data≫
Next, processing when playing back 3D video according to the present invention will be described.
FIG. 2 is a block diagram showing a configuration example of a 3D video playback apparatus according to the present invention. As shown in FIG. 2, the playback apparatus 51 includes a video acquisition unit 53, a video separation unit 55, a video buffer 57, a storage unit 61, a display control unit 75, a display unit 77, a 2D video generation unit 81, and a message display generation unit. 83, a low-speed video generation unit 85, a control unit 87, a menu control unit 89, a remote control light receiving unit 91, and a 3D glasses communication unit 95. In FIG. 2, each part except 3D glasses 97 and the remote control 93 is comprised as one apparatus. However, this is only an example, and as a modification, a mode in which the display unit 77 is further separated, or a mode in which each block up to the video buffer 57 and each block thereafter are separated can be considered.

  The video acquisition unit 53 acquires the video data 41 created by the photographing apparatus of FIG. 1 and the speed table 43 corresponding thereto. Specifically, the contents of the video data 41 and the speed table 43 are recorded and distributed on a recording medium such as a DVD, and the video acquisition unit 53 acquires the video data and the speed table recorded on the recording medium. Alternatively, as a different aspect, the contents of the video data 41 and the speed table 43 are disclosed in a state where they can be accessed via communication means such as the Internet. Then, the video acquisition unit 53 may access the video data and speed table made public via the communication means and acquire the video data on demand or by download.

  The video separation unit 55 separates the video data acquired by the 2D video generation unit 81, the message display generation unit 83, and the low-speed video generation unit 85, which will be described later, in time series so as to be processed. That is, the part that performs processing for 3D sickness and the other part are identified and separated. The video buffer 57 is a buffer that stores the video data processed by the video separation unit 55.

  The storage unit 61 is a memory that stores data related to reproduction of video data. The storage unit 61 stores a speed table 63, threshold data 65, resolution data 67, correction method designation 69, sample video data 71, and sample video speed table 73. When downloading video data, the downloaded video data is further stored.

The speed table 63 is a speed table corresponding to video data to be reproduced, and the contents of the speed table 43 in FIG. 1 are acquired by the video acquisition unit 53 and stored in the storage unit 61.
The threshold data 65 is a threshold for determining whether or not to perform 3D sickness correspondence on video data. In the example of FIG. 2, threshold data for each user (viewer) is stored.
The resolution data 67 is data indicating the resolution of the video data. For the depth direction, that is, the degree of stereo, the fineness of depth expression is expressed as a virtual resolution.

  The correction method designation 69 holds designation of how to deal with 3D sickness when the stereoscopic degree of video data exceeds a threshold value. In the case of FIG. 2, the correction is either 2D conversion, message display, or low-speed video generation. The user designates one of the correction methods using the setting menu. Based on the specified correction method, any one of the 2D video generation unit 81, the message display generation unit 83, and the low speed video generation unit 85 performs processing for handling 3D sickness. In FIG. 2, only one correction method specification 69 is shown as if it is a setting common to each user, but it may be specified individually for each user.

  The sample video data 71 is video data to be displayed on the display unit 77 when the threshold data 65 is set for each user. For example, 3D video data in which the moving speed of the viewpoint gradually increases. The user displays the sample video data 71 on the display unit 77 using the setting menu. When the user views the video and feels uncomfortable, the user performs a predetermined operation using the remote controller 93 and records the speed data at that time in the threshold data 65 as a threshold. The sample video speed table 73 is a speed table corresponding to the sample video data 71. The correspondence relationship corresponds to the correspondence relationship between the video data 41 and the speed table 43.

The display control unit 75 is a circuit that controls the screen display of the display unit 77. The display unit 77 is a liquid crystal display device capable of displaying 3D video. However, the display unit 77 is not limited to the liquid crystal display device. It may be a plasma display display device or an organic EL display device with different operating principles, or may be a projection type display device with a different system.
The 2D video generation unit 81 performs a process of switching video data from 3D display to 2D display as a 3D sickness response process.

  The message display generation unit 83 performs a process of temporarily stopping the display of 3D video data and displaying a message for refusing the display as a 3D sickness response process. As a specific example, a message such as “The screen is turned off due to intense movement that may have a negative effect on the physical condition” is displayed on the display unit 77 instead of the 3D video.

  The low-speed video generation unit 85 performs processing for reducing the playback speed of 3D video data as processing for 3D sickness. In this case, the voice is also linked. Alternatively, it may be reproduced like a picture-story show by thinning out display frames of video data. This is a technique to reduce the burden on the eyes by reducing screen changes per unit time.

  The control unit 87 controls each block related to reproduction of video data. The function of the control unit 87 may be realized by the CPU or the microcomputer executing the processing program. Furthermore, the CPU or the microcomputer may realize functions of other blocks by executing a program different from the control unit processing program. For example, the functions of the video separation unit 55, the 2D video generation unit 81, the message display generation unit 83, the low-speed video generation unit 85, the menu control unit 89, and the like.

The menu control unit 89 controls the display unit 77 to display a setting menu used for the user to set the threshold data 65 and specify the correction method specification 69.
The remote control light receiving unit 91 is a circuit that receives a signal from the external remote control 93. The remote controller 93 is used for an operation when the viewer gives an instruction to the playback device 51. The instruction includes the setting of the threshold data 65 and the setting of the correction method designation 69 using the setting menu described above.
The 3D glasses communication unit 95 performs unprecedented communication with the 3D glasses 97 worn when the viewer views 3D video. Communication relates to control of the shutter of the 3D glasses 97.

≪Specific example of 3D sickness correspondence≫
Next, a specific example of 3D sickness handling according to the present invention will be described while associating the movement of the photographing apparatus, that is, the movement of the viewer's viewpoint and the 3D video display.
FIG. 3 is an explanatory diagram showing an example in which the camera corresponding to the photographing apparatus 11 according to the present invention changes the photographing position with respect to the photographing object 31. As shown in FIG. 3, the photographing apparatus 11 moves from the initial (a) photographing start position to the left obliquely forward in a straight line along the arrow (b) at a moving speed of 1000 pixels / second. To approach. Then, it rotates to the right as shown by the arrow in (c). The rotation is converted into a continuation of a pseudo minute linear motion. The converted moving speed is 4000 pixels / second. Next, the photographing device 11 moves linearly along the arrow (d) at a speed of 500 pixels / second.

  FIG. 4 is an explanatory diagram showing an image corresponding to the movement of (a) to (d) of FIG. However, FIG. 4 shows an image before 3D sickness handling is performed. FIG. 4A is an image at the start of shooting, and the shooting target 31 is shown far away near the center of the screen. FIG. 4B shows a change of the photographing object 31 before and after the movement along the arrow (b) in FIG. The arrows are added to show the flow of time, and the arrows are not shown on the screen. It shows that the object shown at the beginning of the movement is shown as the start point side of the arrow and is shown as the tip side of the arrow at the end of the movement. That is, before and after the movement of the arrow (b) in FIG. 3, the photographing object 31 gradually moves from the vicinity of the center of the screen to the right side of the screen and is close-up.

  FIG. 4C shows before and after the rotation shown by the arrow (c) in FIG. As shown in FIG. 4C, the photographing object 31 moves from the right end portion to the left end portion of the screen while maintaining the size. FIG. 4D shows before and after movement of the arrow (d) in FIG. The subject 31 moves further to the left and further away from the left end of the screen, and eventually leaves the screen.

A specific example of performing 3D sickness correspondence on the video in FIG. 4 will be described. In this embodiment, it is assumed that the threshold value for determining whether to perform 3D sickness correspondence is set to 3000 pixels / second. Then, among the images from (a) the start of shooting to (d) movement in FIG. 4, the images in which the moving speed of the viewer's viewpoint exceeds the above-described threshold are (c) images at the rotation stage.
The video separation unit 55 separates the video packet of FIGS. 4A and 4B and the video of FIG. 4C, and separates the video packet of FIG. 4C and the video packet of FIG. Then, an attribute indicating that 3D sickness correspondence should be performed is added to the video data in FIG.

The 2D video generation unit 81, the message display generation unit 83, and the low speed video generation unit 85 monitor the attribute added to the video data by the video separation unit 55 and the correction method designation 69. When the attribute is added to the packet of the video data taken out from the video buffer 57, the 2D video generation unit 81, the message display generation unit 83, or the low-speed video generation unit 85 specified by the correction method specification 69 It processes the video data of the packet. In addition, the processing that is not designated by the correction method designation 69 is not performed.
FIG. 5 is an explanatory diagram showing an example in which 3D sickness correspondence is performed on the 3D video according to the present invention. In FIG. 5, (c) the input video is the same as the video in FIG. 4 (c), and the 2D video generation unit 81, the message display generation unit 83, and the low-speed video generation unit 85 each perform 3D sickness support. This is the target video.

  FIG. 5 (c-1) shows an output video of the 2D video generation unit 81 for the input video of FIG. 5 (c). The 2D video generation unit 81 generates and outputs a video with no parallax from the input video. That is, the input video in FIG. 5C includes a right-eye video and a left-eye video, and these videos are obtained by viewing the same subject 31 from different viewpoints. The simplest method for converting this to 2D video is to replace the left-eye video with the right-eye video, or the right-eye video with the left-eye video, and make the right-eye video and left-eye video the same. To do.

  FIG. 5C-2 shows an output video of the message display generation unit 83 for the input video of FIG. 5C. The message display generation unit 83 outputs a message “The screen is turned off due to intense movement” instead of the input video. At this time, instead of turning off the input video completely, the reduced video is displayed on a part of the screen, or the video with reduced brightness is displayed on the background of the message so that the viewer can progress the story. You may make it understandable.

  FIG. 5C-3 shows the output video of the low-speed video generation unit 85 for the input video shown in FIG. The low-speed video generation unit 85 displays the video at a low playback speed so that the movement of the viewer's viewpoint is below the threshold. Alternatively, the frames of the input video are thinned out and reproduced as frame-by-frame. At this time, a message indicating that the playback is slow or the frame is thinned may be displayed.

≪Video data creation processing procedure≫
Hereinafter, a procedure of processing performed by the speed data generation unit 29 when capturing video data will be described.
FIG. 6 is a flowchart showing a procedure of processing executed by the speed data generation unit 29 according to the present invention when capturing video data. As shown in FIG. 6, when the capture of video data is started, the speed data generation unit 29 reads information on the lens focal length detected by the distance detection device 25 (step S11). The lens focal length provides the distance in the depth direction to the subject. Further, the speed data generation unit 29 reads information on the angular velocity detected by the angular velocity sensor 23 (step S13). This gives the speed of rotation at which the viewer changes the orientation of the viewpoint.

  The speed data generation unit 29 determines whether or not there has been a change in the focal length or the angular speed (step S15). If there is a change, the information on the focal length and the angular velocity is converted into the information on the moving speed in the xyz direction using the angular velocity → speed converting unit 27 (step S17), and the converted moving speed is stored together with the detection time t. Write to the speed table 43 of the unit 17 (step S19). If there is no change in step S15, the routine proceeds to step S21.

  The speed data generation unit 29 reads information on acceleration detected by the acceleration sensor 21 (step S21). Then, it is determined whether or not there is a change in acceleration (step S23). If there is a change, the detected acceleration information is converted into speed information in the xyz direction (step S25), and the converted moving speed is detected. Is written in the speed table 43 of the auxiliary storage unit 17 together with the time t. If data has already been written in the speed table 43 in step S19, the data is corrected (step S27). If there is no change in step S23, the routine proceeds to step S29.

The speed data generation unit 29 updates the current time t as the next sampling time (step S29). Then, it is determined whether or not the video data capture continues (step S31). If capture continues (NO in step S31), the routine proceeds to step S11 and repeats sampling. When the capturing is completed (YES in step S31), the video data 41 captured and stored in the auxiliary storage unit 17 is associated with the speed table 43.
The above is the processing performed by the speed data generation unit 29 during shooting.

≪Threshold setting and correction method specification process≫
Next, a procedure of processing executed by the menu control unit 87 of the playback device when setting the threshold data 65 of FIG. 2 will be described. In this embodiment, the function of the menu control unit 89 is realized by the CPU executing a control program.

  FIG. 7 is a flowchart showing a procedure of processing executed by the menu control unit 89 of the playback apparatus when setting the threshold data 65 according to the present invention. As shown in FIG. 7, the CPU as the menu control unit 89 responds to the fact that the remote control light receiving unit 91 detects the optical signal emitted when the user operates the remote control 93, and sets the threshold value on the display unit 77. Display the menu. The menu to be displayed first is a selection menu for new registration or selection of the user and whether the user directly sets the threshold (direct input) or simple setting using the sample video (step S41). When the user gives an instruction to display the selection menu by operating the remote controller 93, the CPU determines the content of the instruction (step S43). When receiving an instruction to directly set the threshold value (YES in step S43), the CPU accepts a threshold value for the speed in the xyz direction input by the user operating the remote controller 93 (step S45). Then, the value of the threshold data 65 of the user is updated (step S47). Thereafter, the routine proceeds to step S61 where the designation of the correction method is accepted.

  When a simple setting using the sample video is selected in step S43 (NO in step S43), the CPU displays the explanation of the setting method on the display unit 77 and then displays the sample video data 71 for setting. (Step S51). The sample video is, for example, 3D video data in which the moving speed of the viewpoint is gradually increased. When the user views the video and feels uncomfortable, a predetermined operation is performed using the remote controller 93. There may be a plurality of sample images. For example, the images may move in the xyz direction. Alternatively, a plurality of videos having the same moving direction but different shooting targets may be used. In this case, the user performs a predetermined operation for each video.

The CPU monitors whether the user has performed a predetermined operation (step S53). If there is an input (YES in step S53), the value of the sample video speed table 73 at that time is acquired (step S55). Then, the value of the threshold data 65 of the user is updated (step S57). The process is repeated until the sample video ends (NO loop in step S59).
When the setting using the sample video is completed (YES in step S59), the routine proceeds to step S61.

Subsequently, the CPU displays a setting menu for the correction method designation 69 on the display unit 77 (step S61). In this embodiment, it is required to select one of the three options of 2D video, message display, or slow playback. When the user performs an operation of selecting any one using the remote controller 93, the CPU stores the selected setting in the correction method designation 69 in response to the operation (step S63).
The above is the threshold setting and correction method designation processing.
In this embodiment, the threshold setting and the correction method designation are made in a series, but they may be accepted as individual setting menus.

≪Process during 3D video playback-normal video data playback≫
Subsequently, the processing executed by the CPU as the control unit 87, the video separation unit 55, the 2D video generation unit 81, the message display generation unit 83, the low-speed video generation unit 85, and the menu control unit 89 when the video is reproduced will be described. To do.
8 and 9 are flowcharts showing a procedure of processing performed by the CPU of the playback device 51 according to the present invention during playback. A processing procedure will be described with reference to a flowchart. Although not shown in the flowchart, the CPU as the control unit 87 may first perform processing for specifying a user when receiving an instruction to reproduce video data. This process is for identifying the user related to the threshold data 65 and the correction method designation 69. Specifically, a menu for requesting the input of an identification code may be displayed, and the user may be specified based on the input content.

  First, video data reproduction will be described with reference to FIG. The 3D sickness response will be described later with reference to FIG. When the user operates the remote controller 93 to give a playback instruction, the CPU accepts the instruction as the control unit 87 and causes the video acquisition unit 53 to acquire video data and a speed table to be played back. The acquired speed table is stored in the storage unit 61 as a speed table 63. Then, the value of the time data t used for synchronizing the video data and the speed table is initialized (step S71). The time data t is updated as the reproduction of the video data proceeds. That is, the time data t represents which time frame of the video data is being reproduced. Further, the value of the index i used for referring to the speed table 63 is initialized (step S73).

  Next, the CPU as the video separation unit 55 acquires time t (i) of the speed table referred to by the index i (step S75). Then, the reproduction of the video data proceeds and waits for the time data t to reach t (i) (step S77). Before the time data t reaches t (i), the CPU makes a “NO” determination at step S77, and the routine proceeds to step S89. Here, the CPU inputs the video data acquired by the video acquisition unit 53 to the video buffer 57 and advances the playback of the video (step S89). At this time, the attribute indicating that 3D support is to be added is not added to the video data. Then, the time data t is updated in accordance with the progress of reproduction (step S91). As long as the video data does not end (NO in step S93), the routine follows a loop returning to step S77. In addition, although loop processing is performed on the flowchart for easy understanding, iterative processing is executed as time-division multitask processing.

  Eventually, when the time data t reaches t (i), the CPU determines “YES” in step S77, and the routine proceeds to step S79. Then, the CPU refers to the speed data indicated by the index i in the speed table 63. Then, the magnitude relationship between the speed data and the threshold data 65 is compared (step S83). In the case of an apparatus that uses different units for the speed data in the speed table and the threshold data 65, conversion for aligning the units is performed prior to the comparison described above (step S81).

If the speed data obtained from the speed table does not exceed the threshold data 65 in the comparison in step S83 (NO in step S83), the CPU determines that there is no need to perform 3D sickness handling, and the routine steps. Proceed to S85. This routine continues to step S89 where the acquired video data is input to the video buffer 57 and playback is advanced. However, before that, the index i is updated (step S85), the next data in the speed table 63 is referred to, and the time data t is obtained by using the updated index (step (i)). S87). Thereafter, the routine follows the route of steps S89, S91, S93, and S77, and continues to reproduce the video until the time data t reaches the newly acquired time t (i).
If the video data has been completed, the CPU makes a “YES” determination at step S93 to end the reproduction process.

  On the other hand, if it is determined in step S83 that the speed data exceeds the threshold data 65 (YES in step S83), the CPU separates the video data from the previous video data. Then, an attribute indicating that 3D sickness correspondence should be performed is added to the separated video data, and then input to the video buffer 57 (step S95). Then, the routine proceeds to step S91.

≪Processing during 3D video playback-3D sickness handling process≫
Furthermore, 3D sickness handling processing will be described with reference to FIG. FIG. 9 is a flowchart mainly showing processing performed by the CPU as the 2D video generation unit 81, the message display generation unit 83, and the low-speed video generation unit 85.
The CPU monitors whether the video data output from the video buffer 57 and passed to the display control unit 75 has an attribute for handling 3D sickness (step S100). When the attribute is not added, that is, in the case of video data input to the video buffer 57 through the process of step S89 described above (NO in step S100), the CPU does not perform the correction process and the video data Is transferred to the display control unit 75 (step S133). The display control unit 75 displays the passed video data on the display unit 77. Unless the video data ends (NO in step S135), the routine returns to step S103 and repeats the process. Note that although loop processing is used in the flowchart for easy understanding, the iterative processing is performed as time-division multitask processing.

  In the case where the attribute indicating that 3D sickness support is to be added in step S95 described above, that is, in the case of video data input to the video buffer 57 through the process in step S95 described above (YES in step S100), The CPU acquires the setting of the correction method designation 69 (step S101). If it is set for each user, a correction method corresponding to the user is acquired.

  Then, processing according to the correction method is performed. First, it is determined whether or not the acquired correction method is low-speed playback (step S103). If it is slow playback (YES in step S103), the routine proceeds to step S121. On the other hand, if it is not low-speed reproduction (NO in step S103), the routine proceeds to step S105, and determines whether or not the correction method is message display. If the message is displayed (YES in step S105), the routine proceeds to step S111. On the other hand, if the message is not displayed (NO in step S105), the routine proceeds to step S107 and performs 2D processing.

Specifically, the CPU as the 2D video generation unit 81 replaces the video data for the left eye with the video data for the right eye so that both eyes view the video data for the right eye. In this way, there is no parallax between the video data for the right eye and the video data for the left eye, and the viewer does not feel a stereoscopic effect. Of course, the video data for the right eye may be replaced with the data for the left eye so that both eyes can view the video data for the left eye.
Further, instead of replacing the video data, the shutter control for both eyes of the 3D glasses 97 may be changed.

During normal 3D video playback, left-eye video data and right-eye video data are alternately displayed on the display unit 77 one frame at a time, and the shutter of the 3D glasses 97 is alternately turned on / off in synchronization therewith. ing. That is, when the right-eye video data is displayed on the display unit 77, control is performed such that the right-eye shutter of the 3D glasses 97 is opened and the left-eye shutter is closed. When video data for the left eye is displayed on the display unit 77 in the next frame, control is performed so that the right eye shutter of the 3D glasses 97 is closed and the left eye shutter is opened. This is repeated alternately. On the other hand, when converting the video into 2D, the right-eye shutter and the left-eye shutter of the 3D glasses 97 are opened while the right-eye video data is displayed on the display unit 77. Then, when the left-eye video data is displayed on the display unit 77 in the next frame, the shutters of both the right eye and the left eye of the 3D glasses 97 are closed. In this way, both eyes are allowed to watch only the video for the right eye. Alternatively, the binocular shutter is opened when the left-eye video data is displayed on the display unit 77, and the binocular shutter is closed when the right-eye video data is displayed. Alternatively, both eyes may view only the video for the left eye.
Then, the CPU passes the video data to the display control unit 75 (step S133). The display control unit 75 that has received the video data displays the corrected video data on the display unit 77. The processes from S100 to S133 are repeated until the video data is finished (step S135).

  On the other hand, when the correction method is message display in step S105, the CPU as the message display generation unit 83 generates video data of a message to be displayed instead of the video data output from the video buffer 57 (step S111). ). Then, the video data is replaced with the generated message (step S113) and is transferred to the display control unit 75 (step S133). The processes from S100 to S133 are repeated until the video data is finished (step S135).

  On the other hand, when the correction method is message display in step S103 (YES in step S103), the CPU as the low-speed video generation unit 85 generates a series of n frames of video data output from the video buffer 57 ( (n is an integer equal to or greater than 2) is divided into time-series groups (step S121). Then, a wait process is inserted between the video playback of each group (steps S123 to S131), and the video is played back slowly. The wait time to be inserted is preferably determined by the CPU based on the speed data in the speed table 63 and the threshold data 65. That is, it is preferable to determine the tax and time so that the moving speed of the viewpoint of the slow-played video does not exceed the threshold data 65 setting.

  In addition to the embodiments described above, there can be various modifications of the present invention. These modifications should not be construed as not belonging to the scope of the present invention. The present invention should include the meaning equivalent to the scope of the claims and all modifications within the scope.

11: imaging device 13: imaging unit 15: video data generation unit 17: auxiliary storage unit 21: acceleration sensor 23: angular velocity sensor 25: distance detection device 27: angular velocity → speed conversion unit 29: velocity data generation unit 31: imaging target 41 : Video data 43: Speed table 51: Playback device 53: Video acquisition unit 55: Video separation unit 57: Video buffer 61: Storage unit 63: Speed table 65: Threshold data 67: Resolution data 69: Correction method designation 71: Sample video Data 73: Sample video speed table 75: Display control unit 77: Display unit 81: 2D converted video generation unit 83: Message display generation unit 85: Low speed video generation unit 87: Control unit 89: Menu control unit 91: Remote control light receiving unit 93 : Remote control 95: 3D glasses communication part 97: 3D glasses

Claims (8)

A video acquisition unit that acquires and plays back a recorded video in which the moving speed of the camera position that captured the video is added to the video of the three-dimensional video;
A storage unit that stores in advance a threshold value related to the moving speed of the camera position;
A video separation unit that compares the moving speed of the camera position with the threshold during reproduction of the acquired recorded video, and separates the video into a time zone in which the moving speed exceeds the threshold and a time zone below the threshold;
A video correction unit for correcting a video to be played back in a time zone exceeding the threshold;
A display control unit that controls to display a video that has been corrected by the video correction unit during a time period that exceeds a threshold value, and to display a video that is not corrected by the video correction unit during a time period that is less than or equal to the threshold value. 3D video playback device.   The playback apparatus according to claim 1, wherein the video correction unit slows down the playback speed of the acquired video.   The playback apparatus according to claim 1, wherein the video correction unit corrects frame-by-frame advance by thinning out the video frames.   The playback device according to claim 1, wherein the video correction unit corrects the video acquired by the viewer so as not to be displayed during a time period exceeding the threshold.   The playback apparatus according to claim 4, wherein the video correction unit corrects the predetermined message to be displayed.   The playback apparatus according to claim 1, wherein the video correction unit corrects a three-dimensional video to a two-dimensional video. The three-dimensional video image includes a right-eye image and a left-eye image that are different from each other by the amount of parallax,
The playback apparatus according to claim 6, wherein the video correction unit performs correction so that only the right-eye video can be viewed by the viewer's eyes or only the left-eye video data can be viewed.   The playback apparatus according to claim 1, wherein the storage unit stores in advance a threshold setting video in which a moving speed of the camera position changes in order for the user to set the threshold.