WO2011108180A1

WO2011108180A1 - Stereoscopic image output device and method of outputting stereoscopic image

Info

Publication number: WO2011108180A1
Application number: PCT/JP2011/000263
Authority: WO
Inventors: 隆義岡崎
Original assignee: パナソニック株式会社
Priority date: 2010-03-03
Filing date: 2011-01-19
Publication date: 2011-09-09
Also published as: JP2013093638A

Abstract

Disclosed are a stereoscopic image output device, and a method of outputting a stereoscopic image, wherein the visual fatigue due to a stereoscopic display when watching three-dimensional moving display contents, which are uneditable, is suppressed. A stereoscopic image reproducer (101) is provided with a main image generating unit (302) which generates a three-dimensional moving display by decoding a stereoscopic video stream; an output unit (306) which outputs the three-dimensional moving display; an integrating unit (303) which calculates the integrated value of the time variations in the depth value in the three-dimensional moving display; and a system control unit (307) which controls the output unit (306) such that the display method of the three-dimensional moving display is changed when the integrated value is higher than a given threshold.

Description

3D image output apparatus and 3D image output method

The present invention relates to a stereoscopic video output apparatus and a stereoscopic video output method for displaying a stereoscopic video on a display unit.

2. Description of the Related Art Conventionally, a stereoscopic video display device that displays a stereoscopic video (three-dimensional moving image) that a viewer can feel stereoscopically and a stereoscopic video output device that outputs a stereoscopic video signal to the display device are becoming widespread. At this time, it is required to suppress the visual fatigue of the viewer due to the stereoscopic video. As a conventional technique for suppressing visual fatigue due to a stereoscopic image, there is a technique described in Patent Document 1 or Patent Document 2, for example.

Patent Document 1 discloses a moving image processing apparatus that estimates the amount of motion in the depth direction of a three-dimensional image based on the correlation between the frame image data of both the right eye and the left eye, and prevents visual eye fatigue during reproduction. ing.

Patent Document 2 discloses a stereoscopic video recording method in which an eye fatigue evaluation value is calculated from a left-eye video and a right-eye video based on a change amount of parallax angle, a required time, and the number of times, and recorded within a predetermined range. .

In such a conventional technology for suppressing visual fatigue caused by stereoscopic video, the amount of motion in the depth direction of the stereoscopic video, the amount of change in viewing angle, the required time and the number of times are controlled, and the stereoscopic video itself is edited to visually Fatigue is suppressed.

JP 2007-020130 A JP 2009-135686 A

However, in the above-described prior art, since the stereoscopic video itself is edited, visual fatigue due to the stereoscopic video at the time of viewing the non-editable 3D moving image content such as a distributed content such as a movie cannot be suppressed.

Therefore, an object of the present invention is to provide a stereoscopic video output apparatus and a stereoscopic video output method capable of suppressing visual fatigue caused by stereoscopic video when viewing non-editable 3D moving image content.

In order to solve the above problems, a stereoscopic video output apparatus according to an aspect of the present invention includes a decoding unit that generates a three-dimensional moving image by decoding a stereoscopic video stream, and an output unit that outputs the three-dimensional moving image. And an integration unit that calculates an integrated value of the temporal change amount of the depth value in the 3D moving image, and the display method of the 3D moving image is changed when the integrated value is equal to or greater than a predetermined threshold. A control unit for controlling the output unit.

As a result, the integrated value of the temporal change in the depth value, which is a value indicating whether or not the image includes forward / backward intense motion, is used. In the case of an image with large visual fatigue, the display can be changed more quickly than in the case of an image with small visual fatigue to the viewer. Note that the intense movement back and forth corresponds to a change in the amount of jumping out of the image in the direction from the display surface toward the viewer. Therefore, since the display is changed at a timing according to the content of the 3D moving image, even when the 3D moving image cannot be edited, the viewer can be urged to stop at an appropriate timing. Visual fatigue can be suppressed.

Further, the integration unit sequentially detects the depth value of the three-dimensional moving image at a predetermined time interval, sequentially calculates the absolute value of the difference between the detected depth value and the immediately preceding depth value as the change amount, and calculates The integrated value may be calculated by integrating the amount of change.

Thereby, since the integrated value can be calculated sequentially, the display can be promptly changed at the timing when the integrated value becomes equal to or greater than the threshold value.

The stereoscopic image output device further combines a graphics generation unit that generates a graphics image representing a warning message to a viewer, and the graphics image and the three-dimensional moving image, thereby combining the synthesized image. A synthesis unit for generating the three-dimensional moving image display method by causing the output unit to output the synthesized image when the integrated value is equal to or greater than the predetermined threshold. It may be changed.

Thus, a warning message is displayed on the screen when the integrated value of the temporal change amount of the depth value is equal to or greater than a predetermined threshold value, so that the viewer can be prompted to stop playback. Since a warning message is displayed at a timing according to the content of the 3D moving image, even when the 3D moving image cannot be edited, the viewer can be urged to stop at an appropriate timing. Fatigue can be suppressed.

In addition, after the composite image is output, the control unit changes the 3D moving image to a 2D moving image or stops the output of the 3D moving image by causing the output unit to stop the output of the 3D moving image. You may change the display method of a three-dimensional moving image.

Thereby, after the warning message is displayed on the screen, the display is forcibly changed to the two-dimensional display, or the three-dimensional display is stopped, so that visual fatigue of the viewer can be reliably suppressed.

The stereoscopic video output device further includes an operation receiving unit that receives a user operation, and the control unit outputs the three-dimensional moving image to the two-dimensional moving image by the operation receiving unit after the synthesized image is output. When the user operation for stopping the output of the three-dimensional moving image is received, the three-dimensional moving image is changed to the two-dimensional moving image in the output unit or the three-dimensional moving image is received. The display method of the three-dimensional moving image may be changed by stopping the output of the image.

Thereby, since the display is changed after the user operation is accepted, the visual fatigue of the viewer can be suppressed in accordance with the viewer's intention.

In addition, when the integrated value is equal to or greater than the predetermined threshold, the control unit causes the output unit to change the three-dimensional moving image to a two-dimensional moving image and output the two-dimensional moving image. The display method of the three-dimensional moving image may be changed.

This changes the 3D display to the 2D display, so that visual fatigue of the viewer can be reliably suppressed.

The stereoscopic image output device further combines a graphics generation unit that generates a graphics image representing a warning message to a viewer, and the graphics image and the two-dimensional moving image, thereby combining the synthesized image. A synthesis unit for generating the three-dimensional moving image display method by causing the output unit to output the synthesized image when the integrated value is equal to or greater than the predetermined threshold. It may be changed.

As a result, since the message is displayed after the display is changed to the two-dimensional display, in addition to being able to reliably suppress the visual fatigue of the viewer, for example, the reason for the display being changed by the viewer Can be presented.

The control unit may change the display method of the three-dimensional moving image by causing the output unit to stop outputting the three-dimensional moving image when the integrated value is equal to or greater than a predetermined threshold. Good.

This stops the 3D display, so that visual fatigue of the viewer can be reliably suppressed.

The stereoscopic image output apparatus further includes a graphics generation unit that generates a graphics image representing a warning message to a viewer, and the control unit is configured to perform the operation when the integrated value is equal to or greater than a predetermined threshold. The display method of the 3D moving image may be changed by causing the output unit to stop outputting the 3D moving image and then outputting the graphics image.

As a result, since the message is displayed after the 3D display is stopped, the visual fatigue of the viewer can be reliably suppressed, and for example, the reason for the display being changed by the viewer, etc. Can be presented.

Note that the present invention can be realized not only as a stereoscopic video output device but also as a method in which a processing unit constituting the stereoscopic video output device is used as a step. Moreover, you may implement | achieve as a program which makes a computer perform these steps. Furthermore, it may be realized as a recording medium such as a computer-readable CD-ROM (Compact Disc-Read Only Memory) in which the program is recorded, and information, data, or a signal indicating the program. These programs, information, data, and signals may be distributed via a communication network such as the Internet.

Further, some or all of the components constituting each of the above-described stereoscopic video output devices may be configured by a single system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip, and specifically includes a microprocessor, ROM, RAM (Random Access Memory), and the like. Computer system.

According to the 3D image output apparatus and 3D image output method according to the present invention, visual fatigue due to 3D images when viewing 3D moving image content that cannot be edited can be suppressed.

FIG. 1 is a diagram illustrating an example of a relationship between a stereoscopic video playback device and another device according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of the configuration of the stereoscopic video reproduction apparatus according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of the configuration of the system controller according to the embodiment of the present invention. FIG. 4 is a diagram showing a display example of viewing stop according to the embodiment of the present invention. FIG. 5 is a flowchart showing an example of the operation of the system controller according to the embodiment of the present invention. FIG. 6 is a flowchart showing an example of the operation of the system controller according to the modification of the embodiment of the present invention. FIG. 7A is a flowchart showing an example of the operation of the system controller according to the modification of the embodiment of the present invention. FIG. 7B is a flowchart showing an example of the operation of the system controller according to the modification of the embodiment of the present invention. FIG. 7C is a flowchart showing an example of the operation of the system controller according to the modification of the embodiment of the present invention.

Hereinafter, embodiments will be described with reference to the drawings.

A stereoscopic video output apparatus according to an embodiment of the present invention includes an output unit that outputs a three-dimensional moving image, an integrating unit that calculates an integrated value of temporal changes in depth values in the three-dimensional moving image, and an integrated value And a control unit that controls the output unit so that the display method of the three-dimensional moving image is changed.

FIG. 1 is a diagram illustrating an example of a relationship between a stereoscopic video playback device and other devices according to an embodiment of the present invention. Specifically, FIG. 1 is a diagram illustrating a relationship between the stereoscopic video reproduction device 101, a medium input to the stereoscopic video reproduction device 101, and other devices connected to the stereoscopic video reproduction device 101.

The stereoscopic video reproduction device 101 is an example of the stereoscopic video output device according to the embodiment of the present invention, and is, for example, a digital video recorder or a set top box. The stereoscopic video reproduction apparatus 101 reads stereoscopic video content (stereoscopic video stream) from the server 103, the optical disc 104, or the memory card 106 in which video is stored. Then, the stereoscopic video reproduction device 101 can generate a three-dimensional moving image by decoding the read stereoscopic video content, and can reproduce the generated three-dimensional moving image.

Also, the stereoscopic video reproduction apparatus 101 receives a stereoscopic video program (stereoscopic video stream) broadcast from a broadcasting station via the antenna 105. Then, the stereoscopic video reproduction device 101 can generate a three-dimensional moving image by decoding the received stereoscopic video stream, and can reproduce the generated three-dimensional moving image.

The 3D moving image generated in this way is output from the stereoscopic video reproduction device 101 to the stereoscopic video display device 102 and displayed by the stereoscopic video display device 102. Note that the stereoscopic video display device 102 is, for example, a digital television.

The server 103 is a storage server in which stereoscopic video streams are accumulated. The stereoscopic video reproduction device 101 and the server 103 are connected via a communication network such as the Internet. The server 103 can transmit a stereoscopic video stream to the stereoscopic video reproduction device 101 in response to a request from the stereoscopic video reproduction device 101.

The optical disc 104 is a recording medium in which a stereoscopic video stream is stored, and can be inserted into the stereoscopic video reproduction apparatus 101. The stereoscopic video reproduction apparatus 101 can read a stereoscopic video stream recorded on the optical disc 104 via a disc drive.

The antenna 105 is a device for receiving a broadcast wave including a stereoscopic video stream transmitted from a broadcasting device of a broadcasting station. The broadcast wave is demodulated by the tuner, and a stereoscopic video stream obtained by the demodulation is supplied to the stereoscopic video reproduction apparatus 101.

The memory card 106 is a semiconductor memory storing a stereoscopic video stream or a recording medium equipped with a semiconductor memory. The memory card 106 can be inserted into the stereoscopic video playback device 101. The stereoscopic video reproduction device 101 can read the video stream stored in the memory card 106 via the memory device interface.

Note that the stereoscopic video, that is, the three-dimensional moving image according to the embodiment of the present invention is composed of, for example, a left-eye image and a right-eye image having parallax. The viewer (user) can feel the three-dimensional moving image in three dimensions by viewing the left-eye image with the left eye and the right-eye image with the right eye.

For example, the stereoscopic video reproduction device 101 alternately outputs a left-eye image and a right-eye image for each frame. Then, the stereoscopic video display apparatus 102 alternately displays the left-eye image and the right-eye image for each frame. The viewer views the left-eye image and the right-eye image using active shutter glasses that can switch between transmission and blocking of light between the left eye and the right eye.

The active shutter glasses are synchronized with the display timing of the image by the stereoscopic video display device 102. Specifically, the active shutter glasses block the right eye when the image for the left eye is displayed, and transmit light only to the left eye, and block the left eye when the image for the right eye is displayed. By doing so, light is transmitted only to the right eye. By wearing such active shutter glasses, the viewer can view the left-eye image with the left eye and the right-eye image with the right eye, and can view the three-dimensional moving image.

FIG. 2 is a diagram showing an example of the configuration of the stereoscopic video reproduction device 101 according to the embodiment of the present invention, and is a diagram showing an example of the internal structure of the stereoscopic video reproduction device 101.

The stereoscopic video program and the stereoscopic video content are input to the stereoscopic video reproduction apparatus 101 via various recording media or by various distribution methods. Therefore, the stereoscopic video reproduction apparatus 101 has a video information input unit corresponding to a medium on which stereoscopic video content is recorded and a distribution method of the stereoscopic video program.

Specifically, as shown in FIG. 2, the stereoscopic video reproduction apparatus 101 includes a disk drive 201, a tuner 202, a network communication interface 203, a memory device interface 204, and an HD (Hard Disk) as video information input units. ) Drive 205.

The disk drive 201 is an example of an input unit, and reads stereoscopic video content from the optical disk 104. The network communication interface 203 is an example of an input unit, and reads stereoscopic video content from the server 103. The memory device interface 204 is an example of an input unit, and reads stereoscopic video content from the memory card 106. The tuner 202 is an example of an input unit, and receives a stereoscopic video program from the antenna 105 that receives a broadcast program. Further, the stereoscopic video reproduction apparatus 101 writes the stereoscopic video content and the stereoscopic video broadcast program read from these video information input units to the HD drive 205 within the permitted range of copyright, and the written stereoscopic video content. Can be read out.

Further, as shown in FIG. 2, the stereoscopic video reproduction apparatus 101 includes a system controller 206, a data transmission interface 207, and a user operation reception unit 208.

The system controller 206 is a processing unit that executes main functions of the stereoscopic video output apparatus according to the embodiment of the present invention. As described above, the stereoscopic video content or the stereoscopic video program read by one of the video information input units is converted into a stereoscopic video by the system controller 206 and transmitted to the stereoscopic video display device 102 by the data transmission interface 207. The Details of the system controller 206 will be described later.

The data transmission interface 207 is an interface for connecting the stereoscopic video reproduction device 101 and the stereoscopic video display device 102. Specifically, the stereoscopic video generated by the system controller 206 is output to the stereoscopic video display device 102 via the data transmission interface 207.

The user operation reception unit 208 is an example of an input unit that receives a user operation. The stereoscopic video reproduction apparatus 101 can perform setting operation of the apparatus using a user interface such as a key or a remote control installed on the apparatus main body. The operation of setting the apparatus by the viewer is instructed to the system controller 206 through the user operation receiving unit 208.

FIG. 3 is a diagram illustrating an example of the configuration of the system controller 206 according to Embodiment 1 of the present invention, and is a diagram illustrating an example of the internal structure of the system controller 206. The system controller 206 includes a stream processing unit 301, a main video generation unit 302, an integration unit 303, a comparison unit 304, a graphics generation unit 305, an output unit 306, and a system control unit 307.

The stereoscopic video content and the stereoscopic video program are input to the stream processing unit 301. The stream processing unit 301 organizes data of content and program information, extracts video information and control information necessary for reproduction, and outputs them to the main video generation unit 302.

The main video generation unit 302 is an example of a decoding unit, and generates a three-dimensional moving image by decoding a stereoscopic video stream. Specifically, the main video generation unit 302 generates a right-eye main video and a left-eye main video as a three-dimensional moving image based on the video information and control information input from the stream processing unit 301, Output to the output unit 306.

The integrating unit 303 calculates an integrated value of the temporal change amount of the depth value in the three-dimensional moving image. A specific method for calculating the integrated value will be described later.

It should be noted that the depth value is a value indicating the amount of projection or retraction (depth) of an image from a predetermined reference surface (for example, display surface). Alternatively, the depth value can also be expressed as a distance from the viewer to the subject at the time of shooting (image acquisition). The depth value also corresponds to the amount of parallax. For example, an image with a larger parallax is an image of a subject located closer to the viewer, and the pop-out amount increases.

The comparing unit 304 compares the integrated value calculated by the integrating unit 303 with a predetermined threshold value. That is, the comparison unit 304 determines whether or not the integrated value is greater than or equal to a predetermined threshold value. The comparison result is output to the graphics generation unit 305.

Here, the predetermined threshold value can be determined based on various information. For example, the comparison unit 304 (or the system control unit 307) displays the viewer information indicating the viewer's attributes, the environment information indicating the surrounding environment when the viewer views the 3D moving image, or the viewer's The threshold is determined based on operation information indicating the operation.

For example, the viewer information is information indicating whether the viewer is “adult”, “child”, or “old man”. At this time, the comparison unit 304 determines the threshold value when the viewer is “adult” to a value larger than the threshold value when the viewer is “child” or “old man”.

The viewer information can be acquired by photographing the viewer, analyzing the captured image, and estimating the age of the viewer. Also, when a viewer wears glasses (active shutter glasses) to view a stereoscopic video, the stereoscopic video reproduction device 101 acquires information indicating the type of glasses by communicating with the glasses, and based on the acquired information. Thus, it may be determined whether the viewer is “adult” or “child”. The information indicating the type of glasses is, for example, the size of the glasses, and can be determined as “adult” for large glasses and “child” for small glasses. Or you may make a viewer himself / herself input viewer information.

Also, when there are a plurality of viewers, the lowest threshold may be selected from the thresholds corresponding to each of the plurality of viewers. For example, the comparison unit 304 (or the system control unit 307) selects a threshold value for “children” when “adult” and “children” exist as viewers.

Also, the environment information is information indicating, for example, the brightness of the space in which the stereoscopic video reproduction device 101 and the stereoscopic video display device 102 are installed, or the current time. For example, the comparison unit 304 determines a threshold value that increases as the space becomes brighter. Or the comparison part 304 may determine the threshold value of a value smaller than the time slot | zone in the daytime at the time zone of midnight or early morning.

The graphics generation unit 305 generates a graphics image representing a warning message for the viewer. The graphics generation unit 305 generates an operation screen image corresponding to the viewer's operation.

The output unit 306 outputs the three-dimensional moving image to the stereoscopic video display device 102. The output unit 306 includes a synthesis unit 306a as shown in FIG.

The synthesizing unit 306a synthesizes the main video generated by the main video generating unit 302 and the image generated by the graphics generating unit 305. For example, the synthesizing unit 306a generates a synthesized image by synthesizing a three-dimensional moving image and a graphics image representing a warning message. The generated composite image is output to the stereoscopic video display device 102 via the data transmission interface 207.

The stereoscopic video playback device 101 operates according to a setting operation by the viewer. The setting operation by the viewer is received by the user operation reception unit 208 and input to the system control unit 307. The system control unit 307 controls the stream processing unit 301 to start and stop playback (for example, decoding processing).

The synthesizing unit 306 a generates output video information by superimposing the main video generated by the main video generating unit 302 and the operation screen video generated by the graphics generating unit 305, and outputs the output video information to the data transmission interface 207. In such a process flow, a stereoscopic video is generated and output.

The system control unit 307 is an example of a control unit, and controls the output unit 306 so that the display method of the three-dimensional moving image is changed when the integrated value is equal to or greater than a predetermined threshold. In the present embodiment, the system control unit 307 causes the graphics generation unit 305 to generate a graphics image representing a warning message, thereby outputting a composite image of the graphics image and the three-dimensional moving image to the output unit 306. Let

Specifically, the system control unit 307 performs control such as reproduction start and stop of the stream processing unit 301 and further performs control such as reproduction start and stop of the integration unit 303 and the graphics generation unit 305. .

Note that the graphics generation unit 305 may determine whether to generate a graphics image representing a warning message based on the comparison result by the comparison unit 304 without using the system control unit 307. That is, the comparison unit 304 and the graphics generation unit 305 may implement the function of the control unit of the present invention.

Here, a method of calculating the integrated value of the temporal change amount of the depth value will be described. For example, the integrating unit 303 sequentially detects the depth value of the three-dimensional moving image at a predetermined time interval. Then, the integrating unit 303 sequentially calculates the absolute difference value between the detected depth value and the immediately preceding depth value as the amount of change in the depth value. Then, the integrating unit 303 calculates an integrated value of the change amount by integrating the calculated change amount.

The main video generation unit 302 analyzes video information to generate a right-eye video and a left-eye video when generating a stereoscopic video. At this time, pixel difference information between the right-eye video and the left-eye video included in the video information data is acquired. This pixel difference information is included in the extended area of the video information and can be acquired for each screen.

Also, when creating an image for the right eye and an image for the left eye by adding an offset to the two-dimensional image, the offset is acquired as pixel difference information. Furthermore, pixel difference information is treated as 0 when a two-dimensional image is reproduced or when a stereoscopic image is reproduced as a two-dimensional image. Thus, the pixel difference information acquired by the main video generation unit 302 is output to the integration unit 303.

Integrating unit 303 integrates the amount of change in pixel difference information. Pixel difference information affects the sense of depth of stereoscopic video. When this change in depth is severe, viewers are visually fatigued.

If the time when the pixel difference is detected is tn and the time when the previous pixel difference is detected is tn−1, the integrated value of the depth change amount is as shown in (Equation 1).

(Formula 1)
Integrated value = integrated value up to previous time + | pixel difference (tn−1) −pixel difference (tn) |

For example, the integrating unit 303 detects one depth value (pixel difference) for one screen. Specifically, the integration unit 303 detects the depth value for each pixel in one screen, and determines the maximum depth value among the detected depth values as the depth value (pixel difference) of the screen. To do. Alternatively, the integration unit 303 may determine the average value of the detected depth values as the depth value (pixel difference) of the screen.

The integrating unit 303 detects a depth value for each screen, for example. At this time, the pixel difference (tn) of (Expression 1) corresponds to the depth value of the target frame, and the pixel difference (tn−1) corresponds to the depth value of the previous frame.

Note that not only the pixel difference information is used as it is, but also the corrected pixel difference value may be used in consideration of the screen size and viewing distance of the stereoscopic video display device 102. For example, assuming that a 50-inch screen is the standard and the screen size of the stereoscopic image display device 102 is N, if the pixel size exceeds 50 inches, the corrected pixel difference = N / 50 × pixel difference may be calculated. Good.

The comparison unit 304 compares a predetermined threshold value with the integrated value. When the integrated value is less than a preset threshold value, it is determined that “reproduction is permitted”. If the integrated value is greater than or equal to the threshold value, it is determined that “regeneration is prohibited”. Then, the comparison unit 304 outputs a comparison result indicating “reproduction permission” or “reproduction inhibition” to the graphics generation unit 305.

When the output of the comparison unit 304 is “reproduction prohibited”, the graphics generation unit 305 generates an operation screen image that prompts playback stop and outputs the operation screen image to the synthesis unit 306a.

FIG. 4 is a view showing a display example of viewing stop according to the embodiment of the present invention. As shown in the figure on the left, a warning message is displayed during playback of the three-dimensional picture as shown in the figure on the right.

Subsequently, the operation of the stereoscopic video output apparatus according to the embodiment of the present invention will be described. FIG. 5 is a flowchart showing an example of processing of the integration unit 303, the comparison unit 304, and the graphics generation unit 305 of the system controller 206 according to the embodiment of the present invention.

When the power of the stereoscopic video reproduction apparatus 101 is turned on, for example, the system control unit 307 initializes the depth integration value in the initialization step S11 and starts the integration processing of the depth value change amount.

First, the main video generation unit 302 acquires pixel difference information from the video information in a pixel difference information extraction step S12. That is, the main video generation unit 302 acquires the depth value. For example, the main video generation unit 302 acquires the maximum value of the depth value on one target screen as the depth value of the screen.

Next, the integration unit 303 calculates the change amount of the depth value in the change amount calculation step S13. For example, the integration unit 303 calculates the absolute difference between the depth value of one target screen and the depth value of the previous frame as the change amount of the depth value.

Then, in the integration step S14, the integration unit 303 integrates the change amount calculated in the change amount calculation step S13. Subsequently, in the comparison step S15, the comparison unit 304 compares the integrated value with a preset threshold value.

As a result of the comparison, if the integrated value is less than the threshold value (No in S15), the process returns to the pixel difference information extraction step S12, and the integration process of the change amount of the depth value is continued. If the integrated value is greater than or equal to the threshold value (Yes in S15), the graphics generation unit 305 determines that the screen is a screen with intense back-and-forth motion, and generates an operation screen image that prompts viewing stop in graphics generation step S16. That is, the graphics generation unit 305 generates, for example, a graphics image representing a warning message for the viewer as shown in FIG.

The user decides whether to stop or continue the reproduction by a key operation or a remote control operation after the screen for prompting the viewing stop as shown in FIG. 4 is displayed. The user operation reception unit 208 detects the user's key operation or remote control operation in the user confirmation step S17. Then, the detection result is transmitted to the system control unit 307.

In step S18, the system control unit 307 deletes the operation screen image that prompts the viewer to stop viewing. That is, the system control unit 307 causes the graphics generation unit 305 to stop generating a graphics image representing a warning message.

The operation as described above is continued until the power of the stereoscopic video reproduction apparatus 101 is turned off.

As described above, the stereoscopic video reproduction device 101 according to the embodiment of the present invention calculates the integrated value of the temporal change amount of the depth value in the three-dimensional moving image, and the output unit 306 that outputs the three-dimensional moving image. And a system control unit 307 that controls the output unit 306 so that the display method of the three-dimensional moving image is changed when the integrated value is equal to or greater than a predetermined threshold. Specifically, when the integrated value is equal to or greater than the threshold value, the stereoscopic video playback device 101 generates a graphics image that represents a warning message for prompting the viewer to stop playback, and uses the generated graphics image as the main image. The 3D image display device 102 displays the image superimposed on the image.

According to the stereoscopic video reproduction device 101 according to the embodiment of the present invention, the warning message is displayed on the screen when the integrated value of the temporal change amount of the depth value is equal to or greater than the predetermined threshold value. Can be urged to stop playback.

The integrated value of the temporal change amount of the depth value is a value indicating whether or not the image includes an intense motion before and after. The back-and-forth movement corresponds to a perspective change in the image at a predetermined time interval. Specifically, the back-and-forth movement corresponds to a change in the amount of jumping out of the image in the direction from the display surface toward the viewer. In the case of a video that includes intense motion before and after, the integrated value reaches the threshold value in a short period, and in the case of an image with little forward and backward motion, the time until the integrated value reaches the threshold value becomes long.

Therefore, according to the stereoscopic video reproduction device 101 according to the embodiment of the present invention, in the case of a video with a lot of back-and-forth motion, that is, a video with a large visual fatigue on the viewer, the visual fatigue on the viewer The warning message can be displayed more quickly than in the case of a video with a small. Since a warning message is displayed according to the content of the 3D moving image, even if the 3D moving image cannot be edited, the viewer can be prompted to stop at an appropriate timing, and the viewer's visual fatigue Can be suppressed.

The stereoscopic video output apparatus and the stereoscopic video output method according to the present invention have been described above based on the embodiments. However, the present invention is not limited to these embodiments. Unless it deviates from the meaning of this invention, the form which carried out the various deformation | transformation which those skilled in the art will think to the said embodiment, and the form constructed | assembled combining the component in a different embodiment is also contained in the scope of the present invention. .

For example, the integrating unit 303 detects the depth value from the main video, but may detect the depth value from the three-dimensional moving image generated by the graphics generating unit 305 such as the operation screen video. For example, the graphics generation unit 305 generates a left-eye image and a right-eye image in order to three-dimensionally display a caption or an operation screen. The graphics generation unit 305 or the integration unit 303 extracts pixel difference information from the generated left-eye image and right-eye image. Then, the integration unit 303 calculates the integrated value of the temporal change amount of the depth value, for example, according to the above (Equation 1).

The integrated value of the change amount of the depth value of the three-dimensional moving image generated by the graphics generating unit 305 is usually similar to the integrated value of the main video in many cases. Therefore, by calculating the integrated value of the temporal change amount of the depth value in the three-dimensional moving image synthesized (superposed) on the main video instead of the main video, the viewer's Visual fatigue can be suppressed.

Further, the system control unit 307 may cause the output unit 306 to change the 3D moving image to the 2D moving image when the user operation receiving unit 208 receives a user operation after the composite image is output. Alternatively, after the composite image is output, the system control unit 307 causes the output unit 306 to stop outputting the three-dimensional moving image when the user operation receiving unit 208 receives a user operation, thereby causing the three-dimensional moving image to be stopped. The display method of may be changed. At this time, the user operation is, for example, an instruction for changing the three-dimensional moving image to a two-dimensional moving image, or an instruction for stopping the output of the three-dimensional moving image.

FIG. 6 is a flowchart showing an example of the operation of the system controller 206 according to the modification of the embodiment of the present invention. Specifically, FIG. 6 is another flowchart different from FIG. 5 illustrating the processing of the integration unit 303, the comparison unit 304, and the graphics generation unit 305.

5 is different from the flowchart of FIG. 5 in that a step S21 for confirming the presence or absence of a stop operation by the user and an initialization step S22 are added. If there is a stop operation in step S21 for confirming the presence or absence of a stop operation by the user (Yes in S21), the integrated value is initialized in initialization step S22. If there is no stop operation in step S21 for confirming the presence or absence of a stop operation by the user (No in S21), the initialization step S22 is skipped, and the pixel difference information extraction step S12 is performed.

Note that, in the flowcharts of FIGS. 5 and 6, playback may be stopped after the graphics erasing step S18.

Further, the system control unit 307 may change the three-dimensional moving image to the two-dimensional moving image without waiting for receiving a user operation after the composite image is output. Alternatively, the system control unit 307 may cause the output unit 306 to stop outputting the three-dimensional moving image without waiting for a user operation to be accepted after the composite image is output.

FIG. 7A is a flowchart showing an example of the operation of the system controller 206 according to the modification of the embodiment of the present invention. Compared with the flowchart shown in FIG. 5, the display change step S37 is performed after the graphics generation step S16.

In the display change step S37, after the warning graphics image (synthesized image) is displayed, the system control unit 307 changes the 3D moving image to the 2D moving image or stops outputting the 3D moving image. To change the display. For example, the system control unit 307 changes the display after a predetermined period has elapsed since the composite image is displayed. The predetermined period is a period in which the viewer can sufficiently confirm the warning message, for example, several seconds to several minutes.

This makes it possible to forcibly stop the viewing of the three-dimensional moving image, so that visual fatigue of the viewer can be reliably suppressed.

Further, when the integrated value is equal to or greater than the threshold value, the system control unit 307 changes the three-dimensional moving image to the two-dimensional moving image or stops the output of the three-dimensional moving image, and then displays a warning message. May be.

FIG. 7B is a flowchart showing an example of the operation of the system controller 206 according to the modification of the embodiment of the present invention. Compared with the flowchart shown in FIG. 5, the point that the graphics generation step S16 is performed after the display change step S37 is different.

For example, when the comparison unit 304 determines that the integrated value is equal to or greater than the threshold (Yes in S15), the system control unit 307 displays the three-dimensional moving image immediately or after a predetermined period of time in the display change step S37. The output unit 306 stops the output to change to a two-dimensional moving image or output a three-dimensional moving image. Thereafter, in the graphics generation step S16, the graphics generation unit 305 generates a graphics image representing the warning message, and the synthesis unit 306a synthesizes and outputs the main video and the graphics image.

In this case, it is preferable that the graphics generation unit 305 generates a graphics image representing a warning message including a display change result. For example, the graphics generation unit 305 indicates that “a stereoscopic video with intense motion is being played continuously, so playback has stopped.” Or “a stereoscopic video with intense motion is being played continuously. An image representing a message such as “changed to two-dimensional display” is generated.

This makes it possible to forcibly stop the viewing of the three-dimensional moving image, so that visual fatigue of the viewer can be reliably suppressed. In addition, for the viewer, while viewing the 3D moving image, the display suddenly becomes 2D or the display is stopped. By displaying a message, the reason why the display is changed can be viewed. Can be presented to the person.

Further, the system control unit 307 changes the three-dimensional moving image to the two-dimensional moving image or displays the output of the three-dimensional moving image without displaying a warning message when the integrated value is greater than or equal to the threshold value. May be stopped.

FIG. 7C is a flowchart showing an example of the operation of the system controller 206 according to the modification of the embodiment of the present invention. Compared with the flowchart shown in FIG. 6, the display change step S37 is performed instead of the graphics generation step S16.

For example, when the comparison unit 304 determines that the integrated value is equal to or greater than the threshold (Yes in S15), the system control unit 307 displays the three-dimensional moving image immediately or after a predetermined period of time in the display change step S37. The output unit 306 stops the output to change to a two-dimensional moving image or output a three-dimensional moving image.

In addition, the stereoscopic video output apparatus according to the embodiment of the present invention may output audio representing a warning message instead of generating a graphics image representing the warning message.

Also, when changing the three-dimensional moving image to the two-dimensional moving image, for example, the output unit 306 may sequentially output only the image for the left eye (or the image for the right eye). Or you may change to a two-dimensional moving image by controlling active shutter glasses. For example, it is possible to change to a two-dimensional moving image by causing the viewer to see only the image for the left eye.

In the embodiment of the present invention, the case where the stereoscopic video reproduction device 101 is an example of the stereoscopic video output device has been described. However, the function of the stereoscopic video output device according to the embodiment of the present invention is the same as the stereoscopic video display device 102. May have. At this time, the stereoscopic video output device as the stereoscopic video display device 102 may not include the decoding unit.

As described above, the present invention can be realized not only as a stereoscopic video output device and a stereoscopic video output method, but also as a program for causing a computer to execute the stereoscopic video output method of the present embodiment. Further, it may be realized as a computer-readable recording medium such as a CD-ROM for recording the program. Furthermore, it may be realized as information, data, or a signal indicating the program. These programs, information, data, and signals may be distributed via a communication network such as the Internet.

In the present invention, some or all of the components constituting the stereoscopic video output apparatus may be configured from one system LSI. The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip. Specifically, the system LSI is a computer system including a microprocessor, a ROM, a RAM, and the like. .

Further, each processing unit included in the stereoscopic video output apparatus according to the above-described embodiment is typically realized as an LSI that is an integrated circuit. These may be individually made into one chip, or may be made into one chip so as to include a part or all of them.

Here, LSI is used, but it may be called IC, system LSI, super LSI, or ultra LSI depending on the degree of integration.

Further, the integration of circuits is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI or a reconfigurable processor that can reconfigure the connection and setting of circuit cells inside the LSI may be used.

Furthermore, if integrated circuit technology that replaces LSI emerges as a result of advances in semiconductor technology or other derived technology, it is natural that the processing units may be integrated using this technology. Biotechnology can be applied.

Also, some or all of the functions of the stereoscopic video output apparatus according to the embodiment of the present invention may be realized by a processor such as a CPU (Central Processing Unit) executing a program.

Furthermore, the present invention may be the above program or a recording medium on which the above program is recorded. Needless to say, the program can be distributed via a transmission medium such as the Internet.

Furthermore, although the above embodiment is configured using hardware and / or software, the configuration using hardware can also be configured using software, and the configuration using software uses hardware. Can be configured.

Further, the configuration of the above-described stereoscopic video output device is for illustrating the present invention specifically, and the stereoscopic video output device according to the present invention does not necessarily have all of the above configurations. . In other words, the stereoscopic video output apparatus according to the present invention only needs to have a minimum configuration capable of realizing the effects of the present invention.

For example, the system controller 206 may not include the graphics generation unit 305 and the synthesis unit 306a. Further, the stereoscopic video reproduction device 101 may not include the user operation reception unit 208.

Similarly, the 3D image output method by the 3D image output apparatus is for illustrating the present invention, and the 3D image output method according to the present invention does not necessarily include all the above steps. It is not necessary to include. In other words, the 3D image output method according to the present invention needs to include only the minimum steps that can realize the effects of the present invention. In addition, the order in which the above steps are executed is for illustration in order to specifically describe the present invention, and may be in an order other than the above. Moreover, a part of the above steps may be executed simultaneously (in parallel) with other steps.

The present invention can be applied to a stereoscopic video output device that outputs a stereoscopic video, and can be used for, for example, a digital television, a digital recorder, and the like.

DESCRIPTION OF SYMBOLS 101 3D image reproduction apparatus 102 3D image display apparatus 103 Server 104 Optical disk 105 Antenna 106 Memory card 201 Disk drive 202 Tuner 203 Network communication interface 204 Memory device interface 205 HD drive 206 System controller 207 Data transmission interface 301 Stream processing part 302 Main image generation Unit 303 integration unit 304 comparison unit 305 graphics generation unit 306 output unit 306a synthesis unit 307 system control unit

Claims

A decoding unit that generates a three-dimensional moving image by decoding the stereoscopic video stream;
An output unit for outputting the three-dimensional moving image;
An integration unit for calculating an integrated value of temporal change amounts of depth values in the three-dimensional moving image;
A stereoscopic image output apparatus comprising: a control unit that controls the output unit so that the display method of the three-dimensional moving image is changed when the integrated value is equal to or greater than a predetermined threshold.
The integrating unit sequentially detects the depth value of the three-dimensional moving image at predetermined time intervals, sequentially calculates a difference absolute value between the detected depth value and the immediately preceding depth value as the change amount, and calculates the change amount The three-dimensional video output device according to claim 1, wherein the integrated value is calculated by integrating.
The stereoscopic video output device further includes:
A graphics generation unit that generates a graphics image representing a warning message to the viewer;
A synthesis unit that generates a synthesized image by synthesizing the graphics image and the three-dimensional moving image;
The said control part changes the display method of the said three-dimensional moving image by making the said output part output the said synthesized image, when the said integrated value is more than the said predetermined threshold value. Stereoscopic image output device.
After the composite image is output, the control unit causes the output unit to change the three-dimensional moving image to a two-dimensional moving image, or to stop outputting the three-dimensional moving image, so that the three-dimensional moving image is output. The stereoscopic image output apparatus according to claim 3, wherein the image display method is changed.
The stereoscopic video output device further includes an operation reception unit that receives a user operation,
After the composite image is output, the control unit changes the three-dimensional moving image to the two-dimensional moving image by the operation receiving unit, or performs a user operation for stopping the output of the three-dimensional moving image. When received, the display unit changes the display method of the three-dimensional moving image by changing the three-dimensional moving image to the two-dimensional moving image or stopping the output of the three-dimensional moving image in the output unit. Item 3. The stereoscopic image output device according to Item 3.
When the integrated value is equal to or greater than the predetermined threshold, the control unit causes the output unit to change the three-dimensional moving image to a two-dimensional moving image and output the two-dimensional moving image. The stereoscopic image output apparatus according to claim 1, wherein a display method of the three-dimensional moving image is changed.
The stereoscopic video output device further includes:
A graphics generation unit that generates a graphics image representing a warning message to the viewer;
A synthesis unit that generates a synthesized image by synthesizing the graphics image and the two-dimensional moving image;
The stereoscopic video according to claim 6, wherein the control unit changes the display method of the three-dimensional moving image by causing the output unit to output the composite image when the integrated value is equal to or greater than the predetermined threshold. Output device.
The control unit changes the display method of the three-dimensional moving image by causing the output unit to stop outputting the three-dimensional moving image when the integrated value is equal to or greater than a predetermined threshold. 3. The stereoscopic image output device according to 2.
The stereoscopic video output device further includes a graphics generation unit that generates a graphics image representing a warning message to the viewer,
When the integrated value is greater than or equal to a predetermined threshold, the control unit causes the output unit to stop outputting the three-dimensional moving image, and then causes the graphics image to be output, thereby causing the three-dimensional moving image to be output. The stereoscopic image output device according to claim 8, wherein the display method is changed.
A decoding step of generating a three-dimensional moving image by decoding the stereoscopic video stream;
An output step of outputting the three-dimensional moving image;
An integration step for calculating an integrated value of temporal changes in depth values in the three-dimensional moving image;
A three-dimensional video output method including a changing step of changing a display method of the three-dimensional moving image when the integrated value is equal to or greater than a predetermined threshold value
A program for causing a computer to execute the 3D image output method according to claim 10.
A decoding unit that generates a three-dimensional moving image by decoding the stereoscopic video stream;
An output unit for outputting the three-dimensional moving image;
An integration unit for calculating an integrated value of temporal change amounts of depth values in the three-dimensional moving image;
An integrated circuit comprising: a control unit that controls the output unit so that a display method of the three-dimensional moving image is changed when the integrated value is equal to or greater than a predetermined threshold value.