JP5556493B2 - Display device, display method, and program - Google Patents

Description

  The present invention relates to a display device, a display method, and a program.

  There are individual differences in the three-dimensional feeling that a person who sees a stereoscopic image feels. That is, even when the same 3D content is displayed, there are some people who strongly feel a three-dimensional effect, and some people hardly feel a three-dimensional effect.

  Patent Document 1 Japanese Patent Application Laid-Open No. 2004-289527

  By the way, it is preferable that the display apparatus which displays a stereoscopic image can apply a stereoscopic image with the stereoscopic effect which each person feels appropriately. However, since the three-dimensional feeling felt by each person is different, it is difficult to provide an image that feels an appropriate three-dimensional feeling to all people in common.

  In order to solve the above-described problem, in the first aspect of the present invention, a display unit that displays an image that gives a three-dimensional effect to the viewer, and the display unit displays the image according to the setting by the viewer. There is provided a display device, a display method, and a program including a changing unit that changes the emphasis amount of the stereoscopic effect in the image.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

The structure of the display apparatus 10 which concerns on this embodiment is shown. An example of the original captured image before image processing is performed by the image enhancement unit 16 according to the present embodiment is shown. An example of the captured image after the image processing by the image enhancement unit 16 according to the present embodiment is shown. The structure of the display apparatus 10 which concerns on the modification of this embodiment is shown. 2 shows an exemplary hardware configuration of a computer 1900 according to the present embodiment.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration of a display device 10 according to the present embodiment. The display device 10 displays an image that gives the viewer a stereoscopic effect. In the present embodiment, the display device 10 displays a right-eye image given to the viewer's right eye and a left-eye image given to the left eye as images that give the viewer a stereoscopic effect. The right-eye image and the left-eye image are images with parallax in the left-right direction, and are given to the right eye and the left eye of the viewer so that the viewer can feel a stereoscopic effect.

  The display device 10 includes an input unit 14, an image enhancement unit 16, a display unit 18, and a change unit 20. The input unit 14 inputs an image that gives a viewer a stereoscopic effect from the outside. As an example, the input unit 14 inputs an image reproduced from a storage medium or an image obtained by demodulating a broadcast signal. In this example, the input unit 14 inputs a right-eye image to be given to the observer's right eye and a left-eye image to be given to the observer's left eye.

  The image enhancement unit 16 performs image processing on the image input by the input unit 14 to enhance or reduce the stereoscopic effect that the viewer feels when viewing. Note that if the enhancement level is not set, the image enhancement unit 16 may output the image as it is without performing any image processing on the image input by the input unit 14.

  The display unit 18 displays an image that gives the viewer a stereoscopic effect output from the image enhancement unit 16. In the present embodiment, the display unit 18 displays an image for the right eye and an image for the left eye as an image that gives the viewer a stereoscopic effect.

  As an example, the display unit 18 includes a monitor and dedicated glasses. The monitor displays a right eye image and a left eye image. The dedicated glasses give the right-eye image displayed on the monitor only to the viewer's right eye, and give the left-eye image displayed on the monitor only to the viewer's left eye. Thereby, the display part 18 can make a viewer feel a three-dimensional effect.

  The changing unit 20 changes the emphasis amount of the stereoscopic effect in the image displayed by the display unit 18 according to the setting by the viewer. Specifically, the changing unit 20 changes the parameters for image processing by the image enhancing unit 16 and controls the enhancement amount of the stereoscopic effect.

  Here, as an example, the image enhancement unit 16 enhances or weakens the stereoscopic effect in the image by performing the following image processing.

  When a landscape is imaged, a subject with a long subject distance appears to have a higher blue component ratio than the original subject color due to the influence of the air layer from the camera to the subject. Therefore, when emphasizing the stereoscopic effect, the image enhancement unit 16 increases the proportion of the blue component of the image according to the subject distance. Conversely, when the stereoscopic effect is weakened, the image enhancement unit 16 reduces the proportion of the blue component of the image according to the subject distance. In this case, the image enhancement unit 16 increases or decreases the ratio of the blue component larger as the subject is farther away. Thereby, the image enhancing unit 16 can enhance or weaken the stereoscopic effect of the captured image.

  In this case, the changing unit 20 changes the enhancement amount of the ratio of the blue component to the subject by the image enhancement unit 16 according to the setting of the viewer. That is, the changing unit 20 changes the amount of increase or decrease of the blue component ratio according to the setting of the viewer. Thereby, the change part 20 can change the three-dimensional effect of a captured image according to a viewer's setting.

  In addition, when a landscape is imaged, a subject with a long subject distance appears more blurred than the original contour of the subject due to the influence of the air layer from the camera to the subject. Therefore, when enhancing the stereoscopic effect, the image enhancing unit 16 may increase the blur of the image in accordance with the subject distance. Conversely, when the stereoscopic effect is weakened, the image enhancement unit 16 may reduce the blur of the image according to the subject distance. In this case, the image emphasizing unit 16 increases or decreases the amount of blur larger as the subject has a longer subject distance. Thereby, the image enhancing unit 16 can enhance or weaken the stereoscopic effect of the captured image.

  In this case, the changing unit 20 changes the amount of blur enhancement for the subject by the image enhancing unit 16 according to the setting of the viewer. That is, the changing unit 20 changes the increase amount or the decrease amount of the image blur amount according to the setting of the viewer. Thereby, the change part 20 can change the three-dimensional effect of a captured image according to a viewer's setting.

  Further, if the inter-image distance between the right-eye image and the left-eye image is increased, the viewer's convergence approaches in parallel, and the subject can be felt far away. Therefore, when emphasizing the stereoscopic effect, the image enhancement unit 16 sets the inter-image distance between the display position of the right eye image and the display position of the left eye image of the same subject as the subject distance of the subject. It may be increased accordingly. Conversely, when the stereoscopic effect is weakened, the image enhancement unit 16 may reduce the inter-image distance according to the subject distance. In this case, the image enhancement unit 16 increases or decreases the inter-image distance larger as the subject has a longer subject distance. Thereby, the image enhancing unit 16 can enhance or weaken the stereoscopic effect of the captured image.

  In this case, the changing unit 20 changes the enhancement amount of the inter-image distance with respect to the subject by the image enhancement unit 16 according to the setting of the viewer. That is, the changing unit 20 changes the increase amount or the decrease amount of the inter-image distance according to the setting of the viewer. Thereby, the change part 20 can change the three-dimensional effect of a captured image according to a viewer's setting.

  As described above, the display device 10 can freely change the degree to which the viewer feels a stereoscopic effect. Thereby, according to the display apparatus 10, the three-dimensional image which gives an appropriate three-dimensional effect with respect to each person can be provided.

  FIG. 2 shows an example of an original captured image before image processing is performed by the image enhancement unit 16 according to the present embodiment. FIG. 3 shows an example of a captured image after image processing is performed by the image enhancement unit 16 according to the present embodiment.

  The captured images shown in FIGS. 2 and 3 include, for example, a person (near view), a house (middle view), a mountain (distant view), and a sky (very distant view). Further, in FIG. 3, a cross indicates a region where the ratio of the blue component is increased.

  For example, the image enhancement unit 16 increases the ratio of the blue component with respect to, for example, a mountain (distant view) and a sky (super distant view) included in the image illustrated in FIG. Further, the image enhancement unit 16 increases the ratio of the blue component more greatly in the sky (super far view) area where the subject distance is farther than in the mountain (distant view) area.

  The image enhancement unit 16 may blur the mountain (far view) and the sky (super far view) in addition to or instead of increasing the proportion of the blue component. Also in this case, the image emphasizing unit 16 blurs the image with a larger blur amount in the sky (super-distant view) area where the subject distance is farther than in the mountain (distant view) area.

  Such an image emphasizing unit 16 can make the difference in distance between a region with a close subject distance and a region with a long distance in the captured image feel larger. Thereby, according to the image emphasis part 16, the perspective in a captured image can be emphasized and the stereoscopic effect of an image can be emphasized.

  FIG. 4 shows a configuration of the display device 10 according to a modification of the present embodiment. Since the display device 10 according to this modification employs substantially the same configuration and function as the display device 10 shown in FIG. 1, members having the same configuration and function as those shown in FIG. The description will be omitted except for the differences.

  The display device 10 according to this modification further includes a detection unit 30. The detection unit 30 detects the subject distance for each area of the image to be displayed by the display unit 18.

  For example, the detection unit 30 detects the inter-image distance between the display position of the right-eye image and the display position of the left-eye image in the same subject. When a person observes a distant object, the convergence angles of the right eye and the left eye are narrower than when a close object is observed. Therefore, the inter-image distance between the display position of the right eye image and the display position of the left eye image in the same subject increases as the subject distance increases. Therefore, the detection unit 30 can estimate the subject distance of each region by detecting the inter-image distance in each region in the screen for the right-eye image and the left-eye image input by the input unit 14. .

  In this modification, the image enhancement unit 16 increases the difference in the image display distance in the image displayed by the display unit 18 to increase the stereoscopic effect as the difference in the subject distance detected by the detection unit 30 increases. Increase the amount of emphasis. Thereby, the image enhancement unit 16 can perform stepwise enhancement according to the subject distance.

  In the present modification, the changing unit 20 may perform calibration prior to displaying an image. Specifically, the changing unit 20 displays an image that generates a different stereoscopic effect on the display unit 18 and executes calibration for allowing the viewer to select the enhancement amount of the stereoscopic effect.

  Then, after the calibration is performed, the image enhancement unit 16 enhances the image output from the input unit 14 by the stereoscopic enhancement amount selected by the viewer. Then, the display unit 18 displays the image emphasized by the image enhancement unit 16. Thereby, the change part 20 can observe an image with a suitable three-dimensional effect for an observer.

  FIG. 5 shows an example of a hardware configuration of a computer 1900 according to this embodiment. A computer 1900 according to this embodiment is connected to a CPU peripheral unit having a CPU 2000, a RAM 2020, a graphic controller 2075, and a display device 2080 that are connected to each other by a host controller 2082, and to the host controller 2082 by an input / output controller 2084. Input / output unit having communication interface 2030, hard disk drive 2040, and CD-ROM drive 2060, and legacy input / output unit having ROM 2010, flexible disk drive 2050, and input / output chip 2070 connected to input / output controller 2084 With.

  The host controller 2082 connects the RAM 2020 to the CPU 2000 and the graphic controller 2075 that access the RAM 2020 at a high transfer rate. The CPU 2000 operates based on programs stored in the ROM 2010 and the RAM 2020 and controls each unit. The graphic controller 2075 acquires image data generated by the CPU 2000 or the like on a frame buffer provided in the RAM 2020 and displays it on the display device 2080. Instead of this, the graphic controller 2075 may include a frame buffer for storing image data generated by the CPU 2000 or the like.

  The input / output controller 2084 connects the host controller 2082 to the communication interface 2030, the hard disk drive 2040, and the CD-ROM drive 2060, which are relatively high-speed input / output devices. The communication interface 2030 communicates with other devices via a network. The hard disk drive 2040 stores programs and data used by the CPU 2000 in the computer 1900. The CD-ROM drive 2060 reads a program or data from the CD-ROM 2095 and provides it to the hard disk drive 2040 via the RAM 2020.

  The input / output controller 2084 is connected to the ROM 2010, the flexible disk drive 2050, and the relatively low-speed input / output device of the input / output chip 2070. The ROM 2010 stores a boot program that the computer 1900 executes at startup and / or a program that depends on the hardware of the computer 1900. The flexible disk drive 2050 reads a program or data from the flexible disk 2090 and provides it to the hard disk drive 2040 via the RAM 2020. The input / output chip 2070 connects the flexible disk drive 2050 to the input / output controller 2084 and inputs / outputs various input / output devices via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like. Connect to controller 2084.

  A program provided to the hard disk drive 2040 via the RAM 2020 is stored in a recording medium such as the flexible disk 2090, the CD-ROM 2095, or an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 2040 in the computer 1900 via the RAM 2020, and executed by the CPU 2000.

  A program that is installed in the computer 1900 and causes the computer 1900 to function as the display device 10 includes an input module, an image enhancement module, a display module, and a change module. These programs or modules work on the CPU 2000 or the like to cause the computer 1900 to function as the input unit 14, the image enhancement unit 16, the display unit 18, and the changing unit 20, respectively.

  The information processing described in these programs is read by the computer 1900, whereby the input unit 14, the image enhancement unit 16, and the display unit, which are specific means in which the software and the various hardware resources described above cooperate. 18 and the change unit 20. And the specific display apparatus 10 according to the intended use is constructed | assembled by implement | achieving the calculation or processing of the information according to the intended use of the computer 1900 in this embodiment by these concrete means.

  As an example, when communication is performed between the computer 1900 and an external device or the like, the CPU 2000 executes a communication program loaded on the RAM 2020 and executes a communication interface based on the processing content described in the communication program. A communication process is instructed to 2030. Under the control of the CPU 2000, the communication interface 2030 reads transmission data stored in a transmission buffer area or the like provided on a storage device such as the RAM 2020, the hard disk drive 2040, the flexible disk 2090, or the CD-ROM 2095, and sends it to the network. The reception data transmitted or received from the network is written into a reception buffer area or the like provided on the storage device. As described above, the communication interface 2030 may transfer transmission / reception data to / from the storage device by a DMA (direct memory access) method. Instead, the CPU 2000 transfers the storage device or the communication interface 2030 as a transfer source. The transmission / reception data may be transferred by reading the data from the data and writing the data to the communication interface 2030 or the storage device of the transfer destination.

  The CPU 2000 is all or necessary from among files or databases stored in an external storage device such as a hard disk drive 2040, a CD-ROM drive 2060 (CD-ROM 2095), and a flexible disk drive 2050 (flexible disk 2090). This portion is read into the RAM 2020 by DMA transfer or the like, and various processes are performed on the data on the RAM 2020. Then, CPU 2000 writes the processed data back to the external storage device by DMA transfer or the like. In such processing, since the RAM 2020 can be regarded as temporarily holding the contents of the external storage device, in the present embodiment, the RAM 2020 and the external storage device are collectively referred to as a memory, a storage unit, or a storage device. Various types of information such as various programs, data, tables, and databases in the present embodiment are stored on such a storage device and are subjected to information processing. Note that the CPU 2000 can also store a part of the RAM 2020 in the cache memory and perform reading and writing on the cache memory. Even in such a form, the cache memory bears a part of the function of the RAM 2020. Therefore, in the present embodiment, the cache memory is also included in the RAM 2020, the memory, and / or the storage device unless otherwise indicated. To do.

  In addition, the CPU 2000 performs various operations, such as various operations, information processing, condition determination, information search / replacement, etc., described in the present embodiment, specified for the data read from the RAM 2020 by the instruction sequence of the program. Is written back to the RAM 2020. For example, when performing the condition determination, the CPU 2000 determines whether the various variables shown in the present embodiment satisfy the conditions such as large, small, above, below, equal, etc., compared to other variables or constants. When the condition is satisfied (or not satisfied), the program branches to a different instruction sequence or calls a subroutine.

  Further, the CPU 2000 can search for information stored in a file or database in the storage device. For example, in the case where a plurality of entries in which the attribute value of the second attribute is associated with the attribute value of the first attribute are stored in the storage device, the CPU 2000 displays the plurality of entries stored in the storage device. The entry that matches the condition in which the attribute value of the first attribute is specified is retrieved, and the attribute value of the second attribute that is stored in the entry is read, thereby associating with the first attribute that satisfies the predetermined condition The attribute value of the specified second attribute can be obtained.

  The program or module shown above may be stored in an external recording medium. As the recording medium, in addition to the flexible disk 2090 and the CD-ROM 2095, an optical recording medium such as DVD or CD, a magneto-optical recording medium such as MO, a tape medium, a semiconductor memory such as an IC card, and the like can be used. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1900 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.

DESCRIPTION OF SYMBOLS 10 Display apparatus, 14 Input part, 16 Image emphasis part, 18 Display part, 20 Change part, 30 Detection part, 1900 Computer, 2000 CPU, 2010 ROM, 2020 RAM, 2030 Communication interface, 2040 Hard disk drive, 2050 Flexible disk drive , 2060 CD-ROM drive, 2070 input / output chip, 2075 graphic controller, 2080 display device, 2082 host controller, 2084 input / output controller, 2090 flexible disk, 2095 CD-ROM

Claims (8)

A display unit that displays an image that gives a three-dimensional effect to the viewer;
A changing unit that changes an emphasis amount of the stereoscopic effect in the image displayed by the display unit according to a setting by a viewer;
Equipped with a,
The display unit displays a right-eye image to be given to the right eye of the viewer and a left-eye image to be given to the left eye as an image that gives the viewer a stereoscopic effect,
The display device increases an inter-image distance between the display position of the right-eye image and the display position of the left-eye image as the subject is farther away, thereby enhancing the stereoscopic effect. Further comprising
The display device according to claim 1, wherein the changing unit changes the enhancement amount of the inter-image distance with respect to the subject by the image enhancement unit according to the setting of the viewer. An image enhancement unit that enhances the stereoscopic effect in the image by increasing the proportion of the blue component larger as the subject is farther away;
The display device according to claim 1, wherein the changing unit changes an enhancement amount of a ratio of a blue component to a subject by the image enhancement unit according to the setting of the viewer. An image enhancement unit that enhances the stereoscopic effect in the image by increasing blur as the subject is farther away.
The display device according to claim 1, wherein the changing unit changes a blur enhancement amount with respect to a subject by the image enhancement unit according to the setting of the viewer. The display device further includes a detection unit that detects a subject distance for each region of the image to be displayed by the display unit,
The image enhancement unit is configured as partial subject distance is large, the display device according to claim 2 or 3 to increase the amount of enhancement stereoscopic effect in the image displayed by the display unit. The display unit displays a right-eye image to be given to the right eye of the viewer and a left-eye image to be given to the left eye as an image that gives the viewer a stereoscopic effect,
The display device further includes a detection unit that detects an inter-image distance between the display position of the right-eye image and the display position of the left-eye image in the same subject,
The image enhancing section as the partial image distance is large, the display device according to claim 2 or 3 to increase the amount of enhancement stereoscopic effect in the image displayed by the display unit. The changing unit displays an image having a different stereoscopic effect on the display unit, and performs calibration for causing the viewer to select an emphasis amount of the stereoscopic effect,
Wherein the display unit, the display device according to any one of claims 1 5 for displaying an image by enhancement of stereoscopic effect selected in the view viewer. Display an image that gives viewers a three-dimensional effect,
In accordance with the setting by the viewer, the amount of stereoscopic effect in the displayed image is changed ,
In the display of the image, as an image that gives the viewer a stereoscopic effect, a right eye image to be given to the right eye of the viewer and a left eye image to be given to the left eye are displayed.
By increasing the inter-image distance between the display position of the right-eye image and the display position of the left-eye image as the subject is farther, the image that enhances the stereoscopic effect is enhanced.
The display method of changing the enhancement amount of the inter-image distance with respect to the subject by the enhancement of the image according to the setting of the viewer in the change of the enhancement amount . Program for functioning as a display device according to any one of the computer claims 1-6.

Images