JP2009250987A - Image display apparatus and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display apparatus capable setting the optimum position for browsing 3D display by a simple operation. <P>SOLUTION: A control part 100 carries out eye position checking processing when displaying a content data for the 3D display. A camera image of a user face taken by an in-camera 103 is displayed on a display screen 107a superposedly with an eye position guide screen EG for showing a proper range (optimum position range for browsing the 3D display), and a direction and a degree of deviation from the proper range are guided to the user, when a view point of a user detected based on the camera image comes out of the proper range of the eye position guide screen EG, in the eye position checking processing. The optimum position for browsing the 3D display is thereby set by the simple operation, because the user is only required to match positions of monitor-displayed own right and left eyes to the proper range. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image display device and a program for setting an optimum position for viewing a 3D display (stereoscopic display) with a simple operation, or for reliably viewing a 3D display stereoscopically.

  As a 3D display method for stereoscopic viewing using binocular parallax without using glasses, a lenticular method and a parallax barrier (parallax barrier) method are known. Here, the parallax barrier 3D display will be outlined with reference to FIG. FIG. 11 is a diagram showing a basic configuration in the case where a liquid crystal display panel is used as the display means by the parallax barrier method. In this figure, the liquid crystal display panel 20 alternately displays a right-eye image and a left-eye image for forming binocular parallax in a strip shape. The parallax barrier 30 is disposed in front of the liquid crystal display panel 20 at a predetermined distance. The parallax barrier 30 is provided with a plurality of slits cut at a predetermined pitch.

According to the above configuration, when both eyes of the observer are in the normal viewing position, the right eye of the observer visually sees the image for the right eye on the liquid crystal display panel 20 through the slit of the parallax barrier 30, while As a result of the eyes viewing the image for the left eye on the liquid crystal display panel 20, a stereoscopic effect due to binocular parallax can be obtained.

An apparatus for performing 3D display based on such a display principle is disclosed in, for example, Patent Document 1. Further, for example, Patent Document 2 discloses a display unit that can switch between 2D display and 3D display by electrically forming or eliminating the slit of the parallax barrier 30 described above. Further, Patent Document 3 discloses a line-of-sight auxiliary image for visualizing a red image on the user's left eye and a blue image on the right eye so that a viewpoint (a normal viewing position shown in FIG. 11) for obtaining stereoscopic vision can be found. A technique for displaying is disclosed.

JP 2006-235332 A Japanese Patent Laid-Open No. 2004-153489 Japanese Patent Laid-Open No. 10-28764

  By the way, in the 3D display using binocular parallax, it is necessary to make the user recognize the normal viewing position (see FIG. 11) at which stereoscopic vision is obtained. For this reason, the technique disclosed in Patent Document 3 displays a line-of-sight auxiliary image and visually recognizes a red image with the left eye, and at the same time, the user himself / herself faces the position of the face (eye of the eye). However, if the user is not familiar with the position, the time and effort required to find it will be bothersome.

  Further, when the 3D display is performed, for example, when the user's viewpoint deviates from the normal viewing position where the stereoscopic vision is obtained, such as viewing the display for the left eye with the right eye, the image is visually recognized as a blurred image. I feel uncomfortable. In order to avoid such a sense of incongruity, it is possible to assume a mode of switching to 2D display when the user cannot stereoscopically view 3D display using the technology disclosed in Patent Document 2, but in such a mode, The user cannot reliably view the 3D display stereoscopically.

In other words, in other words, with the conventional technology, there is a problem that it is impossible to set an optimal position for viewing the 3D display with a simple operation, or to reliably stereoscopically view the 3D display. .
Therefore, the present invention has been made in view of the above-described circumstances, and an image display apparatus and program capable of setting an optimum position for viewing a 3D display with a simple operation and reliably allowing a 3D display to be stereoscopically viewed. The purpose is to provide.

  In order to achieve the above object, according to the first aspect of the present invention, in an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen, imaging that captures a user facing the display screen Means, monitor display means for monitoring and displaying the user's video imaged by the imaging means on the display screen, and an eye position indicating an appropriate position of the left and right eyes for allowing the user to stereoscopically view the 3D image on the display screen And a composite display means for displaying the guide image superimposed on the user's video displayed on the monitor by the monitor display means.

  In the invention according to claim 2 subordinate to claim 1, the monitor display means includes an auxiliary display screen different from the display screen, and the imaging means is provided on either the auxiliary display screen or the display screen. The video of the user imaged by the above is displayed on a monitor.

  In the invention according to claim 3 subordinate to claim 1, detection means for detecting the positions of the left and right eyes of the user from the user's video imaged by the imaging means, and the user detected by the detection means And a discriminating means for discriminating whether or not the positions of the left and right eyes coincide with an appropriate position indicated by the eye position guide image, and an informing means for informing the discrimination result of the discriminating means. To do.

  In the invention according to claim 4 that is dependent on the above-described claim 3, the determination unit is configured such that the positions of the left and right eyes of the user detected by the detection unit are relative to an appropriate position indicated by the eye position guide image. When the discriminating means discriminates whether the discriminating means is displaced in the up, down, left, or right direction, it discriminates the direction of the discriminated deviation. It is characterized by.

  In the invention according to claim 5 that is dependent on claim 3, the determination means is configured such that the interval between the positions of the left and right eyes of the user detected by the detection means is determined between the left and right eyes indicated by an eye position guide image. It is determined whether or not the interval between the proper positions is matched, and the notifying unit notifies the mismatch state when the determining unit determines a mismatch between the two intervals.

  In the invention according to claim 6, which is dependent on claim 3, the discriminating means indicates the position of the left and right eyes of the user detected by the detecting means and the eye position guide image when discriminating the discrepancy. The difference direction with respect to the appropriate position is detected, and the notifying unit notifies and informs the shift to the difference direction detected by the determination unit.

  In the invention according to claim 7, which is dependent on claim 3, the determination means determines that the positions of the left and right eyes of the user detected by the detection means coincide with an appropriate position indicated by the eye position guide image. When the determination is made, the monitor display by the monitor display means and the display of the eye position guide image by the composite display means are terminated.

  In the invention according to claim 8, which is dependent on claim 1, the monitor display means displays, on the display screen, a video of the user imaged by the imaging means prior to displaying a 3D image on the display screen. Prior to displaying the 3D image on the display screen, the composite display means displays the eye position guide image superimposed on the user's video displayed on the monitor by the monitor display means. To do.

  According to the ninth aspect of the present invention, in an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen, the position of the user is acquired from a video obtained by imaging the user facing the display screen. Position determination means for determining whether or not the position of the user acquired by the position acquisition means is in a predetermined allowable range position with respect to the display screen, and the determination result of the position determination means And a notification unit for notifying whether or not the position of the user viewing the display screen is appropriate.

  In the invention according to claim 10, which is dependent on claim 9, the notification means can perform stereoscopic viewing when the position determination means determines that the user's position is within a predetermined allowable range with respect to the display screen. The position is notified, and on the other hand, if it is determined that the position is out of the predetermined allowable range, it is notified that the position is not stereoscopically visible.

  In the invention according to claim 11 that is dependent on claim 9, the position acquisition means acquires the positions of the left and right eyes of the user from a video image of the user facing the display screen, and the position determination means. Is characterized in that it is determined whether or not the positions of the left and right eyes of the user acquired by the position acquisition means are within a permissible range position where stereoscopic viewing is possible.

  In the invention according to claim 12, which is dependent on the above-mentioned claim 11, the position determining means is configured such that the positions of the left and right eyes of the user acquired by the position acquiring means are laterally shifted from an allowable range position where stereoscopic vision is possible. It is characterized by determining whether it has shifted | deviated.

  In the invention according to claim 13, which is dependent on claim 11, the position discriminating means is configured such that the interval between the positions of the left and right eyes of the user acquired by the position acquiring means is an allowable range interval that allows stereoscopic viewing. It is characterized by determining whether or not.

  In the invention according to claim 14, which is dependent on claim 9, the position determination means determines that the position of the user acquired by the position acquisition means is not within a predetermined allowable range position with respect to the display screen. In this case, a difference direction between the acquired position of the user and a predetermined allowable range position is detected, and the notifying unit notifies and informs that the difference direction detected by the position determining unit is shifted.

  In the invention according to claim 15, which is dependent on claim 9, the position acquisition means, from displaying a 3D image on the display screen, an image of the user facing the display screen, the user The position determining means obtains the position of the user acquired by the position acquiring means at a predetermined allowable range position with respect to the display screen prior to displaying the 3D image on the display screen. It is characterized by determining whether or not there is.

  In the invention according to claim 16, which is dependent on claim 9, the position determining means determines that the position of the acquired user is not within a predetermined allowable range position with respect to the display screen. The display of the 3D image is suppressed, and on the other hand, when it is determined that the acquired user's position is in a predetermined allowable range position with respect to the display screen, the 3D image is displayed on the display screen. To do.

  In the invention according to claim 17, in an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen, the position of the user is acquired from a video obtained by capturing the user facing the display screen. Position determination means for determining whether or not the position of the user acquired by the position acquisition means is in a predetermined allowable range position with respect to the display screen, and the determination result of the position determination means And a display control means for controlling whether or not to display a 3D image on the display screen.

  In the invention according to claim 18, which is dependent on claim 17, the display control means displays a 3D image on the display screen when the position determination means determines that the position is within a predetermined allowable range, If it is determined that the position is not within the allowable range, a 3D image is displayed as a 2D image on the display screen.

  In the invention according to claim 19 that is dependent on claim 17, the display control means displays a 3D image on the display screen when the position determination means determines that the position is within a predetermined allowable range, When it is determined that the position is not within the allowable range, the display of the 3D image on the display screen is suppressed.

  In the invention according to claim 20, which is dependent on claim 17, the display control means stops the image data reproduction output when the position determination means determines that the position is not within a predetermined allowable range position, and displays on the display screen. The display of the 3D image is suppressed.

  In the invention according to claim 21, which is dependent on the above-mentioned claim 17, the position acquisition means acquires the positions of the left and right eyes of the user from a video image of the user facing the display screen, and the position determination means. Is characterized in that it is determined whether or not the positions of the left and right eyes of the user acquired by the position acquisition means are within a permissible range position where stereoscopic viewing is possible.

  In the invention according to claim 22, which is dependent on claim 17, the position determining means is configured to move the left and right eye positions of the user acquired by the position acquiring means laterally from an allowable range position where stereoscopic vision is possible. It is characterized by determining whether it has shifted | deviated.

  In the invention according to claim 23 subordinate to claim 17, the position determining means is configured such that the interval between the positions of the left and right eyes of the user acquired by the position acquiring means is an allowable range interval that allows stereoscopic viewing. It is characterized by determining whether or not.

  The invention according to claim 24 dependent on claim 17 is characterized in that the position acquisition means acquires the position of the user facing the display screen by optical positioning.

The invention according to claim 25 is a program that is executed by an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen, and that captures an image of a user facing the display screen A monitor display step for monitoring and displaying the user's video imaged in the imaging step on the display screen, and an eye position indicating an appropriate position of the left and right eyes for allowing the user to stereoscopically view a 3D image on the display screen A composite display step of displaying a guide image superimposed on a user image displayed on the monitor in the monitor display step is executed by a computer.

  In a twenty-sixth aspect of the invention, there is provided a program that is executed by an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen, and is an image that captures a user facing the display screen A position acquisition step of acquiring the position of the user from the position, a position determination step of determining whether or not the position of the user acquired in the position acquisition step is in a predetermined allowable range position with respect to the display screen; In accordance with the determination result in the position determination step, a notification step for notifying whether or not the position of the user viewing the display screen is appropriate is executed by a computer.

  The invention according to claim 27, which is dependent on claim 26, further comprises a display control step for controlling whether or not to display a 3D image on the display screen in accordance with the determination result in the position determination step. It is characterized by.

  According to the present invention, it is possible to set an optimal position for viewing a 3D display with a simple operation, and to reliably stereoscopically view the 3D display.

Embodiments of the present invention will be described below with reference to the drawings.
[First Embodiment]
A. Constitution
(1) External configuration of mobile phone 10 FIG. 1 is a diagram showing an external configuration of a mobile phone 10 including an image display device according to the first embodiment. The mobile phone 10 has a well-known folding open / close type housing structure that folds the receiver housing and the transmitter housing, and FIG. 1 illustrates a front appearance in an unfolded state in which the folding is opened. . As shown in this figure, the receiving unit housing of the mobile phone 10 has an in-camera 103 that captures the user's face, a display screen 107a capable of switching between 2D display and 3D display, and a user's viewpoint position during 3D display. A guide LED is provided to notify whether or not it is within the proper range. The transmitter section housing is provided with various operation keys, operation buttons, a mouthpiece (microphone MIC), and the like constituting the operation section 108 described later.

(2) Electrical configuration of mobile phone 10 Next, the electrical configuration of the mobile phone 10 will be described with reference to FIG. In FIG. 2, the control unit 100 includes a CPU, an input / output circuit, and the like, and controls the operation of each unit according to an event supplied from the operation unit 108 (described later). Specifically, when 3D image data for 3D display is displayed in 3D, a control operation for setting an optimal position for viewing the 3D display with a simple operation or for surely viewing the 3D display stereoscopically is performed. Execute. The characteristic processing operation of the control unit 100 according to the gist of the present invention will be described in detail later.

  The ROM 101 includes a program area and a data area. Various programs executed by the control unit 100 are stored in the program area of the ROM 101. The various programs referred to here include content display processing and eye position check processing, which will be described in detail later. In the data area of the ROM 101, in addition to control data referred to by a predetermined program, for example, a screen for forming various display screens such as an eye position guide screen EG (see FIG. 5) described later and a standby screen (not shown) Data is stored.

  The RAM 102 has a work area 102a for temporarily storing various register / flag data used for processing of the control unit 100, an imaging data area 102b for temporarily storing imaging data (image data) output from the in-camera 103, and a display unit. The display screen 107a includes a content data area 102c for storing content data to be displayed in 2D or 3D. The content data referred to here includes normal 2D display image data, left eye image data and right eye image data, and includes 3D image data for 3D display using a parallax barrier method. It is a generic name.

The in-camera 103 is a camera that captures the face of the user facing the display screen 107a of the display unit 107 as so-called “for self-portrait”, starts imaging according to an instruction from the control unit 100, and an image obtained thereby Output data. Image data output from the in-camera 103 is stored in the imaging data area 102 b of the RAM 102 under the control of the control unit 100.

The wireless communication transmitting / receiving unit 104 exchanges data with a base station (not shown) through the antenna ANT1 under the control of the control unit 100 during data communication, and receives and demodulates the voice data received and demodulated through the antenna ANT1 during voice communication. While outputting to the control part 100, the transmission signal obtained by modulating the audio | voice data supplied from the control part 100 is amplified by high frequency, and is sent out from antenna ANT1.

The audio signal processing unit 105 includes a speaker SP and a microphone MIC, D / A converts audio data supplied from the control unit 100 into an audio signal, and supplies the audio signal to the speaker SP, or an audio signal output from the microphone MIC. The audio data is A / D converted and supplied to the control unit 100.

The image processing unit 106 displays the image data stored in the imaging data area 102b of the RAM 102 on the viewfinder (display screen 107a) in accordance with an instruction from the control unit 100. Further, the image processing unit 106 determines whether or not the image data displayed on the viewfinder includes an image pattern corresponding to “human face” in accordance with an instruction from the control unit 100, and sets “human face” as the “human face”. If the corresponding image pattern is included, the positions of the left and right eyes of the face in the viewfinder are detected and output to the control unit 100. Furthermore, the image processing unit 106, when the difference between the position of the left and right eyes of the face detected based on the previous frame image data and the position of the left and right eyes of the face detected based on the next frame image data exceeds a predetermined threshold In addition, a case shake detection event indicating that the case shake has been detected is generated and supplied to the control unit 100.

When the image data for 2D display is supplied from the control unit 100, the display unit 107 electrically eliminates the slit of the parallax barrier and displays 2D on the display screen 107a, while the control unit 100 performs 3D display. When the 3D image data is supplied, the slit of the parallax barrier is electrically formed and displayed in 3D on the display screen 107a. Further, in the display unit 107, when the control unit 100 executes an eye position check process (described later), an eye position guide screen EG illustrated in FIG. 5 is displayed on the display screen 107a. The purpose of the eye position guide screen EG will be described later.

The operation unit 108 is stored in the content data area 102c of the RAM 102, in addition to various operation keys such as a power switch for turning on / off the power, an off-hook / on-hook switch operated at the start / end of a call, and a character input switch also serving as a dial switch. A content display button for instructing execution of content display processing for selecting and displaying any of the various content data to be displayed is generated, and an event corresponding to the operation of these keys and buttons is generated and output to the control unit 100.

B. Action
Next, operations of content display processing and eye position check processing executed by the control unit 100 of the mobile phone 10 will be described with reference to FIGS. 3 is a flowchart showing the operation of the content display process, and FIG. 4 is a flowchart showing the operation of the eye position check process. 5 to 8 are diagrams for explaining the operation of the eye position check process.

(1) Content display processing operation
When the user operates the content display button of the operation unit 108 while the mobile phone 10 is waiting for an incoming call, the control unit 100 executes the content display process shown in FIG. Proceed to In step SA1, attributes of various content data stored in the content data area 102c of the RAM 102 (for example, a file name and a content type for identifying 2D display / 3D display) are read from the content data area 102c. Are displayed as a content list on the display screen 107a.

  Next, in step SA2, content data to be displayed in 2D or 3D is selected from the content list displayed in step SA1 in accordance with a user operation. In steps SA3 to SA4, it is determined whether the content data to be displayed is for 2D display or 3D display based on the content type included in the attribute of the selected content data. Hereinafter, the description of the operation will be made separately for the case where the content data to be displayed is for 2D display and the case for 3D display.

<When content data to be displayed is for 2D display>
If the content data to be displayed is for 2D display, the determination result in step SA4 is “NO”, the process proceeds to step SA5, and the content data selected in step SA2 is read from the content data area 102c of the RAM 102 and displayed. 2D display is performed on the screen 107a. At this time, in the display unit 107, as the content data for 2D display is supplied from the control unit 100, the slit of the parallax barrier is electrically removed and the display screen 107a is set to the state for 2D display. To do. In step SA6, the process waits until a content display end operation is performed. When the operation is performed, the determination result is “YES”, and the process ends.

<When content data to be displayed is for 3D display>
If the content data to be displayed is 3D image data for 3D display, the determination result in step SA4 is “YES”, and the eye position check process is executed via step SA7. In the eye position check process, as will be described later, an eye position guide screen EG for guiding a normal viewing position (hereinafter referred to as an appropriate range) for obtaining stereoscopic vision of a camera image obtained by capturing the user's face with the in-camera 103. If the position of the left and right eyes of the user detected from the camera image deviates from the appropriate range shown on the eye position guide screen EG, the user's viewpoint position is within the appropriate range. It will guide you how far and in what direction it is.

  When the user's viewpoint position falls within the appropriate range by the eye position check process executed through step SA7, the process proceeds to step SA8, and the content data for 3D display selected in step SA2 is stored in the content of the RAM 102. The data is read from the data area 102c and displayed in 3D on the display screen 107a. At this time, as the content data for 3D display is supplied from the control unit 100, the display unit 107 electrically forms a slit of the parallax barrier and displays the 3D on the display screen 107a.

  Next, in step SA9, it is determined whether an incoming call interrupt is detected. If an incoming call interrupt is detected, the determination result is “YES”, the process proceeds to step SA10, the content display is stopped, and then the process returns to step SA7. On the other hand, if an incoming call interrupt is not detected, the determination result in step SA9 is “NO”, and the flow proceeds to step SA11. In step SA11, it is determined whether a case shake detection event is supplied from the image processing unit 106, that is, whether a case shake is detected. When the shaking of the housing is detected, the determination result is “YES”, the process proceeds to step SA10, the content display is stopped, and the process returns to step SA7.

On the other hand, if the shaking of the casing is not detected, the determination result in step SA11 is “NO”, and the process proceeds to step SA12 to determine whether or not a content display end operation has been performed. If the content display end operation has not been performed, the determination result is “NO”, and the process returns to step SA9. On the other hand, when the content display end operation is performed, the determination result in step SA12 is “YES”, and the present process ends.

(2) Operation of Eye Position Check Process Next, the operation of the eye position check process will be described with reference to FIGS. When this process is executed via step SA7 (see FIG. 3) of the content display process described above, the control unit 100 proceeds to step SB1 illustrated in FIG. 4 and activates the in-camera 103. As a result, the in-camera 103 starts imaging the face of the user facing the display screen 107a of the display unit 107. Next, in step SB2, the camera image output from the in-camera 103 is displayed on the display screen 107a serving as a viewfinder on a monitor.

Subsequently, in step SB3, the eye position guide screen EG is superimposed and displayed on the display screen 107a displaying the camera image on the monitor. The eye position guide screen EG is a screen having a left eye position guide frame LE, a right eye position guide frame RE, and a guidance display unit GM, for example, as in the example illustrated in FIG. The left eye position guide frame LE and the right eye position guide frame RE of the screen EG are for guiding the user to an appropriate range (a normal viewing position for obtaining a stereoscopic vision). Therefore, when such an eye position guide screen EG is superimposed and displayed on a camera image obtained by photographing the user's face, an example of the display form illustrated in FIG. 6 is obtained.

  In step SB4, in accordance with an instruction from the control unit 100, the image processing unit 106 determines whether or not the camera image output from the in-camera 103 includes an image pattern corresponding to “human face”. When recognition is performed and it is determined that an image pattern corresponding to “human face” is included, the positions of the left and right eyes of the recognized face are detected and output to the control unit 100.

When the positions of the left and right eyes of the user's face are thus detected by image recognition, the control unit 100 proceeds to step SB5 and compares the detected left and right eye positions with the appropriate positions. That is, it is compared whether the detected positions of the left and right eyes are within the left eye position guide frame LE and the right eye position guide frame RE, respectively. Next, in step SB6, whether or not the left eye position is within the left eye position guide frame LE and the right eye position is within the appropriate range within the right eye position guide frame RE based on the comparison result of step SB5. Determine whether.

  For example, as in the example illustrated in FIG. 6, when the positions of the left and right eyes of the user are within an appropriate range within the left eye position guide frame LE and the right eye position guide frame RE of the eye position guide screen EG, If the left and right eyes of the user are positioned at the normal viewing position where the visual sensation is obtained, the determination result in Step SB6 is “YES”, and this processing is completed. In this case, with the completion of the eye position check process, the monitor display and the display of the eye position guide screen EG are terminated.

  On the other hand, if the position of the left and right eyes of the user deviates from the appropriate range as in the example illustrated in FIG. 7A or FIG. 8A, the determination result in step SB6 is “NO”. In step SB7, the audio signal processing unit 105 is instructed to emit the unmatched sound from the speaker SP, and in the subsequent step SB8, the guide LED (see FIG. 1) disposed on the receiver housing is blinked. To notify the user that the vehicle is out of the proper range.

In the present embodiment, the guide LED is blinked while emitting a disagreement sound to notify the user of the deviation of the appropriate range. However, the present invention is not limited to this, and the left and right eyes of the user are within the appropriate range. It is possible to emit a coincidence sound and turn off the guide LED, thereby notifying the user that the user is in the normal viewing position where stereoscopic vision is obtained.

  Next, in step SB9, whether or not the distance between the left and right eyes is appropriate, that is, the eye distance obtained from the position of the left and right eyes of the user detected in step SB4 is the left eye shown in FIG. It is determined whether or not the distance K1 from the right end of the position guide frame LE to the left end of the right eye position guide frame RE and the interval K2 from the left end of the left eye position guide frame LE to the right end of the right eye position guide frame RE are determined. In other words, in step SB9, it is determined whether the position of the user's eyes is properly separated without being too far or too close to the display screen 107a. Hereinafter, the description of the operation will be made separately for a case where the position of the user's eyes is appropriately separated from the display screen 107a and a case where the position is not so.

<When the position of the user's eyes is appropriately separated from the display screen 107a>
In this case, since the eye interval obtained from the positions of the left and right eyes of the user falls within the interval K1 and the interval K2, the determination result in step SB9 is “YES”, and the flow proceeds to step SB10. . In step SB10, the shift direction (vertical direction or horizontal direction) of the user's eye position deviating from an appropriate range defined by the left eye position guide frame LE and the right eye position guide frame RE of the eye position guide screen EG and its The amount of deviation is detected.

For example, as in the example illustrated in FIG. 7A, in the situation where the position of the user's eyes deviates from the appropriate range, the direction of the shift and the amount of the shift are detected based on the relationship illustrated in FIG. 7B. To do. That is, the right and left shift is a right shift if the center EC of the user's eye interval ES is on the right side of the proper center TC, and a left shift if the center EC is on the left side of the proper center TC.

Therefore, the example illustrated in FIG. 7B is shifted in the right direction. The appropriate center TC refers to the center of the interval K1 (or the interval K2) illustrated in FIG. Further, the amount of deviation L in the left-right direction is obtained by multiplying the difference (TC-EC) between the position of the appropriate center TC and the position of the center EC of the user's eye interval ES by the coefficient C1. The coefficient C1 is a constant for converting the difference (TC-EC) on the display screen 107a into an actual positional deviation distance.

On the other hand, the vertical shift is a downward shift when any of the left eye / right eye position of the user exceeds the lower end of the left eye position guide frame LE or the lower end of the right eye position guide frame RE. When the upper end of LE or the upper end of the right eye position guide frame RE is exceeded, an upward shift occurs. Although not shown, the vertical shift amount L is obtained by multiplying the vertical shift difference between the lower end of the guide frame (or the upper end of the guide frame) and the left eye position (or the right eye position) of the user by a coefficient C2. . The coefficient C2 is a constant for converting the vertical shift difference on the display screen 107a into the actual positional shift distance.
Defined by

  In step SB10, when the deviation direction (vertical direction or horizontal direction) of the user's eye position deviating from the appropriate range and the deviation amount thereof are detected, the control unit 100 proceeds to step SB11, and the detected deviation direction and deviation are detected. The amount is displayed as a guide on the guide display section GM of the eye position guide screen EG. For example, in the example shown in FIG. 7A, as shown in FIG. 7B, a guide message “shifted to the right: 5 cm” is displayed on the guidance display part GM of the eye position guide screen EG. To inform the user.

  When the guidance of the direction in which the user's viewpoint position is deviated from the appropriate range is completed in this way, the control unit 100 returns to the above-described step SB4 and again detects the positions of the left and right eyes of the user's face. Then, it is determined whether or not the detected positions of the left and right eyes are within an appropriate range. At this time, when the user moves the position of the viewpoint according to the above-described guide message, and the position of the left and right eyes of the user falls within the appropriate range, the determination result of the above-described step SB6 becomes “YES”, This process is finished.

<When the position of the user's eyes is not properly separated from the display screen 107a>
In this case, since the eye interval obtained from the positions of the left and right eyes of the user does not fit between the interval K1 and the interval K2, the determination result in step SB9 is “NO”, and the process returns to step SB12. move on. In step SB12, the shift direction (front-rear direction) of the user's eye position deviating from an appropriate range defined by the left eye position guide frame LE and the right eye position guide frame RE of the eye position guide screen EG and the shift amount are determined. To detect.

For example, as in the example illustrated in FIG. 8A, in a situation where the position of the user's eyes deviates from the appropriate range, the direction of the shift and the amount of the shift are detected based on the relationship illustrated in FIG. To do. In other words, the displacement before and after being too far or too close is a backward displacement if the user's eye interval ES is smaller than the interval K1, and a forward displacement if it is larger than the interval K2. Therefore, the example illustrated in FIG. 8B is a backward shift.

As shown in FIG. 8B, the backward shift amount L is obtained by multiplying the difference (K1−ES) between the interval K1 and the user's eye interval ES by a coefficient C3. The coefficient C3 is a constant for converting the difference (K1-ES) on the display screen 107a into an actual positional deviation distance. On the other hand, although not shown, the forward displacement amount L is obtained by multiplying the difference (ES−K2) between the user's eye interval ES and the interval K2 by a coefficient C4. The coefficient C4 is a constant for converting the difference (ES−K2) on the display screen 107a into an actual positional deviation distance.

In step SB12, when the shift direction (front / back shift) of the user's eye position deviating from the appropriate range and the shift amount thereof are detected, the control unit 100 proceeds to step SB13, and the detected shift direction and shift amount are determined. Guide display is performed on the guidance display section GM of the eye position guide screen EG. For example, in the example shown in FIG. 8A, as shown in FIG. 8B, a guide message “Too far: 10 cm” is displayed on the guidance display part GM of the eye position guide screen EG. Inform the user.

  Thus, when the guidance of how much the user's viewpoint position is deviated from the appropriate range and in which direction is completed, the control unit 100 returns to the above-described step SB4 and again detects the positions of the left and right eyes of the user's face. Then, it is determined whether or not the detected positions of the left and right eyes are within an appropriate range. At this time, when the user moves the position of the viewpoint in accordance with the guide message, and the position of the left and right eyes of the user falls within the appropriate range, the determination result in step SB6 described above becomes “YES”, and this processing Finish.

  In this way, in the eye position check process, the camera image obtained by capturing the user's face with the in-camera 103 is superimposed on the eye position guide screen EG and displayed on the display screen 107a, while image recognition is performed on the camera image. The positions of the left and right eyes of the user are detected, and the detected positions of the left and right eyes of the user are defined by the left eye position guide frame LE and the right eye position guide frame RE of the eye position guide screen EG. It is determined whether or not it is within an appropriate range representing the range of the optimum normal vision position to be obtained. And if it deviates from an appropriate range, it will guide how much it has deviated from the normal viewing position. Thereafter, the above guiding operation is repeated until the position of the left and right eyes of the user falls within the appropriate range of the eye position guide screen EG, and when the position of the left and right eyes of the user reaches the normal viewing position, this processing is completed. It is like that.

  As described above, in the first embodiment, when the content data to be displayed is 3D image data for 3D display, an optimal normal view for obtaining stereoscopic vision is obtained from a camera image obtained by capturing the user's face with the in-camera 103. While superimposed on the eye position guide screen EG for guiding the position (appropriate range) and displayed on the display screen 107a, the positions of the left and right eyes of the user detected from the camera image deviate from the appropriate range of the eye position guide screen EG. If so, it is guided to which direction and how much it is displaced.

  Then, the guidance operation is repeated until the positions of the left and right eyes of the user are within the proper range of the eye position guide screen EG. When the positions of the left and right eyes of the user are within the proper range, the content data for 3D display Is read from the content data area 102c of the RAM 102 and displayed in 3D on the display screen 107a. Therefore, since the user only needs to match the positions of his / her left and right eyes displayed on the monitor with the left eye position guide frame LE and the right eye position guide frame RE of the eye position guide screen EG, the user can easily perform 3D display. It is possible to set an optimum position for viewing.

  In the first embodiment described above, the position of the user's eye deviating from an appropriate range defined by the left eye position guide frame LE and the right eye position guide frame RE on the eye position guide screen EG (see FIG. 5). The shift direction and the shift amount are detected based on the image processing. Instead, the user's face position (eye position) deviating from the appropriate range based on the output of a well-known infrared focus sensor. It is possible to adopt a mode for measuring the distance and the amount of displacement.

  Further, in the first embodiment described above, the camera image captured by the in-camera 103 is displayed on a display screen 107a serving as a viewfinder, and an appropriate range (stereoscopic sensation is obtained on the display screen 107a displayed on the monitor. Although the eye position guide screen EG for guiding the (normal viewing position) is superimposed and synthesized and displayed, the present invention is not limited to this, and an auxiliary display screen is provided separately from the display screen 107a for displaying the content data in 3D. While displaying the camera image on the monitor using the display screen as a viewfinder, an eye position guide screen EG showing an appropriate range for optimally viewing the 3D image on the display screen 107a is displayed superimposed on the auxiliary display screen. It is also possible to make it a form.

  Furthermore, in the first embodiment, image recognition is performed on the camera image to detect the positions of the left and right eyes of the user, and the detected positions of the left and right eyes of the user are within an appropriate range defined on the eye position guide screen EG. If it is in a state of deviating from the appropriate range, the user is instructed / notified to what extent it is deviated from the normal viewing position. May fall within the appropriate range of the eye position guide screen EG, the user may be notified that the user is in the normal viewing position.

[Second Embodiment]
Next, a second embodiment will be described with reference to FIGS. Since the configuration of the second embodiment is the same as that of the first embodiment described above, description thereof is omitted. Hereinafter, an operation of content display processing according to the second embodiment, which is different from the first embodiment, will be described.

As in the first embodiment described above, when the user operates the content display button of the operation unit 108 while the mobile phone 10 is waiting for an incoming call, the control unit 100 is illustrated in FIG. 9 based on this operation event. The content display process is executed and the process proceeds to step SC1. In step SC1, attributes of various content data stored in the content data area 102c of the RAM 102 (for example, a file type and a content type for identifying 2D display / 3D display) are read from the content data area 102c. Are displayed as a content list on the display screen 107a.

  Subsequently, in step SC2, content data desired to be displayed in 2D or 3D is selected from the content list displayed in step SC1 in accordance with a user operation. In Steps SC3 to SC4, it is determined whether the content data to be displayed is for 2D display or 3D display based on the content type included in the attribute of the selected content data. Hereinafter, the description of the operation will be made separately for the case where the content data to be displayed is for 2D display and the case for 3D display.

<When content data to be displayed is for 2D display>
If the content data to be displayed is for 2D display, the determination result in step SC4 is “NO”, the process proceeds to step SC5, and the content data selected in step SC2 is read from the content data area 102c of the RAM 102 and displayed. 2D display is performed on the screen 107a. At this time, in the display unit 107, as the content data (image data) for 2D display is supplied from the control unit 100, the slit of the parallax barrier is electrically removed and the display screen 107a is displayed for 2D display. Set to the state of. In step SC6, the process waits until a content display end operation is performed. When the operation is performed, the determination result is “YES”, and the present process ends.

<When content data to be displayed is for 3D display>
If the content data to be displayed is 3D image data for 3D display, the determination result in step SC4 is “YES”, the process proceeds to step SC7, and the in-camera 103 is activated. As a result, the in-camera 103 starts to capture the face of the user facing the display screen 107a of the display unit 107.

Subsequently, in steps SC8 to SC9, according to an instruction from the control unit 100, the image processing unit 106 determines whether or not the camera image output from the in-camera 103 includes an image pattern corresponding to “human face”. The face recognition to be determined is executed, and if an image pattern corresponding to “human face” is included, it is determined whether or not the eye position can be detected from the recognized user face.

  If the eye position cannot be detected, the determination result in step SC9 is “NO”, and the flow proceeds to step SC10. In step SC10, it is determined whether or not 3D priority display is set. The 3D priority display setting means setting a display mode in which 3D display is prioritized when displaying content data. For example, according to the operation of a 3D priority display setting switch provided on the operation unit 108. Is set. If the 3D priority display setting has been made, the determination result is “YES”, the process proceeds to step SC11, the content display is stopped, and the process returns to step SC8. That is, when 3D priority display is set, content display is stopped until the position of the user's left and right eyes can be detected.

  On the other hand, if the 3D priority display setting is not made, the determination result in step SC10 is “NO”, and the process proceeds to step SC12. After 2D display, the process returns to step SC8. That is, when the 3D priority display is not set, the 3D image data for 3D display is converted to 2D display and the content is displayed in 2D until the position of the left and right eyes of the user can be detected.

  When the positions of the left and right eyes of the user can be detected, the determination result at step SC9 is “YES”, and the process proceeds to step SC13 shown in FIG. In step SC13, the detected positions of the left and right eyes of the user are compared with an appropriate range. The appropriate range refers to the range of the normal viewing position where the stereoscopic vision is obtained. Subsequently, in step SC14, based on the comparison result in step SC13, it is determined whether or not the position of the left and right eyes of the user is within an appropriate range. If the position of the left and right eyes of the user is within the appropriate range, the determination result is “YES”, and the flow proceeds to step SC15.

In step SC15, it is determined whether or not 3D display is being performed. If 3D display is not in progress, the determination result is “NO”, and the flow proceeds to step SC17. On the other hand, if the 3D display is being performed, the determination result is “YES”, the process proceeds to step SC16, and after switching to the 3D display, the process proceeds to step SC17. In step SC17, it is determined whether or not a content display end operation has been performed. If the content display end operation is not performed, the determination result is “NO”, and the process returns to step SC7 (see FIG. 9). However, if the content display end operation is performed, the determination result in step SC17 is "YES" is set, and this process is finished.

  On the other hand, if the detected positions of the left and right eyes of the user are not within the proper range, the determination result in step SC14 is “NO”, and the process proceeds to step SC18 to determine whether or not 3D display is being performed. If the 3D display is not in progress, the determination result is “NO”, and the process proceeds to step SC17. If the 3D display is in progress, the determination result is “YES” and the process proceeds to step SC19.

In step SC19, it is determined whether or not 3D priority display is set. If the 3D priority display setting that gives priority to the 3D display is set, the determination result is “YES”, the process proceeds to step SC20, the content display is stopped, and the process proceeds to step SC22 described later. On the other hand, if the 3D priority display setting is not made, the determination result in step SC19 is “NO”, and the process proceeds to step SC21 to switch to 2D display. That is, after the 3D image data for 3D display is converted to 2D display and the content is displayed in 2D, the process proceeds to step SC22.

In step SC22, it is determined whether or not the detected distance between the left and right eyes of the user is appropriate, that is, whether or not the position of the user's eyes is properly separated without being too far or too close to the display screen 107a. . If the user's eye position is appropriately separated from the display screen 107a, the determination result is “YES”, and the process proceeds to step SC23, where the user's eye position deviates from the appropriate range (up and down or left and right). Direction) and the amount of deviation thereof are detected, and in the subsequent step SC24, the detected deviation direction and deviation amount are guided and displayed on the display screen 107a, and then the process returns to step SC17 described above.

On the other hand, if the position of the user's eyes is not properly separated from the display screen 107a, that is, if the user's eye position is too far or too close from the display screen 107a, the determination result in step SC22 is “NO”. Proceeding to SC25, the shift direction (front-rear direction) of the user's eye position deviating from the appropriate range and the shift amount thereof are detected, and in the subsequent step SC26, the detected shift direction and shift amount are displayed on the display screen 107a as a guide. Thereafter, the process returns to step SC17 described above.

  As described above, in the second embodiment, when the content data to be displayed is 3D image data for 3D display, image recognition is performed on the output of the in-camera 103 that captures the face of the user, and the left and right eyes of the user The position of is detected. If the detected positions of the left and right eyes of the user are not within the proper range and the 3D priority display setting is made, after the content display is stopped, the positions of the left and right eyes of the user are within the proper range. The guidance operation is repeated until such a time is reached, and when the position of the left and right eyes of the user is within an appropriate range by this guidance operation, 3D display is performed, so that the user can reliably stereoscopically view the 3D display.

  If the detected positions of the left and right eyes of the user are not within the proper range and 3D priority display is not set, 3D image data for 3D display is converted to 2D display and the content is displayed in 2D. However, the guidance operation is repeated until the position of the left and right eyes of the user falls within the appropriate range, and when the position of the left and right eyes of the user falls within the appropriate range by this guidance operation, the user switches to 3D display. In contrast, the 3D display can be reliably stereoscopically viewed.

  In the first and second embodiments described above, the mobile phone 10 provided with the image display device according to the present invention is given as an example. However, the gist of the present invention is not limited to this, and the 3D display is performed. Needless to say, the present invention can be applied to all electronic devices having possible display means.

It is a figure which shows the external appearance structure of the mobile telephone 10 by 1st Embodiment. 1 is a block diagram showing an electrical configuration of a mobile phone 10 according to a first embodiment. It is a flowchart which shows the operation | movement of the content display process of 1st Embodiment. It is a flowchart which shows operation | movement of the eye position check process of 1st Embodiment. It is a figure which shows an example of the eye position guide screen EG. It is a figure for demonstrating operation | movement of the eye position check process of 1st Embodiment. It is a figure for demonstrating operation | movement of the eye position check process of 1st Embodiment. It is a figure for demonstrating operation | movement of the eye position check process of 1st Embodiment. It is a flowchart which shows the operation | movement of the content display process of 2nd Embodiment. It is a flowchart which shows the operation | movement of the content display process of 2nd Embodiment. It is a figure for demonstrating background art.

Explanation of symbols

10 Mobile phone 100 Control unit 101 ROM
102 RAM
102a work area 102b imaging data area 102c content data area 103 in-camera 104 wireless communication transmission / reception unit 105 audio signal processing unit 106 image processing unit 107 display unit 107a display screen 108 operation unit

Claims (27)

In an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen,
Imaging means for imaging a user facing the display screen;
Monitor display means for displaying a video of the user imaged by the imaging means on the display screen;
Composite display means for displaying an eye position guide image indicating an appropriate position of left and right eyes for allowing a user to stereoscopically view a 3D image on the display screen, superimposed on a user image displayed on the monitor by the monitor display means; An image display device comprising: The monitor display means includes an auxiliary display screen different from the display screen, and displays the user's video imaged by the imaging means on either the auxiliary display screen or the display screen. The image display device according to claim 1. Detecting means for detecting positions of the right and left eyes of the user from the video of the user imaged by the imaging means;
A discriminating unit that discriminates whether or not the positions of the left and right eyes of the user detected by the detecting unit coincide with an appropriate position indicated by the eye position guide image;
The image display apparatus according to claim 1, further comprising: a notification unit that notifies a determination result of the determination unit. The determination means determines whether the left and right eye positions of the user detected by the detection means are deviated in any of up, down, left and right directions with respect to an appropriate position indicated by the eye position guide image,
4. The image display device according to claim 3, wherein when the determining unit determines whether the determining unit is displaced in the up, down, left, or right direction, the notifying direction is notified. The determination unit determines whether or not the interval between the positions of the left and right eyes of the user detected by the detection unit matches the interval between the appropriate positions of the left and right eyes indicated by the eye position guide image,
The image display device according to claim 3, wherein when the determination unit determines a mismatch between the intervals, the notification unit notifies the state of the mismatch. The discriminating means detects the difference direction between the position of the left and right eyes of the user detected by the detecting means and the appropriate position indicated by the eye position guide image when it is discriminated as inconsistent;
The image display device according to claim 3, wherein the notification unit provides guidance and notification of shifting in the difference direction detected by the determination unit. The determination means determines that the monitor display means and the composite display when the positions of the left and right eyes of the user detected by the detection means match the appropriate position indicated by the eye position guide image. 4. The image display device according to claim 3, wherein the display of the eye position guide image by the means is terminated. The monitor display means displays on the display screen the video of the user imaged by the imaging means prior to displaying the 3D image on the display screen,
The composite display means displays an eye position guide image superimposed on a user's video displayed on the monitor by the monitor display means prior to displaying a 3D image on the display screen. The image display device described. In an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen,
Position acquisition means for acquiring the position of the user from a video obtained by imaging the user facing the display screen;
Position determining means for determining whether or not the position of the user acquired by the position acquiring means is in a predetermined allowable range position with respect to the display screen;
An image display apparatus comprising: an informing unit that informs whether the position of a user who views the display screen is appropriate according to a determination result of the position determining unit. The informing means informs that the position of the user can be viewed stereoscopically when the position of the user is determined to be within a predetermined allowable range with respect to the display screen, and determines that the position is out of the predetermined allowable range. The image display device according to claim 9, wherein when it is performed, it is notified that it is in a position where stereoscopic viewing is not possible. The position acquisition means acquires the positions of the left and right eyes of the user from an image captured of the user facing the display screen,
The image display according to claim 9, wherein the position determination unit determines whether or not the positions of the left and right eyes of the user acquired by the position acquisition unit are in an allowable range position where stereoscopic vision is possible. apparatus. 12. The position determination unit determines whether or not the positions of the left and right eyes of the user acquired by the position acquisition unit are shifted laterally from an allowable range position where stereoscopic vision is possible. The image display device described. The said position determination means determines whether the space | interval of the position of the right and left eyes of the user acquired by the said position acquisition means is an allowable range space | interval which can be viewed stereoscopically. Image display device. The position determination unit determines whether the acquired user position and the predetermined allowable range position are in a case where it is determined that the user position acquired by the position acquisition unit is not in the predetermined allowable range position with respect to the display screen. Detect the difference direction,
The image display device according to claim 9, wherein the notification unit provides guidance and notification of shifting in the difference direction detected by the position determination unit. Prior to displaying a 3D image on the display screen, the position acquisition unit acquires the position of the user from a video obtained by capturing the user facing the display screen;
Prior to displaying a 3D image on the display screen, the position determining means determines whether or not the position of the user acquired by the position acquiring means is within a predetermined allowable range position with respect to the display screen. The image display device according to claim 9. The position determination unit suppresses the display of the 3D image on the display screen when it is determined that the acquired user position is not in a predetermined allowable range position with respect to the display screen, while the acquired user The image display device according to claim 9, wherein a 3D image is displayed on the display screen when it is determined that the position is within a predetermined allowable range position with respect to the display screen. In an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen,
Position acquisition means for acquiring the position of the user from a video obtained by imaging the user facing the display screen;
Position determining means for determining whether or not the position of the user acquired by the position acquiring means is in a predetermined allowable range position with respect to the display screen;
An image display device comprising: a display control unit that controls whether or not to display a 3D image on the display screen according to a determination result of the position determination unit. The display control means displays a 3D image on the display screen when the position determination means determines that the position is within a predetermined allowable range position, and displays the 3D image as a 2D image when it is determined that the position is not within the predetermined allowable range position. 18. The image display device according to claim 17, wherein the image display device is displayed on the display screen. The display control unit displays a 3D image on the display screen when the position determination unit determines that the position is within the predetermined allowable range position, and displays the 3D image on the display screen when the display control unit determines that the position is not within the predetermined allowable range position. The image display device according to claim 17, wherein display of a 3D image is suppressed. 18. The display control unit, when the position determination unit determines that the position is not within a predetermined allowable range position, stops image data reproduction output and suppresses display of a 3D image on the display screen. The image display device described. The position acquisition means acquires the positions of the left and right eyes of the user from an image captured of the user facing the display screen,
The image display according to claim 17, wherein the position determination unit determines whether or not the positions of the left and right eyes of the user acquired by the position acquisition unit are within a permissible range position where stereoscopic vision is possible. apparatus. The position determination means determines whether or not the positions of the left and right eyes of the user acquired by the position acquisition means are shifted laterally from an allowable range position where stereoscopic vision is possible. The image display device described. 18. The position determination unit according to claim 17, wherein the position determination unit determines whether or not the interval between the positions of the left and right eyes of the user acquired by the position acquisition unit is an allowable range interval that allows stereoscopic viewing. Image display device. The image display device according to claim 17, wherein the position acquisition unit acquires the position of the user facing the display screen by optical positioning. A program executed by an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen,
An imaging step of imaging a user facing the display screen;
A monitor display step for displaying the video of the user imaged in the imaging step on the display screen;
A composite display step of displaying an eye position guide image indicating an appropriate position of left and right eyes for allowing the user to stereoscopically view a 3D image on the display screen so as to be superimposed on the video of the user displayed on the monitor in the monitor display step. Is executed by a computer. A program executed by an image display device that displays a 3D image to be stereoscopically viewed using binocular parallax on a display screen,
A position acquisition step of acquiring the position of the user from a video obtained by imaging the user facing the display screen;
A position determination step of determining whether or not the position of the user acquired in the position acquisition step is in a predetermined allowable range position with respect to the display screen;
A program for causing a computer to execute a notifying step for notifying whether or not the position of a user viewing the display screen is appropriate according to the determination result in the position determining step. 27. The program according to claim 26, further comprising a display control step of controlling whether or not to display a 3D image on the display screen according to a determination result in the position determination step.

Images