JP2007052304A - Video display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a video display system that display video giving a feeling of depth and a stereoscopic effect to an observer without making the observer feel strained or fatigued. <P>SOLUTION: The face (HF) of the observer is detected in an image photographed by an imaging means (1) and a portion of the source video to be displayed on a display screen (6a) is changed based upon the relative position of the detected face to the display screen (6a). Display magnification can be changed based upon the size of the face (HF) of the observer on an imaging screen. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a video display system, and more particularly, to a video display system in which a stereoscopic effect and a sense of depth can be obtained by changing an image to be displayed according to a relative position of an observer with respect to the video display system. is there.

In a display device that displays an image that gives a viewer a sense of depth or stereoscopic effect, a technique using binocular parallax or motion parallax, which is a physiological factor of stereoscopic vision, is used.
Binocular parallax refers to a shift that occurs in an image obtained by each eye when the left and right eyes are in a distant position. On the other hand, motion parallax refers to the difference in images that accompanies changes in the viewpoint due to the movement of the observer or the movement of what is being observed. For example, when the observer moves while staring at a single point, the user is staring. It refers to the fact that the mutual position between the point close to the boundary and the point far from the point seems to change toward the opposite direction. Humans are thought to process these shifts and changes in the brain and perceive depth.
As a technique for giving a stereoscopic effect using binocular parallax, for example, the following is available. That is, the position of the observer's viewpoint is detected using a sensor composed of an element that emits infrared light and a light receiving element that detects the reflected light, and parallax images for the left and right eyes that reflect changes in the observation direction based on the movement of the viewpoint. Generated and displayed alternately on the stripe-shaped pixels. By projecting these two images separately to the left and right eyes of the observer using a lenticular lens, a stereoscopic image can be given to the observer regardless of the position where the display device is observed (see Patent Document 1). ).

Japanese Unexamined Patent Publication No. 9-238369 (paragraphs 0017 to 0018, FIG. 7)

This conventional method uses binocular parallax. Since the observer processes different images in the right eye and the left eye in the head and constructs a positional relationship, the observer is easily tired. Another problem is that it gives the observer unnaturalness and tension. Use without tension, especially when the purpose is to obtain a video display system that gives viewers a feeling of openness such as windows in closed bathrooms, underground malls, and basements. It is important to be able to do it.
There is also a problem that a special device is necessary for the realization.

  The present invention selects display means having a display screen, video information providing means for providing video information, and a part of the video represented by the video information provided by the video information providing means for display on the display means. A video processing unit, an imaging unit arranged in the vicinity of the display unit and capturing an observer of the video displayed on the display unit, and an image captured by the imaging unit is analyzed to analyze the observation Face detection means for detecting a relative position of the person's face with respect to the display screen, and display control means for controlling selection in the video processing means based on the position of the face detected by the face detection means. Provided video display system.

According to the present invention, it is not necessary for the observer to wear a device or the like for detecting the position, and it is not necessary to process the parallax image in the brain, so that the observer feels nervous, tired, and uncomfortable. It is possible to provide a system that does not cause discomfort and is excellent in usability for an observer.
In addition, since it is not necessary to use a special device specially developed for stereoscopic viewing, it is possible to easily realize a system that gives a viewer a sense of depth and stereoscopic effect.

Embodiments of the present invention will be described below with reference to the drawings.
Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of a video display system according to Embodiment 1 of the present invention.
This video display system is a video display system that changes the video displayed on the display means in accordance with the relative position of the observer with respect to the display means for displaying the video, and includes an imaging means 1, a frame memory 2, a face It has detection means 3, display control means 4, video processing means 5, display means 6, and video information providing means 7.

  As the display means 6, in addition to a liquid crystal display, a plasma display panel, or the like, for example, a display composed of a cathode ray tube can be used. The display means 6 is preferably a flat panel type, for example. Further, the display means 6 shown in FIG. 4 has a rectangular display screen 6a.

  The video information providing means 7 provides, for example, video information (video content) of a still image or a moving image, may be constituted by a video storage device, and is transmitted from an external video information supply source (for example, a website). The received video information may be received.

  The video processing means 5 selects a part (partial region) of the video represented by the video information provided by the video information providing means 7, changes the display magnification as necessary, and supplies it to the display means 6. Display.

  The imaging unit 1 is arranged in the vicinity of the display unit 6 and photographs the observer HB of the video displayed on the display unit 6. The imaging means 1 is provided at a position adjacent to the outer edge 6b of the display screen 6a of the display means 6, for example. In the illustrated example, the imaging unit 1 is installed at a position adjacent to the lower edge 6 c on the lower side of the lower edge 6 c of the outer edge 6 b of the display screen 6 a of the display unit 6. The imaging means 1 has an imaging surface that is oriented in a direction perpendicular to the display screen 6a in a direction where the observer HB is normally viewed to view an image that is displayed, and forms a photographed image of the photographed observer HB. . As the imaging means 1, a digital still camera or a video camera using an image sensor such as a CCD (Charge Coupled Device) is used.

  An image captured by the imaging unit 1 is stored in the frame memory 2.

  The face detecting means 3 receives the image data obtained by photographing by the imaging means 1 and stored in the frame memory 2 and analyzes the photographed image, and determines the relative position of the face HF of the observer HB with respect to the display screen 6a. To detect. Of the relative position of the face HF of the observer HB with respect to the display screen 6a, the size of the image of the face HF on the imaging screen is used to estimate the position from the display screen 6a to the face. The position of the image is used to measure the angle (horizontal angle and vertical angle) of the straight line connecting the face HF to the normal of the display screen from the display screen 6a (center). It is used for estimation of the position on the parallel plane when it is assumed that the plane is parallel to the plane.

  Based on the position of the face HF detected by the face detection unit 3, the display control unit 4 selects a video portion to be displayed in the video processing unit 5 (to be described later with reference to FIGS. 4 to 8) and The display magnification is controlled (described later with reference to FIGS. 9 and 10).

  Of the above, the frame memory 2 forms part of the computer 8, and the face detection means 3, the display control means 4, and the video processing means 5 are realized by software, that is, by a programmed computer 8. ing. Further, the video information providing means 7 may be a part of the computer 8, but in the present embodiment, it is illustrated as being different from the computer 8. Further, although the imaging unit 1 and the display unit 6 are illustrated as being connected to the outside of the computer 8, they may be part of the computer 8.

  FIG. 2 assumes that the position of the observer HB and the image represented by the image information provided by the image information providing means 7 are displayed on the virtual plane 21 located behind the display screen 6a. It is the figure which showed the relationship with the part (area | region) displayed on the display means 6 among the images | videos displayed on the top (henceforth "original image | video").

  For example, as shown by a solid line 13a in FIG. 2, when the observer HB is sitting at the center of the bench 20 and is at a position substantially in front of the display screen 6a, the display means 6 is positioned at the center in the original image. The video portion of the area indicated by the solid rectangle 15 is displayed. Next, when the observer HB moves to the right side of the bench 20 as shown by a broken line 14a and shifts to the right side toward the display screen 6a, the display means 6 is located on the left side in the original video. The video portion of the area indicated by the dashed rectangle 16 is displayed. That is, the video portion or region displayed on the display means 6 in the original video moves in a direction opposite to the moving direction of the observer.

  As described above, in the display system of the present embodiment, it is assumed that the display screen 6a of the display means 6 is a window, and the image represented by the original image is a landscape, a sight, or the like that exists beyond the window. In such a case, the content of the video displayed on the display screen 6a (the displayed portion of the original video) is changed in the same way that the portion visible through the window changes according to the position of the observer. It is.

  As described above, the imaging unit 1 images the observer from the display unit 6 side. Therefore, as shown in FIG. 3, the position of the observer HB in the captured image 12 is opposite to the position of the observer HB when viewed toward the display screen 6a. That is, when the observer HB is at a position substantially in front of the display screen 6a as indicated by the solid line 13a in FIG. 2, the observer's image HC in the captured image 12 is also located at the center as indicated by the solid line 13b. On the other hand, when the observer HB is at the right position toward the display screen 6a as indicated by the broken line 14a in FIG. 2, the image HC of the observer in the captured image 12 is as indicated by the broken line 14b. , Shifted to the left. In the present application, an image of a face in a captured image may be simply referred to as “a face in the captured image”.

  In the present embodiment, the position of the face of the observer HB is detected from the image taken by the image pickup means 1, and an area to be displayed on the display means 6 is determined from the original video according to the detected position.

  The change in the display image (the image displayed on the display means 6) accompanying the change in the position of the observer's face will be described in more detail.

  4, FIG. 5 and FIG. 6 show changes in the display image as the observer moves in the horizontal direction. FIG. 4 shows a case where the observer is aligned with the approximate center of the display screen of the display means 6. In this case, the face of the observer is detected at the center of the image captured by the imaging means 1 (the center in the captured image 12 (FIG. 3)), and the central portion of the original video is displayed on the display screen 6a.

  As shown in FIG. 5, when the observer moves to the left side, the face of the observer is detected on the right side in the captured image 12, and the portion of the original video that is shifted to the right side than in the case of FIG. 6a.

  As shown in FIG. 6, when the observer moves to the right side, the face of the observer is detected on the left side in the captured image 12, and the portion of the original video that is shifted to the left side in the case of FIG. 6a.

  FIG. 7 and FIG. 8 show changes in the display image accompanying the vertical movement of the face HF of the observer HB. As shown in FIG. 7, when the observer HB stands up and the face HF moves upward, an image of the observer's face is formed on the upper side of the photographed image 12, and is lower than the case of FIG. 4 in the original video. The part shifted to the side is displayed on the display screen 6a. As shown in FIG. 8, when the observer HB squats down and the face HF moves downward, an image of the observer's face is formed below the captured image 12, and the original image than in the case of FIG. 4. The portion shifted upward is also displayed on the display screen 6a.

FIG. 9 and FIG. 10 show changes in the display image accompanying changes in the distance between the observer HB (its face HF) and the display means 6. As shown in FIG. 9, when the observer HB approaches the display unit 6, the display magnification decreases, and the portion of the original image that is displayed on the display unit 6 becomes wider. As shown in FIG. 10, when the observer HB moves away from the display unit 6, the display magnification increases, and the portion of the original image projected on the display unit 6 becomes narrower.
In this way, by changing the display image according to the position of the observer HB, it is possible to simulate the change of the scenery seen from the window.

  Next, a method for detecting the face HF will be described. The face detection means 3 extracts portions determined as elements or parts (parts) constituting the face such as eyebrows, eyes, nose and mouth from the image taken by the imaging means 1, and the positional relationship between them is determined. A face is detected by a method such as considering a face if it matches the arrangement of the face, or considering a skin-colored area in the captured image as a face. Then, a rectangle surrounding the detected area is created, and data representing the position of the center of the rectangle and the size of the rectangle is passed to the display control means 4. When a plurality of faces are detected, the one with the largest rectangle surrounding the face is selected and the others are ignored. If no face is detected, all values are set to 0, and the presence / absence of the face is notified to the subsequent processing. In this case, the same part as previously displayed is displayed.

  By comparing the center position of the rectangle obtained here with the reference position, it is possible to know how much the observer has shifted in the vertical and horizontal directions. The reference position can be arbitrarily set, but is usually the center of the captured image.

  Further, the relative distance between the observer and the display means 6 can be known by comparing the size of the rectangle with a predetermined reference value. Strictly speaking, it can be seen whether the observer is moving in the direction approaching the display means 6 or moving away.

  Next, a method for calculating the center of the display image portion of the original image from the position of the observer's face in the display control means 4 will be described. Here, as shown in FIG. 2 and FIG. 3, an example will be described in which the image captured by the imaging unit 1 is a horizontally reversed image when viewed from the observer.

  FIG. 11 shows an original video on the virtual plane 21, and FIG. 12 shows an image taken by the imaging means 1. Each pixel position in each image can be represented by coordinates in which the horizontal direction is the x-axis, the vertical direction is the y-axis, and the upper left is the origin (0, 0). Thereafter, the coordinates in the original video are represented by capital letters, and the coordinates in the image photographed by the imaging means 1 are represented by small letters.

First, a reference position for the original video and a reference position for the captured image are determined. For example, each center may be used as the reference position, but here, the coordinates of the reference position of the original video are represented as (X ₀ , Y ₀ ), and the coordinates of the reference position of the captured image are represented as (x ₀ , y ₀ ). . When the observer's face is at the reference position (x ₀ , y ₀ ) of the captured image, an area centering on the reference position (X ₀ , Y ₀ ) in the original video is displayed on the display means 6. And The size of the display area may be appropriately determined according to the size of the display area of the display means 6.

Display control means 4, the center coordinates (x _{f, y f)} of the rectangle surrounding the face is the face detection unit 3 detects from the captured image and a rectangular size values d _f representing the (size of the face) receive. The rectangle surrounding the face may be a square or a rectangle, but here it will be described as a square. A square, the length of one side and d _f. When a rectangle, may be such as sum or rectangular area of the length of the two sides and d _f.

The display control means 4 calculates the center coordinates (X ′, Y ′) of the area 17 displayed on the display means 6 from the original video according to the equation (1).
X ′ = X ₀ + α · (x ₀ −x _f )
Y ′ = Y ₀ + β · (y ₀ −y _f )
... (1)
The values of the coefficients α and β are, for example, α = 1.0 and β = −1.0.

  The sign of each coefficient is determined by the direction of the captured image. For example, when the captured image of the imaging means is reversed left and right as shown in FIGS. 3 and 12, if the coefficient α is a positive value and the coefficient β is a negative value as described above, the observer The display area of the original video moves in a direction opposite to the moved direction.

  The absolute values of the coefficients α and β are appropriately adjusted depending on the ratio of the moving amount of the display image to the moving amount of the face, the ratio of the size of the original image and the size of the image taken by the image pickup means 1, and the like. For example, when the absolute value is “1”, when the detection position of the observer's face changes by one pixel, the display area of the original video also changes by one pixel.

  Here, the value of the coefficient may be determined based on the following consideration. That is, it is assumed that the video represented by the video information provided by the video information providing unit 7 is displayed on the virtual plane 21 located behind the display screen 6a of the display unit 6 as shown in FIG. Assuming that the screen 6a is a window that can be seen through, it substantially matches the portion of the image on the virtual plane 21 that is visible to the viewer HB (the portion that is visible depends on the position of the viewer HB). The part is selected by the video processing means 5 and displayed on the display screen 6a. More specifically, the display control means 4 assumes that the video represented by the video information provided by the video information providing means 7 is displayed on the virtual plane 21, and the position of the observer's face HF When the line connecting the center of the display screen 6a is centered on the point where the virtual plane 21 intersects, the video processing means 5 is selected.

In the case of processing based on such an idea, the absolute values of the coefficients α and β are set to 1 because the distance sb from the virtual plane 21 in FIG. 13 to the display screen 6a is the face of the observer from the display screen 6a. This corresponds to the case where the distance sf to HF is equal.
FIG. 13 is a plan view showing the relationship between the position of the observer's face HF and the displayed video portion in the left-right direction, but the same relationship exists in the up-down direction.

  In such an arrangement, for example, as shown in FIG. 13, the observer's face HF is positioned on a straight line perpendicular to the display screen 6a through the position P1 in front of the center 6o of the display screen 6a. The video portion R1 centering on the point Q1 where the straight line 22 connecting the observer's face HF and the center 6o of the display screen intersects the virtual plane 21 is selected by the video processing means 5 and displayed. It is displayed on the display screen 6a of the means 6. FIG. 13 is a view seen from above, and the video portion R1 can be seen one-dimensionally. However, in reality, the same applies to the direction perpendicular to the paper surface, and the visible range is two-dimensional. The video portion R1 substantially coincides with a region having a line 24 where the face HF at the position P1 and the edge 6b of the display screen intersect the virtual plane 21 as an outer edge.

  When the observer's face HF is at a position P2 shifted to the right side toward the display screen 6a, the point Q2 where the line 25 connecting the observer's face HF and the center 6o of the display screen intersects the virtual plane 21. Is selected by the video processing means 5 and displayed on the display screen 6a. The video portion R <b> 2 substantially coincides with a region in which the surface 26 connecting the face HF and the edge 6 b of the display screen has a line 27 that intersects the virtual plane 21 as an outer edge.

  With the configuration described above, the image displayed on the display means 6 moves in a direction opposite to the direction in which the face of the observer moves, so that the observer can see a landscape and a scene spreading out through the window. Gives the feeling of watching.

The display control means 4 further calculates a video display magnification Z ′ according to the equation (2).
Z ′ = Z ₀ + γ · (d ₀ −d _f ) (2)
The value of the coefficient γ is, for example, 0.02.
Z ₀ and d ₀ are a reference magnification and a face size, respectively. The standard for magnification is 1.0, for example. The reference face size may be determined according to the size of the photographed image, the distance between the observer and the display means 6, and is, for example, １ ／ the length of the short side of the photographed image.

Thus, since d _f representing the size of the face is larger than the reference d ₀ is made lower display magnification Z ', if the size of the display screen 6a is constant, a wider range of video is displayed on the display screen 6a The Conversely, if d _f is the reference d ₀ less than representing the size of the face becomes high display magnification Z ', if the size of the display screen 6a is constant, it is displayed in a narrower range of the video display screen 6a .

  That is, when the observer approaches the display screen 6a, the range of the image displayed on the display screen 6a is wider than before the observer approaches. As a result, the observer feels that the field of view has been expanded in a pseudo manner. Conversely, when the observer moves away from the display screen 6a, the range of the image displayed on the display screen 6a becomes narrower than before the viewer moves away. As a result, the observer feels that the field of view is pseudo-narrowed.

  FIG. 14 is a flowchart for describing processing for detecting a face from an image captured by the imaging unit 1 and changing the display content of the original video according to the detection result in the first embodiment.

  When the program is started, first, the display positions X 'and Y' and the display magnification Z 'used for the display control means 4 are initialized (step ST1). Next, the face detection means 3 reads the image taken by the imaging means 1 from the frame memory 2 (step ST2), and detects the observer's face from the image (step ST3). If a face is detected (Yes in ST4), parameters X ′, Y ′, and Z ′ are updated (ST5 and ST6). If no face is detected (No in ST4), the parameters are updated. Absent. The control means 5 displays the original video on the display means 6 according to the parameters (step ST7). Thereafter, unless a termination request is generated, the processes of steps ST2 to ST7 are repeatedly executed.

  As described above, according to the present embodiment, when the observer HB of the display screen 6a changes the position, an image in a range that could not be seen is displayed on the display screen 6a, so that the field of view is changed and the observation is performed. Gives the person HB a feeling as if he is watching a part of the scenery spreading out through the window.

  Further, by changing the image displayed on the display screen according to the movement of the observer HB, it is possible to give a sense of depth to the display image.

  In this case, even if the original image is a still image, the portion displayed on the display screen changes according to the change in the position of the observer, so that it is possible to give a feeling of looking at the scenery outside the window. . When a still image is used, a simple image information providing unit 7 can be used. In addition, using moving images as the original video, the scenery slowly changes over time, scenes (sky color change, cloud flow, tree fluctuation, bird flying, movement of people and cars), etc. Also good. On the other hand, an image representing a passing landscape, such as when looking out from the window of a moving vehicle, may be used as the original image.

Embodiment 2. FIG.
Next, a video display system according to the second embodiment will be described. The overall configuration of the system of the second embodiment is the same as that of FIG. 1, but the operation of the display control means 4 is different. That is, in the first embodiment, the size of the portion (area) displayed on the display screen 6a of the original image is changed according to the distance from the display screen 6a to the observer. In addition, the display control means 4 that changes the size of the displayed portion is used as follows. That is, as the display control unit 4, for example, as shown in FIG. 15, the video represented by the video information provided by the video information providing unit 7 is displayed on the virtual plane 21 located behind the display screen 6 a of the display unit 6. Assuming that the image is displayed and assuming that the display screen 6a is a see-through window, the portion of the image on the virtual plane 21 that is visible to the observer HB (changes depending on the position of the face of the observer). The video processing means 5 uses the one that determines the display magnification of the video so that the portion that roughly matches the display) is displayed on the entire display screen 6a. In this case, the position of the observer is estimated based on the size of the face of the observer detected by the imaging unit 1. That is, if the face is large, it is estimated (determined) that the observer is closer, and conversely if the face is small, it is estimated (determined) that the observer is further away.

  For example, when the observer's face HF is at a position relatively far from the display screen 6a (position of the distance sf3) as indicated by reference numeral P3, a narrower video portion R3 of the video on the virtual plane 21 is displayed on the display screen. When the observer HB is at a position relatively close to the display screen 6a (position of the distance sf4) as indicated by reference numeral P4, a wider video portion R4 of the video on the virtual plane 21 is displayed. The display magnification is determined so as to be displayed on the screen 6a.

  The video portion R3 substantially coincides with a region where the surface 33 connecting the face HF at the position P3 and the edge 6b of the display screen has a line 34 intersecting the virtual plane 21, and the video portion R4 A surface 36 connecting the face HF in P4 and the edge 6b of the display screen substantially coincides with a region having an outer edge of a line 37 intersecting the virtual plane 21.

In this case, the following formula (3) may be used instead of the above formula (2) as a calculation formula for obtaining the display magnification Z ′.
Z ′ = Z ₀ × γ · (d ₀ / d _f ) (3)
In this case, the value of the coefficient γ is set to 1, for example.
The coefficient of 1 corresponds to the case where the distance from the virtual plane 21 in FIG. 13 to the display screen 6a is equal to the distance from the display screen 6a to the face of the observer HB.

Embodiment 3 FIG.
Next, the video display system of Embodiment 3 will be described. The overall configuration of the system of the third embodiment is the same as that of FIG. 1, but the display control means 4 controls the size of the display area 6e of the display screen 6a according to the detected face size. Is different. In the first embodiment, the visual field is expanded and narrowed by changing the display magnification of the video, whereas in the third embodiment, the display screen 6a of the display means 6 is adjacent to the outer edge 6b. The frame-shaped peripheral part to be made is a non-display part 6d, and the width of the non-display part 6d is changed to change the size of the display area 6e, thereby expressing the expansion and narrowing of the visual field.

  In the following description, the display magnification is described as being constant regardless of the position of the observer. However, the size of the display screen (display area) may be changed and the display magnification may be changed. In the third embodiment, the imaging unit 1 is installed above the display unit 6.

16 and 17 show changes in the size of the display area 6e of the display screen 6a according to changes in the distance between the observer and the display means 6. FIG. As shown in FIG. 16, when the observer HB approaches the display screen 6a of the display means 6, the width of the non-display portion 6d of the display means 6 is narrowed, and the display area 6e of the display screen 6a is expanded. As shown in FIG. 17, when the observer HB moves away from the display means 6, the width of the non-display portion 6d of the display means 6 increases and the display area 6e narrows.
In this way, by changing the size of the display area 6e according to the position of the observer HB, it is possible to simulate the change of the scenery seen from the window.

A method for determining the size of the display area 6e will be described. The display control means 4 calculates the vertical size W ′ and the horizontal size H ′ of the display area 6e of the display screen 6a according to the equation (4).
W ′ = W ₀ · δ · (d _f / d ₀ )
Z ′ = H ₀ · δ · (d _f / d ₀ )
... (4)

The coefficient δ is, for example, 1.0. W ₀ and H ₀ are the sizes of the reference display area 6e, respectively. Changing the size of the display area 6e according to the size ratio of d _f and the reference d ₀ of the observer's face. That is, the size of the display area 6e increases as the observer's face increases, and the size of the display area 6e decreases as the observer's face decreases. Thereby, the size of the display area 6e increases as the observer approaches the display means 6, and the size of the display area 6e decreases as the observer moves away from the display means 6. Therefore, the field of view widens when the observer approaches the display unit 6, and the field of view appears narrower when the viewer moves away from the display unit 6.

FIG. 18 is a flowchart for explaining processing for detecting a face from an image captured by the imaging unit 1 and changing the display content of the video according to the detection result in the third embodiment.
When the program is started, first, the display position and display magnification of the video used by the display control means 4 are initialized (step ST11). Next, the face detection means 3 reads the image taken by the imaging means 1 from the frame memory 2 (step ST12), and detects the observer's face from the image (step ST13). If a face is detected (Yes in ST14), the parameters X ′, Y ′, W ′, and H ′ are updated (ST15 and ST16). If no face is detected (No in ST14), the parameter Do not update. The control means 5 displays the video on the display means 6 according to the parameters (step ST17). Thereafter, unless a termination request is generated, the processes of steps ST12 to ST17 are repeatedly executed.

  In the first and second embodiments, the display means 6 has the rectangular display screen 6a. In the third embodiment, the display means 6 has the rectangular display area 6e. The region 6e may have another shape imitating a building or vehicle window, for example, a circular shape or an arch shape.

The video display systems of Embodiments 1 to 3 described above can be easily realized because there is no need to use a special device specially developed for stereoscopic viewing.
In addition, since it is not necessary for the observer to wear a device or the like for detecting the position, and it is not necessary to reconstruct a stereoscopic image from the parallax image in the brain, a system excellent in usability for the observer is provided. Can be provided.

It is a block diagram which shows the structure of the video display system of Embodiment 1, 2, 3 of this invention. 4 is an explanatory diagram schematically showing a relationship between an observer's position and a range displayed on a display screen from an original video in Embodiment 1. FIG. It is a figure which shows the position of the image of the observer in the picked-up image by an imaging means. It is explanatory drawing which shows typically the range of the original image | video displayed on a display screen, when an observer is located in front of the display screen of a display means. When an observer is looking at the display screen from the left side, it is explanatory drawing which shows typically the range of the original image | video displayed on a display screen. When an observer is looking at the display screen from the right side, it is explanatory drawing which shows typically the range of the original image | video displayed on a display screen. When an observer is looking at a display screen from a high position, it is explanatory drawing which shows typically the range of the original image | video displayed on a display screen. When an observer is looking at a display screen from a low position, it is explanatory drawing which shows typically the range of the original image displayed on a display screen. FIG. 4 is an explanatory diagram schematically showing a range of an original video displayed on a display screen when an observer is looking at the display screen from a close position. When an observer is looking at a display screen from a distant position, it is explanatory drawing which shows typically the range of the original image displayed on a display screen. It is explanatory drawing which shows typically how to represent the coordinate position of an original image | video. It is explanatory drawing which shows typically how to represent the coordinate position of the picked-up image by an imaging means. It is explanatory drawing which shows typically the relationship between an observer's position and the range displayed on a display screen from an original image | video. 3 is a flowchart showing a video display procedure in the first embodiment. FIG. 10 is an explanatory diagram schematically showing a relationship between an observer's position and a range displayed on a display screen from an original video in the second embodiment. In Embodiment 3, it is explanatory drawing which shows the display area used for a video display, when an observer is looking at a display screen from the near position. In Embodiment 3, it is explanatory drawing which shows the display area used for a video display, when the observer is looking at the display screen from a distant position. 10 is a flowchart illustrating a video display procedure in the third embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging means, 2 Frame memory, 3 Face detection part, 4 Display control means, 6 Display means, 6a Display screen, 6b Outer edge, 7 Image | video information provision means, 8 Computer, 12 Photographed image, 13a Observer located in front, 14a Observer located on the right side, 13b, 14b Image of the observer in the captured image, 15 Display area for the observer from the front, 16 Display area for the observer from the right side, HB observer, HF face.

Claims (12)

Display means having a display screen;
Video information providing means for providing video information;
Video processing means for selecting and displaying on the display means a part of the video represented by the video information provided by the video information providing means;
An imaging unit that is arranged in the vicinity of the display unit and captures an image viewer displayed on the display unit;
Analyzing a captured image obtained by imaging by the imaging unit, and detecting a relative position of the face of the observer with respect to the display screen;
A video display system comprising: display control means for controlling selection in the video processing means based on the position of the face detected by the face detection means. The imaging means is provided at a position adjacent to an outer edge of the display screen of the display means, and is directed in a direction in which an observer of the display screen is normally positioned, and takes a photographed image of the photographed observer Forming,
The face detection unit detects a position of the face in the captured image by the imaging unit, and obtains a position of the face with respect to the display screen based on the position of the face in the captured image. The video display system according to claim 1. The imaging means is provided at a position adjacent to an outer edge of the display screen of the display means, and is directed in a direction in which an observer of the display screen is normally positioned, and takes a photographed image of the photographed observer Forming,
The face detection unit detects the size of the face in the captured image by the imaging unit, and obtains the distance of the face from the display screen based on the size of the face in the captured image. The video display system according to claim 1. The face detection means includes
A rectangle surrounding the face of the observer,
The video display system according to claim 3, wherein a center of the rectangle is detected as a face position and a size of the rectangle is detected as a face size. The face detection means includes
When the rectangle surrounding the face is a square, the length of one side of the rectangle is the size of the face, and when the rectangle surrounding the face is a rectangle, the sum of the lengths of the two sides of the rectangle or the area of the rectangle is the face. The video display system according to claim 4, wherein the video display system is detected as a size of the video.   The display control means assumes that the video represented by the video information provided by the video information providing means is displayed on a virtual plane located behind the display screen of the display means, and the display screen is seen through. 2. The image processing unit according to claim 1, wherein, when it is assumed that the window is possible, the image processing unit selects a portion of the image on the virtual plane that substantially matches a portion visible to the observer. Video display system.   The display control means assumes that the video represented by the video information provided by the video information providing means is displayed on a virtual plane located behind the display screen of the display means, and the face of the observer 2. The video display system according to claim 1, wherein a video portion is selected by the video processing unit when a line connecting the position of the video signal and a center of the display screen is centered on a point where the virtual plane intersects. The display control means includes
In the reference position of the video provided by the video information providing means,
Add a value obtained by multiplying the difference between the reference position of the captured image and the face position by a constant,
2. The video display system according to claim 1, wherein a position of a center of a video portion to be displayed on the display unit is calculated from the video provided by the video information providing unit. The video processing means is capable of changing a video display magnification,
The video display system according to claim 3, wherein the display control unit changes the display magnification according to the size of the face detected by the face detection unit. The display control means includes
10. The display magnification of the image is calculated by adding a value obtained by multiplying a difference between the size of the observer's face and a predetermined reference value by a constant to a reference display magnification. Video display system. The video processing means can change the size of the video display area of the display screen of the display means,
The video display system according to claim 3, wherein the display control unit changes the size of the display area according to the size of the face detected by the face detection unit. The display control means includes
The size of the display area of the display means is calculated by multiplying the size of the reference display area by a value obtained by multiplying a ratio of the size of the observer's face and a predetermined reference value by a constant. 11. The video display system according to 11.

Images