TW201919390A - Display system and method thereof - Google Patents

Abstract

A display system includes: an image capturing module, a display device, and a processing unit. The processing unit is connected to the image capturing module and the display device. The image capturing module captures a viewer's head image, based upon which the processing unit obtains a head direction vector. It should be noted that the head direction vector includes the distance information between the viewer and the display device. The processing unit obtains the viewer's binocular field of view based on the head direction vector. The display device displays an image containing informative data within the binocular field of view.

Description

Display system and display method

The present invention relates to a display system and a display method, and more particularly to a display system and method for displaying more content in a limited display range using a three-dimensional effect.

The field of view (FOV) of the human eye has a certain boundary, so it is necessary to increase the range of sight by constantly changing the line of sight. For example, suppose that in the real world, a car is located directly in front of a viewer, and because of the limitation of the field of view, the viewer can only see the front of the car. However, if the viewer moves slightly to the right, the line of sight will be viewed from the right to the left, and the image of the front and part of the side of the car will be visible. By moving, the field of view can be extended indefinitely in the real world. However, if the picture is presented through the display device, the image can only be presented in accordance with the size of the display device, and the information that can be displayed is limited.

In addition, conventional flat screens use perspective to cause an object, such as a car, to present a stereoscopic visual effect on the screen of the display device. However, perspective is a method of compressing a three-dimensional solid image into a planar representation. Such a planar solid object is static. After the viewer changes the viewing line of sight, the angle and appearance of the object are not changed. Unlike the phenomena we experience in the real world, it greatly detracts from the realism of the display.

According to some embodiments, the present invention discloses a display system. The display system of the present invention comprises: a display device; an image capture module for capturing a head image of a viewer; and a processing unit coupled to the image capture module and the display device. The processing unit calculates a head vector according to the head image, and calculates a left eye position and a right eye position of the viewer according to a face image of the viewer. The processing unit calculates a left eye view and a right eye view according to the head vector, the left eye position, and the right eye position, respectively, and the processing unit obtains a binocular stereo view according to the left eye view and the right eye view set. . The display device displays a picture in the binocular stereoscopic field.

According to some embodiments, the present invention discloses a display system that changes display manner and content as a viewer position. The method includes: a display device; an image capture module, wherein when the viewer is at a first line of sight position, the image capture module captures a first head image of the viewer, and when the viewer is located at a second In the line of sight position, the image capturing module captures a second head image of the viewer; and a processing unit is coupled to the display device and the image capturing module. The processing unit calculates a first head vector of the viewer at the first line of sight position according to the first head image; obtains a first facial image of the viewer, and calculates a first one of the viewer according to the first facial image a left eye position and a first right eye position; respectively, obtaining a first left eye field, a first right eye field, and a first according to the first head vector, the first left eye position, and the first right eye position A binocular stereoscopic field, wherein the first binocular stereo field of view is a set of a first left eye field of view and a second right eye field of view. In addition, the processing unit calculates a second head vector of the viewer at the second line of sight position according to the second head image; acquires a second face image of the viewer, and calculates a viewer's first image according to the second face image. a second left eye position and a second right eye position; and a second left eye view, a second right eye view, and a second according to the second head vector, the second left eye position, and the second right eye position A binocular stereoscopic field of view, wherein the second binocular stereoscopic field of view is a collection of a second left eye field of view and a second right eye field of view. Wherein, when the viewer is in the first line of sight position, the display device displays a first picture in the first binocular stereoscopic field, and when the viewer is in the second line of sight position, the display device displays in the second binocular stereo field of view A second picture.

A further embodiment of the present invention discloses a display method for displaying a navigation map map as a viewer position changes. The display method includes: storing a navigation map map in a database; determining that the viewer is located at a first line of sight position, and displaying a first screen to the viewer for a first portion of the corresponding navigation map map; and determining the viewer by the first A line of sight position moves to a second line of sight position, and a second portion of the corresponding navigation map map displays a second picture to the viewer.

The above and other technical contents, features and advantages of the present invention will be apparent from the following detailed description of the embodiments of the invention.

The directional terms mentioned in the following embodiments, such as up, down, left, right, front or back, etc., refer to the direction of the additional drawing. Therefore, the directional terminology used is for the purpose of illustration and not limitation.

The present invention discloses a display system and method. The display system and method of the present invention can change the display manner according to the viewer's line of sight. Through the display system of the present invention, the object can be presented in the simulated real world, and the effect of changing with the viewer's viewing line of sight changes, further making the display of the object more Authentic. In addition, the present invention can also change the display mode and the corresponding content according to the position change of the viewer to achieve the effect of extending the field of view (FOV).

Fig. 1 is a schematic view showing a display method and a display system of the present invention implemented in a smart car 6000. The smart car 6000 includes a chassis 1, a frame 2, and a display system 3. The frame 2 is disposed on the chassis 1 and has a cabin 20. It should be noted that the display system and method of the present invention are not limited to being applied only to smart cars, and any method equipped with a display system, such as a handheld device, can employ the methods and systems disclosed herein.

Figure 2 is a functional block diagram of a display system in accordance with an embodiment of the present invention. As shown, the display system 3 includes an image capture module 31, a display device 32, and a processing unit 33. The image capturing module 31 and the display device 32 are disposed in the cockpit 20, and the processing unit 33 is coupled to the image capturing module 31 and the display device 32. In practice, the image capturing module 31 can be a camera or any device having the function of capturing images. Display device 32 can be, but is not limited to, a digital vehicle instrument cluster, a central console panel, or a head-up display. The processing unit 33 can be, but is not limited to, an electronic control unit (ECU).

As mentioned above, the display device can only display these images in a planar manner, regardless of whether the objects in the displayed image are stereoscopic or planar. No matter how the display device is viewed from any direction, there will be no change in these images, so the range of viewing fields that the display device can present is fixed to the viewer. The related application of the present invention discloses a display system and a display method for changing display content with a viewer's line of sight angle. In this application, the display device can display different contents depending on the viewer's line of sight.

Continuing the virtual box concept of the application, the present invention discloses a content that displays different depths of field using the sense of extension of the virtual space. In addition, with such a virtual space effect, the same display content (for example, a map map material) can be displayed in any position of the virtual space in a corresponding manner and content according to the difference of the viewer's line of sight.

For example, suppose the content to be displayed by the display system is a navigation material. As described above, the display device can only display a limited range of content under the application of the prior art due to the limitation of size. If the viewer wants to get more information, it may have to do so by zooming in, zooming out or moving the display. Taking Fig. 13 as an example, it is assumed that the navigation system already has complete map data, and the corresponding range is the display range A as shown in Fig. 13. Because of the size limitation of the display device, and in order for the viewer to clearly see the displayed material, only part of the graphic material (solid line portion of Fig. 13) can be displayed on the display device. As shown in Fig. 13, it is assumed that the right border of the display device is just cut on Fifth Avenue. If the viewer wants to know what the building B on the right side of Fifth Avenue is, he must display the limited display range by reducing the way the image is displayed or by pulling the screen to the right to the opposite position. relating documents. On the contrary, the present invention adjusts the display manner by judging the position of the viewer's line of sight and simultaneously adjusts the display content, so that even a display device having a limited display range can display more content in a simple manner. Taking FIG. 12 and FIG. 13 as an example, FIG. 12 is a screen in which the map image is presented on the display device 32 when the viewer 4 views to the right from a more left-right perspective. The 13th picture is the same map map, but the viewer 4 shows the picture when viewed from the more right side view to the left. As shown in Figure 12, the route plan and other vehicles and other information that the viewer sees will be displayed on the right hand side of the screen, and the viewer can see the content of the map map to the right. Conversely, as shown in Figure 13, the route plan seen by the viewer and the information of other vehicles will be displayed on the left hand side of the screen, and the viewer can also see the content of the map map to the left. In the above example, if the viewer wants to know the building B of the Fifth Avenue, in the application of the present invention, the viewer only needs to turn the line of sight to the right, so that the line of sight becomes right to left, the display of the present invention. System 3 can display the corresponding building B information on display device 32. Under such an effect, the display system 3 of the present invention allows the viewer to obtain additional information in a more intuitive manner, and further provides a visual effect that the viewer is closer to when the human eye views the actual object in real life. In the case of, for example, map maps or navigation, the driver can more easily recognize the route direction and be more intuitive in response to situations where special attention is required.

FIG. 3 is a schematic diagram of an embodiment of the display system 3 of the present invention. As shown in the figure, the display system 3 of the present invention can display a screen including a depth of field information (such as map map pictures shown in Figs. 12 and 13). When the viewer views the screen through the display device 32, it is visually perceived that there is a virtual space behind the display device 32 (the reference numeral is not shown). The present invention utilizes such a visual virtual space such that a display object (for example, a building, a front car, a route, etc. shown in FIGS. 12 and 13) can be displayed anywhere in the virtual space along with the viewer's line of sight, while The display device 32 is allowed to display more information in a limited display range.

Figure 3 is an illustration of how the display system of the present invention operates. It is assumed that the distance from the viewer to the display device is D1. Since the display screen M is a screen having depth of field data, when the viewer views the display screen M through the display device 32, the display screen M is not presented on the display device 32. The surface is in a virtual space at a position D2 from the rear of the surface of the display device 32. The distance D2 between the display screen M and the display device 32 is the depth of field of the screen M.

Since the image capturing module 30 is disposed on (or in the vicinity of) the display device 32, the viewer is seated in the cabin 20. For the processing unit 34, the position of the image capturing module 30 and the position of the cabin 20 are known. Based on these related positions and using a reference origin (for example, the image capturing module 30), the processing unit 34 can be established. A standard system. When the image capture module 30 captures an image of the head 40 from the viewer, the processing unit 34 obtains a head vector R of the head 40 relative to the display device 32 based on the coordinate system. The head vector R can be used to indicate the position of the viewer's head, and the head image amount R can include information of a distance D1 between the head 40 and the display device 32.

Before the screen is correctly displayed, the display system 3 of the present invention first defines the facial features of the viewer. In the fourth figure, the image capturing module 31 captures a head image 42 of the viewer. As shown in FIG. 5, the processing unit 33 defines facial feature information 440 based on the facial image 44. The facial image 44 of the present invention can be taken by the head image 42 or directly captured by the image capturing module 31. The method for creating a facial image and a facial feature can be performed by a conventional method for image recognition and image processing, and the present invention will not be described again. The facial features 440 can include: a left eye pupil, a right eye pupil, a nose, an eyebrow, a mouth corner, and the like. In the present embodiment, the facial feature data 440 includes a left eye position and a right eye position. Processing unit 34 analyzes and determines the viewer's perspective and the like based on changes in facial features 440 on different facial images 44.

FIG. 6 is a flowchart of a display method according to an embodiment of the present invention; the display method includes the following steps:

Step 100: The image capturing module 30 captures the viewer's head image 42.

Step 101: The processing unit 34 calculates a head vector R based on the head image 42.

Step 102: The processing unit 34 calculates a left eye position and a right eye position of the viewer according to the viewer's facial image 44 and the facial feature data 440; wherein the facial image 44 It can be obtained by the head image 42 or directly obtained by the image capturing module 30.

Step 103: The processing unit 34 calculates a left eye field of view LFOV, a right eye field of view RFOV, and a binocular stereo field of view BFOV according to the head vector R, the left eye position, and the right eye position.

Step 104: The processing unit 34 generates a left eye rendered image LRI according to the left eye field of view LFOV.

Step 105: The processing unit 34 generates a right eye rendered image RRI according to the right eye field of view RFOV.

Step 106: The processing unit 34 generates a plane of content PC according to the left-eye rendered image LRI and the right-eye rendered image RRI.

Step 107: The display device 32 displays the screen PC in the binocular stereoscopic field BFOV.

The display system and method of the present invention will be further described below. Please refer to Figures 2 to 3, 7A and 8 together. 7A is a top plan view of the display system 3 shown in FIG. 3; and FIG. 8 is a side view of the display system 3 shown in FIG. 3.

First, the image capturing module 30 captures the head image 42 of the viewer's head 40. Based on the head image 42, the processing unit 34 derives a head vector R using known positional relationships. For example, if the position of the image capturing module 30 is fixed, the display system 3 of the present invention can define it as the origin of the coordinate system; according to the relative position of the viewer and the image capturing module 30, Unit 32 can calculate the corresponding header vector.

Next, the processing unit 34 determines the left eye position and the right eye position of the viewer based on the pre-recorded facial features based on the viewer's facial image 44. The facial image 44 can be obtained by the head image 42 or directly obtained by the image capturing module 30. Next, as shown in FIG. 3, FIG. 7A, and FIG. 8, the processing unit 34 estimates a left eye field LFOV (left eye field of view) based on the head vector R, the left eye position, and the right eye position. A right eye field of view (RFOV) and a binocular field of view (BFOV). The left eye field of view LFOV and the right eye field of view RFOV are based on a horizontal angle of view (HAOV), a vertical angle of view (VAOV), a distance D1 between the head 40 and the display device 32, and a display. The device 32 is determined by the depth of field D2 of the screen to be displayed. For example, as shown in FIG. 7A, assuming that the display screen M is a screen of depth D2, the left-eye field of view LFOV can be regarded as being formed by the position of the viewer's left-eye position extending to the rear of the display device 32 by the distance D2. The area, in addition, the right eye field of view RFOV can be regarded as the area formed by the position of the viewer's right eye extending to the position D2 behind the display device 32, and the binocular stereo field of view BFOV is the left eye field of view LFOV and the right eye. The area formed by the field of view RFOV.

Next, the processing unit 34 calculates a left eye rendering image (LRI) according to the left eye field of view LFOV, and calculates a right eye rendering image (RRI) according to the right eye field of view RFOV. Next, the processing unit 34 generates a picture PC according to the left-eye rendered image LRI and the right-eye rendered image RRI. In the present invention, the material of the rendered image is a known and complete material. Taking the above navigation as an example, the display system 3 of the present invention may further include a database for storing all the complete map map materials. Thereafter, the display system 3 can grab the corresponding material from the database according to the viewer's line of sight angle and present it on the display device 32 in an image. In addition, the database may also store only part of the map map data. When the corresponding content needs to be displayed, the processing unit 34 may perform the corresponding content in time.

As shown in FIG. 7A, the left-eye LFOV and the right-eye gaze RFOV have an overlapping area OA within the binocular stereoscopic field BFOV. The left-eye rendered image LRI and the right-eye rendered image RRI located in the overlap area OA are subjected to fusion processing, and the left-eye rendered image LRI located outside the overlap area OA is reserved and located outside the overlap area OA. The right eye rendered image RRI is reserved. Thereby, the processing unit 34 can generate the content to be presented - the picture PC according to the left-eye rendered image LRI and the right-eye rendered image RRI. Finally, the display device 32 displays the picture PC in the binocular stereo field BFOV.

The display system 3 of the present invention changes the display mode and content of the presentation screen PC according to the viewer's line of sight. In the present invention, the viewer's line of sight may be determined based on the position of the viewer's head 40 (head vector R) or the change in the viewer's facial features. For example, the display system 3 of the present invention determines the positions of the viewer's head 40, the left eye 401, and the right eye 402 according to the viewer's head image 42 and the facial image 44 via image processing, and then transmits the processing unit 34. After the calculation, the screen PC is displayed on the display device 32 corresponding to the binocular stereoscopic field BFOV of the positions of the head 40, the left eye 401, and the right eye 402.

Since the image capturing module 30 is fixed on the display device 32, the viewing angle that the image capturing module 30 can capture is fixed. Under such a premise, the head image 42 or the facial image 44 extracted by the image capturing module 30 may vary with the position of the viewer. For example, as shown in FIG. 3, assuming that the viewer moves from the position P1 to the position P2, the face image 44 is converted to a state indicated by a broken line as indicated by the solid line in FIG. In the image captured by the image capturing module 30, since the image capturing module 30 can sense the dynamic offset of the viewer's head, it is relative to all static in-vehicle devices (such as the headrest portion of the driver's seat). In the case of the offset process of the face image 44 (as shown in Fig. 5, the process from the solid line appearance to the dotted line appearance) can be surely taken. The processing unit 34 can then calculate the distance between the current viewer and the display device 32 when the viewer is at the position P2 based on the facial image 44 captured by the new location. In addition to the position of the head 40, the processing unit 34 may also determine the motion of the viewer based on changes in the features 440 on the facial image 44, such as a swing, a head, and the like.

7A-7C is a schematic diagram of a display method for changing the line of sight of a viewer according to the present invention. FIG. 7A is a schematic diagram when the viewer views the display screen directly from the front of the display device 32; FIG. 7B is a schematic view when the viewer looks from left to right; and FIG. 7C shows the viewer when viewed from right to left. Schematic diagram. Taking FIG. 7A as an example, as described above, when the viewer is directly in front of the display device, the processing unit 32 can calculate the distance D1 from the display device 32 to the viewer. The processing unit further obtains a head vector R and calculates the left eye position 401 and the right eye position 402 of the viewer at this time. As described above, based on these materials, the display device 32 can display the corresponding screen M at the viewer's binocular stereoscopic field BFOV and the corresponding depth of field D2 while viewing the position directly in front.

Figure 7B is a diagram showing when the viewer moves from the middle position to the left and the line of sight is viewed from left to right. At this time, the processing unit 32 calculates that the head vector R representing the position of the viewer is changed from the original R to R1. Specifically, the position of the viewer's head 40 is shifted to the left by X1 in the X-axis direction. It should be noted that, in this embodiment, the image capturing module 30 is used as the origin of the coordinate system, and the relative moving distance and direction of the viewer are calculated. Further, the present embodiment is merely an example of moving in the X-axis direction, but it is to be understood that the viewer may also move back and forth at the same time. In such a case, the new header vector also contains components that move in the Y-axis direction.

Further, when the viewer is located at the position indicated by the head vector R (for example, directly in front of the display device), the image capturing module 30 is capturing the first head image of the viewer. Next, the processing unit 34 calculates a first header vector R according to the first header image, wherein the first header vector R contains information of a first distance between the viewer and the display device 32. Next, the processing unit 34 obtains a first facial image. Based on the first facial image, processing unit 34 may calculate the first left eye position and the first right eye position of the viewer. Next, the processing unit 34 obtains the first left-eye view LFOV, the first right-eye view RFOV, and the first binocular stereo field BFOV according to the first head vector R, the first left-eye position, and the first right-eye position. . Next, the processing unit 34 generates a first left-eye rendered image according to the first left-eye view; and generates a first right-eye rendered image according to the first right-eye view. Next, the processing unit 34 generates a first screen according to the first left-eye rendered image and the first right-eye rendered image and displays the first screen on the display device 32, wherein the first screen has a depth of field data.

Further, when the viewer moves to the left, the image capturing module 30 also captures the second head image of the viewer. Next, the processing unit 34 calculates a second header vector R1 according to the second header image, wherein the second header vector R1 contains information of the second distance between the viewer and the display device 32. Next, the processing unit 34 obtains a second facial image. Based on the second facial image, the processing unit 32 calculates the second left eye position 401 and the second right eye position 402 of the viewer at this time. According to the second head vector R1, the second left eye position, and the second right eye position, the processing unit 32 can obtain the second left eye view LFOV-1, the second right eye view RFOV-1, and the second binocular stereo Sight field BFOV-1. Next, the processing unit 34 generates a second left-eye rendered image according to the second left-eye view, and generates a second right-eye rendered image according to the second right-eye view. Then, the processing unit 34 generates a second picture according to the second left-eye rendered image and the second right-eye rendered image, and displays the second picture on the display device 32, wherein the second picture also has a depth of field data.

Assuming that the viewer is at a first line of sight position at a first time point and at a second line of sight position at a second time point, the display device 32 can be in the first binocular respectively using the display system and method of the present invention. The stereoscopic field BFOV displays the first picture and the second picture is displayed in the second binocular stereo field BFOV-1. As shown in FIG. 7A and FIG. 7B, since the position of the viewer at the first time point and the second time point is displaced (ie, the vector difference between the second head vector R1 and the first head vector R), The displacement causes a pan displacement effect between the first picture and the second picture. The sway displacement is the displacement between the second binocular stereo field BFOV-1 and the first binocular stereo field BFOV.

Further, please refer to FIG. 7A and FIG. 7C. Figure 7C is a diagram showing when the viewer moves from the middle position to the right and the line of sight is viewed from right to left. At this time, the processing unit 32 calculates that the head vector R representing the position of the viewer is changed from the original R to R2. Specifically, the position of the viewer's head 40 is shifted to the right by X2 along the X-axis direction. It should be noted that, in this embodiment, the image capturing module 30 is used as the origin of the coordinate system, and the relative moving distance and direction of the viewer are calculated. Further, the present embodiment is merely an example of moving in the X-axis direction, but it is to be understood that the viewer may also move back and forth at the same time. In such a case, the new header vector also contains components that move in the Y-axis direction. As described above, the display system 3 and method of the present invention can change the display mode depending on the position of the viewer at this time.

The display system 3 of the present invention visually creates a virtual space 49. When the viewer moves to the left, the line of sight sees that the right corner of the virtual space is seen; likewise, when the viewer moves to the right, the line of sight sees the meeting. See the left corner of the virtual space. With such a visual virtual space, the display system can display not only more content in a limited display range, but also a way of changing the display using such a visual virtual space. For example, as described above, the display system and method of the present invention can be applied to present a navigation system screen, that is, the screen M can be a map information. Please refer to FIG. 7B, FIG. 7C, FIG. 12, and FIG. 13 together. In such an application example, FIG. 12 is a schematic diagram corresponding to the 7B diagram, and FIG. 13 is a schematic diagram corresponding to the 7C diagram. Specifically, when the viewer moves to the left so that the line of sight becomes viewed from left to right, the viewer can see the map material screen as shown in FIG. 12; visually, the viewer would think that it is from the left side of the map to the screen Look inside (ie the left side view). Conversely, when the viewer moves to the right so that the line of sight becomes viewed from right to left, the viewer can see the map material picture as shown in Fig. 13; visually, the viewer will feel that it is viewed from the right side of the map. (ie right side view).

Furthermore, by using the visual virtual space generated by the display system and method of the present invention, the viewer can easily enlarge or reduce the display. Taking an enlarged display screen as an example, FIG. 9 and FIG. 10 are respectively a plan view and a side view of a zoom-in process of the display system 3 of the present invention. It is assumed that when the viewer approaches the position as shown in Fig. 10 from the position as shown in Fig. 8 toward the display device 32, the distance between the viewer and the display device 32 is changed from the original D1 to D1'. As shown in Fig. 9 and Fig. 10, the range of the left-eye visual field LFOV', the right-eye visual field RFOV', and the binocular stereoscopic field BFOV will thus increase. That is, the left eye visual field LFOV', the right eye visual field RFOV', and the binocular stereoscopic field BFOV shown in FIGS. 9 and 10 are larger than the left eye visual field shown in FIGS. 7A and 8. The range of LFOV, right eye field of view RFOV, and binocular stereo field of view BFOV. That is, when the distance between the viewer and the display device becomes shorter, the same picture can be displayed in a wider range of binocular stereoscopic field BFOV. With such a characteristic, the viewer can easily enlarge or reduce the display screen only by approaching or moving away from the display device 32.

In other words, when the component of the first head vector R in a normal direction of the display device 32 is smaller than the component of the second head vector R' along the normal direction of the display device 32, the first binocular stereoscopic field It will be larger than the second binocular stereoscopic field, causing a zoom-in effect. Similarly, the zoom-out effect can be deduced in this way. For the sake of brevity, it will not be repeated here.

11A, 11B and 11C are respectively a flow chart for adjusting the display mode of the display system 3 according to the position of the viewer's line of sight according to the embodiment of the present invention. In summary, the display method of the present invention comprises the following steps:

Step 200: The image capturing module 30 captures a first head image when the viewer is at a first line of sight position P1.

Step 201: The processing unit 34 calculates a first header vector R according to the first header image, where the first header vector R includes information of a first distance between the viewer's head and the display device 32.

Step 202: The processing unit 34 calculates a first binocular stereo field of view BFOV1 according to the first head image.

Step 203: When the viewer is located at the first line of sight position P1, the display device 32 displays a first picture in the first binocular stereo field BFOV1.

Step 204: The image capturing module 30 captures a second head image when the viewer is at a second line of sight position P2.

Step 205: The processing unit 34 calculates a second header vector R2 according to the second header image, where the second header vector R2 includes information of a second distance between the viewer's head and the display device 32.

Step 206: The processing unit 34 calculates a second binocular stereo field of view BFOV2 according to the second head image.

Step 207: When the viewer is located at the second line of sight position P2, the display device 32 displays a second picture in the second binocular stereo field BFOV2.

As shown in FIG. 11B, the flow chart of the display system 3 adjusting the display mode according to the viewer's line of sight further includes the following steps:

Step 300: The processing unit 34 obtains a first facial image, wherein the first facial image can be obtained by the first facial image or directly captured by the image capturing module 30.

Step 301: The processing unit 34 calculates a first left eye position LE1 and a first right eye position RE1 of the viewer according to the first facial image.

Step 302: The processing unit 34 calculates a first left-eye field of view LFOV1 and a first right-eye field of view RFOV1 according to the first head vector R1, the first left-eye position LE1, and the first right-eye position RE1. A set of left eye field of view LFOV1 and first right eye field of view RFOV1, processing unit 34 may obtain a first binocular stereo field of view BFOV1.

Step 303: The processing unit 34 obtains a second facial image, wherein the second facial image can be obtained by the second facial image or directly captured by the image capturing module 30.

Step 304: The processing unit 34 calculates a second left eye position LE2 and a second right eye position RE2 of the viewer according to the second facial image.

Step 305: The processing unit 34 calculates a second left-eye field of view LFOV2 and a second right-eye field of view RFOV2 according to the second head vector R2, the second left-eye position LE2, and the second right-eye position RE2. The processing unit 34 can obtain the second binocular stereoscopic field BFOV2, which is a set of the two left eye field of view LFOV2 and the right eye second field of view RFOV2.

As shown in FIG. 11C, the flow of the display system 3 changing the display mode according to the viewer's line of sight further includes the following steps:

Step 400: The processing unit 34 calculates a first left-eye rendered image according to the first left-eye scope LFOV1.

Step 401: The processing unit 34 calculates a first right-eye rendered image according to the first right-eye scope RFOV1.

Step 402: The processing unit 34 obtains the first picture according to the first left-eye rendered image and the first right-eye rendered image.

Step 403: The processing unit 34 calculates a second left-eye rendered image according to the second left-eye scope LFOV2.

Step 404: The processing unit 34 calculates a second right-eye rendered image according to the second right-eye scope RFOV2.

Step 405: The processing unit 34 obtains the second picture according to the second left-eye rendered image and the second right-eye rendered image.

As described above, the present invention utilizes the left and right eye parallax to achieve the same effect of increasing the range of the field of view. Further, the display system 3 of the present invention visually creates a virtual space 49. When the viewer moves to the left, the line of sight sees that the right corner of the virtual space is seen (as in the field of view FOV_A shown in FIG. 14). Similarly, when the viewer moves to the right, the line of sight sees the left corner of the virtual space (as in the field of view FOV_C shown in Figure 14). In this way, the original flat display device can be used to display more content by such spatial extension. For example, a screen with an original size of 12.3 inches can display more than 12.3% of what the display device can display by moving the line of sight. This can avoid complicated motion instructions such as zooming in, zooming out, and moving images on the conventional display screen.

Compared with the prior art, the display system of the present invention can use the image capturing module to capture the image of the head including the viewer, calculate the binocular stereoscopic field according to the head image, and control the display device to display in the binocular stereoscopic field. The screen, that is, the display system of the present invention displays a picture according to the binocular stereoscopic field, and the presented picture conforms to human binocular vision. Furthermore, the display system of the present invention can render different pictures at different positions and time points, and these pictures correspond to the relative positions between the viewer and the display device. The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

1000‧‧‧Smart car

1‧‧‧Chassis

2‧‧‧ frame

20‧‧‧Cockpit

3‧‧‧Display system

30‧‧‧Image capture module

32‧‧‧Display device

34‧‧‧Processing unit

4‧‧‧Users

40‧‧‧ head

401‧‧‧ left eye

402‧‧‧ right eye

42‧‧‧ head image

44‧‧‧Face images

440‧‧‧Characteristics

R, R'‧‧‧ head vector

R‧‧‧first head vector

R1, R2‧‧‧ second head vector

D1, D1'‧‧‧ distance

D2‧‧‧ Depth of field

A‧‧‧Display range

FOV_A, FOV_C‧‧‧ field of view

B‧‧‧Buildings

BFOV, BFOV'‧‧‧ binocular stereoscopic field

BFOV‧‧‧ first binocular stereoscopic field

BFOV-1‧‧‧Second binocular stereoscopic field

LFOV, LFOV'‧‧‧ left eye field of view

LFOV‧‧‧first left eye field of view

LFOV-1‧‧‧ second left eye field of view

RFOV, RFOV'‧‧‧ right eye field of view

RFOV‧‧‧first right eye field of view

RFOV-1‧‧‧ second right eye field of view

OA‧‧ overlapping area

HAOV‧‧ horizontal perspective

VAOV‧‧ perpendicular view

M, PC‧‧‧ screen

LRI‧‧‧ left eye rendering image

RRI‧‧‧Right eye rendering image

P1, P2, A1, A2‧‧‧ position

X‧‧‧first shaft

X1‧‧‧ first direction

X2‧‧‧ second direction

1 is a schematic view of a smart car according to an embodiment of the present invention. FIG. 2 is a functional block diagram of a display system according to an embodiment of the present invention. Figure 3 is a schematic diagram of a display system in accordance with an embodiment of the present invention. FIG. 4 is a schematic diagram of capturing an image of a head of a viewer by an image capturing module according to an embodiment of the present invention. FIG. 5 is a schematic diagram of a processing unit extracting a viewer's face image according to an embodiment of the present invention. Figure 6 is a flow chart of a display method according to an embodiment of the present invention. Figure 7A is a top plan view of the display system shown in Figure 3. Figure 7B is a schematic diagram showing the viewer when viewed from left to right in accordance with an embodiment of the present invention. Figure 7C is a diagram showing the viewer when viewed from right to left in accordance with an embodiment of the present invention. Figure 8 is a side elevational view of the display system shown in Figure 3. Figure 9 is a top plan view showing the enlargement of the processing screen of the system. Figure 10 is a side elevational view showing the enlargement of the processing screen of the system. 11A, 11B, and 11C are flowcharts respectively showing a display method according to an embodiment of the present invention when a viewer moves relative to a display device. Figure 12 is a schematic diagram of a situation in which the display system shown in Figure 7B is used to display the map information. Figure 13 is a schematic diagram of a situation in which the display system shown in Figure 7C is used to display the map information. Figure 14 is a schematic diagram showing how the viewer's line of sight position changes display and simultaneously adjusts the display content.

Claims (20)

A display system includes: a display device; an image capture module for capturing a head image of a viewer; and a processing unit coupled to the image capture module and the display device, the process The unit calculates a head vector according to the head image and calculates a left eye position and a right eye position of the viewer according to the face image of the viewer, the head vector including one of the viewer and the display device Distance information, the processing unit calculates a left eye field of view and a right eye field of view according to the head vector, the left eye position, and the right eye position, the processing unit according to the left eye field of view and the right eye field of view A set of images obtains a binocular stereoscopic field, and the display device displays a picture in the binocular stereoscopic field. The display system of claim 1, wherein the processing unit creates the facial image according to the facial image, or the image capturing module directly acquires the facial image. The display system of claim 1, the display system further comprising a database for storing a data. The display system of claim 3, wherein the processing unit generates a left-eye rendered image in the left-eye view according to a first portion of the data, and generates a right-eye rendered image in the right-eye view, The processing unit generates the image according to the left-eye rendered image and the right-eye rendered image, wherein the first left-eye field of view and a portion of the image of the first right-eye field of view are subjected to image fusion processing, and Non-overlapping partial images are retained separately. The display system of claim 1, wherein a range of the binocular stereoscopic field is increased when the viewer is in proximity to the display device, and the binocular stereoscopic field of view is increased when the viewer is away from the display device A range is reduced. A display system for changing a display mode and content with a viewer position, comprising: a display device; an image capture module, wherein the image capture module captures the viewer when the viewer is at a first line of sight position a first head image of the viewer, and when the viewer is in a second line of sight position, the image capturing module captures a second head image of the viewer; and a processing unit, and the display The processing unit is configured to perform the following steps: calculating, according to the first head image, a first head vector of the viewer at the first line of sight position; acquiring one of the viewers a first facial image, and calculating a first left eye position and a first right eye position of the viewer according to the first facial image; according to the first head vector, the first left eye position, and the first a right eye position, a first left eye field of view, a first binocular field of view, and a first binocular stereo field, wherein the first binocular stereo field is the first left eye field and the a collection of second right eye views Calculating a second head vector of the viewer at the second line of sight position according to the second head image; acquiring a second face image of the viewer, and calculating the viewer's image according to the second face image a second left eye position and a second right eye position; and obtaining a second left eye field and a second right according to the second head vector, the second left eye position, and the second right eye position, respectively An eye field of view and a second binocular stereoscopic field, wherein the second binocular stereo field of view is a set of the second left eye field of view and the second right eye field of view; wherein when the viewer is located at the In a line of sight position, the display device displays a first picture in the first binocular stereoscopic field, and when the viewer is in the second line of sight position, the display device displays a second binocular stereoscopic field. The second picture. The display system of claim 6, wherein the processing unit respectively creates the first facial image and the second facial image according to the first head image and the second head image, or the image capturing mode The group directly obtains the first facial image and the second facial image. The display system of claim 6, wherein the first header vector includes a first distance information of the viewer and the display device, and the second header vector includes the viewer and the display device Two distance information. The display system of claim 6, wherein the processing unit generates a first left-eye rendered image according to the first left-eye field of view, and generates a first right-eye rendered image according to the first right-eye field of view. The processing unit generates the first picture according to the first left-eye rendered image and the first right-eye rendered image, wherein the first left-eye view field and a partial image of the first right-eye view overlap The image fusion processing is performed, and the non-overlapping partial images are respectively reserved; wherein the processing unit generates a second left-eye rendered image according to the second left-eye field of view, and generates according to the second right-eye field of view. a second right eye rendering image; wherein the processing unit generates the second image according to the second left eye rendered image and the second right eye rendered image, wherein the second left eye field of view and the second right Part of the image in which the eye field overlaps is subjected to image fusion processing, while non-overlapping partial images are retained separately. The display system of claim 9, the display system further comprising a database for storing the first left-eye rendered image, the first right-eye rendered image, the second left-eye rendered image, and the The second right eye renders a material corresponding to the image. The display system of claim 6, wherein the first picture and the second picture are a map map material, and the first picture and the second picture have partially identical content. The display system of claim 6, wherein if the first line of sight position of the viewer is farther from the display device than the second line of sight position, the range of the first binocular stereoscopic field is smaller than the second binocular The range of the stereoscopic field of view is small. A method for displaying a navigation map map with a change in a viewer position, comprising: storing the navigation map map in a database; determining that the viewer is located at a first line of sight, and corresponding to navigating the map map a first portion displaying a first picture to the viewer on a display device; and determining that the viewer is moved from the first line of sight position to a second line of sight position, and a second portion corresponding to the navigation map is A second screen is displayed on the display device to the viewer. The display method of claim 13, further comprising determining that the observer is located at the first line of sight position or the second line of sight position according to a head position, a left eye position, and a right eye position of the viewer. The display method of claim 13, further comprising: obtaining a first left eye field of view, a first right eye field of view, and a first binocular stereo field when the viewer is located at the first line of sight position, The binocular stereoscopic field of view is a set of the first left eye field of view and the first right eye field of view; and further comprising: obtaining a second left eye field of view when the viewer is located at the second line of sight position, a second right eye field of view and a second binocular stereo field, wherein the second binocular stereo field is a set of the second left eye field of view and the second right eye field of view. The display method of claim 15, further comprising rendering the first left eye view according to the first left eye field of the viewer and the corresponding navigation map image, according to the viewer's A right eye field of view and the corresponding navigation map image are rendered into a first right eye rendered image, and the first picture is generated according to the first left eye rendered image and the first right eye rendered image. The display method of claim 15, further comprising rendering the second left eye view image according to the second left eye field of the viewer and the corresponding navigation map image, according to the second of the viewer The right eye field of view and the corresponding navigation map map are rendered into a second right eye rendered image, and the second picture is generated according to the second left eye rendered image and the second right eye rendered image, wherein the second image A data source of the two left eye rendered images and the second right eye rendered image is the second portion of the navigation map map. The display method of claim 13, wherein the second screen is the first screen if the viewer moves forward from the first line of sight position farther from the display device to the second line of sight position closer to the display device An enlarged picture of a picture. The display method of claim 13, wherein if the viewer moves leftward to the second line of sight position by the first line of sight position facing the center of the display device, the second picture is compared to the first The screen contains more information on the right side of the navigation map. The display method of claim 13, wherein if the viewer moves rightward to the second line of sight position by the first line of sight position facing the center of the display device, the second picture is compared to the first The screen contains more information on the left side of the navigation map.