JP2019119357A - Display system - Google Patents

Abstract

To provide a display system that suppresses information displayed by wearable equipment from being an obstruction to driving.SOLUTION: A display system according to the present invention has: wearable equipment 120 which is put on the body of a user and displays information within a visual field P of the user; detection means which detects the direction of the visual field P of the user; and control means which controls the display on the wearable equipment based upon positional relation between the direction of the visual field P of the user and a pillar Q1 of a vehicle. The control means makes the wearable equipment display pieces of information J, K within the visual field P when the pillar Q1 is included in the visual field P, and only the information J within the visual field P when the pillar 110 is not included.SELECTED DRAWING: Figure 7

Description

  The present invention relates to a display system including wearable devices for displaying information, and more particularly to display control of wearable devices when a display surface of a vehicle is viewed in the wearable devices.

  An eyeglass-type Internet terminal such as Google Glass has been developed, and by linking this terminal to a smartphone, it is possible to draw an image on the eyeglass. Patent Document 1 discloses a display system which prevents an image overlapping with a head-up display (HUD) from being displayed when the user wears a glasses-type wearable and gets into a vehicle. In addition, it is possible to set an item to be preferentially displayed on the wearable side at that time, for example, if the route is set to be displayed as wearable, even if the user's face is moved away from the HUD , Can keep the route displayed in the field of view. In addition, also in Patent Document 2, a display system is disclosed that displays a permitted image on the wearable side and controls the display device on the vehicle side not to display the image displayed on the wearable.

JP, 2015-210580, A Patent No. 6063854

  In Patent Documents 1 and 2, when the information displayed by the wearable device and the information displayed by the HUD on the vehicle conflict, either one of the information is not displayed or the wearable device or the HUD is It is possible to set priority display.

  However, when information on wearable equipment or HUD is constantly displayed, it is assumed that the image interferes with driving and a danger occurs. FIG. 1A is a display example when the driver visually recognizes the front, and FIG. 1B is a display example when the driver visually recognizes the left. Although the range P indicated by a rectangle is the field of view of the user of the glasses-type wearable device, the range P is not actually visible.

  When the driver is looking ahead, the left end of the user's field of view P has several icons 12 (an icon notifying an incoming call etc., an icon notifying an e-mail reception etc., an icon notifying the light color condition of a traffic light ahead Etc) is displayed. In addition, a head-up display (hereinafter, HUD) 10 is mounted on the vehicle, and the HUD 10 projects information in front of the vehicle. Therefore, the user can also view the information displayed by the HUD 10 in the view P. When the driver sees the front, the display of the icon 12 does not get in the way, but for example, as shown in FIG. 1B, when the driver sees the left, the display of the icon 12 It overlaps with the vehicle ahead and may interfere with driving.

  An object of the present invention is to provide a display system which solves the above-mentioned conventional problems and which prevents information displayed by a wearable device from disturbing driving.

  A display system according to the present invention is a wearable device worn on a user's body and displaying information in the user's field of vision, a detection means for detecting the direction of the user's field of vision, and the detection result of the detection means. And control means for controlling the display of the wearable device based on the positional relationship between the direction of view of the user and the specific structure of the vehicle.

  In one embodiment, the control means calculates whether or not the specific structure is included in the field of view of the user. In one embodiment, the position at which the specific structure is included in the field of view of the user is a blind spot area of the field of view of the user. In one embodiment, when the specific structure is included in the field of view of the user, the control means causes the first information to be displayed in the field of view of the user, and the specific structure is not included. Hide the first information within the field of view of the user. In one embodiment, when the specific structure is included in the user's field of view, the control means displays high priority information and low priority information in the user's field of view, and the user When the specific structure is not included in the field of view, the higher priority information is displayed. In one embodiment, when the specific structure is included in the field of view of the user, the control means makes the information displayed in the field of view of the user different according to the specific structure. In one embodiment, the control means causes the information to be displayed according to a predetermined priority according to the specific structure. In one embodiment, the display system further includes detection means for detecting whether the vehicle is traveling, and the control means is all or one of the information displayed by the wearable device when the vehicle is traveling. Hide the part. In one embodiment, the control means causes the hidden information to be displayed when the vehicle is at rest. In one embodiment, the display system further includes a head-up display that is an electronic device separate from the wearable device and displays information on a display surface of a vehicle, and the control means includes the wearable device and the head-up. Control the information displayed on the display.

  Furthermore, the display system according to the present invention comprises a wearable device attached to the user's body and displaying information in the user's field of vision, a detection means for detecting whether the vehicle is traveling, and the vehicle when it is stopped. And control means for causing the wearable device to display the first information and making the wearable device hide the first information when the vehicle is traveling.

  In one embodiment, the specific structure is a pillar adjacent to the side of the front window of the vehicle, a roof portion above the front window of the vehicle, or a dashboard portion below the front window of the vehicle.

  According to the present invention, the display of the wearable device is controlled based on the positional relationship between the user's field of view and the specific structure of the vehicle, so that information that may be an obstacle to driving can be selectively hidden. can do. In addition, displaying high priority information and hiding low priority information can reduce obstacles to driving while presenting important information. Furthermore, since the display of the wearable device is controlled depending on whether the vehicle is traveling or not, it is possible to hide information that would be in the way during driving and to display a lot of information while the vehicle is stopped. .

It is a figure explaining the subject of the conventional display system. FIG. 1 is a diagram showing an overall configuration of a display system according to an embodiment of the present invention. It is a figure which shows the internal structure of the vehicle-mounted apparatus which concerns on the Example of this invention. It is a figure which shows the functional structure of the display control program which concerns on the 1st Example of this invention. It is a table which specified the relation between the gaze direction and the blind spot area. It is a flowchart explaining operation | movement of the display system which concerns on the 1st Example of this invention. It is a figure which shows the example of a display by the 1st Example of this invention. It is a figure which shows the functional structure of the display control program which concerns on the 2nd Example of this invention. It is a flowchart explaining operation | movement of the display system which concerns on the 2nd Example of this invention. It is a figure which shows the example of a display by the 2nd Example of this invention.

  Next, embodiments of the present invention will be described in detail. The display system according to the present invention includes wearable devices such as wearable glasses, a mount head display, and an electronic device that controls the display of the wearable devices. The electronic device may be, for example, an on-vehicle device fixedly mounted on a mobile body such as a car, a portable terminal that can be carried in a vehicle, a laptop computer, or a smartphone. In addition, the display system can include a HUD and has the ability to control the display so that the wearable equipment and the information displayed by the HUD do not conflict.

  Next, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 2 is a diagram showing an overall configuration of a display system according to an embodiment of the present invention. The display system 100 according to this embodiment includes the HUD 110, the wearable device 120, and the in-vehicle device 200. The HUD 110 projects an image on the windshield of the vehicle based on the image data provided by the on-vehicle apparatus 200, and the driver can view a virtual image of the image projected in the direction of the line of sight of the driver. The projected image is, for example, guidance information on navigation, driving support information such as the speed of the vehicle.

  The wearable device 120 is, for example, a glasses-type terminal, and is mounted on the driver's head. The wearable device 120 has a function of performing wireless communication with the in-vehicle apparatus 200 (for example, Bluetooth communication, wireless LAN, etc.), and a lens end which is a field of view of the user based on image data provided from the in-vehicle apparatus 200. Display the image on The displayed image is, for example, an icon notifying an incoming call or the like, an icon notifying reception of an e-mail or the like, or an icon notifying a light color state of a traffic light ahead.

  In one preferred embodiment, when the HUD 110 and the wearable device 120 are connected, the in-vehicle device 200 controls both displays so that the both do not display the same information. For example, when displaying information on navigation on the HUD 110, the wearable device 120 displays information other than that. At that time, a priority may be set for each piece of information, that is, the information may be displayed on a terminal with a high priority.

  FIG. 3 shows an internal configuration of the in-vehicle apparatus 200 according to the present embodiment. As shown in the figure, the in-vehicle device 200 calculates an imaging camera 210 for imaging an in-vehicle space, a navigation unit 130 for calculating the position of the vehicle, and guiding the road around the vehicle position, and reproducing audio data and video data. Multimedia information playback unit 230, external interface 240, vehicle information acquisition unit 250 for acquiring vehicle information such as speed information and parking brake information, display unit 260, audio output unit 270, storage unit 280, and control unit 290. Configured However, this configuration is an example, and the on-vehicle apparatus 100 may further include other functions.

  The imaging camera 210 captures an image of the driver's face from behind the steering wheel, for example, and provides the captured image data to the control unit 290. The control unit 290 analyzes this image data to detect the driver's gaze direction.

  The external interface 240 enables connection with an external device by wire or wireless, and connects the HUD 110 shown in FIG. 2 or connects the wearable device 120 via a wireless communication means. The storage unit 280 can store software executed by the control unit 190, data necessary for the in-vehicle apparatus 200, map data required for the navigation unit 220, and the like. The control unit 290 controls each unit of the in-vehicle apparatus 200. In a preferred embodiment, the control unit 290 is composed of a microcontroller or the like including a ROM, a RAM, etc., and the ROM or RAM stores a program for controlling each unit. In the present embodiment, the control unit 290 executes a display control program for controlling the display of the HUD 110 and the wearable device 120.

  FIG. 4 shows a functional configuration of the display control program 300 of the present embodiment. The display control program 300 includes an information arbitration unit 310, a gaze direction detection unit 320, an overlap determination unit 330, and a display control unit 340.

  When the HUD 110 and the wearable device 120 are connected, the information arbitration unit 310 arbitrates which information is to be displayed on which device. For example, when the navigation unit 220 is being executed, the next intersection guidance arrow is displayed on either the HUD 110 or the wearable device 120, or the speed of the vehicle acquired from the vehicle information acquisition unit 250 is used as the HUD 110 or the wearable device 120. Display on any of.

  The gaze direction detection unit 320 detects the gaze direction of the driver based on the image data provided from the imaging camera 210. That is, it is detected in which direction the driver's gaze is directed on the front window of the vehicle, thereby specifying the direction of the view P of the user of the wearable device.

  The overlap determination unit 330 determines whether the specific structure of the vehicle is included in the field of view of the user of the wearable device 120. The user view of the wearable device 120 is, for example, a rectangular range P shown in FIG. 1, which is shaped according to the lens of the glasses. The overlap determination unit 330 determines the direction of the user's field of view P based on the driver's line of sight direction detected by the line of sight direction detection unit 320, and calculates two-dimensional coordinates of the field of view P on the XZ plane near the front window. Do. For example, if the field of view P of the user is rectangular, the intersection of the diagonals of the rectangle is associated with the detected gaze direction of the driver, and the coordinates of the field of view P in the XZ plane at that time (for example, Coordinates are calculated.

  The specific structure of the vehicle is a structure that is predetermined and can be an area that does not interfere with the driver's viewing direction when the driver's gaze is directed in a certain direction. . For example, as shown in FIG. 5A, when the line of sight of the driver is directed in a certain direction, a structure Q1 such as a pillar of a vehicle present at the left end in the user's view P is shown in FIG. As shown, when the driver's line of sight is directed in a certain direction, the driver Q as shown in FIG. 5C, a structure Q2 such as a roof portion of a vehicle present at the upper end of the user's view P. When the line of sight is directed in a certain direction, it is a dashboard-like structure Q3 present at the lower end of the user's field of view P. When the structures Q1, Q2, Q3 are shown in the field of view P, the structures Q1, Q2, Q3 are either shadows in the field of view or so-called blind spots where visual recognition is relatively unimportant.

  The overlap determination unit 330 determines whether or not the structures Q1, Q2, and Q3 are included in the coordinates of the field of view P of the user. Since the positions of the structures Q1, Q2 and Q3 are known, it is possible to calculate whether or not the structures Q1, Q2 and Q3 are positionally included in the field of view P if the viewing direction is detected. . Here, it should be noted that the area in the field of view P in which the structures Q1, Q2, Q3 are included is also an area in which information is displayed by the wearable device 120. For example, in the case of FIG. 5A, the structure Q1 overlaps the left end of the field of view P, but the left end is an area where the wearable device 120 displays information. Further, in the case of FIG. 5B, the structure Q2 overlaps the upper end portion of the field of view P, but the upper end portion is an area where the wearable device 120 displays information.

  Other than calculating the positional relationship between a specific structure and the field of view P by calculation, for example, as shown in FIG. 5 (D), the overlap determination unit 330 also has the structure of the vehicle of the vehicle and the specific structure. It is also possible to prepare a table that defines the relationship with the line of sight when the body is included in the field of view P, and to determine the overlapping relationship between the field of view P and a specific structure by referring to the table. .

  The display control unit 340 controls the display of the wearable device 120 based on the determination result of the overlap determination unit 330. Specifically, when it is determined that the specific structure and the field of view P overlap, the display control unit 340 causes the wearable device 120 to display information in the field of view P, and when it is determined that the information does not overlap, the wearable device The information is not displayed in the view P at 120. In another embodiment, the display control unit 340 causes the wearable device 120 to display high-priority information and low-priority information in the view P when it is determined that the display control unit 340 determines that they do not overlap. In this case, only low priority information is displayed in the view P.

  Next, the operation of the display system of this embodiment will be described with reference to the flow of FIG. First, the control unit 290 determines whether the wearable device 120 is connected via the external I / F 240 (S100). If it is determined that the wearable device 120 is connected, the information arbitration unit 310 arbitrates the information to be displayed between the HUD 110 and the wearable device 120 (S102). Next, the gaze direction detection unit 320 detects the gaze direction of the driver (S104), that is, the direction of the field of view P of the user is detected.

  Next, the overlap determination unit 330 determines whether a specific structure overlaps in position within the detected field of view P (S106). The display control unit 340 causes the wearable device 120 to display all the high / low priority information when it is determined to be overlapping (S108), and when it is determined not to be overlapping, the priority is low. Only information is displayed (S110).

  FIG. 7A shows a display example when the driver's gaze is directed to the left, and as a result, the pillar Q of the vehicle does not overlap the left end of the field of view P. In this case, the driver's blind spot does not exist in the field of view P. In other words, the entire field of view P is a region that the driver must see. It is desirable to display or display only important information on operation at a minimum. Therefore, the wearable device 120 displays only the important information J about the light color of the traffic light ahead.

  FIG. 7B is a display example when the driver's line of sight is directed forward, and as a result, the pillar Q of the vehicle overlaps the left end of the field of view P. In this case, since the area of the structure Q1 in the field of view P is a blind spot area where the driver's view is blocked, in addition to the important information J, other icon information K is simultaneously displayed here. Ru.

  As described above, according to the present embodiment, it is determined whether or not a specific structure that can be a blind area is included in the field of view P, and information display or non-display is selectively performed according to the determination result. Thus, it is possible to prevent the annoying information from being displayed constantly in the area where the driver needs to visually recognize.

  As a modification, the display control unit 340 may change the information displayed by the wearable device 120 according to the specific structure. For example, as shown in FIG. 5A, when the structure Q1 overlaps the view P, the first information is displayed, and as shown in FIG. 5B, the structure Q2 overlaps the view P. When the second information is displayed, as shown in FIG. 5C, when the structure Q3 overlaps the field of view P, the third information is displayed.

  Furthermore, information may be displayed according to the shape or size of a specific structure. For example, as shown in FIG. 5A, when the structure Q1 has a vertically elongated shape like a pillar, the first information is displayed along the vertically elongated shape, as shown in FIG. 5B, As shown in (C), when the structures Q2 and Q3 have a horizontally long shape, the second information and the third information are displayed along the horizontally long shape. For example, when the first, second, and third pieces of information are a plurality of icons, respectively, the plurality of icons are arranged along the shape of the structure. Furthermore, when displaying a plurality of icons, the line of sight of the user tends to be concentrated on the central icon, in other words, the central icon is easily recognized, so an icon with high priority is arranged at the center. Low-priority icons may be arranged on both sides.

  Next, a second embodiment of the present invention will be described. FIG. 8 is a diagram showing a functional configuration of a display control program 300A according to the second embodiment. The display control program 300A has a vehicle state determination unit 350 in addition to the configuration of the first embodiment. The vehicle state determination unit 350 determines whether the vehicle is traveling or is stopping based on the speed pulse or the brake information acquired from the vehicle information acquisition unit 250. The display control unit 340 controls the display of the wearable device 120 in consideration of the condition of whether the vehicle is traveling or being stopped.

  FIG. 9 shows an operation flow of the display system according to the second embodiment. In the flow shown in FIG. 6, steps S200 and S210 are newly added. That is, when it is determined by the overlap determination unit 330 that the structures do not overlap, it is determined whether the vehicle is at a stop (S200). When the specific structure is a pillar of a vehicle, the pillar overlaps with the field of view P if the driver views the front, but the pillar does not overlap with the field of view P if the driver's line of sight moves. Here, it is assumed that the movement of the line of sight has different causes during traveling and during stoppage. The movement of the sight line during driving is confirmation of the surrounding situation or looking away, and the movement of the sight line while stopping is looking away.

  When it is determined that the display control unit 340 is stopped, the display control unit 340 causes the wearable device 120 to display high-priority information (S110) or causes all the high-priority information and low-priority information to be displayed at all times. (S108) If it is determined that the vehicle is traveling, the information on the wearable device 120 is not displayed (S210).

  FIG. 10 (A) is a display example during traveling when the pillar Q1 is not included in the field of view P, and FIG. 10 (B) is a table during stopping when the pillar Q1 is not included in the field of view P. It is an illustrative example. In the case of traveling, all the information is hidden, and in the case of stopping, all the information J and K are always displayed.

  As described above, according to the present embodiment, it is assumed that the line of sight is moved, and that the driver is checking the surrounding conditions while traveling, and information on wearable devices is not displayed. This makes it easy for the driver to check the situation without being disturbed by the information displayed by the.

  Note that although the second embodiment described above performs the overlap determination between the specific structure and the field of view P, the second embodiment may not include this overlap determination. That is, it may be determined whether the vehicle is traveling or not, and if the vehicle is traveling, the wearable device may hide all the information, and if it is stopped, the wearable device may display all the information. .

  Further, in the above embodiment, in order to detect the direction of the field of view P of the user, the line of sight direction of the driver is detected by the imaging camera, but this is an example, and other methods may be used or combined. May be For example, when the wearable device includes an angular velocity sensor or an acceleration sensor and has a function of detecting its own direction by this sensor, the overlap determination unit 330 uses information representing the direction of the view P from the wearable device. can do.

  Although the preferred embodiments of the present invention have been described above in detail, the present invention is not limited to the specific embodiments, and various modifications may be made within the scope of the present invention as set forth in the claims. Modifications and changes are possible.

100: Display system 110: HUD
120: wearable equipment 200: in-vehicle device 210: imaging camera 220: navigation unit 230: multimedia reproduction unit 240: external I / F
250: vehicle information acquisition unit 260: display unit 270: voice output unit 280: storage unit 290: control unit P: user's field of view Q1, Q2, Q3: specific structure J, K: icon (information)

Claims (14)

Wearable equipment worn on the user's body and displaying information in the user's field of vision;
Detection means for detecting the direction of the field of view of the user;
Control means for controlling the display of the wearable device based on the positional relationship between the direction of the field of view of the user and a specific structure of the vehicle based on the detection result of the detection means;
A display system having: The display system according to claim 1, wherein the control means calculates whether or not the specific structure is included in the field of view of the user. The display system according to claim 1, wherein the position at which the specific structure is included in the field of view of the user is a blind spot area of the field of view of the user. The control means causes the first information to be displayed in the field of view of the user when the specific structure is included in the field of view of the user, and the field of view of the user when the specific structure is not included. The display system according to any one of claims 1 to 3, wherein the first information is not displayed in the inside. When the specific structure is included in the field of view of the user, the control means displays information with high priority and information with low priority in the field of view of the user, and the information in the field of view of the user is displayed. The display system according to any one of claims 1 to 3, wherein the information with high priority is displayed when the specific structure is not included. 6. The control method according to any one of claims 1 to 5, wherein, when the specific structure is included in the field of view of the user, the information to be displayed in the field of view of the user is different according to the specific structure. Display system described in The display system according to claim 6, wherein said control means causes information to be displayed according to a predetermined priority according to said specific structure. The display system further comprises detection means for detecting whether the vehicle is traveling or not
The display system according to any one of claims 1 to 7, wherein the control means hides all or part of the information displayed by the wearable device when the vehicle is traveling. The display system according to claim 8, wherein the control means displays the hidden information when the vehicle is at a stop. The display system further comprises a head-up display, which is an electronic device separate from the wearable device, for displaying information on the display surface of the vehicle,
The display system according to any one of claims 1 to 9, wherein the control means controls information to be displayed on the wearable device and the head-up display. Wearable equipment worn on the user's body and displaying information in the user's field of vision;
Detection means for detecting whether the vehicle is traveling;
Control means for causing the wearable device to display the first information when the vehicle is at a stop, and making the wearable device hide the first information when the vehicle is traveling;
A display system having: The display system according to claim 1, wherein the specific structure is a pillar adjacent to a side of a front window of a vehicle. The display system according to claim 1, wherein the specific structure is a roof portion above a front window of a vehicle. The display system according to claim 1, wherein the specific structure is a dashboard portion below a front window of a vehicle.

Images