WO2017122508A1

WO2017122508A1 - Information display system and information display method

Info

Publication number: WO2017122508A1
Application number: PCT/JP2016/087967
Authority: WO
Inventors: 玲子野田; 馬場　雅裕
Original assignee: 株式会社東芝
Priority date: 2016-01-15
Filing date: 2016-12-20
Publication date: 2017-07-20
Also published as: JP2017126021A

Abstract

The present invention provides an information display system and an information display method with which it is possible to improve work efficiency and production throughput. An information display system according to an embodiment is provided with a display unit, a reception unit, and an output control unit. The display unit is worn on the head of a user and displays information as a virtual image. The reception unit receives notification information from the outside. The output control unit receives notification information while the visibility of the virtual image is reduced, and when a user is not sighting the virtual image, exercises control to make at least a portion of the virtual image changed with time.

Description

Information display system and information display method

Embodiments described herein relate generally to an information display system and an information display method.

In a factory that manufactures various products, using a head-mounted type see-through type (transmission type) display device including glasses, etc., the product assembly manual and the operating status of the equipment that manufactures the product (manufacturing equipment) In addition, the inventory status of parts, information on equipment trouble, etc. can be displayed as a virtual image at the tip of the line of sight to improve the production throughput. In the technical field of such a display device, a technology for controlling the display of a virtual image based on the operation and situation of the wearer (user) of the display device is known, for example, depending on the direction of the user's line of sight, When the virtual image is not seen, the visibility of the virtual image is lowered and low power consumption can be realized.

JP 2008-67218 A

However, in the above-described prior art, when the visibility of the virtual image is reduced and the user does not see the virtual image (typically when the user's line-of-sight direction is not directed toward the virtual image), Even if notification information such as communication such as a construction instruction is displayed as a virtual image, the user often overlooks it. For this reason, there is a problem that work efficiency and production throughput are lowered, such as delay in response to trouble and start of construction.

The information display system of the embodiment includes a display unit, a receiving unit, and an output control unit. The display unit is mounted on the user's head and displays information as a virtual image. The receiving unit receives notification information from the outside. The output control unit performs control to change at least a part of the virtual image with time when the notification information is received in a state where the visibility of the virtual image is lowered and the user does not visually recognize the virtual image.

FIG. 1 is a diagram illustrating an example of the configuration of the information display system according to the embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the embodiment. FIG. 3 is a diagram illustrating an example of the functions of the information processing apparatus according to the embodiment. FIG. 4 is a schematic diagram illustrating a specific arrangement example of each element included in the display device of the embodiment. FIG. 5 is a diagram illustrating an operation example of the information display system according to the embodiment. FIG. 6 is a diagram illustrating an example of a hardware configuration of a circuit unit according to a modification.

Hereinafter, embodiments of an information display system and an information display method will be described in detail with reference to the accompanying drawings.

FIG. 1 is a diagram showing an example of the configuration of the information display system 1 of the present embodiment. As shown in FIG. 1, the information display system 1 includes a display device 10 and an information processing device 20. The display device 10 and the information processing device 20 can communicate with each other directly or indirectly via a wired or wireless connection. The communication method between the display device 10 and the information processing device 20 is arbitrary, and any communication method may be used.

The display device 10 is an example of a “display unit”, and is a device that is mounted on the user's head and displays information as a virtual image. A specific configuration of the display device 10 will be described later. In the following description, “user” indicates a wearer of the display device 10.

The information processing apparatus 20 may be a portable terminal such as a smartphone, a tablet, a notebook PC (Personal Computer), or a stick PC, or a stationary type such as a desktop PC (Personal Computer). It may be a terminal. In this example, a portable terminal possessed by the user is used as the information processing apparatus 20. Here, for example, the information display system 1 including the display device 10 and the information processing device 20 is assigned to each of a plurality of users in the factory. Hereinafter, a specific configuration of the information processing apparatus 20 will be described.

FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 20. As illustrated in FIG. 2, the information processing apparatus 20 includes a CPU (electric circuit such as a microprocessor) 21, a ROM 22, a RAM 23, and an I / F unit 24.

The CPU 21 comprehensively controls the operation of the information processing apparatus 20. The ROM 22 is a non-volatile memory that stores various data such as programs. The RAM 23 is a volatile memory that functions as a work area for various processes executed by the CPU 21. The I / F unit 24 is an interface for connecting to an external device such as the display device 10.

FIG. 3 is a diagram illustrating an example of functions of the information processing apparatus 20. As illustrated in FIG. 3, the information processing apparatus 20 includes a determination unit 210, a reception unit 211, and an output control unit 212. For convenience of explanation, FIG. 3 mainly illustrates functions necessary for explanation of the present embodiment, but the functions of the information processing apparatus 20 are not limited to these.

The determination part 210 determines whether the user (wearer of the display apparatus 10) is visually recognizing the virtual image. More specifically, the determination unit 210 is, for example, a device connected to the information processing apparatus 20 by wire or wirelessly, or a sensor (for example, a vibration sensor, a proximity sensor) separately installed on the information display system 1 or a part of the user's body. An input signal input from a sensor, a camera, or the like is processed to determine whether the user is viewing a virtual image. The determination unit 210 repeats the above determination, for example, at a constant cycle, and generates a visual state signal indicating the determination result each time the determination is performed, and outputs the generated visual state signal to the output control unit 212 described later. . Here, the input signal input to the determination unit 210 may be any signal as long as it can be used to determine whether or not the user is viewing a virtual image. The determination may be performed, for example, only at a timing when the reception unit 211 receives information, or may be performed at a constant cycle for a predetermined time from the timing when the reception unit 211 receives information, for example.

For example, the information display system 1 further includes a function of detecting the user's line of sight (a function of detecting the direction and focus of the line of sight, which may be hereinafter referred to as a “line of sight detection unit”). It is also possible to determine whether or not the user is visually recognizing a virtual image based on the user's line of sight detected by. For example, when the user's line of sight detected by the line-of-sight detection unit is directed to the virtual image, the determination unit 210 can determine that the user is viewing the virtual image. The line-of-sight detection unit may be provided in the information processing device 20 (provided as a function of the information processing device 20), or may be provided in a device different from the information processing device 20 and the display device 10. It may be. In any form, the determination unit 210 acquires a signal indicating a user's line of sight (a signal indicating a detection result by the line-of-sight detection unit) as an input signal, and analyzes the acquired input signal so that the user can obtain a virtual image. It can be determined whether or not the user is visually recognized.

Note that various known methods can be used as a method for detecting the line-of-sight direction. For example, the user's face is illuminated with an infrared LED, the eyes are imaged with an infrared camera, and the imaging data obtained by the imaging is analyzed. A method of identifying the position of reflection in the cornea of the user (reflection position of the infrared LED) and the position of the pupil and detecting the direction of the line of sight from the identified positional relationship (corneal reflection method) can also be used. In this case, for example, the determination unit 210 detects a user's gaze direction based on imaging data generated by the information display system 1 or an infrared camera separately installed on a part of the user's body (in the information display system 1 Is provided separately from the information processing device 20), and a signal indicating the user's line of sight is acquired as an input signal, and the acquired input signal is analyzed to determine whether the user is viewing a virtual image. It may be. Further, for example, the infrared camera is provided separately from the display device 10 and the information processing device 20, while the function of detecting the user's line-of-sight direction (line-of-sight detection unit) based on imaging data generated by the infrared camera is the determination unit 210. Alternatively, it may be provided in the information processing apparatus 20. In this case, the determination unit 210 acquires a signal indicating the user's line of sight (a signal indicating a detection result by the line-of-sight detection unit) as an input signal from the line-of-sight detection unit, and analyzes the acquired input signal so that the user can recognize the virtual image. It can be determined whether or not the user is visually recognized.

Further, for example, the determination unit 210 acquires, as an input signal, an image obtained by capturing the user with the information display system 1 or a camera separately installed on a part of the user's body, and the user's head is obtained from the acquired input signal. If the motion is estimated and it is determined that the user is stationary for a predetermined time, it may be determined that the user is viewing the virtual image. For example, the determination unit 210 indicates an operation signal (indicating an operation state) output from an operation device (a mouse, a keyboard, a touch panel, a switch, or the like) for performing various operations on an image (screen) that is a source of a virtual image. Signal) is acquired as an input signal, and when an input signal corresponding to a state in which a predetermined operation is performed is acquired, the user may determine that the user is viewing a virtual image. In addition, for example, the determination unit 210 acquires data obtained from a vibration sensor or an angle sensor separately installed on the information display system 1 or a part of the user's body as an input signal, and analyzes the acquired data to obtain the user When it is determined that the user is moving such as walking, the user may determine that the user is not visually recognizing the virtual image.

Further, for example, the determination unit 210 acquires, as an input signal, a signal indicating the display state of the image that is the source of the virtual image from the output control unit 212 (or the display device 10) described later, and the image that is the source of the virtual image is not displayed. When an input signal indicating that the image is turned off or an input signal indicating that the visibility of the virtual image is reduced may be acquired, the user may determine that the virtual image is not visually recognized. .

Further, for example, the determination unit 210 determines whether or not the user is performing a predetermined work, and when the user is performing the predetermined work, the determination unit 210 determines that the user does not visually recognize the virtual image. It may be. For example, a case where the user performs a barcode reading operation is assumed as an example of the predetermined operation. In this case, the determination unit 210 acquires a signal indicating the operation state of the device as an input signal from, for example, a barcode reading device. For example, when the input signal indicating that the barcode reading mode is entered is acquired, the user It may be determined that the barcode reading operation is being performed, and the user determines that the virtual image is not visually recognized.

Further, for example, as an example of a predetermined work, a work of transmitting video captured by a camera to a remote operator using a smartphone (may be the information processing apparatus 20 or another apparatus) ( It is assumed that the image transmission work). In this case, when the determination unit 210 acquires a signal indicating the operation state of the smartphone as an input signal from the smartphone, for example, when the input signal indicating that an application for transmitting an image is activated, the user performs an image It may be determined that the transmission work is performed and the user determines that the virtual image is not visually recognized.

In addition, as an example of the predetermined work, a case is assumed in which work that does not use an electronic device, such as unpacking a packing material with a cutter, is performed. In this case, the determination unit 210 acquires a video signal from the information display system 1 or a camera separately installed on a part of the user's body as an input signal, and unpacks based on image recognition using the acquired input signal. When it is detected that the work is started, the user may determine that the virtual image is not visually recognized. In addition, the determination part 210 should just be a form which has the function to determine whether the user is visually recognizing a virtual image, and is not restricted to the above example.

Continue the explanation of FIG. The receiving unit 211 receives notification information from the outside (for example, an information processing device such as a PC or a server used by an administrator who manages processes in a factory). The notification information is information to be notified to the user, for example, information indicating the trouble occurrence status of the manufacturing equipment in the factory, and instructing the start of construction because the conditions necessary for proceeding to the next process in the production process have been prepared. Information, information for notifying telephone contact or mail contact from the instructor or other workers, and the like. The receiving unit 211 outputs notification information received from the outside to the output control unit 212 described later.

The output control unit 212 controls on / off of display of the virtual image displayed on the display device 10, display position, display brightness, display content, contrast, color, and the like. That is, the output control unit 212 controls an image corresponding to a virtual image displayed on the display device 10 (an image that is a source of the virtual image). The output control unit 212 performs control to transmit an image controlled by the output control unit 212 to the display device 10 and display a virtual image corresponding to the image on the display device 10.

The output control unit 212 controls the visibility of the virtual image displayed on the display device 10. For example, the output control unit 212 makes the visibility of the virtual image at the first time lower than the visibility of the virtual image at the second time before the first time. For example, the output control unit 212 makes the visibility of the virtual image in the first time lower than the visibility of the virtual image in the second time before the first time and continuous with the first time. In the present embodiment, the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, at least a part of the virtual image is changed over time. Control to change. In the present embodiment, the output control unit 212 receives notification information from the reception unit 211 in a state where the visibility of the virtual image is reduced, and indicates from the determination unit 210 that the user is not viewing the virtual image. When the visual recognition state signal is received (that is, when the determination unit 210 determines that the user does not visually recognize the virtual image), control is performed to change at least a part of the virtual image over time.

In this example, the output control unit 212 can perform control to reduce the visibility of the virtual image based on the user's operation and situation. For example, the output control unit 212 can perform control to reduce the visibility of the virtual image when the visual recognition state signal indicating that the user is not visually recognizing the virtual image is received from the determination unit 210. Control can be performed to reduce the visibility of the virtual image when the notification information is not received, and the visibility of the virtual image is reduced when the user confirms the virtual image corresponding to the image based on the notification information (described later). It is also possible to perform control.

As a method of reducing the visibility, for example, the entire image (which may be referred to as “display image” in the following description) that is the source of the virtual image is not displayed, or the brightness (luminance value) of the display image is reduced. , Move the position of the virtual image out of line of sight, hide part of the display image, reduce the luminance (luminance value) of part of the display image, switch the display image to another image with low visibility, Etc. are considered. Here, the reason why the visibility is lowered when the brightness of the display image is lowered is that the display device 10 is a transmissive display device, and therefore, when the brightness of the display image is lowered, the transmittance of the display image is increased. is there. In addition, the above example is an example to the last, and methods other than the above may be used as long as the visibility of a virtual image is reduced. Here, since the display device 10 is a transmissive display device, if the visibility of the virtual image is reduced, the real scene becomes easier to see. In addition, it is possible to reduce power consumption by reducing the luminance of at least a part of the display image or by not displaying it.

Next, specific contents of control by the output control unit 212 to change at least a part of the virtual image over time will be described. For example, in peripheral vision (viewing the object in the periphery of the retina that is a certain distance away from the center of the retina), it is easy to detect changes in luminance over time (flicker). It may be changed periodically. Further, it is desirable that the fluctuation period is a frequency at which light-sensitive epilepsy is not easily induced and a frequency that can be detected as flicker. Also, the color, size, shape, etc. of the display image may be changed by animation. These controls may be combined with the aforementioned control for changing the luminance over time.

The output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, at least a part of the brightness, color, size, and shape of the virtual image , One or more of the positions can be controlled to change over time.

When the user visually recognizes the virtual image while performing control to change at least a part of the virtual image over time, the output control unit 212 refers to an image based on notification information (hereinafter referred to as “notification image”). In some cases, the display device 10 is controlled to display a virtual image corresponding to the case. More specifically, the output control unit 212 performs a control to change at least a part of the virtual image over time as described above, and a visual recognition state signal indicating that the user is viewing the virtual image. Is received from the determination unit 210, the display device 10 is controlled to display a virtual image corresponding to an image (notification image) determined according to the notification content indicated by the notification information received from the reception unit 211. The virtual image before the notification information is received has lower visibility than the virtual image corresponding to the image (notification image) determined according to the notification content indicated by the notification information. The output control unit 212 performs control to display a highly visible virtual image on the display device 10 when the user visually recognizes the virtual image while performing control to change at least a part of the virtual image over time. Can do.

For example, when the notification content indicated by the notification information is a content indicating that there is a request for a video call directly from a remote instruction person, a virtual image corresponding to the video call screen with the instruction person may be displayed. Good. Also, if there is a lot of notification information, for example when there are multiple notification contents, if the information cannot be displayed all at once, for example, information indicating a summary of the notification contents, such as information on the device that caused the trouble, the name and status of the device are displayed. You may display the virtual image corresponding to the image which shows the icon etc. to show in list format. Further, for each of a plurality of notification images corresponding to a plurality of notification information on a one-to-one basis, a virtual image corresponding to the notification image may be switched and displayed at regular intervals. Note that the display method of the notification information is not limited to these, and any display method may be used as long as the notification content indicated by the notification information received by the reception unit 211 can be understood, and the display method is arbitrary.

The functions (determination unit 210, reception unit 211, output control unit 212) of the information processing apparatus 20 described above are realized by the CPU 21 executing a program stored in a storage device such as the ROM 22, but this For example, at least a part of these functions may be realized by a dedicated hardware circuit (for example, a semiconductor integrated circuit).

Next, a specific configuration example of the display device 10 will be described, but the configuration of the display device 10 is not limited to the content described below, and can be arbitrarily changed. The display device 10 is worn on the user's head and projects an image (an example of information) to be displayed on a small display onto an optical system in front of the user's eyes so that the user can visually recognize a virtual image corresponding to the image. It is a display device capable of causing (equivalent to “displaying information as a virtual image”). The display device 10 is roughly divided into two types, a non-transmissive type and a transmissive type, but is limited to the latter transmissive type here. The transmission type is often small, but may be large. Further, the display device 10 includes a monocular type that displays information only on one eye and a binocular type that displays information on both eyes, but either one may be used here.

FIG. 4 is a schematic diagram illustrating a specific arrangement example of each element included in the display device 10. In the example of FIG. 4, the display device 10 is a binocular type, but is not limited thereto. In FIG. 4, the direction in which the two eyeglass lenses 160 are arranged is the X-axis direction. One direction perpendicular to the X-axis direction is taken as a Y-axis direction. A direction perpendicular to each of the X-axis direction and the Y-axis direction is taken as a Z-axis direction. In the example of FIG. 4, the X-axis direction corresponds to the user's left-right direction, the Y-axis direction corresponds to the user's vertical direction, and the Z-axis direction corresponds to the user's front-back direction (depth direction).

As shown in FIG. 4, the display device 10 includes two display units 100 corresponding to two spectacle lenses 160 one-to-one. Each display unit 100 includes a projection unit 125, a reflection unit 130, and a circuit unit 140, and is held by a holding unit 320. The projection unit 125 includes a display unit 110 and an optical unit 120.

The circuit unit 140 acquires an image from the information processing apparatus 20 connected by wire or wireless, for example, and sends the acquired image to the display unit 110. In the example of FIG. 4, the circuit unit 140 is electrically connected to the display unit 110 via a bendable cable 145. However, the circuit unit 140 is not limited to this, and for example, the circuit unit 140 and the display unit 110 are connected wirelessly. It may be a form.

The display unit 110 displays the image acquired from the circuit unit 140. The display unit 110 is a display that displays an image, and includes a plurality of pixels 110e. The plurality of pixels 110e are provided side by side on a plane (for example, in a matrix). The display unit 110 emits light L1 including image information. Light L <b> 1 including image information is emitted toward the optical unit 120. In addition, the format of a display is arbitrary, For example, it can be set as the display using liquid crystal, organic EL, or liquid crystal on silicon (Liquid Crystal On Silicon). However, the embodiment is not limited to these.

The optical unit 120 changes the traveling direction of at least a part of the light L1 including the information of the image emitted from the display unit 110. In the example of FIG. 4, the optical unit 120 is provided between the display unit 110 and the reflection unit 130 on the optical path of the light L <b> 1 emitted from the plurality of pixels 110 e of the display unit 110. The optical unit 120 includes at least one or more optical elements. As the optical element, a lens, a prism, a mirror, or the like can be used. In this way, the light L1 emitted from the projection unit 125 enters the reflection unit 130. When a plurality of optical elements are used, they do not have to be arranged on a straight line. The projection unit 125 is an example of an “emission unit” that emits light L1 including image information.

The reflection unit 130 reflects at least a part of the light emitted from the projection unit 125 toward the user's eye 150. The light reflected by the reflecting unit 130 forms an image as a virtual image when viewed from the user's eye 150. In this way, the user can see the image.

Next, an operation example of the information display system 1 of this embodiment will be described. FIG. 5 is a flowchart showing an operation example of the information display system 1 of the present embodiment. As shown in FIG. 5, first, the receiving unit 211 receives notification information from the outside (step S <b> 1), and inputs the received notification information to the output control unit 212. Next, the output control unit 212 confirms whether or not the visibility of the virtual image is reduced (step S2). When the result of step S2 is affirmative (step S2: Yes), the output control unit 212 indicates that the latest visual state signal input from the determination unit 210 at that time indicates that the user is viewing the virtual image. It is confirmed whether or not. That is, it is confirmed whether or not the user is viewing the virtual image (step S3).

If the result of step S3 is negative (step S3: No), the output control unit 212 performs control to change at least a part of the virtual image over time as described above (step S4). This virtual image may be a virtual image displayed in step S2, a virtual image corresponding to an image (notification image) based on the notification information received in step S1, or any other image. And the process after step S3 is repeated. On the other hand, when the result of step S3 described above is positive (step S3: Yes), the output control unit 212 causes the display device 10 to display a virtual image corresponding to the image (notification image) based on the notification information received in step S1. While performing control, the control which improves the visibility which was reduced is performed (step S5).

On the other hand, when the result of the above-described step S2 is negative (step S2: No), the output control unit 212 confirms whether the user is viewing the virtual image, similarly to the above-described step S3 (step S6). . When the result of step S6 is negative (step S6: No), the output control unit 212 performs control to change at least a part of the virtual image with time as described above (step S7). This virtual image may be a virtual image displayed in step S2, a virtual image corresponding to an image (notification image) based on the notification information received in step S1, or any other image. And the process after step S6 is repeated. On the other hand, when the result of step S6 described above is positive (step S6: Yes), the output control unit 212 causes the display device 10 to display a virtual image corresponding to the image (notification image) based on the notification information received in step S1. Control is performed (step S8). In this case, since the visibility of the virtual image is not lowered, the control for improving the visibility of the virtual image is not required unlike step S5 described above.

As described above, in the present embodiment, at least a part of the virtual image is received when the notification information from the outside is received in a state where the visibility of the virtual image is reduced and the user does not visually recognize the virtual image. For example, when there is a notification such as device trouble or instruction contact in a state where the visibility of the virtual image is reduced, even when the user's line of sight is not directed to the virtual image, The user's attention can be directed to the virtual image (that is, the user's line of sight can be directed to the virtual image). Further, in the present embodiment, when the above-described control (control for changing at least a part of the virtual image with time) is performed, if the user visually recognizes the virtual image, it corresponds to the image (notification image) based on the notification information. Since the control is performed to display the virtual image to be displayed on the display device 10, the user can immediately view necessary information only by turning the line of sight toward the changed virtual image (hands-free). According to the configuration of the present embodiment described above, work efficiency and production throughput can be improved.

As mentioned above, although embodiment of this invention was described, the above-mentioned embodiment was shown as an example and is not intending limiting the range of invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These novel embodiments and modifications thereof are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

(Modification)
Hereinafter, modified examples will be described.

(1) Modification 1
For example, the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, the brightness of at least a part of the virtual image is within a predetermined value or less. It is also possible to perform control that changes with time. Thereby, power consumption can be reduced.

(2) Modification 2
For example, the information display system 1 may be configured to further include a notification unit that generates sound or vibration. In this form, the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, the output control unit 212 generates sound or vibration from the notification unit. Can also be done. The notification unit may be connected to the display device 10 or the information processing device 20 via a wired or wireless connection. For example, the notification unit may be a component of the display device 10 or the information processing device 20 (for example, the display device 10). Or as a speaker or a vibrator inside the information processing apparatus 20.

For example, if the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced and the user does not visually recognize the virtual image, the output control unit 212 first changes at least a part of the virtual image with time. If control is performed to generate sound or vibration without control, and the user does not visually recognize the virtual image even after a certain period of time, control may be performed to change at least a part of the virtual image over time. Good. Conversely, if control is performed to change at least a part of the virtual image over time without first performing control to generate sound or vibration, and if the user does not visually recognize the virtual image after a certain period of time, the voice Or the form which performs control which generates a vibration may be sufficient.

(3) Modification 3
For example, the output control unit 212 can perform control to change a change pattern of at least a part of the virtual image according to the notification information. For example, the higher the importance of the notification information, the greater the change in at least a part of the virtual image can be controlled. Here, changing the pattern of change of at least a part of the virtual image means a pattern of change over time of the color and size of the image that is the source of the virtual image, and a maximum value of luminance when the luminance is changed over time. It means changing the minimum value width, change period, etc.

Similarly, the output control unit 212 can also perform control to change the sound or vibration pattern generated by the notification unit described in the modification 2 in accordance with the notification information. For example, the higher the importance of the notification information, the higher the voice or vibration generated by the notification unit may be.

For example, when the configuration of this embodiment is used when it is desired to notify a plurality of workers (users) in a factory of a machine trouble in a production factory, for example, a user who exists in a place close to a device in which the trouble has occurred In the information display system 1 used by the system, in order to make it easier to notice the notification information for notifying the occurrence of the trouble, it is also possible to perform control to increase at least a part of the virtual image (in addition, control can be performed). It is also possible to control to increase the sound or vibration generated by the notification unit). That is, it sets so that the importance of the notification information notified to the information display system 1 becomes high. On the other hand, in the information display system 1 used by a user who is located far from the troubled device, it is less necessary to make it easier to notice the notification information for notifying the occurrence of the trouble. Compared to the information display system 1 used by a user who is close to the device where the image is generated, a change in at least a part of the virtual image may be reduced (and sound or vibration generated by the notification unit may be reduced). ). That is, the importance of the notification information notified to the information display system 1 is set to be low. Also, for example, if the trouble is not resolved after a certain period of time, the brightness of the virtual image is increased stepwise so that the notification is easily noticed, or the area where the virtual image is displayed is increased. Processing may be performed.

Note that the importance may be included in the notification information in advance. In this form, the server that sends the notification information is a plurality of one-to-one correspondences with a plurality of users based on, for example, the positions of a plurality of users existing in the factory and the position of the device in which the trouble has occurred. The importance included in the notification information notified to each of the information display systems 1 can be determined. In this case, a function for detecting the position of the user in the factory is required. For example, the information display system 1 has a wireless arrival time difference from the information display system 1 to a plurality of wireless terminals installed in the factory. An existing method can be applied as long as it is a method for detecting a position, such as a method for obtaining a position (that is, a position of each user) or a method using a BLE beacon.

Further, the present invention is not limited to this. For example, the information display system 1 that receives notification information from the outside may determine the importance of the received notification information. For example, each information display system 1 receives the received notification information based on the notification content indicated by the notification information received from the outside (for example, including information indicating the position of the device in which the trouble has occurred) and the position of the own device. The importance of can also be determined. For example, the importance of the received notification information can be increased as the position of the own apparatus is closer to the position of the device in which the trouble has occurred.

Moreover, in the information display system 1 used by a user who is familiar with the device according to the skill level of the device in which the trouble has occurred for each of a plurality of users, a notification for notifying the occurrence of the trouble In order to make the reception of information easier to notice, it is possible to perform control to increase the change of at least a part of the virtual image. In this case, for each of a plurality of users, information that associates each skill level of a plurality of devices in a factory is stored in a database or the like in advance, and for example, a server that has transmitted notification information has a problem. From the relationship between the device and the information stored in the database or the like, each information is set so that the importance included in the notification information notified to the information display system 1 used by the user familiar with the device in which the trouble has occurred is increased. The importance included in the notification information notified to the display system 1 can also be determined. Further, the present invention is not limited to this. For example, the information display system 1 that has received notification information from the outside may determine the importance of the received notification information. For example, each information display system 1 determines the user of its own device based on the relationship between the notification content indicated by the notification information received from the outside (for example, including information indicating the device in which the trouble has occurred) and the information stored in the database or the like. However, if the user is familiar with the troubled device, the importance of the received notification information can be determined so that the importance of the received notification information is increased. Further, the importance of the notification information may be determined in consideration of both the position of each user described above and the skill level of the device. Furthermore, the importance of the notification information may be determined in consideration of, for example, whether the user is performing a predetermined work or whether the user is moving.

(4) Modification 4
For example, the display device 10 may include the determination unit 210, the reception unit 211, and the output control unit 212 described in the above-described embodiment without providing the information processing device 20. In this case, for example, the above-described display unit 100 can be considered to correspond to a “display unit that displays information as a virtual image”. Further, for example, the circuit unit 140 described above may have a function of each of the determination unit 210, the reception unit 211, and the output control unit 212.

FIG. 6 is a diagram illustrating an example of a hardware configuration of the circuit unit 140. As illustrated in FIG. 6, the circuit unit 140 includes at least a processing circuit (processor) 141, a memory 142, and an interface 143.

The processing circuit 141 comprehensively controls the operation of the circuit unit 140. The memory 142 stores various data such as the program 144. The program 144 may be provided in a state stored in the memory 142 in advance, or may be provided via a non-volatile recording medium such as a CD-ROM or a network, and may be installed as appropriate. The interface 143 is an interface for connecting to the outside (device, storage medium, network, etc.). The connection method with the outside is arbitrary, and may be wired connection or wireless connection.

In this example, the processing circuit 141 executes the program 144 stored in the memory 142, thereby realizing the functions of the determination unit 210, the reception unit 211, and the output control unit 212 described above. For example, at least a part of the functions of the determination unit 210, the reception unit 211, and the output control unit 212 described above may be realized by a dedicated hardware circuit.

In this example, it can be considered that the display device 10 itself corresponds to the “information display system 1”.

(5) Modification 5
For example, the display device 10 may have a part of the functions of the information processing device 20 described in the above embodiment. For example, the display device 10 may include the determination unit 210 described above, and the information processing device 20 may include the reception unit 211 and the output control unit 212 described above.

In short, the information display system 1 according to the present embodiment is worn on the user's head, and displays a display unit (display device 10 or display unit 100) that displays information as a virtual image, and receives notification information from the outside. When the notification information is received in a state in which the visibility of the virtual image is reduced with the unit 211 and the user does not visually recognize the virtual image, the output control is performed to change at least a part of the virtual image with time. As long as the unit 212 is provided at least, the unit 212 may be configured by a single device or a combination of a plurality of devices.

The above embodiment and each modification can be arbitrarily combined.

The program executed by the information display system 1 (the display device 10 and the information processing device 20) is stored on a computer connected to a network such as the Internet and is provided by being downloaded via the network. May be. The program executed by the information display system 1 described above may be provided or distributed via a network such as the Internet. Furthermore, the program executed by the information display system 1 described above may be provided by being incorporated in advance in a nonvolatile recording medium such as a ROM.

1 Information Display System 10 Display Device 20 Information Processing Device 21 CPU
22 ROM
23 RAM
24 I / F unit 100 Display unit 110 Display unit 120 Optical unit 125 Projection unit 130 Reflection unit 140 Circuit unit 141 Processing circuit 142 Memory 143 Interface 160 Eyeglass lens 210 Determination unit 211 Reception unit 212 Output control unit

Claims

A display unit that is worn on the user's head and displays information as a virtual image;
A receiving unit for receiving notification information from the outside;
When the notification information is received in a state in which the visibility of the virtual image is lowered and the user does not visually recognize the virtual image, an output for performing control to change at least a part of the virtual image with time A control unit,
Information display system.
The output control unit
Performing control to change one or more of luminance, color, size, shape, and position of at least a part of the virtual image over time,
The information display system according to claim 1.
The output control unit
Performing control to change the luminance of at least a part of the virtual image over time in a range of a predetermined value or less,
The information display system according to claim 1.
It further includes a notification unit that generates sound or vibration,
The output control unit
When the notification information is received in a state where the visibility of the virtual image is reduced, and the user does not visually recognize the virtual image, control is performed to generate sound or vibration from the notification unit.
The information display system according to claim 1.
The output control unit
In accordance with the notification information, control to change a change pattern of at least a part of the virtual image,
The information display system according to claim 1.
The output control unit
Depending on the notification information, control to change the pattern of sound or vibration generated in the notification unit,
The information display system according to claim 4.
A determination unit for determining whether or not the user visually recognizes the virtual image;
The information display system according to claim 1.
A line-of-sight detection unit that detects the line of sight of the user;
The determination unit determines whether the user is viewing the virtual image based on the user's line of sight detected by the line-of-sight detection unit.
The information display system according to claim 7.
The output control unit
When performing control to change at least a part of the virtual image over time, if the user visually recognizes the virtual image, control to display the virtual image with high visibility on the display unit,
The information display system according to claim 1.
A receiving step for receiving notification information from outside;
When the user who has received the notification information in a state in which the visibility of the virtual image is reduced and wears a display unit that displays information as the virtual image on the head is not visually recognizing the virtual image, the virtual image An output control step for performing control to change at least a part of the output over time,
Information display method.