WO2017122508A1 - Système d'affichage d'informations et procédé d'affichage d'informations - Google Patents

Système d'affichage d'informations et procédé d'affichage d'informations Download PDF

Info

Publication number
WO2017122508A1
WO2017122508A1 PCT/JP2016/087967 JP2016087967W WO2017122508A1 WO 2017122508 A1 WO2017122508 A1 WO 2017122508A1 JP 2016087967 W JP2016087967 W JP 2016087967W WO 2017122508 A1 WO2017122508 A1 WO 2017122508A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual image
user
unit
information
notification
Prior art date
Application number
PCT/JP2016/087967
Other languages
English (en)
Japanese (ja)
Inventor
玲子 野田
馬場　雅裕
Original Assignee
株式会社東芝
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社東芝 filed Critical 株式会社東芝
Publication of WO2017122508A1 publication Critical patent/WO2017122508A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/10—Intensity circuits
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/38—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory with means for controlling the display position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/64—Constructional details of receivers, e.g. cabinets or dust covers
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus

Definitions

  • Embodiments described herein relate generally to an information display system and an information display method.
  • the product assembly manual and the operating status of the equipment that manufactures the product can be displayed as a virtual image at the tip of the line of sight to improve the production throughput.
  • a technology for controlling the display of a virtual image based on the operation and situation of the wearer (user) of the display device is known, for example, depending on the direction of the user's line of sight, When the virtual image is not seen, the visibility of the virtual image is lowered and low power consumption can be realized.
  • the information display system of the embodiment includes a display unit, a receiving unit, and an output control unit.
  • the display unit is mounted on the user's head and displays information as a virtual image.
  • the receiving unit receives notification information from the outside.
  • the output control unit performs control to change at least a part of the virtual image with time when the notification information is received in a state where the visibility of the virtual image is lowered and the user does not visually recognize the virtual image.
  • FIG. 1 is a diagram illustrating an example of the configuration of the information display system according to the embodiment.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus according to the embodiment.
  • FIG. 3 is a diagram illustrating an example of the functions of the information processing apparatus according to the embodiment.
  • FIG. 4 is a schematic diagram illustrating a specific arrangement example of each element included in the display device of the embodiment.
  • FIG. 5 is a diagram illustrating an operation example of the information display system according to the embodiment.
  • FIG. 6 is a diagram illustrating an example of a hardware configuration of a circuit unit according to a modification.
  • FIG. 1 is a diagram showing an example of the configuration of the information display system 1 of the present embodiment.
  • the information display system 1 includes a display device 10 and an information processing device 20.
  • the display device 10 and the information processing device 20 can communicate with each other directly or indirectly via a wired or wireless connection.
  • the communication method between the display device 10 and the information processing device 20 is arbitrary, and any communication method may be used.
  • the display device 10 is an example of a “display unit”, and is a device that is mounted on the user's head and displays information as a virtual image. A specific configuration of the display device 10 will be described later. In the following description, “user” indicates a wearer of the display device 10.
  • the information processing apparatus 20 may be a portable terminal such as a smartphone, a tablet, a notebook PC (Personal Computer), or a stick PC, or a stationary type such as a desktop PC (Personal Computer). It may be a terminal. In this example, a portable terminal possessed by the user is used as the information processing apparatus 20.
  • the information display system 1 including the display device 10 and the information processing device 20 is assigned to each of a plurality of users in the factory.
  • a specific configuration of the information processing apparatus 20 will be described.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of the information processing apparatus 20.
  • the information processing apparatus 20 includes a CPU (electric circuit such as a microprocessor) 21, a ROM 22, a RAM 23, and an I / F unit 24.
  • the CPU 21 comprehensively controls the operation of the information processing apparatus 20.
  • the ROM 22 is a non-volatile memory that stores various data such as programs.
  • the RAM 23 is a volatile memory that functions as a work area for various processes executed by the CPU 21.
  • the I / F unit 24 is an interface for connecting to an external device such as the display device 10.
  • FIG. 3 is a diagram illustrating an example of functions of the information processing apparatus 20.
  • the information processing apparatus 20 includes a determination unit 210, a reception unit 211, and an output control unit 212.
  • FIG. 3 mainly illustrates functions necessary for explanation of the present embodiment, but the functions of the information processing apparatus 20 are not limited to these.
  • the determination part 210 determines whether the user (wearer of the display apparatus 10) is visually recognizing the virtual image. More specifically, the determination unit 210 is, for example, a device connected to the information processing apparatus 20 by wire or wirelessly, or a sensor (for example, a vibration sensor, a proximity sensor) separately installed on the information display system 1 or a part of the user's body. An input signal input from a sensor, a camera, or the like is processed to determine whether the user is viewing a virtual image. The determination unit 210 repeats the above determination, for example, at a constant cycle, and generates a visual state signal indicating the determination result each time the determination is performed, and outputs the generated visual state signal to the output control unit 212 described later. .
  • the input signal input to the determination unit 210 may be any signal as long as it can be used to determine whether or not the user is viewing a virtual image.
  • the determination may be performed, for example, only at a timing when the reception unit 211 receives information, or may be performed at a constant cycle for a predetermined time from the timing when the reception unit 211 receives information, for example.
  • the information display system 1 further includes a function of detecting the user's line of sight (a function of detecting the direction and focus of the line of sight, which may be hereinafter referred to as a “line of sight detection unit”). It is also possible to determine whether or not the user is visually recognizing a virtual image based on the user's line of sight detected by. For example, when the user's line of sight detected by the line-of-sight detection unit is directed to the virtual image, the determination unit 210 can determine that the user is viewing the virtual image.
  • the line-of-sight detection unit may be provided in the information processing device 20 (provided as a function of the information processing device 20), or may be provided in a device different from the information processing device 20 and the display device 10. It may be.
  • the determination unit 210 acquires a signal indicating a user's line of sight (a signal indicating a detection result by the line-of-sight detection unit) as an input signal, and analyzes the acquired input signal so that the user can obtain a virtual image. It can be determined whether or not the user is visually recognized.
  • various known methods can be used as a method for detecting the line-of-sight direction.
  • the user's face is illuminated with an infrared LED
  • the eyes are imaged with an infrared camera
  • the imaging data obtained by the imaging is analyzed.
  • a method of identifying the position of reflection in the cornea of the user (reflection position of the infrared LED) and the position of the pupil and detecting the direction of the line of sight from the identified positional relationship can also be used.
  • the determination unit 210 detects a user's gaze direction based on imaging data generated by the information display system 1 or an infrared camera separately installed on a part of the user's body (in the information display system 1 Is provided separately from the information processing device 20), and a signal indicating the user's line of sight is acquired as an input signal, and the acquired input signal is analyzed to determine whether the user is viewing a virtual image. It may be.
  • the infrared camera is provided separately from the display device 10 and the information processing device 20, while the function of detecting the user's line-of-sight direction (line-of-sight detection unit) based on imaging data generated by the infrared camera is the determination unit 210.
  • the determination unit 210 acquires a signal indicating the user's line of sight (a signal indicating a detection result by the line-of-sight detection unit) as an input signal from the line-of-sight detection unit, and analyzes the acquired input signal so that the user can recognize the virtual image. It can be determined whether or not the user is visually recognized.
  • the determination unit 210 acquires, as an input signal, an image obtained by capturing the user with the information display system 1 or a camera separately installed on a part of the user's body, and the user's head is obtained from the acquired input signal. If the motion is estimated and it is determined that the user is stationary for a predetermined time, it may be determined that the user is viewing the virtual image.
  • the determination unit 210 indicates an operation signal (indicating an operation state) output from an operation device (a mouse, a keyboard, a touch panel, a switch, or the like) for performing various operations on an image (screen) that is a source of a virtual image.
  • the determination unit 210 acquires data obtained from a vibration sensor or an angle sensor separately installed on the information display system 1 or a part of the user's body as an input signal, and analyzes the acquired data to obtain the user When it is determined that the user is moving such as walking, the user may determine that the user is not visually recognizing the virtual image.
  • the determination unit 210 acquires, as an input signal, a signal indicating the display state of the image that is the source of the virtual image from the output control unit 212 (or the display device 10) described later, and the image that is the source of the virtual image is not displayed.
  • a signal indicating the display state of the image that is the source of the virtual image from the output control unit 212 (or the display device 10) described later, and the image that is the source of the virtual image is not displayed.
  • the user may determine that the virtual image is not visually recognized. .
  • the determination unit 210 determines whether or not the user is performing a predetermined work, and when the user is performing the predetermined work, the determination unit 210 determines that the user does not visually recognize the virtual image. It may be. For example, a case where the user performs a barcode reading operation is assumed as an example of the predetermined operation. In this case, the determination unit 210 acquires a signal indicating the operation state of the device as an input signal from, for example, a barcode reading device. For example, when the input signal indicating that the barcode reading mode is entered is acquired, the user It may be determined that the barcode reading operation is being performed, and the user determines that the virtual image is not visually recognized.
  • a work of transmitting video captured by a camera to a remote operator using a smartphone may be the information processing apparatus 20 or another apparatus ( It is assumed that the image transmission work).
  • the determination unit 210 acquires a signal indicating the operation state of the smartphone as an input signal from the smartphone, for example, when the input signal indicating that an application for transmitting an image is activated, the user performs an image It may be determined that the transmission work is performed and the user determines that the virtual image is not visually recognized.
  • the determination unit 210 acquires a video signal from the information display system 1 or a camera separately installed on a part of the user's body as an input signal, and unpacks based on image recognition using the acquired input signal.
  • the user may determine that the virtual image is not visually recognized.
  • the determination part 210 should just be a form which has the function to determine whether the user is visually recognizing a virtual image, and is not restricted to the above example.
  • the receiving unit 211 receives notification information from the outside (for example, an information processing device such as a PC or a server used by an administrator who manages processes in a factory).
  • the notification information is information to be notified to the user, for example, information indicating the trouble occurrence status of the manufacturing equipment in the factory, and instructing the start of construction because the conditions necessary for proceeding to the next process in the production process have been prepared. Information, information for notifying telephone contact or mail contact from the instructor or other workers, and the like.
  • the receiving unit 211 outputs notification information received from the outside to the output control unit 212 described later.
  • the output control unit 212 controls on / off of display of the virtual image displayed on the display device 10, display position, display brightness, display content, contrast, color, and the like. That is, the output control unit 212 controls an image corresponding to a virtual image displayed on the display device 10 (an image that is a source of the virtual image). The output control unit 212 performs control to transmit an image controlled by the output control unit 212 to the display device 10 and display a virtual image corresponding to the image on the display device 10.
  • the output control unit 212 controls the visibility of the virtual image displayed on the display device 10. For example, the output control unit 212 makes the visibility of the virtual image at the first time lower than the visibility of the virtual image at the second time before the first time. For example, the output control unit 212 makes the visibility of the virtual image in the first time lower than the visibility of the virtual image in the second time before the first time and continuous with the first time. In the present embodiment, the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, at least a part of the virtual image is changed over time. Control to change.
  • the output control unit 212 receives notification information from the reception unit 211 in a state where the visibility of the virtual image is reduced, and indicates from the determination unit 210 that the user is not viewing the virtual image.
  • the visual recognition state signal is received (that is, when the determination unit 210 determines that the user does not visually recognize the virtual image)
  • control is performed to change at least a part of the virtual image over time.
  • the output control unit 212 can perform control to reduce the visibility of the virtual image based on the user's operation and situation. For example, the output control unit 212 can perform control to reduce the visibility of the virtual image when the visual recognition state signal indicating that the user is not visually recognizing the virtual image is received from the determination unit 210. Control can be performed to reduce the visibility of the virtual image when the notification information is not received, and the visibility of the virtual image is reduced when the user confirms the virtual image corresponding to the image based on the notification information (described later). It is also possible to perform control.
  • the entire image (which may be referred to as “display image” in the following description) that is the source of the virtual image is not displayed, or the brightness (luminance value) of the display image is reduced.
  • the brightness (luminance value) of the display image is reduced.
  • Move the position of the virtual image out of line of sight, hide part of the display image, reduce the luminance (luminance value) of part of the display image, switch the display image to another image with low visibility, Etc. are considered.
  • the reason why the visibility is lowered when the brightness of the display image is lowered is that the display device 10 is a transmissive display device, and therefore, when the brightness of the display image is lowered, the transmittance of the display image is increased. is there.
  • the above example is an example to the last, and methods other than the above may be used as long as the visibility of a virtual image is reduced.
  • the display device 10 is a transmissive display device, if the visibility of the virtual image is reduced, the real scene becomes easier to see.
  • control by the output control unit 212 to change at least a part of the virtual image over time will be described.
  • peripheral vision viewing the object in the periphery of the retina that is a certain distance away from the center of the retina
  • it is easy to detect changes in luminance over time flicker
  • the fluctuation period is a frequency at which light-sensitive epilepsy is not easily induced and a frequency that can be detected as flicker.
  • the color, size, shape, etc. of the display image may be changed by animation.
  • the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, at least a part of the brightness, color, size, and shape of the virtual image , One or more of the positions can be controlled to change over time.
  • the output control unit 212 refers to an image based on notification information (hereinafter referred to as “notification image”).
  • the display device 10 is controlled to display a virtual image corresponding to the case. More specifically, the output control unit 212 performs a control to change at least a part of the virtual image over time as described above, and a visual recognition state signal indicating that the user is viewing the virtual image. Is received from the determination unit 210, the display device 10 is controlled to display a virtual image corresponding to an image (notification image) determined according to the notification content indicated by the notification information received from the reception unit 211.
  • the virtual image before the notification information is received has lower visibility than the virtual image corresponding to the image (notification image) determined according to the notification content indicated by the notification information.
  • the output control unit 212 performs control to display a highly visible virtual image on the display device 10 when the user visually recognizes the virtual image while performing control to change at least a part of the virtual image over time. Can do.
  • the notification content indicated by the notification information is a content indicating that there is a request for a video call directly from a remote instruction person
  • a virtual image corresponding to the video call screen with the instruction person may be displayed.
  • Good if there is a lot of notification information, for example when there are multiple notification contents, if the information cannot be displayed all at once, for example, information indicating a summary of the notification contents, such as information on the device that caused the trouble, the name and status of the device are displayed. You may display the virtual image corresponding to the image which shows the icon etc. to show in list format.
  • a virtual image corresponding to the notification image may be switched and displayed at regular intervals.
  • the display method of the notification information is not limited to these, and any display method may be used as long as the notification content indicated by the notification information received by the reception unit 211 can be understood, and the display method is arbitrary.
  • the functions (determination unit 210, reception unit 211, output control unit 212) of the information processing apparatus 20 described above are realized by the CPU 21 executing a program stored in a storage device such as the ROM 22, but this For example, at least a part of these functions may be realized by a dedicated hardware circuit (for example, a semiconductor integrated circuit).
  • the display device 10 is worn on the user's head and projects an image (an example of information) to be displayed on a small display onto an optical system in front of the user's eyes so that the user can visually recognize a virtual image corresponding to the image. It is a display device capable of causing (equivalent to “displaying information as a virtual image”).
  • the display device 10 is roughly divided into two types, a non-transmissive type and a transmissive type, but is limited to the latter transmissive type here.
  • the transmission type is often small, but may be large.
  • the display device 10 includes a monocular type that displays information only on one eye and a binocular type that displays information on both eyes, but either one may be used here.
  • FIG. 4 is a schematic diagram illustrating a specific arrangement example of each element included in the display device 10.
  • the display device 10 is a binocular type, but is not limited thereto.
  • the direction in which the two eyeglass lenses 160 are arranged is the X-axis direction.
  • One direction perpendicular to the X-axis direction is taken as a Y-axis direction.
  • a direction perpendicular to each of the X-axis direction and the Y-axis direction is taken as a Z-axis direction.
  • the X-axis direction corresponds to the user's left-right direction
  • the Y-axis direction corresponds to the user's vertical direction
  • the Z-axis direction corresponds to the user's front-back direction (depth direction).
  • the display device 10 includes two display units 100 corresponding to two spectacle lenses 160 one-to-one.
  • Each display unit 100 includes a projection unit 125, a reflection unit 130, and a circuit unit 140, and is held by a holding unit 320.
  • the projection unit 125 includes a display unit 110 and an optical unit 120.
  • the circuit unit 140 acquires an image from the information processing apparatus 20 connected by wire or wireless, for example, and sends the acquired image to the display unit 110.
  • the circuit unit 140 is electrically connected to the display unit 110 via a bendable cable 145.
  • the circuit unit 140 is not limited to this, and for example, the circuit unit 140 and the display unit 110 are connected wirelessly. It may be a form.
  • the display unit 110 displays the image acquired from the circuit unit 140.
  • the display unit 110 is a display that displays an image, and includes a plurality of pixels 110e.
  • the plurality of pixels 110e are provided side by side on a plane (for example, in a matrix).
  • the display unit 110 emits light L1 including image information.
  • Light L ⁇ b> 1 including image information is emitted toward the optical unit 120.
  • the format of a display is arbitrary, For example, it can be set as the display using liquid crystal, organic EL, or liquid crystal on silicon (Liquid Crystal On Silicon). However, the embodiment is not limited to these.
  • the optical unit 120 changes the traveling direction of at least a part of the light L1 including the information of the image emitted from the display unit 110.
  • the optical unit 120 is provided between the display unit 110 and the reflection unit 130 on the optical path of the light L ⁇ b> 1 emitted from the plurality of pixels 110 e of the display unit 110.
  • the optical unit 120 includes at least one or more optical elements.
  • As the optical element a lens, a prism, a mirror, or the like can be used. In this way, the light L1 emitted from the projection unit 125 enters the reflection unit 130. When a plurality of optical elements are used, they do not have to be arranged on a straight line.
  • the projection unit 125 is an example of an “emission unit” that emits light L1 including image information.
  • the reflection unit 130 reflects at least a part of the light emitted from the projection unit 125 toward the user's eye 150.
  • the light reflected by the reflecting unit 130 forms an image as a virtual image when viewed from the user's eye 150. In this way, the user can see the image.
  • FIG. 5 is a flowchart showing an operation example of the information display system 1 of the present embodiment.
  • the receiving unit 211 receives notification information from the outside (step S ⁇ b> 1), and inputs the received notification information to the output control unit 212.
  • the output control unit 212 confirms whether or not the visibility of the virtual image is reduced (step S2).
  • step S2 confirms whether or not the visibility of the virtual image is reduced.
  • step S3 the output control unit 212 indicates that the latest visual state signal input from the determination unit 210 at that time indicates that the user is viewing the virtual image. It is confirmed whether or not. That is, it is confirmed whether or not the user is viewing the virtual image (step S3).
  • step S3 If the result of step S3 is negative (step S3: No), the output control unit 212 performs control to change at least a part of the virtual image over time as described above (step S4).
  • This virtual image may be a virtual image displayed in step S2, a virtual image corresponding to an image (notification image) based on the notification information received in step S1, or any other image. And the process after step S3 is repeated.
  • step S3 when the result of step S3 described above is positive (step S3: Yes), the output control unit 212 causes the display device 10 to display a virtual image corresponding to the image (notification image) based on the notification information received in step S1. While performing control, the control which improves the visibility which was reduced is performed (step S5).
  • step S2 determines whether the user is viewing the virtual image, similarly to the above-described step S3 (step S6).
  • the output control unit 212 performs control to change at least a part of the virtual image with time as described above (step S7).
  • This virtual image may be a virtual image displayed in step S2, a virtual image corresponding to an image (notification image) based on the notification information received in step S1, or any other image. And the process after step S6 is repeated.
  • step S6 when the result of step S6 described above is positive (step S6: Yes), the output control unit 212 causes the display device 10 to display a virtual image corresponding to the image (notification image) based on the notification information received in step S1. Control is performed (step S8). In this case, since the visibility of the virtual image is not lowered, the control for improving the visibility of the virtual image is not required unlike step S5 described above.
  • At least a part of the virtual image is received when the notification information from the outside is received in a state where the visibility of the virtual image is reduced and the user does not visually recognize the virtual image.
  • the notification information from the outside is received in a state where the visibility of the virtual image is reduced and the user does not visually recognize the virtual image.
  • the notification information from the outside is received in a state where the visibility of the virtual image is reduced and the user does not visually recognize the virtual image.
  • control control for changing at least a part of the virtual image with time
  • the user visually recognizes the virtual image, it corresponds to the image (notification image) based on the notification information. Since the control is performed to display the virtual image to be displayed on the display device 10, the user can immediately view necessary information only by turning the line of sight toward the changed virtual image (hands-free). According to the configuration of the present embodiment described above, work efficiency and production throughput can be improved.
  • the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, the brightness of at least a part of the virtual image is within a predetermined value or less. It is also possible to perform control that changes with time. Thereby, power consumption can be reduced.
  • the information display system 1 may be configured to further include a notification unit that generates sound or vibration.
  • the output control unit 212 receives the notification information in a state where the visibility of the virtual image is reduced, and when the user does not visually recognize the virtual image, the output control unit 212 generates sound or vibration from the notification unit. Can also be done.
  • the notification unit may be connected to the display device 10 or the information processing device 20 via a wired or wireless connection.
  • the notification unit may be a component of the display device 10 or the information processing device 20 (for example, the display device 10). Or as a speaker or a vibrator inside the information processing apparatus 20.
  • the output control unit 212 first changes at least a part of the virtual image with time. If control is performed to generate sound or vibration without control, and the user does not visually recognize the virtual image even after a certain period of time, control may be performed to change at least a part of the virtual image over time. Good. Conversely, if control is performed to change at least a part of the virtual image over time without first performing control to generate sound or vibration, and if the user does not visually recognize the virtual image after a certain period of time, the voice Or the form which performs control which generates a vibration may be sufficient.
  • the output control unit 212 can perform control to change a change pattern of at least a part of the virtual image according to the notification information.
  • the higher the importance of the notification information the greater the change in at least a part of the virtual image can be controlled.
  • changing the pattern of change of at least a part of the virtual image means a pattern of change over time of the color and size of the image that is the source of the virtual image, and a maximum value of luminance when the luminance is changed over time. It means changing the minimum value width, change period, etc.
  • the output control unit 212 can also perform control to change the sound or vibration pattern generated by the notification unit described in the modification 2 in accordance with the notification information. For example, the higher the importance of the notification information, the higher the voice or vibration generated by the notification unit may be.
  • the configuration of this embodiment when it is desired to notify a plurality of workers (users) in a factory of a machine trouble in a production factory, for example, a user who exists in a place close to a device in which the trouble has occurred
  • the information display system 1 used by the system in order to make it easier to notice the notification information for notifying the occurrence of the trouble, it is also possible to perform control to increase at least a part of the virtual image (in addition, control can be performed). It is also possible to control to increase the sound or vibration generated by the notification unit). That is, it sets so that the importance of the notification information notified to the information display system 1 becomes high.
  • the information display system 1 used by a user who is located far from the troubled device it is less necessary to make it easier to notice the notification information for notifying the occurrence of the trouble.
  • a change in at least a part of the virtual image may be reduced (and sound or vibration generated by the notification unit may be reduced).
  • the importance of the notification information notified to the information display system 1 is set to be low.
  • the brightness of the virtual image is increased stepwise so that the notification is easily noticed, or the area where the virtual image is displayed is increased. Processing may be performed.
  • the server that sends the notification information is a plurality of one-to-one correspondences with a plurality of users based on, for example, the positions of a plurality of users existing in the factory and the position of the device in which the trouble has occurred.
  • the importance included in the notification information notified to each of the information display systems 1 can be determined.
  • a function for detecting the position of the user in the factory is required.
  • the information display system 1 has a wireless arrival time difference from the information display system 1 to a plurality of wireless terminals installed in the factory.
  • An existing method can be applied as long as it is a method for detecting a position, such as a method for obtaining a position (that is, a position of each user) or a method using a BLE beacon.
  • the information display system 1 that receives notification information from the outside may determine the importance of the received notification information. For example, each information display system 1 receives the received notification information based on the notification content indicated by the notification information received from the outside (for example, including information indicating the position of the device in which the trouble has occurred) and the position of the own device. The importance of can also be determined. For example, the importance of the received notification information can be increased as the position of the own apparatus is closer to the position of the device in which the trouble has occurred.
  • a notification for notifying the occurrence of the trouble In order to make the reception of information easier to notice, it is possible to perform control to increase the change of at least a part of the virtual image.
  • information that associates each skill level of a plurality of devices in a factory is stored in a database or the like in advance, and for example, a server that has transmitted notification information has a problem.
  • each information is set so that the importance included in the notification information notified to the information display system 1 used by the user familiar with the device in which the trouble has occurred is increased.
  • the importance included in the notification information notified to the display system 1 can also be determined.
  • the present invention is not limited to this.
  • the information display system 1 that has received notification information from the outside may determine the importance of the received notification information.
  • each information display system 1 determines the user of its own device based on the relationship between the notification content indicated by the notification information received from the outside (for example, including information indicating the device in which the trouble has occurred) and the information stored in the database or the like.
  • the importance of the received notification information can be determined so that the importance of the received notification information is increased. Further, the importance of the notification information may be determined in consideration of both the position of each user described above and the skill level of the device. Furthermore, the importance of the notification information may be determined in consideration of, for example, whether the user is performing a predetermined work or whether the user is moving.
  • the display device 10 may include the determination unit 210, the reception unit 211, and the output control unit 212 described in the above-described embodiment without providing the information processing device 20.
  • the above-described display unit 100 can be considered to correspond to a “display unit that displays information as a virtual image”.
  • the circuit unit 140 described above may have a function of each of the determination unit 210, the reception unit 211, and the output control unit 212.
  • FIG. 6 is a diagram illustrating an example of a hardware configuration of the circuit unit 140.
  • the circuit unit 140 includes at least a processing circuit (processor) 141, a memory 142, and an interface 143.
  • processor processing circuit
  • the processing circuit 141 comprehensively controls the operation of the circuit unit 140.
  • the memory 142 stores various data such as the program 144.
  • the program 144 may be provided in a state stored in the memory 142 in advance, or may be provided via a non-volatile recording medium such as a CD-ROM or a network, and may be installed as appropriate.
  • the interface 143 is an interface for connecting to the outside (device, storage medium, network, etc.).
  • the connection method with the outside is arbitrary, and may be wired connection or wireless connection.
  • the processing circuit 141 executes the program 144 stored in the memory 142, thereby realizing the functions of the determination unit 210, the reception unit 211, and the output control unit 212 described above.
  • the processing circuit 141 executes the program 144 stored in the memory 142, thereby realizing the functions of the determination unit 210, the reception unit 211, and the output control unit 212 described above.
  • at least a part of the functions of the determination unit 210, the reception unit 211, and the output control unit 212 described above may be realized by a dedicated hardware circuit.
  • the display device 10 itself corresponds to the “information display system 1”.
  • the display device 10 may have a part of the functions of the information processing device 20 described in the above embodiment.
  • the display device 10 may include the determination unit 210 described above, and the information processing device 20 may include the reception unit 211 and the output control unit 212 described above.
  • the information display system 1 is worn on the user's head, and displays a display unit (display device 10 or display unit 100) that displays information as a virtual image, and receives notification information from the outside.
  • a display unit display device 10 or display unit 100
  • the output control is performed to change at least a part of the virtual image with time.
  • the unit 212 may be configured by a single device or a combination of a plurality of devices.
  • the program executed by the information display system 1 (the display device 10 and the information processing device 20) is stored on a computer connected to a network such as the Internet and is provided by being downloaded via the network. May be.
  • the program executed by the information display system 1 described above may be provided or distributed via a network such as the Internet.
  • the program executed by the information display system 1 described above may be provided by being incorporated in advance in a nonvolatile recording medium such as a ROM.

Abstract

La présente invention concerne un système d'affichage d'informations et un procédé d'affichage d'informations avec lesquels il est possible d'améliorer l'efficacité de travail et le débit de production. Un système d'affichage d'informations selon un mode de réalisation est équipé d'une unité d'affichage, d'une unité de réception et d'une unité de commande de sortie. L'unité d'affichage est portée sur la tête d'un utilisateur et affiche des informations sous forme d'images virtuelles. L'unité de réception reçoit des informations de notification en provenance de l'extérieur. L'unité de commande de sortie reçoit les informations de notification pendant que la visibilité de l'image virtuelle est réduite, et lorsqu'un utilisateur ne visualise pas l'image virtuelle, exerce une commande pour modifier dans le temps au moins une partie de l'image virtuelle.
PCT/JP2016/087967 2016-01-15 2016-12-20 Système d'affichage d'informations et procédé d'affichage d'informations WO2017122508A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-006224 2016-01-15
JP2016006224A JP2017126021A (ja) 2016-01-15 2016-01-15 情報表示システムおよび情報表示方法

Publications (1)

Publication Number Publication Date
WO2017122508A1 true WO2017122508A1 (fr) 2017-07-20

Family

ID=59311169

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/087967 WO2017122508A1 (fr) 2016-01-15 2016-12-20 Système d'affichage d'informations et procédé d'affichage d'informations

Country Status (2)

Country Link
JP (1) JP2017126021A (fr)
WO (1) WO2017122508A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113050278A (zh) * 2019-12-26 2021-06-29 精工爱普生株式会社 显示系统、显示方法以及记录介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007163634A (ja) * 2005-12-12 2007-06-28 Olympus Corp 情報表示装置
JP2009223187A (ja) * 2008-03-18 2009-10-01 Pioneer Electronic Corp 表示内容制御装置、表示内容制御方法及び表示内容制御方法プログラム
JP2014120786A (ja) * 2012-12-13 2014-06-30 Seiko Epson Corp 頭部装着型表示装置および頭部装着型表示装置の制御方法
JP2014219682A (ja) * 2014-06-23 2014-11-20 株式会社デンソー 表示制御システム及びプログラム
JP2015125464A (ja) * 2013-12-25 2015-07-06 Kddi株式会社 ウェアラブルデバイス

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007163634A (ja) * 2005-12-12 2007-06-28 Olympus Corp 情報表示装置
JP2009223187A (ja) * 2008-03-18 2009-10-01 Pioneer Electronic Corp 表示内容制御装置、表示内容制御方法及び表示内容制御方法プログラム
JP2014120786A (ja) * 2012-12-13 2014-06-30 Seiko Epson Corp 頭部装着型表示装置および頭部装着型表示装置の制御方法
JP2015125464A (ja) * 2013-12-25 2015-07-06 Kddi株式会社 ウェアラブルデバイス
JP2014219682A (ja) * 2014-06-23 2014-11-20 株式会社デンソー 表示制御システム及びプログラム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113050278A (zh) * 2019-12-26 2021-06-29 精工爱普生株式会社 显示系统、显示方法以及记录介质
CN113050278B (zh) * 2019-12-26 2023-06-06 精工爱普生株式会社 显示系统、显示方法以及记录介质

Also Published As

Publication number Publication date
JP2017126021A (ja) 2017-07-20

Similar Documents

Publication Publication Date Title
US10416946B1 (en) Wearable computer using programmed local tag
TWI638188B (zh) 顯示裝置、頭部配戴型顯示裝置、顯示系統及顯示裝置之控制方法
US9898868B2 (en) Display device, method of controlling the same, and program
CN106471419B (zh) 管理信息显示
US10585288B2 (en) Computer display device mounted on eyeglasses
US9864198B2 (en) Head-mounted display
US10642348B2 (en) Display device and image display method
CN106817913B (zh) 头戴式显示器、移动信息终端、图像处理装置、显示控制程序、显示控制方法和显示系统
US20190227694A1 (en) Device for providing augmented reality service, and method of operating the same
US20150168729A1 (en) Head mounted display device
US9846305B2 (en) Head mounted display, method for controlling head mounted display, and computer program
US20170115736A1 (en) Photo-Based Unlock Patterns
US11487354B2 (en) Information processing apparatus, information processing method, and program
JP2014132305A (ja) 表示装置、および、表示装置の制御方法
JP2018142857A (ja) 頭部装着型表示装置、プログラム、及び頭部装着型表示装置の制御方法
JP6507827B2 (ja) 表示システム
JP2015176186A (ja) 情報処理装置、情報処理方法、及び情報処理システム
JP2017049763A (ja) 電子機器、支援システムおよび支援方法
JP2014187574A (ja) 頭部装着型表示装置および頭部装着型表示装置の制御方法
US11137600B2 (en) Display device, display control method, and display system
WO2017122508A1 (fr) Système d'affichage d'informations et procédé d'affichage d'informations
JP2017102221A (ja) 画像表示装置
JP6262177B2 (ja) ウェアラブル端末、方法及びシステム
JP2016122085A (ja) 表示装置、及び、表示装置の制御方法
KR20160027813A (ko) 글래스형 단말기

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16885110

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16885110

Country of ref document: EP

Kind code of ref document: A1