JP2013025220A - Safety securing system, device, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a safety securing system that enables a user equipped with a head-mounted display device to always see information and also enables the safety of a user during movement to be secured.SOLUTION: A safety securing system includes movement sensing means 1 that senses the movement of a user equipped with a head-mounted display device, and display control means 2 that, if the movement sensing means 1 senses the movement of a user, controls the head-mounted display device to limit the display content.

Description

  The present invention relates to a safety ensuring system, a head-mounted display device, a safety ensuring method, and a safety ensuring program.

  The glasses-type display device has an advantage that, unlike a general display device, it is not necessary to direct a line of sight to the device to view the displayed information, and the information can always be seen. As a related technique, for example, Patent Document 1 describes a technique related to a head-mounted display device.

JP 2004-233903 A

  However, since the glasses-type display device can always see information, there is a demerit that displayed information may be an obstacle. For example, it is conceivable that there is a risk of hitting an obstacle, for example, by focusing too much attention on information displayed by the glasses-type display device during movement.

  Patent Document 1 describes a head-mounted display device that turns off image output and secures a user's field of view when a user's movement is detected. However, in the method described in Patent Document 1, since the image output is turned off during movement, the user cannot obtain any information during that time, and the merit of the glasses-type display device is completely erased.

  Therefore, the present invention provides a safety ensuring system, a head mounted display device, a safety ensuring method, and a safety enabling a user wearing a head mounted display device to always see information and ensuring the safety of a moving user. The purpose is to provide a secure program.

  The safety ensuring system according to the present invention controls movement sensing means for sensing movement of a user wearing a head-mounted display device, and restricts display contents to the head-mounted display device when the movement sensing means senses movement of the user. Display control means.

  The head-mounted display device according to the present invention includes a movement sensing unit that senses the movement of a user wearing the head-mounted display device, and a display control unit that controls display content when the movement sensing unit senses the movement of the user. It is characterized by comprising.

  The safety ensuring method according to the present invention is characterized in that the movement of a user wearing a head-mounted display device is sensed, and when the movement of the user is sensed, the head-mounted display device is controlled to limit display contents.

  The security ensuring program according to the present invention controls the computer to restrict the display content to the head-mounted display device when the computer detects the movement of the user who wears the head-mounted display device and senses the movement of the user. Display control processing is executed.

  ADVANTAGE OF THE INVENTION According to this invention, the user who mounted | wore the head mounted display apparatus can always see information, and can ensure the safety of the user who is moving.

It is a block diagram which shows an example of a structure of the safety ensuring system by this invention. It is a block diagram which shows an example of the data flow of a safety ensuring system. It is a flowchart which shows the process example which a safety ensuring system performs. It is a block diagram which shows the minimum structural example of a safety ensuring system.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an example of the configuration of a safety ensuring system according to the present invention. The safety ensuring system includes a head mounted display device 100, a triaxial acceleration sensor 110, and an information processing unit 120. In the configuration example shown in FIG. 1, the head mounted display device 100 is mounted on the user's head. Further, the triaxial acceleration sensor 110 and the information processing unit 120 are attached to the head mounted display device 100. Note that the configuration is not limited to the configuration example illustrated in FIG. 1. For example, the three-axis acceleration sensor 110 and the information processing unit 120 may be included in the head mounted display device 100 or may be configured as separate devices. It may be.

  FIG. 2 is a block diagram showing an example of the data flow of the safety ensuring system. In the configuration example shown in FIG. 2, the triaxial acceleration sensor 200, the information processing unit 210, and the head mounted display device 220 are connected to each other by wired or wireless communication. The user wears at least the triaxial acceleration sensor 200 and the head mounted display device 220.

  The triaxial acceleration sensor 200 has a function of measuring acceleration in three directions of the XYZ axes. The triaxial acceleration sensor 200 transmits the measured sensor information to the sensor information collection unit 211 of the information processing unit 210. Note that a normal acceleration sensor may be used instead of the three-axis acceleration sensor. However, it is desirable to use a triaxial acceleration sensor in order to grasp the user's operation more accurately.

  The information processing unit 210 is realized by a small information processing apparatus and operates according to a program. The information processing unit 210 includes a storage device such as a CPU and a memory, and includes a sensor information collection unit 211, a movement detection display control engine unit 212, and a display control unit 213.

  The sensor information collection unit 211 is realized by a CPU and a network interface unit of an information processing apparatus that operates according to a program. The sensor information collection unit 211 has a function of receiving sensor information from the triaxial acceleration sensor 110 and outputting it to the movement detection display control engine unit 212.

  The movement detection display control engine unit 212 is realized by a CPU of an information processing apparatus that operates according to a program. The movement detection display control engine unit 212 has a function of detecting the movement of the user wearing the head mounted display device 100. In the present embodiment, the movement detection display control engine unit 212 determines that the user is moving is expressed as detecting the movement of the user.

  The display control unit 213 is realized by a CPU and a network interface unit of an information processing apparatus that operates according to a program. The display control unit 213 has a function of controlling the display unit 211 provided in the head mounted display device 220 to display a predetermined image (for example, a still image or a moving image).

  The head mounted display device 220 is specifically a glasses-type display device. The head mounted display device 220 includes a display unit 211.

  The display unit 211 has a function of displaying a predetermined image. In the present embodiment, a glasses-type head-mounted display device is used. However, the present invention is not limited to this. For example, a helmet-type or goggles-type display device may be used as long as it can be attached to the head. In the present embodiment, according to general expressions, a glasses-type, helmet-type, goggles-type, retinal irradiation-type, optical-type, and the like are collectively referred to as a head-mounted display device.

  Next, the operation of the safety ensuring system will be described. FIG. 3 is a flowchart showing an example of processing executed by the safety ensuring system. Here, it is assumed that the logistics worker A is wearing the head mounted display device 220 on which the three-axis acceleration sensor 200 and the information processing unit 210 are mounted. First, a case where the logistics worker A wearing the head mounted display device 220 checks the work list displayed on the display unit 221 in a stationary state and moves according to the work contents will be described.

  The triaxial acceleration sensor 200 transmits the measured triaxial acceleration data to the sensor information collection unit 211. Then, the sensor information collection unit 211 outputs the received triaxial acceleration data to the movement detection display control unit engine unit 212 (step S1 in FIG. 3). The triaxial acceleration sensor 200 constantly measures triaxial acceleration and transmits it to the sensor information collection unit 211.

  Next, the movement detection display control unit engine unit 212 determines whether or not the logistics worker A is moving based on the triaxial acceleration data.

  Specifically, the movement detection display control unit engine unit 212 calculates the movement speed and movement distance of the logistics worker A based on the triaxial acceleration data (step S2 in FIG. 3). For example, the movement detection display control unit engine unit 212 measures the time from when the acceleration changes in the acceleration direction to when the acceleration changes in the deceleration direction, and multiplies the movement speed obtained from the acceleration by the measured time. Is calculated. In addition, since the movement detection display control unit engine unit 212 can measure acceleration in three directions, the movement speed and movement distance in three directions can be obtained. Therefore, the movement detection display control unit engine unit 212 may combine, for example, the movement speed and movement distance in three directions and use them in the determination process described later.

  When the movement speed and the movement distance are calculated, the movement detection display control unit engine unit 212 determines whether or not the calculated movement speed is equal to or higher than a predetermined speed (for example, 2 m / sec) (step S3 in FIG. 3). . When it is determined that the moving speed is equal to or higher than the predetermined speed, the movement detection display control unit engine unit 212 determines whether the calculated moving distance is equal to or greater than a predetermined distance (for example, 1 m) (FIG. 3). Step S4). Note that the movement detection display control unit engine unit 212 may determine, for example, whether or not the movement distance in a certain direction is equal to or greater than a predetermined distance. Further, the movement detection display control unit engine unit 212 may execute the steps S3 and S4 in the reverse order.

  If it is determined in step S4 that the moving distance is equal to or greater than the predetermined distance, the movement detection display control unit engine unit 212 determines that the logistics worker A is moving (step S5 in FIG. 3). In this embodiment, it is determined that the logistics worker A is moving when the conditions of step S3 and step S4 are satisfied. However, when the condition of either step S3 or step S4 is satisfied, the logistics worker A is determined. It may be determined that A is moving.

  If it is determined in step S5 that the logistics worker A is moving, the display control unit 213 controls the display unit 221 of the head mounted display device 220 to increase the transparency of the image currently displayed (FIG. 5). 3 step S7).

  For example, when the movement detection display control unit engine unit 212 determines that the movement detection display control unit engine unit 212 is moving, the display control unit 213 changes the brightness or contrast of the display unit 221 to increase the transparency of the currently displayed image. To control. By this control, the display of the currently displayed work list or the like is dimmed. In this case, it is assumed that the head mounted display device 220 has a function that can adjust brightness, contrast, and the like. In addition, since the characteristics of the function for adjusting brightness, contrast, and the like differ depending on the type of the head mounted display device, the display control unit 213 needs to perform different control processing for each type of the head mounted display device.

  Regardless of the type of the head-mounted display device, the display control means 213 converts the image data to be output to the display unit 221 to increase the transparency of the image displayed by the same process, thereby displaying the image before moving. It may be controlled to display an image having higher transparency than the image that has been displayed.

  For example, a method of increasing the transparency by changing the color of the image displayed on the display unit 221 may be used. This is because the head-mounted display device utilizes the characteristic of transmitting an image by bringing the color of the displayed image close to black.

  Specifically, it can be realized as follows. For example, color change pattern information indicating a color change pattern (for example, indicating how much color is closer to black) is stored in the storage unit in advance. If it is determined that the movement detection display control unit engine unit 212 is moving, the information processing unit 210 generates an image with high transparency based on the image being displayed by the display unit 221 and the color change pattern information. Specifically, image data with increased transparency is generated by generating a composite image of a displayed image and a black image. Then, the display control unit 213 controls the display unit 221 to display the generated image with high transparency.

  Further, for example, a normal image displayed in normal time and a moving image with increased transparency for display during movement are stored in the storage unit in advance. When it is determined that the movement detection display control unit engine unit 212 is moving, the display control unit 213 causes the display unit 221 to display the moving image associated with the normal image being displayed. Control. Not only images with increased transparency, but also images with reduced number of display information, which will be described later, images that contain information that you want to show only during movement, images with a small display area, etc. are stored as moving images. It may be.

  As described above, by converting the image data to be output to the display unit 221, even when a head mounted display device in which the brightness and contrast cannot be adjusted is used, the transparency of the image to be displayed can be changed. In addition, since the method is not affected by the functions and characteristics of the head mounted display device, there is no need to perform different control processing for each type of head mounted display device.

  Further, in the example shown in FIG. 3, in order to ensure the safety of the moving logistics worker A, a process of increasing the image transparency is executed in step S7, but instead of this process, a different process is performed. It is also possible to ensure safety by executing.

  For example, when it is determined that the movement detection display control unit engine unit 212 is moving, the display control unit 213 may control the display unit 221 to display only information to be confirmed during the movement. In other words, the display control unit 213 performs control so that an image having a smaller number of display information (for example, a figure and characters) is displayed as compared with the image displayed before the movement.

  Specifically, an image in which characters are deleted from a normal-time image including figures and characters is stored as a moving image. The display control means 213 controls the image displayed on the display unit 221 to change from the normal time image to the moving image while the logistics worker A is moving. Then, since the character disappears from the image displayed in front of the user during the movement, the logistics worker A can prevent the attention from being distracted by reading the character.

  In addition to reducing the information displayed during movement, an image including information desired to be displayed only during movement may be displayed. For example, when a logistics worker moves from A shelf to B shelf, if it is known that there is a step in the passage or that it passes by a dangerous device, information notifying the danger is displayed. Therefore, safety can be ensured.

  Specifically, when the movement detection display control unit engine unit 212 determines that it is moving based on the triaxial acceleration data measured by the triaxial acceleration sensor 200, the display control unit 213 displays information for notifying the danger. The display unit 221 is controlled to display the included image. At this time, for example, the information processing unit 210 generates an image in which information notifying danger is superimposed on the image being displayed by the display unit 221, and the display control unit 213 displays the generated image on the display unit 221. You may control to.

  In addition, the display control unit 213 may perform control so that an image including information notifying the danger is not displayed during the movement, but is displayed for a predetermined period (for example, several seconds) after the movement is started. Further, once the logistics worker A stops moving, the control may be performed such that the display of the information notifying the danger disappears. That is, when the movement detection display control unit engine unit 212 determines that the logistics worker A is not moving, the display control unit 213 controls the display unit 221 to display the image displayed before the movement starts.

  Further, for example, when the movement detection display control unit engine unit 212 determines that the movement detection display control unit engine unit 212 is moving, the display control unit 213 causes the display unit 221 to display an image having a smaller display area compared to the image displayed before the movement. You may make it control so. By displaying an image with a small display area, the logistics worker A can secure a wide field of view during movement.

  Further, for example, the display control unit 213 may execute the process of increasing the image transparency in Step S7 or a combination of the above modifications.

  Next, a case will be described in which the logistics worker A is stationary and moves finely or moves his / her neck. In this case, for example, in step S3, the movement detection display control engine 212 determines that the calculated movement speed is less than a predetermined speed. Further, for example, in step S4, the movement detection display control engine 212 determines that the calculated movement distance is less than a predetermined distance. If it is determined that the movement speed is less than the predetermined speed or the movement distance is less than the predetermined distance, the movement detection display control engine 212 determines that the movement is fine (that is, does not determine movement) (see FIG. 3). Step S6). Note that the movement detection display control engine 212 may determine that the movement is a slight movement even when the movement detection display control engine 212 determines that the movement is in the rotational direction based on the triaxial acceleration data.

  When the movement detection display control engine 212 determines that the movement is slight in step S6, the display unit 221 continues to display the currently displayed image.

  As described above, in this embodiment, when it is determined that the user is moving based on the triaxial acceleration data measured by the triaxial acceleration sensor, for example, the transparency of the display image is automatically increased and the user's Ensure a wide field of view. Therefore, the display contents are not completely erased, but are limited to the minimum necessary display contents, so that the user wearing the head mounted display device can always see the information and ensure safety during movement. it can.

  Next, the minimum configuration of the safety ensuring system according to the present invention will be described. FIG. 4 is a block diagram showing a minimum configuration example of the safety ensuring system. As shown in FIG. 4, the safety ensuring system includes movement sensing means 1 and display control means 2 as minimum components.

  In the safety ensuring system with the minimum configuration shown in FIG. 4, when the movement sensing means 1 senses the movement of the user wearing the head mounted display device, the display control means 2 controls the display contents to be limited to the head mounted display device. To do.

  Therefore, according to the safety ensuring system with the minimum configuration, the user wearing the head mounted display device can always see the information, and the safety of the moving user can be secured.

  In addition, in this embodiment, the characteristic structure of the safety ensuring system as shown to the following (1)-(7) is shown.

  (1) The safety ensuring system includes movement detection means (for example, movement detection display control engine unit 212) for detecting movement of a user wearing a head mounted display device (for example, realized by the head mounted display device 220); When the movement sensing means senses the movement of the user, it includes display control means (for example, realized by the display control unit 213) for controlling the head mounted display device so as to limit display contents.

  (2) In the safety ensuring system, when the movement sensing unit senses the movement of the user, the display control unit is configured to control the head mounted display device to display an image having higher transparency than before sensing. May be.

  (3) In the safety ensuring system, when the movement sensing unit senses the movement of the user, the display control unit is configured to control the head mounted display device to display an image having a smaller display area compared to before the sensing. May be.

  (4) In the safety ensuring system, when the movement sensing means senses the movement of the user, the display control means controls the head mounted display device to display an image with a smaller number of display information than before sensing. It may be configured.

  (5) In the safety ensuring system, the storage control unit includes a storage unit that stores a moving image to be displayed while the user is moving, and the display control unit is moving to the head mounted display device when the movement detecting unit detects the movement of the user. You may be comprised so that it may control so that the image for a display may be displayed.

  (6) In the safety ensuring system, the display control unit is configured to control the head mounted display device to display the image displayed before the detection when the movement detection unit stops detecting the movement of the user. It may be.

  (7) In the safety ensuring system, the movement detection means calculates the movement speed and movement distance of the user, and detects the movement of the user when the calculated movement speed and movement distance satisfy a predetermined condition. It may be configured.

  A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.

(Supplementary Note 1) When the movement sensing means senses the movement of the user, the display control means transmits an image different in color from the image displayed before the sensing to the head mounted display device as compared with before the sensing. The safety ensuring system according to claim 2, wherein control is performed so as to display an image having a high degree.

(Supplementary note 2) The safety ensuring system according to claim 5, wherein the display control means controls the display image for movement to be displayed on the head mounted display device for a predetermined period when the movement sensing means senses the movement of the user.

  The present invention can be applied to applications that support work activities using a head-mounted display.

1 Movement sensing means 2 Display control means

Claims (10)

Movement sensing means for sensing movement of a user wearing the head mounted display device;
When the movement sensing means senses the movement of the user, the safety ensuring system includes display control means for controlling the head mounted display device so as to limit display contents. The safety ensuring system according to claim 1, wherein when the movement sensing means senses a user's movement, the display control means controls the head mounted display device to display an image having a higher transparency than before sensing. The safety control according to claim 1 or 2, wherein when the movement sensing means senses the movement of the user, the display control means controls the head mounted display device to display an image having a smaller display area compared to before the sensing. system. The display control means, when the movement sensing means senses a user's movement, controls the head mounted display device to display an image with a smaller number of display information than before sensing. The safety ensuring system according to any one of the above. Storage means for storing a moving image to be displayed while the user is moving;
5. The display control unit according to claim 1, wherein when the movement detection unit detects a movement of the user, the display control unit controls the head mounted display device to display the moving image. 6. Safety system. The display control unit controls the head mounted display device to display an image displayed before the detection when the movement detecting unit stops detecting the movement of the user. The safety ensuring system according to item 1. The movement sensing means calculates a movement speed and a movement distance of the user, and senses the movement of the user when the calculated movement speed and the movement distance satisfy a predetermined condition. The safety ensuring system according to any one of the above. Movement sensing means for sensing movement of a user wearing the head mounted display device;
When the movement sensing means senses the movement of the user, the head mounted display device further comprises display control means for controlling to limit display contents. Sense the movement of the user wearing the head mounted display device,
When the movement of the user is sensed, control is performed so as to restrict display contents to the head mounted display device. On the computer,
A movement sensing process for sensing movement of a user wearing a head mounted display device;
A safety ensuring program for executing a display control process for controlling the head-mounted display device so as to limit display contents when sensing the movement of the user.

Images