JP6534810B2 - Vision control device, vision control system, vision control method, and vision control program - Google Patents

Description

  The present invention relates to a visibility control device and the like that notify of danger through vision.

  It is very important to detect danger quickly in various aspects of daily life. For example, if it is delayed to detect the presence of an object which is burnt by touching, or the generation of a toxic gas, it may be life-threatening. There are known various techniques for notifying such a danger through sight or hearing. In general, human beings receive the most information from vision among the five senses, so there is a growing expectation of technology for avoiding danger by notifying danger through vision, in particular.

  As an example of such a technique, Patent Document 1 acquires an image in the direction of the field of view of the user, generates attention information that warns the user based on the acquired image, and displays the attention information as a virtual image. There is disclosed a head mounted display device capable of experiencing augmented reality. This device warns the user of the user's attention by estimating the attention point such as the danger in the user's sight direction without requiring the information on the separately prepared danger place.

  In addition, according to Patent Document 2, when the turning of the following vehicle is detected from the information output from the inter-vehicle distance sensor, the rearview mirror changes the rear view from the normal state so that the following vehicle does not get into the driver's eyes. A support device is disclosed. This device prevents the occurrence of an accident due to a driving error by reducing the driver's anxiety.

JP, 2014-120786, A Unexamined-Japanese-Patent No. 2010-271906

  The head-mounted display device described in Patent Document 1 described above displays icons, figures, etc. in the vicinity of a location requiring attention on the screen for displaying the field of view, in order to alert the user easily without comprehending the field of view. indicate. In this case, if the user does not understand in advance the meaning indicated by the icon or graphic displayed on the screen displaying the view, the user may be late in detecting the danger. It is also possible for the user to miss these icons or shapes displayed in the vicinity of the area requiring attention. That is, the technology described in Patent Document 1 is insufficient for solving the problem of steadily notifying the user of the danger so that the user can steadily sense the danger. Patent Document 2 does not disclose any technique for solving this problem.

  The main object of the present invention is to provide a view control device and the like that solve the problems described above.

  A visibility control apparatus according to an aspect of the present invention is configured to have transparency covering a user's visibility when a value indicated by environment information representing a result of measurement of a state of a surrounding environment of the own apparatus satisfies a predetermined determination condition. And control means for controlling the view changing device capable of changing the state regarding the object or the view image so that the state regarding the object having the state or the view image displayed by the display device and configuring the view changes. .

  In another aspect for achieving the above object, the view control method according to an aspect of the present invention is configured such that the value indicated by the environmental information indicating the result of measurement of the state of the surrounding environment of the own device satisfies a predetermined determination condition It is possible to change the state relating to the object or the view image such that the state relating to the transparent object covering the view of the user, or the state relating to the view image displayed by the display device and constituting the view changes. Control the visibility changing device.

  Further, in a further aspect of achieving the above object, the view control program according to an aspect of the present invention is characterized in that the value indicated by the environmental information indicating the result of the measurement of the state of the peripheral environment of the own device is a predetermined judgment condition When it is satisfied, the state regarding the object or the view image is changed so that the state regarding the object having transparency covering the view of the user or the state regarding the view image displayed by the display device and configuring the view changes. A computer executes control processing to control possible visibility changing devices.

  Furthermore, the present invention can also be realized by a computer readable non-volatile storage medium storing such a view control program (computer program).

  The present invention makes it possible to notify the user of the danger so that the user can steadily sense the danger.

BRIEF DESCRIPTION OF THE DRAWINGS It is a block diagram which shows the structure of the visual field control system which concerns on the 1st Embodiment of this invention. BRIEF DESCRIPTION OF THE DRAWINGS It is a perspective view of the spectacles which mounted the visual field control system which concerns on the 1st Embodiment of this invention. It is a flowchart which shows operation | movement of the visual field control system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the structure of the visual field control apparatus which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows the structure of the information processing apparatus which can perform the control part and the determination part of the visual field control apparatus which concern on each embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

First Embodiment
FIG. 1 is a block diagram conceptually showing the configuration of a view control system 1 according to the first embodiment. The view control system 1 according to the present embodiment includes a view control device 10, a measurement device 20, a view changing device 30, and an eyeglass lens 40.

  The spectacle lens 40 may be a general spectacle lens or may be a lens including a material that can change the transmittance of visible light by electrical control. In the present embodiment, the spectacle lens 40 may be replaced with, for example, a windshield of a car. Alternatively, in the present embodiment, the spectacle lens 40 may be replaced with a display device such as a head mounted display device for displaying the peripheral vision.

  The measuring device 20 includes a measuring device 21. The measuring device 21 is a device that measures the state of the surrounding environment. The measuring device 21 may be, for example, a sensor that measures temperature, humidity, or the like, or may be a sensor that measures toxic gas, radiation, or the like. In addition, the measuring device 21 may be, for example, a camera for capturing an image of a surrounding area, or may be a microphone for collecting sound. The measuring device 21 can, for example, continuously measure the state of the surrounding environment. At this time, the measuring device 21 may measure at regular intervals or may measure when a predetermined condition is satisfied. The measuring device 20 generates environmental information 200 in time series by performing analog-to-digital conversion, scale conversion, and the like on measurement data obtained by measurement by the measuring device 21. The measuring device 20 inputs the generated environment information 200 to the view control device 10.

  The visibility changing device 30 is controlled by the visibility control device 10 to change the state of the spectacle lens 40. Specifically, the state relating to the spectacle lens 40 is, for example, the transmittance of visible light transmitted through the spectacle lens 40. If the vision control system 1 comprises a general spectacle lens 40 or a windshield of a motor vehicle, the vision modification device 30 comprises, for example, a sprayer that sprays water vapor. As the visibility changing device 30 sprays water vapor on the spectacle lens 40 or the windshield of the car, the transmittance of visible light transmitted through the spectacle lens 40 or the windshield of the car is reduced. When the sprayer sprays water vapor on the windshield of a car, the windshield must be made frosty to such an extent that the operation of the car is not hindered.

  Moreover, when the spectacles lens 40 is a lens containing the material which can change the transmittance | permeability in which visible light permeate | transmits by electrical control, the visibility change apparatus 30 changes the said transmittance | permeability by electrical control. When the material contained in the spectacle lens 40 is capable of changing the color of visible light to be transmitted by electrical control, the view changing device 30 may, for example, display the entire view of the user through the spectacle lens 40 or The state relating to the spectacle lens 40 may be changed so as to be almost entirely red.

  When the view control system 1 includes a display device such as a head mounted display device for displaying a peripheral view instead of the eyeglass lens 40, the view changing device 30 is a transparency, a color tone, etc. of an image displayed by the display device. Perform image processing to change the.

  In response to an instruction from the view control device 10, the view changing device 30 restores the state of the spectacle lens 40 whose state has been changed back to the original state. The view changing device 30 has, for example, a function of warming the spectacle lens 40, and eliminates the fogging of the spectacle lens 40 by making the cloudy spectacle lens 40 the same temperature as the ambient temperature. When the vehicle exterior side of the windshield of the automobile is fogged with water vapor, the visibility changing device 30 eliminates the fogging of the windshield, for example, by operating a wiper. The visibility change device 30 eliminates the fogging of the windshield, for example, by activating the defroster when the interior of the windshield of the automobile is fogged with water vapor.

  The visibility changing device 30 returns the transmittance to the original value when the transmittance of visible light through the spectacle lens 40 is changed by electrical control. When the field-of-view change device 30 performs image processing to change the transparency, color tone, and the like of an image displayed by a display device such as a head mounted display device, the display image is returned to the state before the image processing.

  As described above, the view changing device 30 changes the state of the view of the user by changing the state of the image displayed by the display device such as the spectacle lens 40 or the windshield of the car or the head mounted display device. change.

  The visibility control device 10 includes a determination unit 11, a control unit 12, and a switch 13. The determination unit 11 and the control unit 12 may be an electronic circuit or may be realized by a computer program and a processor operating according to the computer program.

  The determination unit 11 stores, in an internal memory (not shown in FIG. 1), a determination condition 110 which is a reference when determining whether or not the state of the surrounding environment is dangerous. The determination condition (information representing the determination condition) 110 is, for example, a threshold related to the temperature, the humidity, or the like when the measurement device 21 is a sensor that measures the temperature, the humidity, or the like. For example, when the measuring device 21 is a sensor that measures toxic gas, radiation, or the like, the determination condition 110 is a threshold related to the concentration or radiation dose of the toxic gas. The determination condition 110 is, for example, image information related to a dangerous substance such as a blade when the measuring device 21 is a camera for capturing an image of the surroundings.

  The determination unit 11 determines whether the value indicated by the environment information 200 input from the measuring device 20 satisfies the determination condition 110. For example, when the temperature or humidity indicated by the environmental information 200 or the concentration or radiation dose of toxic gas is equal to or higher than the threshold indicated by the determination condition 110, the determination unit 11 determines that the state of the surrounding environment is dangerous. For example, when an image related to a dangerous object such as a blade indicated by the determination condition 110 is included in the peripheral image indicated by the environment information 200, the determination unit 11 determines that the state of the peripheral environment is dangerous. The determination unit 12 inputs the determination result to the control unit 12. The determination unit 11 may perform this determination every constant time, or may perform this determination when a predetermined condition is satisfied.

  When the determination result input from the determination unit 11 indicates that the state of the surrounding environment is dangerous, the control unit 12 changes the view changing device 30 so that the state of the view seen by the user through the spectacle lens 40 changes. Control.

  After instructing the view changing device 30 to change the state regarding the spectacle lens 40 or the like, the control unit 12 instructs the view changing device 30 to input a determination result indicating that the danger has been eliminated from the determining unit 11. , Instructs to restore the state of the changed view.

  The switch 13 is a switch that can be pressed by the user. The control unit 12 detects that the user has pressed the switch 13 while the visibility changing device 30 is changing the visibility of the user. In this case, the control unit 12 instructs the view changing device 30 to restore the changed view state to the original state. At this time, whether or not the state of the field of view is being changed by incorporating a memory for storing information indicating whether or not the state of the field of view is being changed. You may decide whether or not. Alternatively, the control unit 12 may determine whether or not the state of the field of view is being changed by obtaining information indicating the state of the spectacle lens 40 or the like from the field of view changing device 30.

  After the state of the field of view returns to the original state by the user pressing the switch 13, the controller 12 causes the field of view until the notification of the occurrence of a new danger from the determination unit 11 Control the visibility changing device 30 so as not to change the state of.

  The perspective view of the example which mounted the vision control system 1 which concerns on this embodiment to the spectacles 2 is shown in FIG. The glasses 2 include a measuring device 20 at the front of the frame to measure the state of the surrounding environment. The glasses 2 are provided with the view control device 10 and the view changing device 30 on the side of the frame, and change the state of the user's view by changing the state regarding the eyeglass lens 40 according to the state of danger related to the surrounding environment. Do. The glasses 2 also have a switch 13 on the side of the frame that the user presses in order to restore the changed view state.

  Next, the operation (process) of the view control system 1 according to the present embodiment will be described in detail with reference to the flowchart of FIG. 3.

  The measuring device 20 measures the state of the surrounding environment using the measuring device 21, and generates the environmental information 200 based on the result of measurement by the measuring device 21. The measuring device 20 inputs the generated environmental information 200 to the view control device 10 (step S101). The determination unit 11 in the view control device 10 checks whether the value indicated by the environment information 200 satisfies the determination condition 110. (Step S102).

  When the value indicated by the environment information 200 satisfies the determination condition 110 (Yes in step S103), the determination unit 11 determines that the state of the surrounding environment is dangerous, and the process proceeds to step S104. When the value indicated by the environment information 200 does not satisfy the determination condition 110 (No in step S103), the determination unit 11 determines that the state of the surrounding environment is not dangerous, and the process proceeds to step S107.

  When the view changing device 30 has not yet changed the state regarding the eyeglass lens 40 (No in step S104), the control unit 12 controls the view changing device 30 to change the state regarding the eyeglass lens 40 (step S105). The view changing device 30 changes the state of the spectacle lens 40 (step S106), and the whole process ends. If the field of view change device 30 has already changed the state of the spectacle lens 40 (Yes in step S104), the process proceeds to step S108.

  When the field of view changing device 30 has not changed the state regarding the spectacle lens 40 (No in step S107), the entire process ends. When the view changing device 30 has already changed the state of the eyeglass lens 20 (Yes in step S107), the control unit 12 controls the view changing device 30 to restore the state of the eyeglass lens 40 to the original state (step S109). The view changing device 30 returns the state regarding the spectacle lens 40 to the original state (step S110), and the whole process ends.

  When control unit 12 detects that switch 13 is pressed (Yes in step S108), the process proceeds to step S109. When the control unit 12 does not detect that the switch 13 is pressed (No in step S108), the entire process ends.

  The visibility control system 1 according to the present embodiment can notify the user of the danger so that the user can steadily sense the danger. The reason is that, from the state of the surrounding environment measured by the measuring device 20, when the determining unit 11 determines that there is a danger in the surrounding environment, the view changing device 30 changes the state related to the spectacle lens 40. Controlling the state of the user's view.

  There are known various techniques for assisting a user to quickly sense dangers by visually notifying the dangers encountered in various aspects of daily life. However, even if the user is notified of the danger, if the user can not understand the notified content or if the user may miss the notified content, the user can not avoid the danger. There is a risk of being involved in human life.

  On the other hand, in the view control system 1 according to the present embodiment, when the determination unit 11 detects a danger, the control unit 12 controls to change the state of the user's view, such as fogging the spectacle lens 40. I do. That is, the view control device 10 according to the present embodiment supports the user to intuitively and quickly detect danger by directly appealing to the primitive sense of the human being to change the state of the view. Do. Thereby, the visibility control device 10 according to the present embodiment can notify the user of the danger so that the user can steadily sense the danger. Note that the view control device 10 can change the state of the whole or substantially the whole of the view of the user, in order to make the recognition of the danger by the user more certain, the whole of the view of the user or the view changing device 30. Control may be made to change the overall state.

  Further, in the view control device 10 according to the present embodiment, since the determination unit 11 continuously detects the danger, after detecting the danger, it is also detected that the danger has been eliminated. The control unit 12 performs control to change the state of the field of view through the eyeglass lens 40 at the timing notified that the danger has occurred from the judgment unit 11, and then notifies the judgment unit 11 that the danger has been eliminated. Control is performed to restore the state of the field of view at the specified timing. That is, the visibility control device 10 according to the present embodiment can prevent the user from being unnecessarily inconvenient by maintaining the state where the visibility is changed for a long time more than necessary.

  Furthermore, in the view control device 10 according to the present embodiment, the control unit 12 detects that the switch 13 is pressed. When the user presses the switch 13 while the visibility changing device 30 is changing the visibility state, the control unit 12 performs control to restore the visibility state. When the user presses the switch 13, the user already senses the danger, so even if the danger has not been eliminated, there is no need to change the state of view. Therefore, the visibility control device 10 according to the present embodiment can prevent the user from being unnecessarily inconvenient.

Second Embodiment
FIG. 4 is a block diagram conceptually showing the configuration of the view control device 50 according to the second embodiment.

  The view control device 50 according to the present embodiment includes a control unit 52.

  The control unit 52 obtains environment information 600 representing the result of measurement of the state of the surrounding environment of the own device. When the value indicated by the environment information 600 satisfies the predetermined determination condition 520, the control unit 52 controls the view changing device 70 so that the state of the transparent object 80 covering the view of the user is changed. The visibility changing device 70 is a device capable of changing the state of the object 80 having transparency. The target whose view changing device 70 changes the state may be a view image forming the view displayed by the display device instead of the transparent object 80.

  The visibility control device 50 according to the present embodiment can notify the user of the danger so that the user can steadily sense the danger. The reason is that, when the control unit 52 determines that the surrounding environment is dangerous based on the environment information 600 and the determination condition 520, it controls the view changing device 70 to change the state regarding the transparent object 80. This is because it changes the state of the user's view.

<Hardware configuration example>
Each part shown in FIG. 1 and FIG. 4 in each embodiment described above can be realized by a dedicated HW (HawdWare) including an electronic circuit. Further, at least the determination unit 11 and the control units 12 and 52 can be regarded as a function (processing) unit (software module) of the software program. However, the division of each part shown in these drawings is a configuration for convenience of explanation, and various configurations can be assumed at the time of mounting. An example of the hardware environment in this case will be described with reference to FIG.

  FIG. 5 exemplarily illustrates the configuration of an information processing apparatus 900 (computer) capable of executing a view control apparatus according to an exemplary embodiment of the present invention. That is, FIG. 5 is a configuration of a computer (information processing apparatus) capable of realizing the view control device shown in FIG. 1 and FIG. 4 and shows a hardware environment capable of realizing each function in the above-described embodiment.

The information processing apparatus 900 illustrated in FIG. 5 includes the following as constituent elements.
CPU (Central_Processing_Unit) 901,
ROM (Read_Only_Memory) 902,
RAM (Random_Access_Memory) 903,
Communication interface 904 with an external device
Input / output interface 906,
The information processing apparatus 900 is a general computer whose configuration is connected via a bus 905 (communication line).

  The present invention described by taking the above-described embodiment as an example supplies a computer program capable of realizing the following functions to the information processing apparatus 900 shown in FIG. The function is the function of the determination unit 11 and the control units 12 and 52 or the flowchart (FIG. 3) in the block configuration diagram (FIGS. 1 and 4) referred to in the description of the embodiment. The present invention is then achieved by reading, interpreting and executing the computer program on the CPU 901 of the hardware. In addition, the computer program supplied in the apparatus may be stored in a readable / writable volatile storage memory (RAM 903) or a non-volatile storage device such as the ROM 902.

  Also, in the above case, the method of supplying the computer program into the hardware can adopt a general procedure at present. The procedure includes, for example, a method of downloading from the outside via a communication line such as the Internet. And, in such a case, the present invention can be understood as being constituted by a code that constitutes the computer program or a storage medium in which the code is stored.

  The present invention has been described above by taking the above-described embodiment as an exemplary example. However, the present invention is not limited to the embodiments described above. That is, the present invention can apply various aspects that can be understood by those skilled in the art within the scope of the present invention.

DESCRIPTION OF SYMBOLS 1 visibility control system 10 visibility control device 11 determination unit 110 determination condition 12 control unit 13 switch 20 measuring device 21 measuring device 200 environment information 30 view changing device 40 eyeglass lens 2 glasses 50 view control device 52 control unit 520 determination condition 600 environment information 70 Field of view changer 80 Object with transparency 900 Information processor 901 CPU
902 ROM
903 RAM
904 Communication interface 905 Bus 906 I / O interface

Claims (6)

A state related to an object having transparency that covers the user's field of view when a value indicated by environment information representing a result of measuring the state of the surrounding environment of the own device satisfies a predetermined determination condition representing the danger of the surrounding environment. Alternatively, when controlling the view changing device capable of changing the state of the object or the state of the view image so that the state of the view image displayed by the display device and constituting the view causes deterioration of the view .
Controlling the visibility changing device so as to reduce the transmittance of visible light transmitted through the object by spraying water vapor onto the object, or performing image processing to change the transparency or color tone of the visibility image, A visibility control device comprising control means for controlling the visibility changing device. When the value indicated by the environment information, which is a result of measuring the state of the surrounding environment in time series, satisfies the determination condition and then the determination condition is not satisfied after passing a specific time. And controlling the view changing device to return the state relating to the object or the state relating to the view image to the state before the change.
The visibility control device according to claim 1 . The control means changes the state relating to the object or the state relating to the view image before the state relating to the object or the view image is received after receiving a predetermined input operation after the state relating to the object or the state relating to the view image is changed by the view changing device. Control the visibility changing device to return to the state of
Visual-field control device according to claim 1 or 2. A visibility control device according to any one of claims 1 to 3 .
A measuring device that generates the environmental information based on a result of measuring the state of the surrounding environment;
The visibility changing device;
The object or the display device;
Vision control system with Depending on the information processing device
A state related to an object having transparency that covers the user's field of view when a value indicated by environment information representing a result of measuring the state of the surrounding environment of the own device satisfies a predetermined determination condition representing the danger of the surrounding environment. Alternatively, when controlling the view changing device capable of changing the state of the object or the state of the view image so that the state of the view image displayed by the display device and constituting the view causes deterioration of the view.
Controlling the visibility changing device so as to reduce the transmittance of visible light transmitted through the object by spraying water vapor onto the object, or performing image processing to change the transparency or color tone of the visibility image, Control the visibility changing device,
Vision control method. A state related to an object having transparency that covers the user's field of view when a value indicated by environment information representing a result of measuring the state of the surrounding environment of the own device satisfies a predetermined determination condition representing the danger of the surrounding environment. Alternatively, when controlling the view changing device capable of changing the state of the object or the state of the view image so that the state of the view image displayed by the display device and constituting the view causes deterioration of the view .
Controlling the visibility changing device so as to reduce the transmittance of visible light transmitted through the object by spraying water vapor onto the object, or performing image processing to change the transparency or color tone of the visibility image, A vision control program that causes a computer to execute control processing for controlling the visibility changing device .

Images