WO2023157057A1

WO2023157057A1 - Head-mounted display, wearable terminal, and uv monitoring method

Info

Publication number: WO2023157057A1
Application number: PCT/JP2022/005861
Authority: WO
Inventors: 眞弓中出; 康宣橋本; 仁秋山
Original assignee: マクセル株式会社
Priority date: 2022-02-15
Filing date: 2022-02-15
Publication date: 2023-08-24

Abstract

This head-mounted display comprises at least one UV sensor, a display, a memory element, and a processor. The processor: stores, in the memory, measured values for UV light detected by the UV sensor; adds up the measured values and calculates a cumulative UV light amount; makes a comparison between the cumulative UV light amount with a cumulative upper limit value that is the permissible limit value of the cumulative amount of UV light that a user can be exposed to within a predetermined measurement period defined in advance; and upon determining that the cumulative UV light amount has increased to or beyond the cumulative upper limit value, performs control for displaying a warning on the display.

Description

Head-mounted display, wearable terminal, and ultraviolet monitoring method

The present invention relates to head-mounted displays, wearable terminals, and ultraviolet monitoring methods.

UV rays not only cause sunburn by increasing melanin and cause spots, but also cause skin aging such as wrinkles and sagging called photoaging. Most of the skin troubles in areas that are exposed to direct sunlight are caused by UV rays. In particular, UV-A waves have a higher ability to penetrate the skin than UV-B waves and do not cause skin inflammation, so they damage the skin without being noticed. Patent Document 1 discloses a portable information terminal that displays an alarm by obtaining the amount of ultraviolet rays that the user is exposed to from the current time based on the ultraviolet intensity measured by the ultraviolet intensity measuring means mounted on the portable information terminal.

JP 2005-266170 A

In the above conventional example, the amount of ultraviolet rays in the facial area most desired to avoid is not measured, nor is the integrated amount considered to be the cause of wrinkles. Also, no consideration is given to providing adequate shielding in the direction of the ultraviolet rays.

The present invention has been made in view of the above circumstances, and aims to prevent photoaging of the face by making the user aware that the face is exposed to ultraviolet rays and taking avoidance actions.

In order to solve the above problems, the present invention has the configuration described in the claims. One example is a head-mounted display, comprising at least one or more ultraviolet sensors, a display, a memory, and a processor, wherein the processor stores measured values of ultraviolet rays detected by the ultraviolet sensors. Stored in the memory, an integrated amount of ultraviolet rays is calculated by integrating the measured values, and an upper limit of the integrated amount that is a permissible limit value of the integrated amount of ultraviolet rays that the user is exposed to within a predetermined predetermined measurement period with the accumulated amount of ultraviolet rays and a value, and when it is determined that the integrated amount of ultraviolet rays has increased to the upper limit value of the integrated amount or more, display control of a warning is performed on the display.

According to the present invention, photoaging of the face can be reduced by making the user's face aware that it is exposed to ultraviolet rays and taking avoidance actions. Problems, configurations, and effects other than those described above will be clarified by the following description of the embodiments.

FIG. 2 is an external view of a transmissive HMD; The hardware block diagram of HMD. FIG. 2 is a block diagram showing the functional configuration of the HMD; 4 is a flowchart showing the flow of processing of the HMD according to the first embodiment; The figure which shows the transition example of the amount of ultraviolet rays integrated. The figure which shows the example of a warning display. 8 is a flowchart showing the flow of processing of the ultraviolet monitoring system according to the second embodiment; The figure which shows the estimation curve example of the ultraviolet-ray integrated amount. The flowchart which shows the flow of a process of the ultraviolet monitoring system which concerns on 3rd Embodiment. Explanatory drawing which shows the determination process of the amount of fluctuation integrations. The flowchart which shows the flow of a process of the ultraviolet monitoring system which concerns on 4th Embodiment. Explanatory drawing of an ultraviolet irradiation direction. Explanatory drawing which shows the example of the virtual reality object which shows an ultraviolet irradiation direction. The flowchart which shows the flow of a process of the ultraviolet monitoring system which concerns on 5th Embodiment. FIG. 4 is an explanatory diagram showing an example of a virtual reality object showing the irradiation direction of sunlight and the irradiation direction of ultraviolet rays; The flowchart which shows the flow of a process of the ultraviolet monitoring system which concerns on 6th Embodiment. The flowchart which shows the flow of a process of the ultraviolet monitoring system which concerns on 7th Embodiment.

This embodiment measures the amount of ultraviolet rays irradiated to the user's body with an ultraviolet sensor mounted on a wearable terminal, integrates the amount of ultraviolet rays for a day, and exceeds the upper limit of the accumulated amount, or when it is predicted that it will exceed The present invention relates to wearable terminals that present warnings and avoidance methods.

Below, we will monitor the amount of UV rays that hit the face, especially the user's body. A head-mounted display (hereinafter abbreviated as “HMD”) will be described as an example of a wearable terminal that is suitable for measuring the amount of ultraviolet rays hitting the face.

The present invention has an adverse effect on the skin when exposed to large amounts, and is expected to reduce the effects of ultraviolet rays that may cause diseases such as cancer. It can be expected to contribute to Goal 3 of Development Goals, "Good health and well-being for all."

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In principle, the same members are denoted by the same reference numerals in all the drawings for describing the embodiments, and repeated description thereof will be omitted.

<First Embodiment>
In the first embodiment, an ultraviolet sensor mounted on an HMD measures the integrated amount of ultraviolet irradiation applied to the user's face for a predetermined period of time, for example, one day, one week, or one month. In this embodiment, a warning is issued or an avoidance action is urged when the integrated amount becomes equal to or greater than the upper limit value N2 (see FIG. 5). The integrated amount upper limit value N2 corresponds to the allowable limit value of ultraviolet rays that the user is exposed to within a predetermined measurement period (for example, one day from 00:00 to 24:00).

FIG. 1 is an external view of a transmissive HMD 10. FIG.

The HMD 10 has a display 119 , a right ultraviolet sensor 131 , a left ultraviolet sensor 132 (see FIG. 2), and a front ultraviolet sensor 133 mounted on the frame 11 .

The frame 11 is a member that keeps the HMD 10 mounted on the head of the user of the HMD 10 and holds other components of the HMD 10 .

The display 119 is a transmissive display 119. It is installed in front of both eyes of the user wearing the HMD 10 . The user sees the outside world through the display 119 . The display 119 displays a warning message and the ultraviolet measurement result.

FIG. 2 is a hardware configuration diagram of the HMD 10.

The HMD 10 includes an out-camera 111, an in-camera 112, a ranging sensor 113, an illuminance sensor 114, an acceleration sensor 115, a gyro sensor 116, an orientation sensor 117, a GPS (Global Positioning System) sensor 118, a display 119, a network communication device 120, and a microphone. 121, a speaker 122, a timer 124, a processor 125, a memory 128, a power button 130, a right ultraviolet sensor 131, a left ultraviolet sensor 132, a front ultraviolet sensor 133, an RTC 134 (corresponding to a "clock circuit"), and a vibrator 135. They are connected to each other via a bus 140 that connects the components. A GPS sensor is an example of a sensor used for position acquisition in a global satellite navigation system, and sensors with different names may be used depending on regions and countries.

The network communication device 120 is, for example, a short-range wireless communication device or a wireless LAN communication device. Network communicator 120 is connected to antenna 123 . The HMD 10 is connected to a communication network 9 such as a domestic LAN or the Internet through a network communication device 120 and an antenna 123 . The network communication device 120 may also transmit and receive data to and from the server 2 via the communication network 9 . The network communication device 120 may be a terminal for making a wired communication connection, such as a USB terminal.

The short-range wireless communication device is a wireless device such as Bluetooth (registered trademark), IrDA (Infrared Data Association, registered trademark), Zigbee (registered trademark), HomeRF (Home Radio Frequency, registered trademark), or Wi-Fi (registered trademark). A communication device compatible with the LAN communication method may be used.

The memory 128 is composed of flash memory and non-volatile memory. The memory 128 also stores programs 126 such as an OS (Operating System), an ultraviolet monitoring application, map navigation, and data 127 used by the processor 125 .

The processor 125 is composed of, for example, a CPU.

Since the amount of ultraviolet rays can be measured with one of the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133, any one of them may be used in the first embodiment. However, in an embodiment in which the irradiation direction of ultraviolet rays is also detected, the HMD 10 is equipped with a plurality of ultraviolet sensors.

The out-camera 111 is used for photographing the surroundings. The number and arrangement are not limited to this place.

The in-camera 112 is a camera that measures the line of sight of the user. The opening and closing of the eyes can also be detected from the in-camera image generated by the in-camera 112 .

In this embodiment, the control device including the processor 125 and the memory 128 is configured integrally with the HMD 10, but the control device is configured with a smart phone or a mobile information terminal (a personal computer is also acceptable at home) and configured separately from the HMD 10. may

FIG. 3 is a block diagram showing the functional configuration of the HMD.

The processor 125 of the HMD 10 reads the operating system program, the ultraviolet monitoring program, and the map navigation application from the program 126 in the memory 128, develops them in the work area, and executes them, thereby obtaining a measurement data acquisition unit 125a, a target value setting unit 125b, Functional units such as an ultraviolet light analysis unit 125c, a sunlight direction analysis unit 125d, a navigation unit 125e, an action analysis unit 125f, an input sound processing unit 125g, an image analysis unit 125h, a display control unit 125i, and an output sound processing unit 125j are realized.

The input sound processing unit 125g analyzes the sound collected by the microphone 121 and constitutes the sound input device of the HMD 10.

The output audio processing unit 125j outputs audio from the speaker 122 and constitutes an audio output device for warnings and guidance.

The functions of other parts will be described later with reference to the flowchart. It is not necessary to include all of the functional units described above, and it is only necessary to include the functional units necessary for each embodiment.

Each storage area in which the data 127 of the memory 128 is stored includes a measurement data storage section 128a, a target value storage section 128b, and a map information storage section 128c.

The measurement data storage unit 128a stores measured values of ultraviolet rays obtained from the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133, respectively. Information indicating the place of measurement and the date and time of measurement is added to the measured value as necessary.

The target value storage unit 128b stores various target values that the UV analysis unit 125c compares with the UV cumulative amount on the measurement target day, specifically, the cumulative amount lower limit value N1, the cumulative amount upper limit value N2, and the fluctuation cumulative amount upper limit value N3. remembered. Details of each target value will be described later.

The map information storage unit 128c stores map information that the navigation unit 125e refers to when searching for a route.

FIG. 4 is a flowchart showing the processing flow of the HMD 10 according to the first embodiment. FIG. 5 is a diagram showing an example of transition of the integrated amount of ultraviolet rays.

When the HMD 10 starts up, the processor 125 reads out the ultraviolet monitoring program from the memory 128 and starts processing.

First, the user sets the lower limit value N1 (see FIG. 5) and the upper limit value N2 (see FIG. 5) of the integrated amount of ultraviolet light that are allowed in the measurement period T_count for measuring the integrated amount of ultraviolet light (S01). The integrated amount lower limit value N1 is the necessary amount for producing vitamin D and is the minimum amount of ultraviolet rays that should be exposed, and corresponds to the recommended irradiation value. The integrated amount upper limit value N2 corresponds to the upper limit value of the allowable amount of ultraviolet rays. A person who does not want to tan as much as possible may set N1=N2.

The right ultraviolet sensor 131, left ultraviolet sensor 132, and front ultraviolet sensor 133 start measuring the amount of ultraviolet rays. The ultraviolet analysis unit 125c acquires ultraviolet measurement values from the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133, stores them in the measurement data storage unit 128a, and calculates an integrated ultraviolet amount U (S02 ).

When the integrated amount is calculated by adding the measured values of the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133, the integrated amount increases as the number of sensors increases. The accuracy of the comparison of Therefore, the ultraviolet analysis unit 125c may calculate the integrated amount of any one of the measured values of the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133. FIG. Further, the ultraviolet analysis unit 125c may add up the measured values of the respective ultraviolet sensors and divide the result by the number of sensors as the ultraviolet integrated amount U.

The ultraviolet ray analysis unit 125c compares the ultraviolet ray accumulated amount U and the accumulated amount upper limit value N2. If it is less than T_count (S05: No), the process returns to step S02 to continue the measurement of the amount of ultraviolet rays and the calculation of the integrated amount of ultraviolet rays U.

On the other hand, the ultraviolet analysis unit 125c displays a warning on the display 119 when the ultraviolet integrated amount U is equal to or greater than the integrated amount upper limit value N2 (S03: Yes) (S04). If the elapsed time T from the start of measurement is less than the measurement period T_count, the process returns to step S02, and the measurement of the amount of ultraviolet rays and the calculation of the integrated amount of ultraviolet rays U are continued.

When the elapsed time T from the start of measurement reaches the measurement period T_count (S05: Yes), the process ends.

In FIG. 5, the measurement period T_count is set to 24 hours, the measurement start time is set to 0:00, the measurement end time is set to 24:00, and the lower limit value N1 and the upper limit value N2 of the cumulative amount of UV rays per day are set. After sunrise, the UV integrated amount U increases, and after sunset, the UV integrated amount U does not increase. If the integrated amount of ultraviolet rays is less than N2, the warning display in step S04 is not performed.

The ultraviolet ray analysis unit 125c may provide information to the user when the daily ultraviolet ray accumulated amount U is less than the accumulated amount lower limit value (required amount) N1.

FIG. 6 is a diagram showing an example of warning display.

The ultraviolet analysis unit 125c performs display control (corresponding to one aspect of "warning output control") for displaying warning information on the display control unit 125i. In response, the display control unit 125i notifies the display 119 of text information 119a as warning information.

As another example of "warning output control", the ultraviolet analysis unit 125c may instruct the output sound processing unit 125j to output warning information by voice, and output the sound from the speaker 122.

According to the present embodiment, a warning can be issued when the integrated amount of ultraviolet rays U becomes equal to or greater than the integrated amount upper limit value N2. As a result, the adverse effects on the human body caused by overexposure to ultraviolet rays can be reduced. In particular, by installing an ultraviolet sensor in the HMD 10, it is possible to monitor the integrated amount of ultraviolet rays U on the face, so that it is possible to anticipate the effect of preventing sunburn, blemishes, and wrinkles on the face caused by ultraviolet rays.

<Second embodiment>
In the second embodiment, an estimated curve indicating the temporal transition of the estimated value of the integrated amount of ultraviolet light is obtained, and the integrated amount of ultraviolet light U (actually measured value) is a predetermined ratio (“permissible divergence This is an embodiment in which a warning is displayed when the ratio is equal to or greater than the ratio.

The permissible deviation ratio is determined in advance. The permissible deviation ratio may be changed for each hour. For example, a warning may be given loosely in the morning and even a small difference in the evening.

FIG. 7 is a flowchart showing the processing flow of the ultraviolet monitoring system according to the second embodiment.

Following step S2, the ultraviolet analysis unit 125c generates an estimated curve of the accumulated amount of ultraviolet rays and compares it with the current accumulated amount of ultraviolet rays U (S11).

The ultraviolet light analysis unit 125c may generate an estimated curve of the accumulated ultraviolet light amount on the day of measurement based on the moving average of the accumulated ultraviolet light amount U per day in the most recent past, for example, the past one week. Also, the transition of the accumulated amount of ultraviolet rays U on the same day of the same month in the past may be used as the estimated curve on the day of measurement. The process of generating an estimated curve is not limited to the above example.

The ultraviolet analysis unit 125c compares the estimated amount on the estimated curve with the current integrated ultraviolet amount U (S11).

FIG. 8 is a diagram showing an example of an estimated curve of the integrated amount of ultraviolet rays.

The ultraviolet analysis unit 125c reads out the estimated amount on the estimated curve at the same time as the current time, and performs a comparison operation between the estimated amount and the current integrated ultraviolet amount U by the following equation (1).
UV integrated amount U/estimated amount on the estimated curve≧permissible divergence ratio (1)

If the result of determination in step S11 is affirmative (S12: Yes), a warning is displayed (S04). If the answer is negative (S12: No), the process proceeds to step S05, as in the first embodiment.

According to the present embodiment, a warning is issued when the current integrated amount of ultraviolet rays U increases with respect to the estimated curve by more than the permissible divergence ratio. As a result, when the integrated amount of ultraviolet rays U rapidly increases (increases more than the permissible divergence ratio), a warning is given before the integrated amount of ultraviolet rays U reaches the upper limit value N2 of the accumulated amount, thereby avoiding action from the ultraviolet rays. can be encouraged.

<Third Embodiment>
The third embodiment is an embodiment that sets an integrated amount upper limit value (referred to as “fluctuation integrated amount upper limit value”) N3 to be used in the next measurement period based on the ultraviolet ray integrated amount for a plurality of days. In the description of the third embodiment, the integrated amount upper limit value N2 is referred to as the fixed integrated amount upper limit value N2 in order to more clearly distinguish it from the variable integrated amount upper limit value N3.

FIG. 9 is a flowchart showing the processing flow of the ultraviolet monitoring system according to the third embodiment.

After step S05, the target value setting unit 125b determines the fluctuation integrated amount upper limit value N3 and stores it in the target value storage unit 128b (S06). After that, the process ends.

The integrated fluctuation amount upper limit value N3 is set so that the total amount of ultraviolet rays that the user has been exposed to over multiple days does not exceed the fixed integrated amount upper limit value N2 x the number of days for multiple days. to decide. If the measurement period is from 0:00 to 24:00, the "next measurement period" can be rephrased as the next day.

FIG. 10 is an explanatory diagram showing the process of determining the integrated fluctuation amount. In this example, the number of days is set to seven days, and the target is that the integrated amount of ultraviolet light for one week does not exceed seven times the fixed upper limit N2 of integrated amount. Therefore, the target value setting unit 125b obtains the excess amount Δ1 by subtracting five times the integrated amount upper limit value N2 from the total value of the UV integrated amounts for the previous five days, as the fluctuation integrated amount upper limit value N3. If the excess amount Δ1 is offset only on the sixth day, the target value setting unit 125b may determine the upper limit value N3 of the integrated fluctuation amount using the following equation (2).
N3=N2-Δ1 (2)

As another example, the target value setting unit 125b may determine the upper limit value N3 of the integrated fluctuation amount using the following equation (3) when the excess amount Δ1 is offset in two days, the sixth day and the seventh day.
N3=N2-(Δ1/2) (3)

The period of one week for determining the upper limit value N3 of the integrated fluctuation amount is merely an example, and a longer or shorter period may be used.

In step S01 after the start of the next measurement, the target value setting unit 125b reads out the upper limit value N3 of integrated fluctuation amount from the target value storage unit 128b. Compare with Then, in the next measurement period, the ultraviolet analysis unit 125c outputs a warning in step S04 when the integrated amount of ultraviolet light U becomes equal to or greater than the upper limit value N3 of integrated amount of fluctuation.

According to the present embodiment, the upper limit value N3 of the accumulated amount of fluctuation is calculated based on the accumulated amount for a plurality of days, the accumulated amount of ultraviolet rays is analyzed, and a warning can be issued as necessary. It is possible to flexibly monitor the amount of UV irradiation.

(Modification 1)
When the cumulative amount of ultraviolet rays U for a certain period of time (for example, one week, one month, etc.) is below the lower limit value N1 for a long period of time, the target value setting unit 125b sets the threshold value of damage to the skin. As the upper limit, the reference value+difference (insufficient amount of ultraviolet rays) may be determined as the upper limit of the integrated fluctuation amount.

(Modification 2)
The ultraviolet analysis unit 125c does not need to issue a daily warning when the integrated amount falls below the lower limit N1, but when the integrated amount lower limit N1 continues for too long, it displays a warning to the effect that the amount of ultraviolet light is low. You may encourage the action of basking in ultraviolet rays.

<Fourth Embodiment>
The fourth embodiment is an embodiment in which a virtual reality object is displayed by detecting the direction of irradiation of ultraviolet rays together with the integrated amount of ultraviolet rays.

FIG. 11 is a flowchart showing the processing flow of the ultraviolet monitoring system according to the fourth embodiment.

When the UV analysis unit 125c determines that the UV integrated amount U has reached or exceeded the integrated amount upper limit value N2 (S03: Yes), the UV analysis unit 125c analyzes the direction in which the UV irradiation amount is high (S21). At that time, the user may move his/her head so that the measurement can be performed with higher accuracy.

FIG. 12 is an explanatory diagram of the ultraviolet irradiation direction.

The ultraviolet analysis unit 125c compares the measured values measured at the same time by the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133, and determines the direction with the highest intensity as the ultraviolet irradiation direction.

Based on this, the display control unit 125i displays a virtual reality object consisting of an ultraviolet mark 119b indicating the irradiation direction of ultraviolet rays, a figure, a warning, etc. (S22). More specifically, the image analysis unit 125h performs subject detection processing on the real-world image captured by the out-camera 111, and detects objects that can block ultraviolet rays, such as curtains and parasols. The display control unit 125i displays information prompting closing of the curtains and a virtual reality object indicating the direction in which the parasol should be held so as to overlap the possible subjects on the display 119 .

FIG. 13 is an explanatory diagram showing an example of a virtual reality object indicating the ultraviolet irradiation direction.

The display control unit 125i displays on the display 119 text information 119a warning that ultraviolet rays are strong. An ultraviolet mark 119b is displayed on the display 119 to indicate the direction in which stronger ultraviolet rays are irradiated. Since the display 119 is of a transmissive type, the user sees a mixed reality image in which the ultraviolet mark 119b is superimposed on the real world 119r (window in this example) that is actually viewed through the display 119 .

According to this embodiment, the ultraviolet analysis unit 125c detects the direction in which the intensity of the ultraviolet rays is high, and displays the irradiation direction on the display 119 as a virtual reality object, thereby avoiding ultraviolet rays, such as putting up a curtain or shielding objects. , making it easier to reduce the amount of UV exposure. In particular, direct light from a window, the sun, etc. is easy for the user to notice, but it is difficult for the user to notice UV exposure due to reflected light from a white wall. can be expected to reduce

<Fifth Embodiment>
The fifth embodiment is an embodiment that displays the direction of the sun together with the direction of ultraviolet rays. For example, when using a parasol outdoors, it may be difficult to see the direction of the sun, and on cloudy days, the parasol may not be properly used to block ultraviolet rays. Furthermore, even if sunlight is blocked, the reflected light may be strong. Therefore, in this embodiment, in order to cope with both, the direction of the sun is calculated based on the current location, the direction of the user, the date and time, etc., and if the amount of ultraviolet rays from the direction of the sun and other directions is strong, a virtual Show real objects.

FIG. 14 is a flowchart showing the processing flow of the ultraviolet monitoring system according to the fifth embodiment.

When the sunlight direction analysis unit 125d determines that the integrated amount of ultraviolet rays U has reached or exceeded the integrated amount upper limit value N2 (S03: Yes), it acquires the direction of the sun (S31). Specifically, the sunlight direction analysis unit 125d acquires the direction in which the front of the HMD 10 faces (north, south, east, and west directions) from the direction sensor 117 mounted on the HMD 10, current position information from the GPS sensor 118, and time information from the RTC 134. . Then, the server 2 (see FIG. 2) is inquired about the direction of sunlight at the current time at the current position, and response information is obtained.

The sunlight direction analysis unit 125d calculates in which direction on the display 119 of the HMD 10 an arrow indicating the irradiation direction of sunlight should be drawn based on the direction of the sun in the absolute coordinate system and the direction in which the HMD 10 faces. Output to the display control unit 125i.

On the other hand, the ultraviolet analysis unit 125c calculates the irradiation direction of ultraviolet rays (S21). Steps S31 and S21 may be performed in reverse order.

The display control unit 125i displays a virtual reality object indicating the irradiation direction of sunlight and the irradiation direction of ultraviolet rays (S32). As an example, when the direct light is strong, it may block the direct light or show a suggestion to turn the face, or even if the direct light is blocked, when the reflected light is strong, the reflected light may be blocked or the location may be changed. A display suggesting movement may be provided.

FIG. 15 is an explanatory diagram showing an example of a virtual reality object showing the irradiation direction of sunlight and the direction of ultraviolet irradiation.

The display control unit 125i displays on the display 119 text information 119a warning that the ultraviolet rays are strong, an ultraviolet mark 119b indicating the direction in which the strong ultraviolet rays are emitted, and an arrow 119c indicating the irradiation direction of the sunlight. . In the example of FIG. 15, when the irradiation of ultraviolet rays due to reflection from the ground is strong, such as asphalt or a ski resort, a direction different from the irradiation direction of sunlight, specifically, an ultraviolet mark on the running surface 119g of the road surface or the slope 119b is a virtual reality object. In the text information 119a, information may be displayed that guides the person to turn the face in a direction where the amount of ultraviolet rays is low.

In this embodiment, when the user is exposed to strong ultraviolet rays from a direction different from the irradiation direction of the sunlight, such as reflection from the ground, the user can be encouraged to avoid the ultraviolet rays in a direction different from the sunlight. , a reduction in the integrated amount of ultraviolet rays U can be expected.

(Modification 3)
The ultraviolet analysis unit 125c may estimate a direction in which the amount of ultraviolet rays is small (for example, a dark place on the same wall) from the ultraviolet image, and display it on the display 119 so that the face is turned to that direction.

<Sixth Embodiment>
The sixth embodiment is an embodiment that separates UV-A (ultraviolet A wave) and UV-B (ultraviolet B wave) and determines the type of warning based on each numerical value. UV-B has the characteristic of making it easy to get sunburned in a short period of time, but the seasons when UV-A and UV-B are strong differ. Therefore, the allocation value is decided according to the actual measurement and the season.

FIG. 16 is a flow chart showing the processing flow of the ultraviolet monitoring system according to the sixth embodiment.

In step S02, the ultraviolet analysis unit 125c performs frequency analysis on the ultraviolet rays detected by the right ultraviolet sensor 131, the left ultraviolet sensor 132, and the front ultraviolet sensor 133. Then, a measured value belonging to the UV-A frequency and a measured value belonging to the UV-B frequency are obtained for each sensor to calculate an integrated amount. As a result, integrated amounts of UV-A and UV-B are obtained for each sensor.

In step S03, the UV analysis unit 125c compares the UV integrated amount U, which is the sum of the UV-A and UV-B integrated amounts, with the integrated amount upper limit value N2. If the result is affirmative, a warning is displayed (S04).

If not, the UV analysis unit 125c compares the UV-A integrated amount upper limit value N2A set in advance with the UV-A integrated amount UA. Even if the UV integrated amount U is less than the integrated amount upper limit N2 (S02: No), if the UV-A integrated amount UA is equal to or greater than the UV-A integrated amount upper limit N2A (S41: Yes), a warning is displayed. (S04).

As described above, in the present embodiment, even if the UV integrated amount U is less than the integrated amount upper limit value N2, a warning is issued if the UV-A is equal to or greater than the UV-A integrated amount upper limit value N2A. Ultraviolet monitoring can be performed by focusing on high UV-A.

<Seventh Embodiment>
The seventh embodiment is an embodiment for predicting the amount of ultraviolet rays that the vehicle will be exposed to when passing through the route to the destination from the direction of sunlight and map information.

FIG. 17 is a flowchart showing the processing flow of the ultraviolet monitoring system according to the seventh embodiment.

In the seventh embodiment, navigation processing of steps S51 to S56 described below is executed in parallel with the ultraviolet monitoring processing described in the first to sixth embodiments.

First, in step S01, an integrated amount lower limit value N1 and an integrated amount upper limit value N2 are set (S01).

After that, the ultraviolet monitoring process from step S02 to step S05 is executed. In step S02, in preparation for the next navigation process, the measurement data acquisition unit 125a adds the position information of the measurement point acquired from the GPS sensor 118 and the time information of the measurement date and time acquired from the RTC 134 to the measurement value. It is stored (associated) in the measurement data storage unit 128a.

Wait until the navigation process starts (S51: No).

Before going out, the user activates the navigation process, for example, taps the navigation application icon to activate the navigation unit 125e (S51: Yes), and inputs the current location and destination (S52).

The navigation unit 125e searches for a route from the current location to the destination. The behavior analysis unit 125f searches the measurement data storage unit 128a, extracts measurement data linked to points on each route, and further extracts measurement data included from the departure time to the arrival time. Then, the measurement values included in the extracted measurement data are integrated to calculate the predicted value of the integrated amount of ultraviolet rays when each route is passed (S53).

The navigation unit 125e displays on the display 119 at least one or more routes with the amount of UV light calculated by the behavior analysis unit 125f added to the route (S54).

When the user gives an input instruction to start navigation (S55: Yes), the navigation unit 125e receives the current position from the GPS sensor 118 and updates the current position (S56). After that, the update of the current location is continued until the navigation application is stopped (S57: No).

If the user does not start navigation (S55: No), or if the user inputs to stop the navigation app (S57: Yes), stop the navigation app and return to step S51.

According to this embodiment, the measured values of ultraviolet rays linked to past measurement locations and measurement times are stored, and a route is searched when an instruction to search for a route to a destination is received. Then, the behavior analysis unit 125f refers to the past measurement data, calculates and presents a predicted value of the amount of ultraviolet rays that the driver will be exposed to when the searched route is taken. Seeing this, the user can select a route in consideration of the amount of ultraviolet rays.

　Since the amount of UV rays varies depending on the height of the building and the reflection of sunlight from the surroundings, even if it is simply calculated based on the map information, it will deviate greatly from the actual amount of UV rays. On the other hand, in the present embodiment, since the amount of ultraviolet rays for each route is integrated based on the past action history, it is possible to predict the amount of ultraviolet rays that is more realistic.

The invention made by the present inventor has been specifically described above based on the embodiment, but the present invention is not limited to the above embodiment, and various changes can be made without departing from the gist of the invention. Needless to say.

For example, when the in-camera 112 detects whether the user's eyes are open or closed, the user takes a nap in a place where the amount of ultraviolet rays is relatively high, such as outdoors or near a window, and the amount of ultraviolet rays above a predetermined level is detected while the user is sleeping. may change the notification form of the warning from display to voice output or vibration by the vibrator 135 .

In addition, the content of the warning can be used not only when the amount of ultraviolet rays is exceeded or is predicted to be exceeded, such as when comparing the upper limit value N2 of the integrated amount, but also when the user wants to get a tan and want to stop at an appropriate point. For example, a warning may be issued based on the result of inputting a desired amount of ultraviolet rays and comparing that value with the accumulated amount of ultraviolet rays U. FIG.

In addition, as the content of the warning, not only when the amount of ultraviolet rays exceeds or is predicted to exceed, such as comparing the upper limit value N2 of the integrated amount, but also guidance such as shifting to the head so as not to leave a sunburn mark by the HMD 10 may be output. good. In this case, guidance for shifting the position of the HMD 10 may be output when, for example, the half value of the integrated amount upper limit value N2 is exceeded or the predetermined ultraviolet exposure time is exceeded.

In addition to the HMD 10, the present embodiment may be realized by mounting an ultraviolet sensor on another wearable terminal and placing it in close proximity to the user's body.

　Preferably, it is a wearable terminal that has a frame that can hold an ultraviolet sensor near the user's face.

More preferably, it is a wearable terminal having an output device that outputs warning information when the amount of ultraviolet rays increases, such as a speaker, vibrator, or display.

Typical examples include smart glasses, wireless earphones, wireless headphones, and wireless microphones. In addition, although it is difficult to bring a smartwatch or smartphone close to the face, the distance from the face to the part where the smartwatch or smartphone is worn is measured by the distance sensor 113, and the measured value of ultraviolet rays is corrected by the detected distance. , can be used as a wearable terminal suitable for this embodiment.

A wearable terminal according to this embodiment includes at least one ultraviolet sensor, an output device that outputs a warning, and a frame that holds the ultraviolet sensor near the face of a user wearing the wearable terminal and that holds the output device. and a communicator for communicating with a control device including a memory and a processor to transmit and receive data to and from the control device. That is, the frame holding the ultraviolet sensor and the control device may be configured separately.

Then, the wearable terminal may hold an ultraviolet sensor near the face, measure the amount of ultraviolet rays hitting the face, send the measured value to a control device such as a smartphone using short-range wireless communication, and monitor the amount of ultraviolet rays. A warning may be output from a wearable terminal, or may be output from a device equipped with a control device, such as a smart phone.

In addition, in each of the above-described embodiments, the ultraviolet irradiation amount of the user's face is monitored, but the ultraviolet irradiation amount of other parts including the user's face may be monitored in addition to the face.

For example, when the user goes out, the out-camera 111 captures the image of the user reflected in the mirror, and the image analysis unit 125h performs face recognition processing and skin color detection processing on the image.

Next, the image analysis unit 125h calculates the exposed skin area S1 and the face area S2 of the user and outputs them to the ultraviolet analysis unit 125c. The ultraviolet analysis unit 125c performs ultraviolet monitoring processing by converting the ultraviolet measurement value to (S1/S2) times. As a result, the HMD 10 measures the UV integrated amount U near the face and corrects it by the exposure area ratio (S1/S2), thereby performing UV monitoring processing including the user's body area.

The embodiment includes the following forms.
(Appendix 1)
a head-mounted display,
at least one ultraviolet sensor;
a display;
memory;
a processor;
The processor
storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
Integrating the measured values to calculate an integrated amount of ultraviolet rays,
comparing the cumulative amount of ultraviolet rays with an upper limit cumulative amount, which is a permissible limit value of the cumulative amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
When it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more, display control of a warning is performed on the display.
head mounted display.

(Appendix 2)
A wearable device,
at least one ultraviolet sensor;
an output device that outputs a warning;
a frame holding the ultraviolet sensor near the face of a user wearing the wearable terminal and holding the output device;
a communicator that communicates with a controller that includes a memory and a processor;
The control device is
storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
Integrating the measured values to calculate an integrated amount of ultraviolet rays,
comparing the cumulative amount of ultraviolet rays with an upper limit cumulative amount, which is a permissible limit value of the cumulative amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
when it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more, sending warning information to the output device;
The output device outputs the received warning information,
wearable device.

(Appendix 3)
An ultraviolet monitoring method performed by a wearable terminal comprising at least one or more ultraviolet sensors, a memory, and a processor,
the processor
a step of storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
a step of calculating an integrated amount of ultraviolet rays by integrating the measured values;
a step of comparing the integrated amount of ultraviolet rays with an integrated amount upper limit value that is a permissible limit value of the accumulated amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
a step of controlling output of a warning when it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more;
Ultraviolet monitoring method comprising:

2: Server 9: Communication network 10: HMD
11 : Frame 111 : Out camera 112 : In camera 113 : Ranging sensor 114 : Illuminance sensor 115 : Acceleration sensor 116 : Gyro sensor 117 : Orientation sensor 118 : GPS sensor 119 : Display 119a : Text information 119b : Ultraviolet mark 119c : Arrow 119g: sliding surface 119r: real world 120: network communication device 121: microphone 122: speaker 123: antenna 124: timer 125: processor 125a: measurement data acquisition unit 125b: target value setting unit 125c: ultraviolet analysis unit 125d: sunlight direction Analysis unit 125e: Navigation unit 125f: Behavior analysis unit 125g: Input sound processing unit 125h: Image analysis unit 125i: Display control unit 125j: Output sound processing unit 126: Program 127: Data 128: Memory 128a: Measurement data storage unit 128b: Target value storage unit 128c: map information storage unit 130: power button 131: right ultraviolet sensor 132: left ultraviolet sensor 133: front ultraviolet sensor 134: RTC
135: Vibrator 140: Bus

Claims

a head-mounted display,
at least one ultraviolet sensor;
a display;
memory;
a processor;
The processor
storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
Integrating the measured values to calculate an integrated amount of ultraviolet rays,
comparing the cumulative amount of ultraviolet rays with an upper limit cumulative amount, which is a permissible limit value of the cumulative amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
When it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more, display control of a warning is performed on the display.
head mounted display.
The head mounted display according to claim 1,
The processor calculates an estimated curve showing the temporal transition of the integrated amount of ultraviolet rays during the measurement period based on the past measured values of ultraviolet rays stored in the memory,
Compare the measured value obtained from the ultraviolet sensor and the estimated amount of ultraviolet light at the time of measurement on the estimated curve,
When it is determined that the measured value has increased by a predetermined allowable divergence ratio or more with respect to the estimated amount of ultraviolet rays, display control of the warning is performed.
head mounted display.
The head mounted display according to claim 1,
The measurement period is one day,
The processor determines an upper limit value of integrated amount of change, which is an upper limit value of integrated amount for one day on the measurement target day, based on the accumulated ultraviolet light amount for a plurality of days past the measurement target day,
Comparing the integrated amount of the measured value obtained from the ultraviolet sensor on the measurement target day and the upper limit of the integrated fluctuation amount,
When it is determined that the integrated amount of the measured value has increased to the upper limit of the integrated variation amount or more, display control of the warning is performed.
head mounted display.
The head mounted display according to claim 1,
The head mounted display comprises a plurality of the ultraviolet sensors,
The processor determines an irradiation direction in which the intensity of ultraviolet rays striking the head-mounted display is relatively strong based on the measured values obtained from each of the plurality of ultraviolet sensors;
displaying a virtual reality object indicating the irradiation direction on the display;
head mounted display.
The head mounted display according to claim 4,
the processor detects the direction of the sun;
further displaying a virtual reality object indicating the direction of the sun on the display;
head mounted display.
The head mounted display according to claim 1,
The processor performs frequency analysis on the ultraviolet rays detected by the ultraviolet sensor,
calculating the integrated amount of ultraviolet A waves and the integrated amount of ultraviolet B waves by discriminating between ultraviolet A waves and ultraviolet B waves;
Comparing the integrated amount of the ultraviolet A wave with a predetermined upper limit of the integrated amount of the ultraviolet A wave,
When it is determined that the integrated amount of the ultraviolet A wave has increased to the upper limit of the integrated amount of the ultraviolet A wave or more, the display control of the warning is performed.
head mounted display.
The head mounted display according to claim 1,
a GPS sensor;
a clock circuit;
The processor receives from the GPS sensor position information of the place where the measured value was measured, receives time information at which the measured value was measured from the clock circuit, and adds the position information and the time information to the measured value. Store the linked measurement data in the memory,
When the input of the current location and the destination and the search instruction of the route from the current location to the destination are received, the route is searched, and based on the measurement data, the integrated amount of ultraviolet rays is predicted when the searched route is taken. calculating a value and displaying it on the display along with the searched route;
head mounted display.
A wearable device,
at least one ultraviolet sensor;
an output device that outputs a warning;
a frame holding the ultraviolet sensor near the face of a user wearing the wearable terminal and holding the output device;
a communicator that communicates with a controller that includes a memory and a processor;
The control device is
storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
Integrating the measured values to calculate an integrated amount of ultraviolet rays,
comparing the cumulative amount of ultraviolet rays with an upper limit cumulative amount, which is a permissible limit value of the cumulative amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
when it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more, sending warning information to the output device;
The output device outputs the received warning information,
wearable device.
An ultraviolet monitoring method performed by a wearable terminal comprising at least one or more ultraviolet sensors, a memory, and a processor,
the processor
a step of storing the measured value of ultraviolet rays detected by the ultraviolet sensor in the memory;
a step of calculating an integrated amount of ultraviolet rays by integrating the measured values;
a step of comparing the integrated amount of ultraviolet rays with an integrated amount upper limit value that is a permissible limit value of the accumulated amount of ultraviolet rays that the user is exposed to within a predetermined measurement period;
a step of controlling output of a warning when it is determined that the integrated amount of ultraviolet rays has increased to the upper limit of the integrated amount or more;
Ultraviolet monitoring method comprising: