JP6930618B2 - Navigation systems, client terminals, control methods, storage media, and programs - Google Patents

Description

The present disclosure relates to navigation systems, client terminal devices, control methods , storage media , and programs .

In recent years, with the development of communication technology, in an emergency such as a disaster, disaster warnings and disaster information are transmitted, and evacuation guidance is presented to users.

Regarding the presentation of evacuation guidance to the user, for example, techniques such as the following Patent Documents 1 to 3 have been proposed. Specifically, in Patent Document 1 below, the victim is asked to select whether to wait for rescue or to evacuate by himself / herself on the TV screen or the like, and the evacuees can take an evacuation route to a highly safe place. A system that supports activities as a civilian rescue team is disclosed by presenting and notifying the rescuers on the route.

Further, in Patent Document 2 below, voice information (road traffic information) representing a traffic jam situation visually recognized by the driver is uploaded to the server, and in response to a request from the driver in each area, via the corresponding area server. , A system in which road traffic information is distributed and voice guidance is disclosed.

Further, in Patent Document 3 below, the head-mounted display type guidance device that guides the user recognizes a surrounding object, and when the recognized object exists in the guidance path, the degree of temptation to the user of the object is increased. A system is disclosed in which a user can be moved according to a guidance route by adjusting and adjusting so as to reduce the degree of temptation when the user is not present in the guidance route.

Japanese Unexamined Patent Publication No. 2013-25653 Japanese Unexamined Patent Publication No. 2013-218477 WO2006 / 080344

However, for evacuation guidance in an emergency such as a disaster, it is desirable to present information and induce actions in a hands-free situation, and there is a problem that the conventional guidance method using a smartphone, a tablet terminal, or the like blocks the hand. In addition, in an emergency situation where the moment is competing, it is difficult to intuitively grasp which way to escape by presenting information using a map application, etc., and by gazing at the screen, it is cut off from the external environment and the surroundings are affected. There was also the problem of distraction and danger.

In addition, in the conventional evacuation guidance, it is assumed that the evacuation site will be guided to the nearest evacuation site among the locations registered in advance by the local government as an evacuation site based on the disaster risk location map, etc. It is unclear how the evacuees are currently feeling and feeling. Therefore, even if the guided evacuation site is a safe place from the viewpoint of disaster, it is a place where the evacuated people feel uneasy for some reason, and there are frequent conflicts and troubles between evacuees. It is assumed that it may be a place, and such an evacuation place is not preferable as an evacuation guidance destination in consideration of staying for a long time.

Therefore, the present disclosure proposes a navigation system, a client terminal device, a control method, a storage medium , and a program that can guide a person to a place with a high degree of security based on emotional information of people associated with the place.

According to the present disclosure, the acquisition unit that acquires the position information indicating the position of the client terminal device and the information related to the user's emotion of the client terminal device, and the position information and the information related to the user's emotion are included. Based on this, a generation unit that generates an emotion map by generating a degree of security of the position represented by the position information, an environment map generation unit that generates an environment map showing the distribution of the safety degree, the emotion map, and the environment map. Generates an estimation unit that estimates a location with a high degree of security and safety, and guidance for guiding the user of the client terminal device to the location with a high degree of security and security according to the integrated map. We propose a navigation system including a guidance generation unit for providing guidance and a providing unit for providing the guidance to a user of the client terminal device.

According to the present disclosure, the position information detection unit that detects the position of the client terminal device and generates the position information representing the position, the detection unit that detects the information related to the user's emotion of the client terminal device, and the above. Represented by a transmitter that transmits position information and information related to the user's emotions to an external device, and the position information generated by the external device based on the position information and information related to the user's emotions. The degree of security and safety are high according to the acquisition unit that acquires the emotion map showing the degree of security of the position and the environment map showing the distribution of the degree of safety, and the integrated map in which the emotion map and the environment map are integrated. We propose a client terminal device including an output unit that outputs guidance for guiding a user of the client terminal device to the user of the client terminal device at a place presumed to be.

According to the present disclosure, it is based on the acquisition of position information indicating the position of the client terminal device and information related to the emotion of the user of the client terminal device, and based on the position information and the information related to the emotion of the user. By generating the degree of security of the position represented by the location information, an emotion map is generated, and an environment map showing the distribution of the degree of safety is generated.
Estimate a place with a high degree of security and safety according to the integrated map in which the emotion map and the environment map are integrated, and guide the user of the client terminal device to the place with a high degree of security and safety. A control method is proposed, which includes generating guidance for the user and providing the guidance to the user of the client terminal device.

According to the present disclosure, the computer has a position information detection unit that detects the position of the client terminal device and generates position information indicating the position, and a detection unit that detects information related to the user's feelings of the client terminal device. And the transmission unit that transmits the position information and the information related to the user's emotion to the external device, and the position generated by the external device based on the position information and the information related to the user's emotion. Depending on the acquisition unit that acquires the emotional map that shows the degree of security of the position represented by the information and the environment map that shows the distribution of the degree of safety, and the integrated map that integrates the emotion map and the environment map, the degree of security and safety. A storage medium in which a program for functioning as an output unit that outputs guidance for guiding the user of the client terminal device to the user of the client terminal device in a place presumed to have a high degree is stored. suggest.

As described above, according to the present disclosure, it is possible to guide the user to a place with a high degree of security based on the emotional information of the people associated with the place.

It should be noted that the above effects are not necessarily limited, and together with or in place of the above effects, any of the effects shown herein, or any other effect that can be grasped from this specification. May be played.

It is a figure explaining the outline of the navigation system by one Embodiment of this disclosure. It is a figure explaining the whole structure of the navigation system by this embodiment. It is a block diagram which shows an example of the structure of the evacuation guidance server by this embodiment. It is a figure explaining concretely about the generation of the environmental heat map by this embodiment. It is a figure which shows an example of the emotion heat map by this embodiment. It is a figure explaining the calculation of the degree of security of the evacuation candidate area by this embodiment. It is a figure which shows an example of the graph which predicted the change with the passage of time of the degree of security by this embodiment. It is a figure which shows an example of the integrated heat map by this embodiment. It is a block diagram which shows an example of the configuration of the Kansei server by this embodiment. It is a block diagram which shows an example of the structure of HHMD by this embodiment. It is a flowchart which shows the evacuation guidance processing of the navigation system by this embodiment. It is a figure explaining the application example of the navigation system by this embodiment.

Preferred embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

In addition, the explanation shall be given in the following order.
1. 1. Outline of the navigation system according to the embodiment of the present disclosure 2. Basic configuration 2-1. Evacuation guidance server 2-2. Kansei server 2-3. Client terminal 3. Operation processing 4. Application example 5. summary

<< 1. Outline of navigation system according to one embodiment of the present disclosure >>
First, an outline of the navigation system according to the embodiment of the present disclosure will be described with reference to FIG. As shown in FIG. 1, the navigation system according to the present embodiment guides the user to a safe and secure place in an emergency such as a disaster, and is a head-mounted wearable device (HHWD: Head-Hack Wearable). Device) 3. The HHWD3 is mounted on a disaster prevention helmet that is supposed to be worn by the user at the time of evacuation, and can intuitively convey an evacuation instruction to the user by means of a bone conduction speaker or vibration to the head.

The navigation system according to the present embodiment is a safe place calculated by HHMD3a based on an environmental heat map showing a dangerous place according to a disaster category, and presents the current emotions of people in each area. Guide the user to a safe place calculated based on the emotional heat map shown. The emotions of people in each area are acquired from, for example, biological information acquired by HHMD3b to 3g, facial expressions, and the like.

For example, in the example shown in FIG. 1, area E1 is a place where the risk of disaster is high and people's anxiety is high, and area E2 is a place where the risk of disaster is low but people's anxiety is high. Therefore, the navigation system grasps that the area E3 is a place where the risk of disaster is low and the degree of security of people is high. In the conventional navigation system, it is assumed that the user is guided to the area E2 or E3 where the risk of a disaster is low. The user can be preferentially guided to the high area E3.

The outline of the navigation system according to the embodiment of the present disclosure has been described above. Subsequently, the overall configuration of the navigation system of the present embodiment will be described. FIG. 2 is a diagram showing an overall configuration of a navigation system according to the present embodiment. As shown in FIG. 2, the navigation system according to the present embodiment includes an evacuation guidance server 1, a sensitivity server 2, an HHMD3, and a heat map server 4. These are connected, for example, via the Internet 5.

The evacuation guidance server 1 communicates with the HHMD3 via an access point or the like, and guides the user to evacuate to a safe and secure place via the HHMD3. Although one HHMD3 having a common configuration is shown in FIG. 2, the evacuation guidance server 1 has a large number of HHMD3a to 3g mounted on a disaster prevention helmet worn by a large number of users in the event of a disaster (see FIG. 1). To acquire biometric information, facial expression captured images, and current position information, which are emotional information factors.

In addition, the evacuation guidance server 1 is safe and secure by using an environmental heat map that shows dangerous places according to the disaster category acquired from the heat map server 4 and an emotion heat map that shows emotional information of people associated with the place. Estimate the location and guide the user. The environmental heat map may be acquired from the heat map server 4 or generated by the evacuation guidance server 1. In addition, the emotional information of people associated with the place can be acquired from the biological information of each user and the facial expression captured image received from a large number of HHMD3a to 3g. Further, the evacuation guidance server 1 according to the present embodiment may acquire the sensitivity values of people in the evacuation site from the sensitivity server 2 as an emotion information factor. The Kansei server 2 accumulates a "Kansei value" which is a specific index indicating what kind of person the person is. The "sensitivity value" is a quantification of feelings toward an object or person, which is calculated based on an evaluation value of an interaction (that is, an action) that occurs between a plurality of objects including a person or an object. For example, an object. A person who is treated roughly is judged to be a rough person because the sensitivity value is calculated to be low. If the sensitivity value is high, the person is judged to be a reliable person. Therefore, the evacuation guidance server 1 can be used when estimating a place with a high degree of security by acquiring the sensitivity values of people in the area from the sensitivity server 2 when estimating a safe place.

The overall configuration of the navigation system according to the present embodiment has been described above. Subsequently, the basic configuration of each device included in the navigation system of the present embodiment will be specifically described.

<< 2. Basic configuration >>
<2-1. Evacuation guidance server ＞
FIG. 3 is a block diagram showing an example of the configuration of the evacuation guidance server 1 according to the present embodiment. As shown in FIG. 3, the evacuation guidance server 1 has a control unit 10, a communication unit 11, and a storage unit 12.

(Control unit)
The control unit 10 controls each configuration of the evacuation guidance server 1. The control unit 10 is realized by a microcomputer provided with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and a non-volatile memory. Further, as shown in FIG. 3, the control unit 10 according to the present embodiment includes an HHMD position acquisition unit 10a, a user emotion acquisition unit 10b, an emotion heat map generation unit 10c, an environment heat map generation unit 10d, and a safe / secure location estimation unit. It also functions as 10e, an evacuation information generation unit 10f, and an evacuation guidance unit 10g.

The HHMD position acquisition unit 10a acquires the current position information of a large number of HHMD3s. The current position information of the HHMD3 is transmitted from, for example, the HHMD3, and is received by the communication unit 11. The HHMD position acquisition unit 10a outputs the acquired current position information of the HHMD3 to the emotion heat map generation unit 10c.

The user emotion acquisition unit 10b acquires information related to the emotion of the user wearing the HHMD3. The user's emotional information is assumed to be, for example, biosensor information, facial expression information, and activity amount transmitted from HHMD3, as well as SNS (Social Networking Service) information and sensitivity values. Specifically, for example, the biosensor information is an electroencephalogram, a heart rate, a body temperature, a blood glucose level, etc. acquired by a biosensor 33 (see FIG. 10) provided in the HHMD3. Further, the facial expression information is a facial expression such as a smile degree, an uneasy face degree, and an angry face degree recognized from the user's facial image, facial expression myoelectric potential, etc. captured by a camera which is an example of the environmental information sensor 34 provided in the HHMD3. It is a recognition result. The amount of activity is the amount of movement of the user detected by the acceleration, the geomagnetic sensor, the gyro sensor, etc., which is an example of the environmental information sensor 34 provided in the HHMD3, and the amount of speech of the user picked up by the microphone 37. .. Further, the SNS information is information that can be acquired from information on a network such as SNS, and for example, a new density of a user who guides evacuation and people existing in an evacuation candidate area is assumed. The new density can be calculated from, for example, whether or not there is a friendship on the SNS, the number of times the user has shown interest on the SNS, the ratio of favorable remarks based on the linguistic analysis result of the remarks exchanged with each other, and the like. In addition, the SNS information also includes the content analysis result of a text message written by a message tool, an e-mail, or the like, and these also include real-time information. Message tools are used by users in the event of a disaster to comment on their situation, anxiety, and tension, and to inform family and friends that they have been relieved to be in a safe place. It is possible to acquire real-time user emotions. Moreover, the sensitivity value is acquired from the sensitivity server 2. For example, the user emotion acquisition unit 10b may calculate the total amount of sensitivity values of people existing in the evacuation candidate area. As a result, it is effective in selecting an evacuation candidate area by grasping in advance what kind of person is evacuating, instead of using only temporary emotions (security level) as a judgment material.

The emotion heat map generation unit 10c generates a map in which the user emotion is associated with the user position and mapped. Here, FIG. 5 shows an example of the emotion heat map 42. As shown in FIG. 5, the emotion heat map generation unit 10c generates an emotion heat map 42 showing the distribution of relief and anxiety by mapping the user emotions associated with the location on the axes of relief and anxiety. Can be done. Here, the user emotion can be judged from various factors as described above. Therefore, the emotion heat map generation unit 10c may calculate the degree of security of the entire evacuation candidate area by using a plurality of types of user emotion information factors of a large number of users acquired by the user emotion acquisition unit 10b. It is also assumed that the user's emotions in the evacuation candidate area may change over time. FIG. 6 is a diagram for explaining the calculation of the degree of security of the evacuation candidate area. The graph 51 of the sensor value shown on the left side of FIG. 6 is a graph 51 showing an example of a change with time of each information serving as a user emotion information factor of people existing in the evacuation candidate area. In the present embodiment, the biosensor information, the facial expression information, and the amount of activity are acquired in real time, and a time change is expected. On the other hand, the SNS information and the sensitivity value are user emotion information factors that can be calculated and acquired later based on the accumulated information, and although it is difficult to assume a large change with the passage of time, the degree of security of the evacuation candidate area is calculated. It is referred to as a factor in doing so. As a result, the temporal changes in emotions due to the comings and goings of people in the evacuation candidate area can be grasped. Then, the emotion heat map generation unit 10c calculates a graph 52 of the degree of security as shown on the right side of FIG. 6 based on the graph 51. Further, as a specific calculation method of the degree of security / anxiety, the emotion heat map generation unit 10c may predefine or learn an evaluation function / model function using a user emotion information factor that changes with time, and calculate the evaluation function / model function. Conceivable. It is also conceivable to generate a rule table such as a score table as a guideline for "safety / anxiety" in advance and use this to calculate the security / anxiety in the evacuation candidate area. For example, depending on whether the biological information such as "heart rate" and "body temperature" is at an appropriate value, the total amount of positive emotions such as a smile, the amount of sudden change in each sensor measurement value, or the amount of time that exceeds an abnormal value. A score table is used.

In addition, in the event of a disaster, rescue activities will be given priority at sites that require emergency, so it is expected that systematic rescue activities for evacuated people will take place after several days have passed. Is required to evacuate independently, and it is expected that the evacuation life will be prolonged. Therefore, even in the evacuation candidate area where the degree of security is temporarily high, the degree of anxiety increases according to the elapsed time from the time of the disaster (trouble between evacuees, crimes, evacuation supplies arrive). Anxiety due to lack of it, etc.) is possible. Therefore, the emotion heat map generation unit 10c is not limited to the emotion heat map showing the temporary distribution of the degree of security / anxiety at a certain point in time, and is calculated by anticipating the evacuation candidate area where the degree of security is maintained for a long time. You may generate an emotional heatmap. For example, as shown in FIG. 7, the high degree of security lasts a long time from the occurrence of a disaster to the start of systematic rescue based on the graph 53 that predicts the change in the degree of security over time in areas E1, E2, E3, etc. An emotional heat map showing the distribution of the degree of security may be generated by determining the area to be used as an area with a high degree of security as a whole. It can be inferred that groups with high sensibility values and SNS information (new density) also have high group moral behavior, and since these have a low degree of attenuation with time, they are weighted as factors that can last a longer period of security. Therefore, it is used to calculate the evacuation candidate area where the degree of security lasts for a long time.

As described above, in the generation of the emotional heat map showing the distribution of the degree of security / anxiety, a map showing the distribution of the degree of security at a certain time may be generated, or the change with the passage of time may be taken into consideration. You may generate a map showing the distribution of areas with long-lasting security. Further, the emotion heat map generation unit 10c may generate a map showing the distribution of the degree of security by simulating the change in the degree of security / anxiety when the user to be guided actually joins the evacuation candidate area. good.

The environmental heat map generation unit 10d generates a heat map showing the distribution of safety according to the disaster category. The environment heat map generation unit 10d may be acquired from the heat map server 4. The heat map according to the disaster category shows the risk level according to the disaster category, for example, in the case of a rain disaster, the risk level related to flooding and landslides. This is because dangerous places and evacuation methods will change due to possible disasters (tsunami, earthquakes directly under the capital, torrential rain, snow damage, etc.). Further, the environmental heat map generated by the environmental heat map generation unit 10d may be stored in the storage unit 12 of the evacuation guidance server 1 or may be stored in the heat map server 4. Further, the environmental heat map generation unit 10d may periodically update to the latest environmental heat map.

Here, FIG. 4 shows a diagram specifically explaining the generation of the environmental heat map. As shown in FIG. 4, for example, in the case of tsunami assumed damage caused by a large earthquake, a simulation is performed based on topographical data and building data, and for example, the degree of danger / safety is determined according to the altitude and the environmental heat map 41 is used. Will be generated. In addition, the environmental heat map 41 may be generated using open data provided by the Ministry of Land, Infrastructure, Transport and Tourism, local governments, and the like. Further, the environmental heat map 41 manually generated from the experience of an expert may be stored in the heat map server 4.

The safe / secure place estimation unit 10e estimates a safe / safe place based on the environmental heat map 41 and the emotional heat map 42. Specifically, the safe / secure place estimation unit 10e estimates a safe / secure place by using, for example, an integrated heat map that integrates an environmental heat map 41 and an emotional heat map 42. Here, FIG. 8 shows an example of the integrated heat map 43 according to the present embodiment. When integrating the environmental heat map 41 and the emotional heat map 42, by weighting one of the heat maps, it is possible to generate an integrated heat map that emphasizes the environmental heat map 41 or the emotional heat map 42. The integrated heat map 43 shown in FIG. 8 serves as information for comprehensively determining the “optimal evacuation site for the user”. The safety / safety location estimation unit 10e estimates an evacuation site with a high degree of safety and a high degree of security based on the integrated heat map 43, and outputs the estimation result to the evacuation information generation unit 10f. Further, the integrated heat map 43 is updated according to the update of the environmental heat map 41 or the emotion heat map 42. Especially in the event of a disaster, the ups and downs of user emotions are severe, so it is desirable that the emotion heat map 42 is continuously updated.

The evacuation information generation unit 10f functions as a guidance generation unit that generates guidance for guiding a user who wears the HHMD3 to a safe and secure place estimated by the safety / safety place estimation unit 10e. Specifically, the evacuation information generation unit 10f selects a route from the user's current location to the evacuation site, and generates information for intuitively guiding the user. Also, if the user's current position is within the normal user's range of activity, the user can easily understand the surrounding roads and the location of the building as a landmark, but it is intuitive for unfamiliar lands such as during business trips and sightseeing. Evacuation route guidance is effective.

The evacuation guidance unit 10g functions as a providing unit that provides the guidance generated by the evacuation information generation unit 10f from the HHMD3 to the user. As mentioned above, the HHMD3 is, for example, a head-mounted wearable device mounted on a disaster prevention helmet, and has audio output ("walk straight", "turn right", etc.) or vibration output (user). The evacuation route can be intuitively shown to the user by vibrating the part in the traveling direction when viewed from the viewpoint. In addition, since the user does not need to gaze at the image when evacuating, the user can safely evacuate according to voice or the like while maintaining attention to the surroundings without being blocked from the external environment.

(Communication Department)
The communication unit 11 transmits / receives data to / from an external device. For example, the communication unit 11 connects to the HHMD3 to receive biosensor information, facial expression information, and current position information, or connects to the sensitivity server 2 to receive the user's sensitivity value. Further, the communication unit 11 transmits evacuation guidance to the user to the HHMD3 under the control of the evacuation guidance unit 10g.

(Memory)
The storage unit 12 stores, for example, a program for executing each of the above processes by the control unit 10. Further, the storage unit 12 may store the current position information of the environmental heat map 41, the emotion heat map 42, the integrated heat map 43, and the HHMD3.

<2-2. Sensitivity server ＞
Next, the configuration of the Kansei server 2 according to the present embodiment will be described. FIG. 9 is a block diagram showing an example of the configuration of the Kansei server 2 according to the present embodiment. As shown in FIG. 9, the Kansei server 2 has a control unit 20, a communication unit 21, an object DB 22, and a Kansei information DB 24.

(Communication Department)
The communication unit 21 connects to the evacuation guidance server 1 via the network, and returns the sensitivity value associated with the object ID of the target user designated by the evacuation guidance server 1. In addition, the communication unit 21 receives interaction information from a sensing device (not shown) mounted / mounted on each object (person, object).

(Control unit)
The control unit 20 controls each configuration of the Kansei server 2. Further, the control unit 20 is realized by a microcomputer provided with a CPU, a ROM, a RAM, and a non-volatile memory. Further, the control unit 20 according to the present embodiment functions as an interaction memory control unit 20a, an evaluation unit 20b, an object management unit 20c, a related object search unit 20d, and a sensitivity value calculation unit 20e.

The interaction storage control unit 20a controls to store the interaction information received from the sensing device mounted / mounted on the object in the sensitivity information DB 24. The sensing device is realized by a humidity sensor, a temperature sensor, a vibration sensor, an infrared sensor, a camera, a tactile sensor, a gyro sensor, or the like, and detects an interaction of an object with another object. Interaction is an act, such as conversation, telephone, email, going out together, giving a gift, etc. between people, and care, storage, cleaning, appreciation, wearing, etc. between people and objects. Can be mentioned.

The evaluation unit 20b evaluates the interaction stored in the sensitivity information DB 24. The evaluation method of the interaction is not particularly limited, but for example, the evaluation unit 20b evaluates the interaction as high as it is preferable for the interacted object, and specifically gives a score of -1.0 to 1.0. The evaluation result is stored in the Kansei information DB 24 in association with the interaction.

The object management unit 20c manages registration, change, deletion, and the like of information about the object stored in the object DB 22.

The related object search unit 20d searches the object DB 22 and the sensitivity information DB 24 as related objects for other objects in which an interaction has occurred with the requested object ID.

The sensitivity value calculation unit 20e calculates the sensitivity value (feelings for other objects) of the target user based on the interaction evaluation associated with the object ID of the target user. For example, the sensitivity value calculation unit 20e may calculate the total sensitivity value of the target user from the sum of the interaction evaluation values, or may calculate the total sensitivity value of the target person from the average value of the interaction evaluation values.

(Object DB)
The object DB 22 is a storage unit that stores the object ID of each object. In addition to the object ID, the object DB 22 stores a lot of information about the object such as name, age, gender, product name, product type, manufacturer ID, model number, and date and time of manufacture.

(Kansei information DB)
The Kansei information DB 24 is a storage unit that stores interactions between objects and evaluations of the interactions.

<2-3. HHMD>
Next, the configuration of HHMD3, which is an example of the client terminal according to the present embodiment, will be described with reference to FIG. FIG. 10 is a block diagram showing an example of the configuration of HHMD3 according to the present embodiment. As shown in FIG. 10, the HHMD3 includes a control unit 30, a communication unit 31, a current position measurement unit 32, a biological sensor 33, an environmental information sensor 34, a speaker 35, a vibration unit 36, a microphone 37, and a storage unit 38.

(Control unit 30)
The control unit 30 is composed of, for example, a microcomputer including a CPU, a ROM, a RAM, a non-volatile memory, and an interface unit, and controls each configuration of the HHMD3. Further, the control unit 20 controls the speaker 35 to output the voice of the evacuation guidance based on the evacuation guidance instruction signal received from the evacuation guidance server 1, and the vibration unit 36 outputs the vibration for the evacuation guidance. To control.

(Communication unit 31)
The communication unit 31 has a function of wirelessly / wiredly connecting to an external device and transmitting / receiving data. The communication unit 31 according to the present embodiment is connected to, for example, the evacuation guidance server 1 and continuously transmits the user's biosensor information detected by the biosensor 33 and the current position information of the HHMD3 measured by the current position measurement unit 32. Send. Further, the communication unit 31 receives an evacuation guidance instruction signal from the evacuation guidance server 1.

(Current position measurement unit 32)
The current position measuring unit 32 has a function of detecting the current position of the HHMD3 based on an externally acquired signal. Specifically, for example, the current position measurement unit 32 is realized by a GPS (Global Positioning System) positioning unit, receives radio waves from GPS satellites, detects the position where the HHMD3 exists, and detects the position information. Is output to the control unit 30. In addition to GPS, the current position measurement unit 32 detects the position by transmission / reception with, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), mobile phone / PHS / smartphone, or short-range communication. It may be.

(Biological sensor 33)
The biosensor 33 has a function of detecting the biometric information of the user who wears the HHMD3. Since the HHMD3 according to the present embodiment is attached to the user's head as described above, the body temperature sensor, the sweating amount sensor, the heart rate sensor, which are examples of the biological sensor 33, are located at places where the HHMD3 comes into contact with the user's skin when attached. A brain wave detection sensor or the like is provided. The biological sensor 33 may be provided with a plurality of the plurality of types of sensors described above.

(Environmental information sensor 34)
The environment information sensor 34 has a function of detecting information about the surrounding environment including the user. The environmental information sensor 34 according to the present embodiment is realized by, for example, a humidity sensor, a temperature sensor, and an air quality sensor. Further, the environmental information sensor 34 may be realized by a 3-axis acceleration sensor, a gyro sensor, a geomagnetic sensor, or the like that detects the movement of the user wearing the HHMD3. Further, the environmental information sensor 34 may be realized by an infrared camera for acquiring object information existing around the user or a camera for acquiring facial expression information of the user. The environmental information sensor 34 may be provided with a plurality of the plurality of types of sensors described above.

(Speaker 35)
The speaker 35 has a voice output function, and is specifically realized by, for example, a bone conduction speaker. Further, a plurality of speakers 35 may be provided in the HHMD3.

(Vibration unit 36)
The vibrating unit 36 has a vibrating function, and is provided in, for example, a plurality of HHMD3s. As a result, the vibrating unit 36 corresponding to the evacuation route direction vibrates according to the control of the control unit 30, so that the user can intuitively guide the evacuation. Further, the vibrating unit 36 may vibrate as a whole as a warning when the user is heading for the danger zone.

(Microphone 37)
The microphone 37 has a sound collecting function, and is specifically realized by, for example, a bone conduction microphone. Further, a plurality of microphones 37 may be provided in the HHMD3.

(Memory unit 38)
The storage unit 38 stores, for example, a program for executing each of the above processes by the control unit 30. Further, the storage unit 38 may store the evacuation guidance instruction signal received from the evacuation guidance server 1, may store the position information of the HHMD3 detected by the current position measurement unit 32, and may store various sensors (living body). Information detected by the sensor 33 and the environmental information sensor 34) may be stored.

The specific configuration of the HHMD3 according to the present embodiment has been described above. The configuration of HHMD3 shown in FIG. 10 is an example, and the present embodiment is not limited to this. For example, the HHMD3 may intuitively guide the user to evacuate by using an output unit other than the speaker or the vibrating unit.

<< 3. Operation processing >>
Subsequently, the navigation operation processing according to the present embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing an evacuation guidance process for navigation according to the present embodiment.

As shown in FIG. 11, first, in step S103, the evacuation guidance server 1 determines whether or not a disaster has occurred. As an example of this operation processing, the occurrence of a disaster is used as a trigger for navigation processing. The disaster occurrence notification can be notified from, for example, a predetermined disaster notification server.

Next, when a disaster occurs (“Yes” in S103), in step S106, the HHMD position acquisition unit 10a of the evacuation guidance server 1 acquires the user's current position information (that is, the current position information of the HHMD3).

Next, in step S109, the control unit 10 of the evacuation guidance server 1 determines whether or not the user needs evacuation guidance support according to the current position of the user. For example, if the user's current position is far away from the disaster location, evacuation guidance support is not particularly required.

Next, when evacuation guidance support is required (“Yes” in S109), in step S112, the environmental heat map generation unit 10d shows an environmental heat map showing the distribution of safety / risk according to the disaster category that has occurred. Generate 41 (or get an environmental heatmap that has already been generated).

Next, in step S115, the HHMD position acquisition unit 10a acquires the current position of the HHMD3, and the user emotion acquisition unit 10b acquires the emotion of the user who owns the HHMD3.

Next, in step S118, the emotion heat map generation unit 10c generates an emotion heat map 42 showing the distribution of the degree of security / anxiety of people associated with the place based on the acquired current position of HHMD3 and the user emotion information. do.

Subsequently, in step S121, the safety / security location estimation unit 10e generates an integrated heat map 43 based on the environmental heat map 41 and the emotion heat map 42.

Next, in step S124, the safety / security location estimation unit 10e estimates a location where the safety level and the security level exceed a predetermined value as a safe and secure evacuation site based on the integrated heat map 43.

Next, in step S127, the evacuation information generation unit 10f generates guidance for guiding the user to the evacuation site, and the evacuation guidance unit 10g starts evacuation guidance to the user's evacuation site. Specifically, the evacuation guidance unit 10g transmits an evacuation guidance signal to the HHMD3, and the HHMD3 guides the user to evacuate.

Next, in step S130, the control unit 10 of the evacuation guidance server 1 determines whether or not the user has arrived at the evacuation site according to the evacuation guidance based on the user's position information continuously acquired by the HHMD position acquisition unit 10a. to decide.

Next, if the evacuation site has not yet arrived (“No” in S130), in step S133, the evacuation guidance server 1 uses the current positions of a large number of HHMD3s, emotional information of possessing users, and environmental information around the HHMD3s. Is acquired from HHMD3 in real time.

Then, in step S136, the evacuation guidance server 1 updates the emotion heat map based on the newly acquired user emotions, and also updates the environment heat map based on the environment information, and these updates are performed. The integrated heat map will be updated accordingly.

Then, the process returns to step S124, and evacuation guidance is performed based on the latest integrated heat map.

The evacuation guidance process of the navigation system according to the present embodiment has been described above.

<< 4. Application example >>
<4-1. First application example>
In the above-mentioned navigation, guidance mainly specialized in evacuation guidance processing has been described, but the present embodiment is not limited to this. For example, the HHMD3 may perform sightseeing navigation during normal times and switch to disaster navigation when a disaster occurs.

FIG. 12 is a diagram illustrating an application example of the navigation system according to the present embodiment. Suppose a large number of visitors come from overseas due to an event held over a certain period of time, such as the Olympic Games or an international forum. By having such overseas visitors wear the HHMD3 according to the present embodiment at airports and accommodation facilities, tourist navigation is normally performed, and when a disaster occurs, it operates as disaster navigation overseas. Tourists can safely evacuate even in unfamiliar lands.

The HHMD3 is not limited to the one mounted on the disaster prevention helmet as described above, and may be mounted on a hat or a wig, whereby, as shown on the left side of FIG. 12, the tourist can use the HHMD3h, 3i, You can enjoy navigation services such as Olympic sightseeing by wearing 3j on a daily basis. For example, in a situation of watching sports at a stadium, audio guide information in the native language is reproduced from the speakers of HHMD3h, 3i, and 3j.

Then, in the event of a large-scale disaster such as an earthquake or eruption, HHMD3h, 3i, and 3j can switch to disaster navigation and provide evacuation guidance in their native language. The evacuation guidance process performed here is as shown in FIG.

For example, when a large-scale disaster occurs while watching a game at a stadium, the navigation system according to this embodiment first guides the user to the emergency exit of the stadium based on the current position of the user wearing the HHMD3, and then registers as an evacuation destination candidate. Start evacuation guidance to hotels, embassies, and nearby evacuation centers (schools, etc.). At this time, the navigation system refers to the degree of security of the evacuation destination candidate 1 and the evacuation destination candidate 2 based on the emotional heat map 42. If the evacuation destination candidate 2 has a higher degree of security than the evacuation destination candidate 1, the user is guided to the evacuation destination candidate 2.

In this way, the HHMD3 may be mounted on a hat or wig and normally used as a tourist navigation. Further, the navigation system according to the present embodiment can guide the user to a more secure place based only on the emotional heat map 42.

<4-2. Second application example>
As an application example of guiding the user to a more secure place based only on the emotional heat map 42, for example, a navigation that guides the user from a crowded place to a vacant place at an event venue or a sightseeing spot can be considered. .. In other words, in tourist spots, crowded places are places with a high degree of anxiety, and vacant places are places with a high degree of security. In this case as well, by mounting the HHMD3 on a hat or wig, it is possible to guide the user to a place that is normally used as a tourist navigation and has a high degree of security as needed.

<< 5. Summary >>
As described above, the navigation system according to the embodiment of the present disclosure makes it possible to guide the user to a place with a high degree of security based on the emotional information of the people associated with the place.

Although the preferred embodiments of the present disclosure have been described in detail with reference to the accompanying drawings, the present technology is not limited to such examples. It is clear that a person having ordinary knowledge in the technical field of the present disclosure can come up with various modifications or modifications within the scope of the technical ideas described in the claims. Of course, it is understood that the above also belongs to the technical scope of the present disclosure.

For example, a computer for exerting the functions of the evacuation guidance server 1, the sensitivity server 2, or the HHMD3 on the hardware such as the CPU, ROM, and RAM built in the evacuation guidance server 1, the sensitivity server 2, or the HHMD3 described above. Programs can also be created. Also provided is a computer-readable storage medium that stores the computer program.

Further, it has been explained that the facial expression information of the user of HHMD3 is recognized based on the captured image captured by the camera provided in HHMD3, but the present embodiment is not limited to this, and the facial expression information is captured by the peripheral cameras. It may be recognized based on the captured image.

Further, at least one of the functions of the control unit 10 of the evacuation guidance server 1 shown in FIG. 3 may be provided in the HHMD3.

Further, the evacuation guidance server 1 according to the present embodiment may perform evacuation guidance after notifying the user of the time change of the degree of security as shown in FIGS. 6 and 7 and the integrated heat map as shown in FIG. good.

In addition, the effects described herein are merely explanatory or exemplary and are not limited. That is, the techniques according to the present disclosure may exhibit other effects apparent to those skilled in the art from the description herein, in addition to or in place of the above effects.

The present technology can also have the following configurations.
(1)
An acquisition unit that acquires position information indicating the position of the client terminal device and information related to the emotion of the user of the client terminal device.
A generation unit that generates an emotion map by generating a degree of security of the position represented by the position information based on the position information and information related to the user's emotion.
An estimation unit that estimates a place with a high degree of security based on the emotion map,
A guidance generation unit that generates guidance for guiding the user of the client terminal device to the place with a high degree of security, and
A provider that provides the guidance to the user of the client terminal device, and
A navigation system with.
(2)
The navigation system according to (1), wherein the acquisition unit acquires the biometric information of the user detected by the client terminal device as information related to the emotion of the user.
(3)
The navigation system according to (1) or (2) above, wherein the acquisition unit acquires the content posted on social media posted by the user of the client terminal device as information related to the emotion of the user.
(4)
The navigation system according to any one of (1) to (3) above, wherein the acquisition unit acquires the facial expression of the user of the client terminal device as information related to the emotion of the user.
(5)
The acquisition unit corresponds to the user registered as an object from the sensitivity value database constructed by accumulating the sensitivity values of each object generated based on the information related to the interaction between the objects. The navigation system according to any one of (1) to (4) above, which acquires a sensitivity value as information related to the emotion of the user.
(6)
The navigation system
It also has an environment map generator that generates an environment map that shows the distribution of safety.
The navigation system according to any one of (1) to (5) above, wherein the estimation unit estimates a place having a high degree of security and safety according to the emotion map and the environment map.
(7)
The environment map generation unit generates an environment map having a different safety distribution according to the type of disaster.
The navigation system according to (6) above, wherein the estimation unit estimates a place having a high degree of security and safety according to the emotion map and the environment map.
(8)
The navigation system according to any one of (1) to (7) above, wherein the providing unit guides the user in the guidance direction by voice output in the client terminal device.
(9)
A position information detector that detects the position of the client terminal device and generates position information that represents the position.
A detection unit that detects information related to the user's emotions of the client terminal device, and
A transmitter that transmits the location information and information related to the user's emotions to an external device, and
An acquisition unit that acquires an emotion map representing the degree of security of the position represented by the position information generated based on the position information and information related to the user's emotion by the external device.
An output unit that outputs guidance for guiding the user of the client terminal device to the user of the client terminal device at a place presumed to have a high degree of security based on the emotion map.
A client terminal device.
(10)
The client terminal device according to (9) above, wherein the detection unit detects the biometric information of the user of the client terminal device as information related to the emotion of the user.
(11)
The client terminal device according to (9) or (10), wherein the detection unit detects the content posted on social media posted by the user of the client terminal device as information related to the emotion of the user.
(12)
The client terminal device according to any one of (9) to (11) above, wherein the detection unit detects the facial expression of the user of the client terminal device as information related to the emotion of the user.
(13)
The item according to any one of (9) to (12) above, wherein the detection unit detects information related to the interaction between the user and the object of the client terminal device as information related to the emotion of the user. Client terminal device.
(14)
The acquisition unit acquires an environment map showing the distribution of the degree of safety, and obtains the environment map.
The output unit outputs guidance to guide the user of the client terminal device to the user of the client terminal device at a place estimated to have a high degree of security and safety based on the emotion map and the environment map. The client terminal device according to any one of (9) to (13).
(15)
The acquisition unit acquires an environmental map in which the distribution of safety levels changes according to the type of disaster.
The output unit outputs guidance to guide the user of the client terminal device to the user of the client terminal device at a place estimated to have a high degree of security and safety based on the emotion map and the environment map. The client terminal device according to any one of (9) to (14).
(16)
The client terminal device according to any one of (9) to (15) above, wherein the output unit provides guidance for guiding the user by voice output or vibration.
(17)
Acquiring the position information indicating the position of the client terminal device and the information related to the emotion of the user of the client terminal device, and
To generate an emotion map by generating a degree of security of the position represented by the location information based on the location information and information related to the emotion of the user.
Estimating a place with a high degree of security based on the emotion map,
To generate guidance for guiding the user of the client terminal device to the place with a high degree of security, and
To provide the guidance to the user of the client terminal device,
Control methods, including.
(18)
Computer,
A position information detector that detects the position of the client terminal device and generates position information that represents the position.
A detection unit that detects information related to the user's emotions of the client terminal device, and
A transmitter that transmits the location information and information related to the user's emotions to an external device, and
An acquisition unit that acquires an emotion map representing the degree of security of the position represented by the position information generated based on the position information and information related to the user's emotion by the external device.
An output unit that outputs guidance for guiding the user of the client terminal device to the user of the client terminal device at a place presumed to have a high degree of security based on the emotion map.
A storage medium in which a program for functioning as is stored.

1 Evacuation guidance server 10 Control unit 10a HHMD position acquisition unit 10b User emotion acquisition unit 10c Emotion heat map generation unit 10d Environmental heat map generation unit 10e Safe and secure location estimation unit 10f Evacuation information generation unit 10g Evacuation guidance unit 12 Storage unit 2 Sensitivity Server 3 HHMD

Claims (17)

An acquisition unit that acquires position information indicating the position of the client terminal device and information related to the emotion of the user of the client terminal device.
A generation unit that generates an emotion map by generating a degree of security of the position represented by the position information based on the position information and information related to the user's emotion.
An environment map generator that generates an environment map showing the distribution of safety,
An estimation unit that estimates a place with a high degree of security and safety according to an integrated map that integrates the emotion map and the environment map.
A guidance generation unit that generates guidance for guiding a user of the client terminal device to a place having a high degree of security and a high degree of safety.
A provider that provides the guidance to the user of the client terminal device, and
Equipped with a,
The estimation unit
A navigation system that generates the integrated map by weighting one of the emotion map and the environment map. The navigation system according to claim 1, wherein the acquisition unit acquires the biometric information of the user detected by the client terminal device as information related to the emotion of the user. The navigation system according to claim 1 or 2, wherein the acquisition unit acquires the content posted on social media posted by the user of the client terminal device as information related to the emotion of the user. The navigation system according to any one of claims 1 to 3, wherein the acquisition unit acquires the facial expression of the user of the client terminal device as information related to the emotion of the user. The acquisition unit corresponds to the user registered as an object from the sensitivity value database constructed by accumulating the sensitivity values of each object generated based on the information related to the interaction between the objects. The navigation system according to any one of claims 1 to 4, wherein the sensitivity value is acquired as information related to the emotion of the user. The environment map generation unit generates an environment map having a different safety distribution according to the type of disaster.
The navigation system according to any one of claims 1 to 5, wherein the estimation unit estimates a place having a high degree of security and safety according to the emotion map and the environment map. The navigation system according to any one of claims 1 to 6, wherein the providing unit guides a user in a guidance direction by voice output in the client terminal device. A position information detector that detects the position of the client terminal device and generates position information that represents the position.
A detection unit that detects information related to the user's emotions of the client terminal device, and
A transmitter that transmits the location information and information related to the user's emotions to an external device, and
The external device acquires an emotion map showing the degree of security of the position represented by the position information generated based on the position information and information related to the user's emotion, and an environment map showing the distribution of the safety degree. Acquisition department and
Guidance to guide the user of the client terminal device to a place presumed to have a high degree of security and safety according to the integrated map in which the emotion map and the environment map are integrated is given to the user of the client terminal device. The output section to output and
Equipped with a,
The integrated map is a client terminal device that is generated by weighting one of the emotion map and the environment map. The client terminal device according to claim 8, wherein the detection unit detects the biometric information of the user of the client terminal device as information related to the emotion of the user. The client terminal device according to claim 8 or 9, wherein the detection unit detects the content posted on social media posted by the user of the client terminal device as information related to the emotion of the user. The client terminal device according to any one of claims 8 to 10, wherein the detection unit detects the facial expression of the user of the client terminal device as information related to the emotion of the user. The client terminal device according to any one of claims 8 to 11, wherein the detection unit detects information related to the interaction between the user and the object of the client terminal device as information related to the emotion of the user. .. The acquisition unit acquires an environmental map in which the distribution of safety levels changes according to the type of disaster.
The output unit outputs guidance to guide the user of the client terminal device to the user of the client terminal device at a place estimated to have a high degree of security and safety based on the emotion map and the environment map. The client terminal device according to any one of claims 8 to 12. The client terminal device according to any one of claims 8 to 13, wherein the output unit provides guidance for guiding the user by voice output or vibration. Acquiring the position information indicating the position of the client terminal device and the information related to the emotion of the user of the client terminal device, and
To generate an emotion map by generating a degree of security of the position represented by the location information based on the location information and information related to the emotion of the user.
Generating an environmental map showing the distribution of safety and
Estimating a place with a high degree of security and safety according to the integrated map in which the emotion map and the environment map are integrated,
To generate guidance for guiding the user of the client terminal device to the safe and secure location, and
To provide the guidance to the user of the client terminal device,
Only including,
A control method for generating the integrated map by weighting one of the emotion map and the environment map. Computer,
A position information detector that detects the position of the client terminal device and generates position information that represents the position.
A detection unit that detects information related to the user's emotions of the client terminal device, and
A transmitter that transmits the location information and information related to the user's emotions to an external device, and
The external device acquires an emotion map showing the degree of security of the position represented by the position information generated based on the position information and information related to the user's emotion, and an environment map showing the distribution of the safety degree. Acquisition department and
Guidance to guide the user of the client terminal device to a place presumed to have a high degree of security and safety according to the integrated map in which the emotion map and the environment map are integrated is given to the user of the client terminal device. The output section to output and
The program to function as is memorized ,
The integrated map is a storage medium generated by weighting one of the emotion map and the environment map. Computer,
A position information detector that detects the position of the client terminal device and generates position information that represents the position.
A detection unit that detects information related to the user's emotions of the client terminal device, and
A transmitter that transmits the location information and information related to the user's emotions to an external device, and
The external device acquires an emotion map showing the degree of security of the position represented by the position information generated based on the position information and information related to the user's emotion, and an environment map showing the distribution of the safety degree. Acquisition department and
Guidance to guide the user of the client terminal device to a place presumed to have a high degree of security and safety according to the integrated map in which the emotion map and the environment map are integrated is given to the user of the client terminal device. The output section to output and
To function as,
The integrated map is a program generated by weighting one of the emotion map and the environment map.

Images