JP2019101766A - User support system - Google Patents

Abstract

To provide a user support system that performs processing according to a request of a user even outdoors.SOLUTION: A user side device 20 includes: acquisition means (microphone 26) for acquiring a voice uttered by a user; and transmission means (transmission/reception unit 21) for transmitting information on the voice acquired by the acquisition means to an aircraft. An aircraft 10 includes: hovering means (control unit 16) for performing control to hover the aircraft in the vicinity of the user; tracking means (control unit 16) for performing control to make the aircraft follow the user as the user moves; reception means (transmission/reception unit 15) for receiving information on the voice transmitted from the transmission means of a user side device; and execution means (control unit 16) for executing a process corresponding to the information on the voice received by the reception means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a user support system.

  In recent years, devices that receive user's voice instructions, for example, respond to user's schedule, respond to a weather forecast, search on the Internet, and respond to results, are being sold in the market.

  There is Patent Document 1 as a prior art related to such a device. The technology disclosed in Patent Document 1 includes a first storage unit, a first acquisition unit, a first search unit, a second storage unit, a second search unit, and a control unit. The first storage unit stores a plurality of pieces of first environment information related to the surrounding environment and a situation explanatory note describing the surrounding situation. The first acquisition unit acquires second environment information on a surrounding environment to be processed. The first search unit searches similar environment information which is first environment information whose similarity to the second environment information is equal to or more than a first threshold value, and obtains a situation explanatory note corresponding to the similar environment information. The second storage unit stores a plurality of task expressions in association with one or more solutions of the task expressions. The second search unit searches for a similar task expression that is a task expression in which the degree of similarity to the situation explanatory text is equal to or higher than a second threshold, and obtains one or more solutions corresponding to the similar task expression. The control unit controls the interaction with the user using the acquired one or more solutions. According to such a technology, it is possible to efficiently present the solution to the user.

JP, 2015-148842, A

  However, in the technique disclosed in Patent Document 1, for example, when the user is outdoors, there is a problem that the user's request can not be received. Therefore, although it is possible to provide a biped walking leg in order to follow the user, the apparatus becomes expensive because the control of biped walking requires a large number of resources. There is a problem of that.

  An object of the present invention is to provide a user support system capable of performing processing according to various requests following a user even outdoors.

In order to solve the above problems, the present invention is a user support system comprising at least a hoverable flying object and a user side device worn by a user on a part of the body, wherein the user side device is the user An acquiring unit for acquiring a voice uttered by the user, and a transmitting unit for transmitting information on the audio acquired by the acquiring unit to the aircraft, the aircraft in the vicinity of the user Regarding the voice transmitted from the transmission means of the user-side device, hovering means for performing control to hover the flying object, tracking means for performing control to cause the user to follow the user with the movement of the user, and Receiving means for receiving information, and execution means for executing a process corresponding to the information on the voice received by the receiving means; A, wherein the.
According to such a configuration, it is possible to follow the user and perform processing according to various requests even outdoors.

Further, according to the present invention, the flying object is a speaker specifying unit for specifying the uttered user among the voices of the plurality of users registered in advance, and information indicating the process to be executed for each of the users Search means for searching for information indicating the process to be executed, corresponding to the user identified by the speaker identification means, from a database in which is registered, and the execution means is acquired by the search means Executing the processing corresponding to the stored information.
According to such a configuration, it is possible to execute desired processing for each user.

Further, the present invention is characterized in that the process is a surrounding situation monitoring process for monitoring a traffic situation around the user or a suspicious person.
According to such a configuration, it is possible to protect the user from the traffic accident and the damage of the suspicious person.

Further, the present invention is characterized in that the process is a route guidance process for guiding the user to a destination.
According to such a configuration, it is possible to reliably guide the user to the destination.

Further, the present invention is characterized in that the process is a person search process for searching for a specific person from around the user.
According to such a configuration, it is possible to reliably search for a desired person.

Further, the present invention is characterized in that the process is an emergency notification process in which occurrence of an emergency situation is notified to surrounding people.
According to such a configuration, it is possible to prevent the user from being damaged by notifying the surrounding person of the occurrence of the emergency situation.

Further, the present invention is characterized in that the process is a package transfer process of transferring a package to a destination.
According to such a configuration, the package can be quickly transported to the destination.

Further, the present invention is characterized in that the process is a search process for searching for desired information from the Internet.
According to such a configuration, desired information can be obtained even outdoors.

Further, the present invention is characterized in that the process is an information notification process of notifying the user of information or an advertisement related to a current location.
According to such a configuration, various information on the current location can be obtained.

Further, the present invention is characterized in that the processing is an emergency processing for guiding the user to a safe place when an emergency occurs.
According to such a configuration, when an emergency such as an earthquake or a tsunami occurs, it is possible to evacuate the user to a safe place.

Further, according to the present invention, the user-side device further includes an augmented reality display unit that superimposes and displays visual information obtained by image processing on an existing landscape, and the augmented reality display unit is configured to Display visual information obtained by processing in the body.
According to such a configuration, it is possible to present the information obtained by the processing by the flying object without disturbing the user's vision.

  According to the present invention, it is possible to provide a user support system capable of performing processing according to various requests following the user even outdoors.

It is a figure showing an example of composition of a user support system concerning an embodiment of the present invention. It is a figure which shows the detailed structural example of the flying body shown in FIG. It is a figure which shows the example of a detailed structure of the user side device shown in FIG. It is a figure which shows the example of a detailed structure of the server shown in FIG. It is a flowchart for demonstrating an example of the main process performed in the flying body shown in FIG. It is a figure which shows an example of the user's attribute information registered into the server shown in FIG. It is a flowchart for demonstrating the detail of the follow-up process shown in FIG. It is a flowchart for demonstrating the detail of the watching process shown in FIG. It is a flowchart for demonstrating the detail of the requirement corresponding | compatible process shown in FIG. It is a flowchart for demonstrating the detail of the route guidance process shown in FIG. It is a flowchart for demonstrating the detail of the person search process shown in FIG. It is a flowchart for demonstrating the detail of the information notification process shown in FIG. It is a flowchart for demonstrating the detail of emergency processing shown in FIG. It is a figure which shows the other structural example of the user side device shown in FIG. It is a figure which shows the external appearance of the user side device shown in FIG.

  Next, an embodiment of the present invention will be described.

(A) Description of the Configuration of the Embodiment of the Present Invention FIG. 1 is a diagram showing an example of the configuration of a user support system according to the embodiment of the present invention. As shown in FIG. 1, the user support system 1 has a flying object 10, a user device 20, a base station 30, a network 40, and a server 50, and supports the user.

  The flying object 10 is an unmanned air vehicle (UAV), and is configured of, for example, a drone or the like that can be hovered (stopped in the air) by four or more propellers. In addition, the form of the flying object 10 shown in FIG. 1 is an example, and the flying object may have other forms. Further, the flying object 10 may be configured by a small helicopter, a balloon or the like.

  The user-side device 20 is constituted by, for example, a wristband-type device worn on the wrist of the user, and transmits information such as an instruction or request of the user (hereinafter referred to as “instruction or the like”) to the aircraft 10. , Receive information transmitted from the aircraft 10 and present it as voice or image.

  The base station 30 exchanges information with the user device 20 by radio waves, and exchanges information with the server 50 via the network 40.

  The network 40 is configured by, for example, the Internet, and exchanges information between the base station 30 and the server 50 based on a predetermined protocol.

  The server 50 performs processing corresponding to the request transmitted from the user device 20 via the base station 30 and the network 40, and supplies various information to the user device 20.

  FIG. 2 shows a configuration example of the flying object 10. In the example of FIG. 2, the flying object 10 includes an imaging device 11, a gimbal 12, an image processing unit 13, an audio processing unit 14, a transmitting and receiving unit 15, antennas 15 a and 15 b, a control unit 16, a GPS (Global Positioning System) 17, and a sensor And motors 19-1 to 19-4.

  The imaging device 11 separates the visible light reflected by the subject into the three primary colors, photoelectrically converts the intensities of the light of the respective colors into corresponding charges, and outputs the charges as image data.

  The gimbal 12 controls the inclination of the fixing member to which the imaging device 11 is fixed by electronic control, so that the image captured by the imaging device 11 does not swing even when the flying object 10 swings. The gimbal 12 is configured to be able to control the tilt (tilt) in the vertical direction of the imaging device 11.

  The image processing unit 13 performs image recognition processing and the like on the image data output from the imaging device 11, and supplies the obtained result to the control unit 16 via the transmission / reception unit 15.

  The voice processing unit 14 executes recognition processing on the voice data of the user transmitted from the user device 20 and received by the transmitting and receiving unit 15, and the obtained result is transmitted to the control unit 16 via the transmitting and receiving unit 15. Supply.

  The transmitting / receiving unit 15 transmits / receives information by radio waves to / from the user device 20 by the antenna 15a, and transmits / receives information by radio waves to / from the base station 30 by the antenna 15b.

  The control unit 16 controls the gimbal 12 and the motor 19 based on the information supplied from the transmitting / receiving unit 15, the position information supplied from the GPS 17, the information indicating the flight state of the flying object 10 supplied from the sensor 18, etc. Control 1 to 19-4.

  The GPS 17 receives signals having time information transmitted from a plurality of artificial satellites, detects information (latitude information and longitude information) regarding its own position from these time differences, and supplies the information to the control unit 16.

  The sensor 18 has, for example, a gyro sensor, a magnetic sensor, a barometric pressure sensor, an ultrasonic sensor, and a vision positioning sensor, and the attitude, height, and distance to an obstacle, the shape of the obstacle, etc. It detects and notifies the control unit 16.

  The motors 19-1 to 19-4 are constituted by, for example, brushless motors or the like, and propellers are attached to the respective motors 19-1 to 19-4. The control unit 16 can move in a target direction or change the direction of the flying object 10 by individually controlling the rotational speeds of the motors 19-1 to 19-4.

  FIG. 3 is a diagram showing a detailed configuration example of the user device 20 shown in FIG. In the example of FIG. 3, the user device 20 includes a transmitting / receiving unit 21, an antenna 21 a, a sensor 22, a control unit 23, a display unit 24, an operation unit 25, a microphone 26, and a speaker 27.

  Here, the transmitting / receiving unit 21 transmits / receives information by radio waves to / from the flying object 10 via the antenna 21 a.

  The control unit 23 generates an instruction or the like for the flying object 10 based on the information supplied from the microphone 26 and the operation unit 25 and transmits the instruction to the flying object 10 via the transmission / reception unit 21 and the antenna 21 a. Further, the information transmitted from the flying object 10 and received via the antenna 21 a and the transmitting and receiving unit 21 is output from the display unit 24 and the speaker 27.

  The display unit 24 is configured of, for example, a liquid crystal display panel or the like, and displays information supplied from the control unit 23.

  The operation unit 25 is configured by, for example, a touch panel, and is configured to be superimposed on the display unit 24. The operation unit 25 generates information based on a user's operation and supplies the information to the control unit 23. The operation unit 25 may be configured by, for example, an operation button and a jog dial.

  The microphone 26 converts the voice uttered by the user into an electrical signal and supplies the electrical signal to the control unit 23. The speaker 27 converts the electric signal supplied from the control unit 23 into sound and outputs the sound.

  FIG. 4 shows a detailed configuration example of the server 50 shown in FIG. As shown in FIG. 4, the server 50 includes a central processing unit (CPU) 51, a read only memory (ROM) 52, a random access memory (RAM) 53, a hard disk drive (HDD) 54, an I / F 55, and a bus. It has 56.

  Here, the CPU 51 is a central processing unit that controls each unit in accordance with programs stored in the ROM 52 and the HDD 54.

  The ROM 52 is configured by a non-volatile semiconductor storage device, and stores a basic program and the like executed by the CPU 51.

  The RAM 53 is configured of a volatile semiconductor storage device, and temporarily stores a program to be executed by the CPU 51 and data during calculation.

  The HDD 54 is formed of a magnetic storage device, and stores programs executed by the CPU 51, information to be supplied to the user, and the like. The HDD 54 stores user attribute information and the like, which will be described later.

  When the I / F 55 exchanges information with the base station 30 via the network 40, the I / F 55 executes a process of converting the representation form of the information.

  The bus 56 is a group of signal lines for mutually connecting the CPU 51, the ROM 52, the RAM 53, the HDD 54, and the I / F 55 and enabling the exchange of information among them.

(B) Description of Operation of the Embodiment of the Present Invention Next, the operation of the embodiment of the present invention will be described. For example, when the user goes out, the user support system according to the present embodiment follows the user and flies while supporting the user. FIG. 5 is a flow chart for explaining an example of main processing executed in the flying object shown in FIG. When the process of the flowchart shown in FIG. 5 is started, the following steps are performed.

  In step S10, the control unit 16 determines whether or not the takeoff instruction has been made. If it is determined that the takeoff instruction has been made (step S10: Y), the process proceeds to step S11, otherwise (step S10: N) Repeat the same process for). For example, when the flying object 10 is disposed at the entrance of the user's house and the user wearing the user-side device 20 tries to go outside from the entrance, or when the user takes off the operation unit 25 of the user-side device 20 When the user operates a button to instruct, when the user instructs takeoff by voice, or when the user takes out the flying object 10 accommodated in a pocket or bag and throws it into the air, the takeoff is performed. It is determined that the instruction has been given, and the process proceeds to step S11. Note that takeoff may be instructed by a method other than these.

  In step S11, the control unit 16 specifies the user who has issued the takeoff instruction. More specifically, for example, when the user device 20 has a user ID (Identification), the user can identify the user. In addition to this, for example, the user can be specified by executing the speaker specifying process based on the voiceprint analysis process in the voice processing unit 14 of the voice input from the microphone 26 of the user device 20. Alternatively, the image processing unit 13 may perform recognition processing on the image of the user captured by the imaging device 11 to specify the user.

  When the user is specified by the process of step S11, the control unit 16 can access the server 50 and obtain attribute information of the specified user. FIG. 6 is an example of user attribute information stored in the HDD 54 of the server 50. In the example of FIG. 6, as the user attribute information, user ID, age, gender, voice feature, face feature, body feature, possessed device, behavior pattern, preference information (food, clothes, place, etc.), There are moving speed (normal time), moving speed (emergency time), notification information type, and watching content.

  Here, the user ID, the age, and the gender indicate the ID, the age, and the gender of the user. Also, the voice feature is information indicating the voice feature for speaker identification, the face feature is information indicating the feature for identifying the user by face recognition, and the body feature is, for example, , Body weight, body weight, and other characteristics of the body. The possessed device is information indicating the type of the user device 20. The action pattern is information indicating an action pattern of the user, for example, information indicating an action pattern (walking, attending school, commuting, etc.) for each day of the week and for each time zone. The preference information (food, clothing, place, etc.) is information indicating the user's preference, and, for example, food preference (eg, preference for Japanese food etc.), clothing preference (eg, casual clothes preference, etc.) , And is information indicating a preference of a place (e.g., prefer a place where music is being played, etc.). The moving speed (normal time) and moving speed (emergency time) are the normal moving speed (for example, 4 km / h) and the movable speed time for emergency (for example, when an emergency occurs) (for example, 8 km / hour) It is the information which shows). The notification information type indicates information that the user is permitted to notify (for example, a push advertisement, information on a place, etc.). The watching content is information indicating the type of watching required by the user (for example, monitoring of a suspicious person, monitoring of surrounding traffic conditions, etc.). Note that FIG. 6 is an example, and information other than these may be registered, or part of the information in FIG. 6 may be registered.

  In step S12, the control unit 16 starts hovering. More specifically, the control unit 16 controls the flying object 10 to stay at a predetermined position based on the position information supplied from the GPS 17 and the acceleration information supplied from the sensor 18 or the like.

  In step S13, the control unit 16 determines whether or not the user has moved, and if it is determined that the user has moved (step S13: Y), the process proceeds to step S14, and otherwise (step S13: N) The process proceeds to step S15. For example, the position information of the user detected by the GPS of the sensor 22 of the user device 20 is referred to, and when it is determined that the user has moved, the process can proceed to step S14. In addition, as a method of determining whether the user has moved, for example, when the intensity of the radio wave from the user-side device 20 received by the transmitting / receiving unit 15 changes, it can be determined that the user has moved .

  In step S14, the control unit 16 executes a following process, which is a process in which the flying object 10 follows the user. The details of this process will be described later with reference to FIG.

  In step S15, the control unit 16 determines whether or not the user watching process is to be performed. If it is determined that the process is to be performed (step S15: Y), the process proceeds to step S16, otherwise (step S15: N) In step S17). For example, when information indicating that watching is necessary is added to the “watching content” at the end of the attribute information shown in FIG. 6, it is possible to determine Y and proceed to step S16.

  In step S16, the control unit 16 executes watching processing to watch the user by the flying object 10. The details of the watching process will be described later with reference to FIG.

  In step S17, the control unit 16 determines whether the user has made a request, and if it is determined that a request has been made (step S17: Y), the process proceeds to step S18, otherwise (step S17: N) )) Goes to step S19. For example, when the user makes a request to the microphone 26 of the user device 20 or when the user operates the operation unit 25 to make a request, it is determined as Y and the process proceeds to step S18.

  In step S18, the control unit 16 executes a request handling process according to the user's request. The details of the request handling process will be described later with reference to FIG.

  In step S19, the control unit 16 determines whether or not there is information to be notified to the user. If it is determined that there is information to be notified (step S19: Y), the process proceeds to step S20. In step S19: N), the process proceeds to step S21. For example, when the user permits the push advertisement, if there is a push advertisement to be displayed, it is determined as Y and the process proceeds to step S20.

  In step S20, the control unit 16 executes an information notification process of notifying the user of the information. The details of the information notification process will be described later with reference to FIG.

  In step S21, the control unit 16 determines whether or not an emergency situation has occurred. If it is determined that an emergency situation has occurred (step S21: Y), the process proceeds to step S22, otherwise (step S21) : N) Go to step S23. For example, when an earthquake or the like occurs, it is determined as Y and the process proceeds to step S22.

  In step S22, the control unit 16 executes emergency situation processing corresponding to the emergency situation. The details of the emergency process will be described later with reference to FIG.

  In step S23, the control unit 16 determines whether to land or not, and when it is determined to land (step S23: Y), the process proceeds to step S24, and in other cases (step S23: N), step S10. Return to and repeat the same process as described above. For example, when the user arrives at home from the place to go out, it is determined as Y and the process proceeds to step S24.

  In step S24, the control unit 16 executes a landing process. Specifically, the control unit 16 refers to the outputs of the GPS 17 and the sensor 18, and lands on a predetermined place (for example, a place where a charging facility at the entrance is arranged) while keeping the airframe horizontal.

  According to the above-described flowchart, it is possible to take off in response to the user going out, support the user's action and the like, and land in response to the user's return and the like.

  Next, details of the follow-up process shown in step S14 of FIG. 5 will be described with reference to FIG. When the process of the flowchart shown in FIG. 7 is started, the following steps are performed.

  In step S30, the control unit 16 acquires the set default position of the flying object 10. For example, in the case of watching or the like, the default position of the flying object 10 is the upper side immediately above or behind the user. Moreover, in the case of a route guidance, it is set as a position ahead of a user about 2-3 m.

  In step S31, the control unit 16 acquires the position of the own aircraft of the aircraft 10. More specifically, the control unit 16 acquires the position of the own aircraft based on the position information (latitude and longitude information) supplied from the GPS 17.

  In step S32, the control unit 16 acquires the position of the user. More specifically, the control unit 16 requests the user device 20 to transmit position information. As a result, the user device 20 acquires position information (latitude and longitude information) from the GPS included in the sensor 22, and the transmitting and receiving unit 21 transmits the position information to the aircraft 10. Thereby, the control unit 16 of the aircraft 10 can acquire the position information of the user.

  In step S33, the control unit 16 acquires the traveling direction of the user. More specifically, the control unit 16 acquires the traveling direction of the user from the temporal change of the user position information acquired in step S32.

  In step S34, the control unit 16 detects the reception intensity of the radio wave. More specifically, the control unit 16 detects the reception intensity of the radio wave transmitted from the user device 20 by the transmission / reception unit 15.

  In step S35, the control unit 16 causes the imaging device 11 to capture an image of the user. As a result, an image of the user from the current position of the flying object 10 is captured.

In step S36, the control unit 16 calculates the positional relationship between the user and the own apparatus with reference to the position of the user, the traveling direction, the reception intensity of radio waves, and the image of the user acquired in step S32. More specifically, the distance between the user and the own aircraft is estimated from the strength of the radio wave, and the rough positional relationship is estimated from the position information by GPS. Then, a process of correcting the estimated positional relationship is executed based on the captured image. As a result, the correct positional relationship between the own machine and the user can be determined.

  At step S37, the control unit 16 calculates the moving direction and moving speed of the own machine. More specifically, the moving direction and the moving speed of the own device are calculated based on the positional relationship between the user and the own device calculated in step S36 and the traveling direction of the user acquired in step S33.

  In step S38, the control unit 16 controls the motors 19-1 to 19-4, refers to the moving direction and the moving speed calculated in step S37, and executes the process of moving the own machine. As a result, for example, even when the user moves on foot or travels, it is possible to follow while maintaining a predetermined default position.

  In step S39, the control unit 16 determines whether or not the appropriate positional relationship has been obtained, and if it is determined that the appropriate positional relationship has been obtained (step S39: Y), the processing returns to the original processing (return). Otherwise (step S39: N), the process returns to step S30 and repeats the same process as described above.

  According to the processing of the above flowchart, the user can be made to follow the flying object 10 while maintaining the predetermined positional relationship with the user.

  Next, details of the watching process shown in step S16 of FIG. 5 will be described with reference to FIG. When the process of the flowchart shown in FIG. 8 is started, the following steps are performed.

  In step S50, the control unit 16 determines whether or not to watch over the child, and if it is determined to watch over the child (step S50: Y), the process proceeds to step S51, otherwise (step In step S50, the process proceeds to step S53. For example, the monitoring content of the user's attribute information shown in FIG. 6 is referred to, and if it is determined that the currently following user is a child and the child monitoring is to be performed, the process proceeds to step S51.

  In step S51, the control unit 16 executes a process of monitoring surrounding traffic conditions. More specifically, the control unit 16 controls the gimbal 12 and controls the motors 19-1 to 19-4 to capture an image around the user. In particular, the rear etc. which are easy to become a blind spot of a user are imaged. A fisheye lens or the like having a wide angle of view may be used as the imaging device. Alternatively, two fisheye lenses and two imaging devices may be used to capture an image of 360 degrees around the player. The image processing unit 13 refers to the peripheral image of the user captured in this manner, and detects the presence of a vehicle (for example, a car, a motorcycle, a bicycle, etc.) approaching the user. Then, it is monitored whether the approaching vehicle contacts or collides with the user. In the case of a child, a sudden jump or the like may be performed. Therefore, when the user suddenly runs, the vehicle may follow and monitor surrounding vehicles. Also, the control unit 16 acquires current position information by the GPS 17, transmits the acquired position information to the server 50 via the base station 30 and the network 40, and acquires map information centered on the current position. May be Then, the situation of the road is grasped from the map information centering on the current position, and it is grasped whether the place where the user is now is the road or the roadside zone, and monitoring is performed based on the grasped contents. It is also good.

  At step S52, the control unit 16 executes a process of monitoring surrounding suspicious persons. More specifically, the control unit 16 controls the gimbal 12 and controls the motors 19-1 to 19-4 to capture an image of the periphery of the user, and in the same manner as in step S51, the controller 16 is suspicious around the user. Monitor if there is a person making a move. In addition, as suspicious movement, for example, movement at a constant speed can be defined as suspicious movement such as movement or stopping. Of course, other definitions may be used.

  In step S53, the control unit 16 determines whether or not watching of the elderly person is to be executed, and if it is determined that watching of the elderly person is to be executed (step S53: Y), the process proceeds to step S54. In (Step S53: N), the process proceeds to Step S56. For example, the monitoring content of the user's attribute information shown in FIG. 6 is referred to, and if it is determined that the currently following user is an elderly person and that the elderly person is to be guarded, the process proceeds to step S54.

  In step S54, the control unit 16 executes a process of monitoring the surrounding traffic condition by the same process as step S51. In the case of an elderly person, the walking speed is slow, and in many cases the approaching vehicle can not be detected due to a decrease in cognitive ability. Therefore, for example, the moving speed of attribute information shown in FIG. Refers to map information centered on the current location acquired from the server 50, and when it is determined that a road is crossed, the altitude of the own aircraft is raised to see if there is a vehicle approaching from the periphery. You may do it.

  In step S55, the control unit 16 executes a process of monitoring the presence or absence of a fall or the like. For example, while the user does not move from the same place, it is monitored from the captured image whether it is not in a walking state (a state of lying on the ground). In addition, even if not lying, it may be monitored whether or not the user is sitting down on the ground.

  In step S56, the control unit 16 determines whether or not to watch a woman, and if it is determined that a watch on a woman is to be executed (step S56: Y), the process proceeds to step S57, otherwise (step S56) In step S56: N), the process proceeds to step S58. For example, the monitoring content of the user's attribute information shown in FIG. 6 is referred to, and when it is determined that the currently following user is a female and the female watching is to be performed, the process proceeds to step S57.

  In step S57, the control unit 16 executes a process of monitoring surrounding suspicious persons by the same process as step S52. In addition, in order to prevent damage such as stalkers, for example, when there is a person who makes a suspicious motion around the user, the face of the person is imaged, and the same person continues around the person by the person identification process. If it exists, it may be determined as a stalker.

  In step S58, the control unit 16 determines whether or not watching of the running is to be executed, and when it is determined that watching of the running is to be executed (step S58: Y), the process proceeds to step S59, and in the other case (step In step S58: N), the process proceeds to step S61. For example, it is described that jogging is performed with reference to the action pattern of the user's attribute information shown in FIG. 6, and when it is determined that watching of running is performed on watching content, the process proceeds to step S59.

  In step S59, the control unit 16 executes a process of monitoring the surrounding traffic condition by the same process as step S51. In the case of jogging, the moving speed is high, so the risk of collision with other pedestrians and the like increases, and when the user wears headphones and the like, it is often impossible to detect an approaching vehicle. For this reason, it is desirable to monitor a wide area and issue a warning early.

  In step S60, the control unit 16 executes a process of monitoring the physical condition of the user. More specifically, for example, when a pulse sensor is included as the sensor 22 of the user-side device 20, the pulse sensor detects a recommended heart rate at the time of exercise estimated from the age included in the attribute information The monitored heart rate may be monitored to see if it is exceeded, and if it is exceeded it may be warned to slow down.

  In step S61, the control unit 16 determines whether or not a danger has been detected by the processes of steps S50 to S60. If a danger is detected (step S61: Y), the process proceeds to step S62. In the case (step S61: N), the process returns to the original process (return).

  In step S62, the control unit 16 executes a warning process corresponding to the detected danger. For example, when a danger is detected from the surrounding traffic condition, a loud warning sound may be emitted, and the vehicle may be lowered immediately before the user to prevent the vehicle from advancing. Alternatively, in the case of an elderly person's fall or the like, it is possible to notify the surrounding people of the fall by voice and send a message to the registered telephone number or e-mail address. Also, in the case of watching over a woman, the woman is notified of the presence of a suspicious person, and when approaching a certain extent, it rises to an altitude at which the suspicious person can not approach and voices asking for help from surrounding people May be emitted. In addition, in monitoring the physical condition or the like in watching over the running, the user may be notified by voice and warn that he / she descends immediately before the user to pace down. A warning sound may be emitted from the speaker 27 of the user device 20, or a warning may be issued by vibrating the vibration unit (not shown).

  In step S63, the control unit 16 executes a recording process corresponding to the detected danger. More specifically, in the case of a suspicious person, an image is taken close to a position where the face of the suspicious person is clearly imaged. Further, in the case of monitoring of the surrounding traffic condition, the vehicle number and the driver's face can be photographed in order to provide evidence showing the situation in the event of an accident. In addition, in the case of a fall or the like, it is possible to capture an image so as to include surrounding landmarks so that the fall place is known, and transmit the image to a family or the like registered in advance.

  Next, the details of the request handling process shown in step S18 of FIG. 5 will be described with reference to FIG. When the process of the flowchart shown in FIG. 9 is started, the following steps are performed.

  In step S70, the control unit 16 determines whether or not the route guidance processing has been requested by the user, and if it is determined that the route guidance processing has been requested (step S70: Y), the process proceeds to step S71. In the case (step S70: N), the process proceeds to step S72. For example, it is assumed that the user spoke to the microphone 26 of the user-side device 20 as "guide to a nearby French restaurant". In this case, the voice of the user converted into an electrical signal by the microphone 26 is converted into a digital signal by the control unit 16, and is transmitted to the flying object 10 via the transmission / reception unit 21. In the flying object 10, the transmitting and receiving unit 15 receives audio data and supplies the audio data to the audio processing unit 14. The speech processing unit 14 transmits / receives processing results obtained by executing morpheme analysis processing as natural language analysis processing, syntax analysis processing, semantic analysis processing, and context analysis processing on speech data. It supplies to the control part 16 via. The control unit 16 determines that the user has requested guidance to a nearby French restaurant based on the information supplied from the voice processing unit 14, and proceeds to step S71. In addition, you may make it request the route guidance by operating the operation part 25 of the user side device 20 instead of making a request | requirement by an audio | voice, for example.

  In step S71, the control unit 16 executes route guidance processing for guiding the user to the designated destination. The details of this process will be described later with reference to FIG.

  In step S72, the control unit 16 determines whether the user requests execution of a person search process for searching for a predetermined person, and determines that the user search request is performed (step S72). If Y (Y), then the process proceeds to step S73; otherwise (N in step S73), the process proceeds to step S74. For example, when the user is a mother and requests to search for a lost child, it is determined as Y, and the process proceeds to step S73.

  In step S73, the control unit 16 executes a person search process for searching for a predetermined person. The details of the process will be described later with reference to FIG.

  In step S74, the control unit 16 determines whether the user has requested execution of the net search processing for searching for predetermined information from the Internet, and determines that the execution of the net search processing has been requested ( In step S74: Y, the process proceeds to step S75, and in the case other than that (step S74: N), the process proceeds to step S77. For example, it is determined that a search is requested when the user hears an evaluation of a restaurant in front of the eye toward the microphone 26 from the Internet (for example, when "tell me the evaluation of this restaurant 00"). Then, the process proceeds to step S75. Alternatively, when referring to the shopping list stored in association with the attribute information of the server 50 and inquiring whether or not there is an item to be shopped (for example, “the shopping list is to be bought out at this shop If it is determined that a search has been requested, the process proceeds to step S75.

  In step S75, the control unit 16 searches the network 40 via the transmission / reception unit 15 and the base station 30 for the information requested in step S74. For example, in the case of “Tell me the evaluation of this restaurant 00”, the nearest restaurant is searched from the position information acquired from the GPS 17, and the evaluation related to the restaurant is searched and acquired from the network 40. Also, in the case of “Is there a shopping list available for purchase at this store?”, First, the shopping list is obtained from the server 50, and the group of products listed in the shopping list and the latest retail store The group of products sold is compared, and products matching the two are identified.

  In step S76, the control unit 16 notifies, for example, the user device 20 of the information obtained as the search result in step S75, and causes the speaker 27 to output the information as sound or display on the display unit 24 as an image or text. . For example, in the case of "Teach me the rating of this restaurant 00", "a rating of 4.5 stars" is output. In addition, in the case of "Is there anything to buy in this store on the shopping list?", "You need to buy soy sauce and jam" is output.

  In step S77, the control unit 16 determines whether or not the emergency notification process has been requested by the user. If it is determined that the emergency notification process has been requested (step S77: Y), the process proceeds to step S78. In the case (step S77: N), the process proceeds to step S80. For example, in the case where the suspicious person is being followed, if the user screams "help" toward the microphone 26, it is determined that the emergency notification process is requested, and the process proceeds to step S78.

  In step S78, the control unit 16 executes an emergency notification process. For example, in the case of a suspicious person, the police or the like is notified that the suspicious person is being followed along with the position information acquired from the GPS 17.

  In step S79, the control unit 16 executes a process of asking the surrounding people for help. For example, it is possible to capture an image of the periphery by the imaging device 11, identify a person present in the periphery by face recognition processing or the like, and request the person for help. As a method for asking for help, for example, a sound such as “help” or the like can be output from a speaker (not shown) or a warning sound (for example, a sound such as a buzzer) can be output. In addition, when a speaker does not exist, an audio | voice signal is superimposed with respect to the drive current which drives motor 19-1-19-4, and the sound from the propeller attached to motor 19-1-19-4 It is also possible to output (for example, "help" or "alert sound").

  In step S80, the control unit 16 determines whether or not the package transfer processing has been requested by the user, and if it is determined that the package transfer processing has been requested (step S80: Y), the process proceeds to step S81. In the case (step S80: N), the process returns to the original process (return). For example, if there is a thing (for example, frozen food or freshly baked food) that you want to bring home quickly and hurry, when the user utters "take home home" to the microphone 26, Y And the process proceeds to step S81.

  In step S81, the control unit 16 descends to attach the load carried by the user to, for example, a hook or the like (not shown) provided on the bottom of the fuselage of the aircraft 10, and attaches the load. Is completed, the processing of transporting the package to the home is executed with reference to the output of the GPS 17. In addition, when arriving at home, you can call a family member by phone etc. and deliver the package. Of course, you can also connect to your home network and make calls from the intercom.

  According to the above process, it is possible to execute the process corresponding to various requests of the user.

  Next, with reference to FIG. 10, the details of the route guidance process shown in step S71 of FIG. 9 will be described. When the process of the flowchart shown in FIG. 10 is started, the following steps are performed.

  In step S90, the control unit 16 receives designation of a destination from the user. For example, when the user utters "guide to 00" toward the microphone 26, the voice data is acquired via the transmitting / receiving unit 15, and processed by the voice processing unit 14 so that the destination can be obtained. Acquire a certain "OO". Note that, for example, the designation of the destination may be received on the map displayed on the display unit 24 of the user device 20 instead of the voice.

  In step S91, the control unit 16 executes a process of searching for the destination acquired in step S90 on the map. For example, a place corresponding to “〇” is searched and specified on the map.

  In step S92, the control unit 16 executes a process of searching for a route from the current position to the destination. The control unit 16 acquires position information indicating the current position from the GPS 17, and searches the map for the route up to "OO" specified in step S91.

  In step S93, the control unit 16 sets the default position of the flying object 10 in front of the user (for example, 2 m ahead).

  In step S94, the control unit 16 moves along the route searched in step S92. More specifically, the control unit 16 controls the motors 19-1 to 19-4 while referring to the outputs of the GPS 17 and the sensor 18, and executes a process of moving along the route.

  In step S95, the control unit 16 executes processing to keep the distance between the user and the own machine constant. More specifically, the control unit 16 compares the position information of the own device supplied from the GPS 17 with the position information of the user which is output from the GPS included in the sensor 22 and is received through the transmitting / receiving unit 15; Control the own machine to keep the distance to the user constant (for example, control to be located 2 m ahead of the user).

  In step S96, the control unit 16 compares the position information output from the GPS 17 with the position information of the destination, determines whether or not the destination has arrived, and determines that the destination has arrived (step). In step S96, the process proceeds to step S97. In other cases (step S96: N), the process returns to step S94 to repeat the same process as described above.

  In step S97, the control unit 16 notifies the user that the destination has arrived. For example, the control unit 16 notifies the user that the user has arrived at the destination by outputting the voice “Arrive at destination” from the speaker 27 of the user-side device 20.

  According to the above process, it is possible to guide the user to the destination.

  Next, the details of the person search process shown in step S73 of FIG. 9 will be described with reference to FIG. When the process of the flowchart shown in FIG. 11 is started, the following steps are performed.

  In step S110, the control unit 16 receives designation of a person to be searched from the user. For example, when the user utters “search for 0 (person's name)” toward the microphone 26, the voice data is transmitted to the voice processing unit 14 via the transmission / reception unit 21. The voice processing unit 14 specifies “OO” as the person's name from the voice data. In addition, when the user refers to the information displayed on the display unit 24 and operates the operation unit 25 to designate a specific person, the person may be set as a search target.

  In step S111, the control unit 16 acquires information on the corresponding person. For example, the control unit 16 acquires an image of the face of the corresponding person from the server 50. Note that not only the image of the face but also attribute information such as height, weight, and gender may be acquired together.

  In step S112, the control unit 16 controls the motors 19-1 to 19-4 to raise the flying object 10 to an altitude (for example, 2.5 m) that does not collide with a person.

  In step S113, the control unit 16 executes a process of searching for surrounding people. More specifically, the control unit 16 executes processing for searching for a person by face recognition processing among a plurality of objects present around the user.

  In step S114, the control unit 16 executes a process of imaging the person specified as a result of the search in step S113 by the imaging device 11.

  In step S115, the control unit 16 causes the image processing unit 13 to execute a process of extracting the feature of the person imaged in step S114. As a result, the features of the captured person are extracted as feature vectors, for example.

  In step S116, the control unit 16 compares the feature extracted in step S115 with the feature of the person to be searched obtained in step S111 from the image captured in step S114, and the feature matches or not If it is determined that the features match (step S116: Y), the process proceeds to step S117. Otherwise (step S116: N), the process returns to step S113 to repeat the same process.

  In step S117, the control unit 16 notifies the user that a person to be searched for has been found. For example, the speaker 27 of the user-side device 20 outputs a voice such as “Mr.

  In step S118, the control unit 16 guides the user to the place where the person found in step S117 is present. More specifically, the control unit 16 stores position information of a person to be searched and guides the motors 19-1 to 19-4 from the current position to the position. Then, the process returns to the original process (return).

  According to the above processing, for example, a child who got lost or a person who is waiting can be searched. In particular, even when there are a large number of people or obstacles or the like, it is possible to quickly find out the person who is the object by the image from a high place.

  Next, the details of the information notification process shown in step S20 of FIG. 5 will be described with reference to FIG. When the process of the flowchart shown in FIG. 12 is started, the following steps are performed.

  In step S130, the control unit 16 refers to the notification information type included in the attribute information of the user shown in FIG. 6, determines whether or not the push advertisement is permitted, and determines that it is permitted (step In step S130, the process proceeds to step S131. In other cases (step S130: N), the process proceeds to step S135.

  In step S131, the control unit 16 acquires preference information from the attribute information of the user stored in the server 50. For example, as preference information, food preference (for example, preference for Japanese food etc.), clothing preference (for example, casual clothes preference, etc.), location preference (for example, preference for places where music is played, etc.) Get information that indicates Note that information other than these may be acquired.

  In step S132, the control unit 16 acquires position information indicating the current position from the GPS 17.

  In step S133, the control unit 16 determines whether there is an advertisement that is information associated with the current position and that matches the user's preference, and if there is an advertisement (step S133: Y), step S134. Otherwise (step S133: N), the process proceeds to step S135. For example, there are "Japanese restaurant", "Western restaurant", and "bakery" advertisements as advertisements associated with the current position, and the time is 12:00 and the user's preference is, for example, In the case of “prefer Japanese food”, it is determined that an advertisement of “Japanese food restaurant” is present, and the process proceeds to step S134.

  In step S134, the control unit 16 transmits and presents the advertisement determined to match the preference in step S133 to the user device 20. For example, in the present example, “Japanese restaurant 〇 is recommended today xxx” is presented from the user-side device 20 as a voice or an image.

  In step S135, the control unit 16 refers to the notification information type included in the attribute information of the user shown in FIG. 6, and determines whether notification of the information on the place is permitted, and it is determined that the permission is permitted. In the case (step S135: Y), the process proceeds to step S136, and in the other case (step S135: N), the process returns to the original process (return).

  In step S136, the control unit 16 acquires preference information from the user's attribute information stored in the server 50, as in step S131.

  In step S137, the control unit 16 acquires position information indicating the current position from the GPS 17 as in step S132.

  In step S138, the control unit 16 determines whether there is information that is associated with the current position and that matches the preference of the user. If there is information (step S138: Y), the process proceeds to step S139. Otherwise (step S133: N), the processing returns to the original processing (return). For example, “historical information”, “business information”, and “information on music” exist as information associated with the current position, and the user's preference is, for example, “a place where music is played. In the case of “prefer”, the process proceeds to step S139.

  In step S139, the control unit 16 presents information on the place. More specifically, for example, the control unit 16 selects "information about music", and "Today, there is a live on the street of the music group 00" is presented from the user device 20 as a voice or an image.

  According to the above process, it is possible to present information that is associated with the place and that matches the user's preference.

  Next, with reference to FIG. 13, the details of the emergency process shown in step S22 of FIG. 5 will be described. When the process of the flowchart shown in FIG. 13 is started, the following steps are performed.

  In step S150, the control unit 16 acquires earthquake information from the site distributing the disaster information of the network 40, and if it is determined that an earthquake has occurred (step S150: Y), the process proceeds to step S151, otherwise The process proceeds to 153 in (step S150: N).

  In step S151, the control unit 16 searches the surroundings for a safe place that is somewhat distant from the place where there is a risk of collapse, such as a structure or a slope. For example, the control unit 16 refers to position information on the current position acquired from the GPS 17, and searches for a safe place (for example, a park or the like) existing around the current position.

  In step S152, the control unit 16 guides the user to the safe place searched in step S151, for example, by the same process as that of FIG.

  In step S153, the control unit 16 acquires earthquake information from the site to which the weather information of the network 40 is distributed, and proceeds to step S154 if it is determined that heavy rain, tornado and lightning have occurred (step S153: Y). Otherwise (step S153: N), the process proceeds to 156.

  In step S154, the control unit 16 searches for a strong building (for example, a reinforced concrete building) from the surroundings. For example, the control unit 16 refers to position information on the current position acquired from the GPS 17 and searches for a robust building existing around the current position.

  In step S155, the control unit 16 guides the user to the robust building searched in step S154, for example, by the same process as that of FIG.

  In step S156, the control unit 16 acquires tsunami information from the site to which the earthquake information on the network 40 is distributed, and when it is determined that a tsunami has occurred (step S156: Y), the process proceeds to step S157. In the case (step S156: N), the process returns to the original process (return).

  In step S157, the control unit 16 estimates the wave height when the tsunami reaches the point based on the information on the site to which the earthquake information is distributed and the current position of the user.

  In step S158, the control unit 16 searches for places or buildings higher than the wave height estimated in step S157 from the surroundings. For example, the control unit 16 refers to position information on the current position acquired from the GPS 17 and searches for a place or a building higher than a wave height existing around the current position.

  In step S159, the control unit 16 guides the user to a place or a building higher than the wave height searched in step S158, for example, by the same processing as that in FIG. Even if the user's moving speed (emergency) included in the user's attribute information is referred to, the optimal evacuation location is searched from the time until the tsunami arrival expected time and the moving speed (emergency). Good.

  According to the above processing, when an emergency occurs, the user can be guided to a safe place.

(C) Description of Modified Embodiments It goes without saying that each of the above-described embodiments is an example, and the present invention is not limited only to the case described above. For example, in the above example, the image processing unit 13 and the voice processing unit 14 are provided to the flying object 10, but for example, the user side device 20 or the server 50 is provided. It is also good.

  In addition, although the process of identifying the speaker is performed in the flying object 10, the process may be performed in the user device 20 or the server 50.

  Further, although the attribute information of the user is stored in the server 50, it may be stored in the flying object 10 or the user device 20, for example.

  Further, in the person search process, the search is performed using the image of the face of a person, but for example, it is transmitted from a device (for example, a mobile phone or a device on the user side) possessed by the person to be searched. A person may be searched using ID information included in radio waves.

  Further, in the above-described embodiment, the user device 20 is the wristband device shown in FIG. 1, but may be a smart glass device shown in FIGS. 14 and 15, for example. FIG. 14 is a block diagram showing a configuration example of a smart glass type device. In the example shown in FIG. 14, the smart glass type device 20A includes a transmitting / receiving unit 21, an antenna 21a, a sensor 22, a control unit 23, a display unit 24, a microphone 26, and a speaker 27.

  FIG. 15 is a perspective view showing a configuration example of the smart glass type device 20A shown in FIG. In the smart glass type device 20A, the lens portion of the glasses is used as the display unit 24, images and text are projected on the lens portion, and the user can view the projected image and text as well as view the scenery. That is, in the smart glass type device shown in FIGS. 14 and 15, the image and the text can be browsed in a mode of being superimposed on the landscape as AR (Augmented Reality). Further, since the smart glass type device 20A has the microphone 26 and the speaker 27 built-in, the voice uttered by the user is acquired by the microphone 26 and transmitted to the flying object 10, and the sound transmitted from the flying object 10 Data can be output as sound from the speaker 27. Furthermore, since the smart glass type device 20A incorporates a sensor 22 such as a GPS sensor, an acceleration sensor, and a geomagnetic sensor, the user's position, head movement, movement direction, etc. are acquired, and the flying object is obtained. Can be sent to ten.

  In the configuration example shown in FIG. 14, the operation unit 25 is excluded and a finger sensor 28 is newly added. That is, in the example of FIG. 14, the pointing device 20B including the finger sensor 28 is configured separately from the smart glass type device 20A. In the example of FIG. 14, the pointing device 20B is attached to the user's finger, the movement of the finger is detected by the finger sensor 28, and the detected finger movement is transmitted and received through the antenna 28a. It is configured to be sent to. When the user moves the finger, the finger sensor 28 detects the movement of the finger, and the transmitting and receiving unit 21 receives the signal via the antenna 28a and the antenna 21a. The control unit 23 generates a signal indicating the movement of the received finger, and transmits the signal to the aircraft 10 via the transmission / reception unit 21. The flying object 10 that has received such a signal related to the movement of the finger can perform an operation according to the movement of the finger. A visual line sensor may be provided in the smart glass type device 20A, the visual axis of the user may be detected by this visual line sensor, and information corresponding to the movement of the detected visual axis may be generated and transmitted to the flying object 10. According to such a configuration, the user can send a command to the flying object by moving the sight line. Also, in the above-described example, the smart glass type device 20A projects an image on a lens, but a retina manipulation display that projects directly on the retina may be used.

  According to the configurations shown in FIGS. 14 and 15, it is possible to provide the user with images and text supplied from the flying object 10 without blocking the user's view. In addition to images and texts, it also becomes possible to exchange information by voice.

  The display unit and the speaker may be disposed on the flying object 10, and the information obtained by the control unit 16 may be displayed on the display unit disposed on the flying object 10 and output as sound from the speaker.

  The flowcharts shown in FIGS. 5 and 7 to 19 are merely examples, and the present invention is not limited to these flowcharts.

1: user support system 10: flying object 11: imaging device 12: gimbal 13: image processing unit 14: audio processing unit 15: transmitting and receiving unit 15 a: antenna 15 b: antenna 16: control unit 17: GPS
18: sensor 19: motor 20: user device 20A: user device 21: transceiver 21a: antenna 22: sensor 23: control unit 24: display unit 25: operation unit 26: microphone 27: speaker 30: base station 40: base station 40: Network 50: Server 51: CPU
52: ROM
53: RAM
54: HDD
55: I / F
56: Bus

In order to solve the above problems, the present invention is a user support system having at least a hoverable flying object and a user-side device worn by a user, wherein the user-side device performs voice uttered by the user. An acquisition means for acquiring, and a transmission means for transmitting information on the voice acquired by the acquisition means to the aircraft, the aircraft hovering the aircraft in the vicinity of the user A hovering means for controlling, a following means for controlling the flying object to follow the user as the user moves, an acquiring means for acquiring information on disaster from the network, and a disaster acquired by the acquiring means Specific means for specifying the type of the evacuation site, and an evacuation site corresponding to the type of disaster identified by the Search means for searching from near standing position, and having a an induction means for inducing until retrieved refuge by the searching means.

Further, the present invention is a user support system having at least a hovering capable aircraft, the aircraft includes a hovering means for performing control to hover the aircraft in the vicinity of the user, in accordance with the movement of the user Tracking means for performing control to cause the user to follow the user, acquisition means for acquiring information on disaster from a network, identification means for identifying the type of disaster acquired by the acquisition means, identification by the identification means It has a search means which searches the evacuation place according to the kind of disaster made from the periphery of the user's present position, and the guidance means which guides to the evacuation place searched by the search means .

Further, the present invention is characterized in that, when the type of disaster is an earthquake, the search means searches a place where there is no risk of collapse of the structure .

Further, the present invention is characterized in that the search means searches for a reinforced concrete structure when the type of disaster is heavy rain, tornado, or lightning.

Further, the present invention is characterized in that the search means searches for a place or a building higher than the estimated tsunami wave height when the type of disaster is a tsunami.

Further, the present invention is characterized in that the search means searches for an optimum place based on an estimated arrival time of a tsunami and a moving speed of the user.

Further, according to the present invention, the flying object has a propeller for hovering and a motor for rotating the propeller, and an audio signal is superimposed on a drive current for driving the motor to generate a signal from the propeller. It is characterized by outputting voice.

Claims (11)

A user assistance system comprising at least a hoverable flying object and a user side device worn by a user, comprising:
The user device is
Acquisition means for acquiring the voice uttered by the user;
And transmission means for transmitting information on the voice acquired by the acquisition means to the aircraft.
The aircraft is
Hovering means for controlling the hovering of the flying object in the vicinity of the user;
Tracking means for performing control of causing the flight object to follow the user as the user moves;
Receiving means for receiving information on the voice transmitted from the transmitting means of the user-side device;
Executing means for executing processing corresponding to the information on the voice received by the receiving means;
User support system characterized in that. A speaker specifying unit for specifying the uttered user among the voices of a plurality of the users registered in advance;
Search means for searching for information indicating the process to be executed corresponding to the user identified by the speaker identification means from a database in which information indicating the process to be executed for each user is registered; And
The execution means executes the process corresponding to the information acquired by the search means.
The user support system according to claim 1, characterized in that:   The user support system according to claim 1 or 2, wherein the process is a surrounding situation monitoring process for monitoring a traffic situation or a suspicious person around the user.   The user support system according to claim 1, wherein the process is a route guidance process for guiding the user to a destination.   The user support system according to claim 1, wherein the process is a person search process for searching for a specific person from around the user.   The user support system according to claim 1 or 2, wherein the process is an emergency notification process of notifying a surrounding person of occurrence of an emergency situation.   The user support system according to claim 1 or 2, wherein the process is a package transfer process for transferring a package to a destination.   The user support system according to claim 1 or 2, wherein the process is a search process for searching for desired information from the Internet.   The user support system according to claim 1 or 2, wherein the process is an information notification process of notifying the user of information or an advertisement related to a current location.   The user support system according to claim 1 or 2, wherein the process is an emergency process for guiding the user to a safe place when an emergency situation occurs. The user-side device has an augmented reality display unit that superimposes and displays visual information obtained by image processing on an existing landscape,
The augmented reality display unit displays visual information obtained by the process on the aircraft.
The user support system according to any one of claims 1 to 10, characterized in that:

Images