JP2003109162A - Agent apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an agent apparatus in which exact information can be collected and provided in the case of an emergency when the dispatch of an ambulance crew is required. SOLUTION: The knowledge of emergency medical care is made into data and questions to be ordinarily asked by the ambulance crew for knowing the state of a patient in the case of an emergency is prepared as emergency questions to be asked by an agent. From an emergency call (call of No.199) from a vehicle to the arrival of the ambulance crew, the agent asks the emergency questions and required information is collected from the patient. When all the questions are finished, the collected information of the patient is transmitted to an emergency institution, to which the emergency call is originated. Further, from the end of the questions to the arrival of the ambulance crew, by asking to the patient at prescribed intervals, the consciousness of the patient is kept.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an agent device and, more particularly, to an agent device for notifying an emergency agency in an emergency such as when a passenger feels uncomfortable.

[0002]

2. Description of the Related Art In an emergency such as when a driver feels unwell in a vehicle, the 119th call is made as usual, but it is not always the case that a companion is present. When there is only one driver, the driver's self-confidence may feel an abnormality in his / her body and may make a report. In the event of such an emergency, an emergency notification device has been proposed that prepares a switch for emergency contact and automatically reports the occurrence of the emergency.

[0003]

In the conventional emergency notification device, only the fact that an emergency has occurred is notified to the emergency agency and the dispatch of emergency personnel is requested. For this reason, if the driver loses consciousness at the time when the rescue staff arrives at the scene, it will be impossible to ask about the symptoms and situation. In addition, the act of the ambulance crew asking the current state from the patient (the person who is carried by the ambulance) cannot be performed unless the ambulance crew arrives at the scene. Such an emergency inquiry action requires asking a question based on specialized knowledge, and may not obtain appropriate information even if there is a passenger.

Therefore, the present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide an agent device capable of collecting and providing accurate information in an emergency when dispatching emergency personnel. The first purpose. Also,
The second purpose is to provide the agent with possible treatment by the time the paramedics arrive.

[0005]

According to the invention as set forth in claim 1, an emergency call means for making an emergency call to the emergency agency about the current position of the vehicle and the occurrence of an emergency situation in an emergency requiring dispatch of emergency personnel. When the emergency call means makes a report, an agent that is an artificial pseudo-life appears in the passenger compartment and asks the passenger about the state of the passenger. The object is achieved by providing the agent device with an answer storage means for saving the answer from the passenger and a status output means for outputting the saved answer as patient information. The invention according to claim 2 is characterized in that, in the agent device according to claim 1, the inquiring means inquires about an emergency question item in which the next question is decided according to the answer from the passenger. According to a third aspect of the invention, in the agent apparatus according to the first aspect, the state output means transmits the stored answer as patient information to an emergency agency that is the emergency call destination. According to a fourth aspect of the invention, in the agent device according to the first aspect, there is provided storage means for storing information regarding passengers,
The inquiry means may inquire whether or not the information stored in the storage means is correct.

[0006]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, preferred embodiments of an agent device of the present invention will be described in detail with reference to FIGS. (1) Outline of the embodiment The knowledge of life-saving emergency is converted into data, and the questions that ambulance crews usually ask in order to know the condition of the patient in an emergency are prepared in advance as emergency questions that the agent asks. Then, after making an emergency call (call 119) from the vehicle, the agent asks an emergency question and collects the necessary information from the patient before the rescue staff arrives. When all the questions have been completed, send the collected patient information to the emergency department who has contacted the emergency. Further, after the question is completed, the patient is kept conscious by asking the patient at a predetermined interval until the ambulance crew arrives. The emergency call may be made by the driver himself / herself selecting the emergency call key, or the agent may automatically make an emergency call when the emergency detecting device detects an emergency. Then, when the rescue staff arrives, the status information of the collected patient is notified to the rescue staff. Announcement is done by screen display and voice,
Repeat until the end instruction (voice or end button selection) is given. The start of the notification starts when the emergency personnel select the patient information switch displayed on the screen, or when the voice recognition device recognizes the siren sound of the ambulance. In this way, the time between the emergency call and the arrival of the ambulance crew is effectively utilized, and the patient (driver) can be used as soon as possible.
By hearing the status information from the person and assisting the ambulance crew to take appropriate measures, the effect of the ambulance crew's emergency activities can be improved.

The agent in the present embodiment is an artificial pseudo-lifeform, and its appearance (planar image, stereoscopic image such as holography) appears in the vehicle by the image display device. As the processing of this agent, the situation of the vehicle including the vehicle itself, passengers, oncoming vehicles, etc. is judged and learned (including not only the learning of the situation but also the response and reaction of the driver), and the vehicle situation at each time point. Based on the learning results up to that point, the agent responds to the driver and the vehicle with various variations (action = action and voice). As a result, the driver can freely call out a plurality of agents in the vehicle and have a relationship (communication) with each other, thereby making the environment in the vehicle comfortable. Here, the artificial artificial life form (agent) in the present embodiment has a certain human, living thing, cartoon character and the like, and the pseudo life form having the same identity is The output (action, response by voice) is performed so as to maintain continuity. Further, the identity / continuity is expressed as having a unique individuality, and the agent of the present embodiment that appears in the vehicle interior can recognize the voices that are uttered according to the past learning content even in the same vehicle situation. Images are different. As various communication actions of this agent, emergency processing such as an emergency call and an emergency question is performed. Then, each action including the emergency processing performed by the agent is composed of a plurality of scenarios. Each scenario is standardized by a plurality of scenario data (including an application) that defines the content of a series of continuous actions by the agent, and a start condition for starting each scenario data.

(2) Details of Embodiment FIG. 1 is a block diagram showing the configuration of an agent device in this embodiment. The present embodiment includes an overall processing unit 9 that controls the entire communication function. The overall processing unit 9 searches for a route to a set destination and guides it by voice or image display, an agent processing unit 11, an external I / F unit for the navigation processing unit 10 and the agent processing unit 11. 1
2. Image processing unit 13 that processes image output and input images of agent images and map images, voice control unit 14 that controls voice output and input voice of agent voices and route guidance voices, and relates to vehicles and drivers. It has a situation information processing unit 15 that processes detection data of various situations, an input control unit 16, and a storage device control unit 17.

The navigation processing unit 10 and the agent processing unit 11 include a CPU (central processing unit) that controls data processing and operations of each unit, and a ROM that is connected to the CPU by a bus line such as a data bus or a control bus. RAM,
Equipped with a timer. Both processing units 10 and 11 are connected to a network (in-vehicle LAN (Local Area Net).
work)), and mutually processed data can be acquired. In the agent processing unit 11 of the present embodiment, when the navigation data (destination data, travel route data, etc.) is obtained from an external device such as an information center according to the scenario, or the destination is communicated with the user based on the scenario. When acquired, these data are stored in the navigation processing unit 1.
It is designed to supply 0. The ROM is a read-only memory in which various data and programs for controlling by the CPU are stored in advance, and the RAM is a random access memory used as a working memory by the CPU.

In the navigation processing unit 10 and the agent processing unit 11 of this embodiment, the CPU reads various programs stored in the ROM and executes various processes. The CPU is the storage medium drive device 23.
The computer program is read from the external storage medium set in the storage device and stored in the agent data 30 and the navigation data 31 of the storage device 29, or another storage device such as a hard disk (not shown) (installation).
However, a necessary program or the like may be read (loaded) from the storage device into the RAM and executed. In addition, necessary programs and the like are read from the storage medium drive device 23
You may make it read in AM directly and perform.

The agent processing unit 11 is adapted to perform various communication operations of the agent including conversation with the driver according to a scenario created in advance assuming various situations (scenes) of the vehicle and the driver. . That is, various situations such as vehicle speed, time, traveling area, temperature, gasoline level, and emergency detection are set as scenario activation conditions, and the behavior of the agent in each situation is defined as a scenario for each situation. Each scenario is composed of a plurality of consecutive scenes. The scene is one of the scenes in the scenario, and in the question scenario after the emergency call according to the present embodiment, the scene is composed of scenes in which the agent asks a question for information collection based on emergency and lifesaving. Each scene is organized by title, list, balloon, background, and other small units (parts). Each scene sequentially progresses according to the scenario, and depending on the scenario, there are a plurality of scenes selected depending on the driver's answer to the question given in a specific scene, the condition of the vehicle, and the like. That is, there is a scenario in which a scene branches according to an answer on the way. The data of the scenario including the scene is stored in the scenario data file 302 described later. Information (scenario activation condition) that defines when and where to execute a scenario, what kind of screen configuration is used when it is executed, what kind of operation or conversation the agent has, and the modules such as the navigation processing unit 10 What kind of instruction and what to do next when receiving an event (what scene to move to)
For each scene is collectively stored as scenario data 1 to n in the scenario data file 302. In the present embodiment, by using the scenario data thus standardized, various questions for collecting the state information of the patient based on the knowledge of emergency lifesaving are converted into scenario data as emergency questions.

FIG. 2 shows the configuration of the agent processing section 11. As shown in FIG. 2, the agent processing unit 11 includes a situation determination unit 111, a scenario execution request unit 112, a scenario drive unit 113, a scenario data reading unit 114, a drawing processing unit 115, a voice recognition management unit 116, and a user input. The reception unit 117 is provided. Each of these units 111 to 117 is realized by a corresponding engine (software) stored in a CPU, a ROM, and the like included in the agent processing unit 11. The engine that constitutes each unit such as the situation determination unit 111 issues a corresponding event when transmitting data to another engine. The events issued by the respective units 111 to 117 include an event for determining whether or not to branch the scene.

The status judgment unit 111 is an API (Applicat) for notifying a change in status such as time, place, and various inputs.
Ion Programming Interface)
Is equipped with. The situation determination unit 111 (destination setting, etc.)
The scenario execution request determination unit 112 responds to changes in the situation.
Issue an event to. Scenario execution request determination unit 112
Determines whether or not to execute the scenario by referring to the situation determination result with the API function. When executing a scenario, a scenario activation request event is issued to the scenario driver 113.

The scenario drive unit 113 determines whether or not to start the scenario activation request event issued by the scenario execution request unit 112. When it is determined that the scenario data is to be activated, the scenario driving unit 113 requests the scenario data reading unit 114 to read the scenario data. In addition, drawing request according to the scenario data,
The drawing processing unit 115 is requested to request a motion with the character. It also notifies the voice recognition management unit 116 of the dictionary used for voice recognition according to the scenario data. Furthermore,
The scenario drive unit 113 drives a scenario (manages scene transitions) based on the result of voice recognition or user input.

The scenario data reading unit 114 reads the corresponding scenario data from the scenario data file 302 based on the event request from the scenario driving unit 113. Further, the image data is read in response to an event request from the scenario drive unit 113. The drawing processing unit 115 draws a corresponding scene or a character (agent) based on an event request from the scenario driving unit 113. The voice recognition management unit 116 controls instructions to the voice recognition unit 142. For example, the usage dictionary notified from the scenario drive unit 113 is designated. The voice recognition unit 116, when the voice recognition unit 142 produces a voice recognition result based on the specified use dictionary, outputs an event corresponding to the recognition result to the scenario drive unit 11.
Issue to 3. The user input reception unit 117 issues an event corresponding to the input content to the scenario drive unit 113 when there is an input from the user. The input from the user is determined by the information from the input control unit 16.

In this embodiment, when the situation judging section 111 issues an event for detecting an emergency or an event for an emergency call key, the scenario item request judging section 112 sends an event requesting execution of an emergency question scenario to the scenario driving section 113.
To publish. The scenario driving unit 113 issues an event requesting the scenario data reading unit to read the emergency question scenario, issues a drawing request to the drawing processing unit 115 in accordance with the read scenario data, and outputs a voice to the voice recognition management unit 116. Issue a recognition request event. In addition, in each part of the agent processing unit 11,
Although the case of issuing an event and the case of using an API function have been described, it is possible to issue all events,
Alternatively, all may use API functions.

In FIG. 1, the external I / F unit 12 includes an emergency notification device 21, a storage medium driving device 23, and a communication control unit 2.
4 is connected, the image processing unit 13 is connected to the display device 27 and the imaging device 28, the voice control unit 14 is connected to the voice output device 25 and the microphone (voice acquisition means) 26, and the situation information processing unit 15 is connected. Is connected to various status detecting devices 40, and the input device 16 is connected to the input device 22.

The various situation detecting device 40 comprises a current position detecting device 41, a situation detecting section 42 and an emergency situation detecting device 43. The current position detection device 41 is for detecting the absolute position (by latitude and longitude) of the vehicle, and is a GPS (Global) that measures the position of the vehicle using an artificial satellite.
l Positioning System) receiving device 411, azimuth sensor 412, rudder angle sensor 413,
A distance sensor 414 and a beacon receiving device 415 that receives position information from beacons arranged on the road are used. GPS receiver 411 and beacon receiver 415
Can measure position independently, but GPS receiver 41
1 and a place where the beacon receiving device 415 cannot receive, the current position is detected by dead reckoning using at least one of the azimuth sensor 412, the steering angle sensor 413, and the distance sensor 414. The azimuth sensor 412 is, for example, a gyro such as a gas rate gyro or an optical fiber gyro that detects the azimuth of the vehicle by detecting the geomagnetism, a rotational velocity of the vehicle is detected, and the angular velocity is integrated to obtain the azimuth of the vehicle. A wheel sensor, etc., in which the wheel sensor is arranged and the amount of displacement of the azimuth is calculated by detecting the turning of the vehicle by the output pulse difference (difference in moving distance), is used. The rudder angle sensor 413 detects the steering angle α using an optical rotation sensor attached to the rotating portion of the steering wheel, a rotation resistance volume, or the like. As the distance sensor 414, various methods such as a method of detecting and counting the number of rotations of the wheel or a method of detecting acceleration and integrating twice are used. Distance sensor 414
The steering angle sensor 413 also functions as a driving operation status detecting unit.

The situation detecting section 42 functions as a driving operation situation detecting means for detecting the situation of a driving operation, a brake sensor 421, a vehicle speed sensor 422, and a direction indicator detector 42.
3, a shift lever sensor 424, and a side brake (parking brake) sensor 425. The situation detection unit 42 also includes an air conditioner detector 427, a wiper detector 428, and an audio detector 429 that function as a device operation situation detection unit that detects the situation of equipment operation.

The brake sensor 421 detects whether or not the foot brake is depressed. Vehicle speed sensor 422
Detects the vehicle speed. The turn signal detector 423 detects whether the driver is operating the turn signal and whether the turn signal is blinking. Shift lever sensor 424
Detects whether the driver is operating the shift lever and the shift lever position. The side brake (parking brake) sensor 425 detects whether the driver is operating the side brake and the state of the side brake (on or off).

The air conditioner detector 427 detects whether the driver is operating various switches of the air conditioner. The wiper detector 428 detects whether the driver is operating the wiper. The audio detector 429 is a radio, C
It is detected whether or not an audio device such as a D player or a cassette poker is being operated, and whether or not sound from the audio device is being output. In addition, the status detection unit 42 also serves as device operation status detection means, such as a light detection sensor that detects the operation status of lamps such as headlamps and room lamps, a seatbelt detection sensor that detects a driver's seatbelt removal operation. It is equipped with a sensor.

The emergency detecting device 43 includes a hazard switch sensor 431 and a collision sensor 432. The hazard switch sensor 431 detects the on / off state of the hazard switch and supplies it to the situation information processing unit 15. The situation information processing unit 15 supplies an emergency signal from the hazard switch sensor 431 to the situation determining unit 111 of the agent processing unit 11 when the switch-on state continues for a predetermined time t or longer. The collision sensor 432 is a sensor that detects a collision of the vehicle. In the present embodiment, the collision sensor 432 detects the collision by detecting that the airbag is activated, and supplies a detection signal to the situation information processing unit 15. Has become.

The input device 22 is used for the driver to input driver information, and for the driver to respond to all other inquiries from the agent according to the present embodiment.
It is also one means. The input device 22 is a predetermined traveling environment (transmission condition) of a vehicle that wants to transmit a request for information such as traffic jam information to the information providing station, the current location (departure point) and destination (arrival point) at the start of traveling in the navigation processing, It is also for inputting the type of mobile phone used in the car. As the input device 22, various devices such as a touch panel (functioning as a switch), a keyboard, a mouse, a light pen, a joystick, a remote controller using infrared rays, a voice recognition device, and the like can be used. Also,
A remote controller using infrared rays and the like, and a receiving unit for receiving various signals transmitted from the remote controller may be provided. On the remote control, in addition to the joystick for moving the cursor displayed on the screen, menu specifying keys (buttons),
Various keys such as a numeric keypad are arranged. The input device 22 is
In this embodiment, the driver is provided with an emergency call key for making an emergency call. Although the emergency call key in this embodiment has a dedicated button, it may be arranged on the touch panel. The input control unit 16 detects data corresponding to the content input by the input device 22 and supplies the data to the agent processing unit 11 and the navigation processing unit 10. The input control unit 16 functions as a device operation status detection unit by detecting whether or not the driver is performing an input operation.

The emergency call device 21 is adapted to establish emergency communication with the emergency agency when the emergency call key is selected or when an emergency situation is detected. Communication with the emergency department is based on the establishment of various communication lines such as a telephone line, a dedicated emergency line, and the Internet.

The storage medium drive unit 23 is a drive unit used to read a computer program for the navigation processing unit 10 and the agent processing unit 11 to perform various processes from an external storage medium. The computer program recorded in the storage medium includes various programs and data. Here, the storage medium refers to a storage medium in which a computer program is recorded, and specifically, a magnetic storage medium such as a floppy (registered trademark) disk, a hard disk, a magnetic tape, or a semiconductor storage such as a memory chip or an IC card. Medium, CD-ROM, MO,
A storage medium such as a PD (Phase Change Rewritable Optical Disk) from which information is optically read, a storage medium using a paper card, a paper tape, or the like, and a storage medium in which a computer program is recorded by various other methods are included.

The storage medium driving device 23 reads the computer program from these various storage media, and when the storage medium is a writable storage medium such as a floppy disk or an IC card, the navigation processing unit 10 The RAM of the agent processing unit 11, the data of the storage device 29, and the like can be written in the storage medium. For example, the IC card is made to store data such as learning contents (learning item data, response data) about the agent function and driver information, and the data is read from the IC card storing these even when driving another vehicle. By using it, it becomes possible to communicate with the agent in the learned state according to his / her past response situation. As a result, not the agent for each vehicle but the agent having the learning content unique to each driver can appear in the vehicle. It is also possible to store scenarios, emails, etc. The scenario data file may be stored in the IC card. This makes it possible to create an original scenario unique to each user.

The communication control unit 24 is adapted to be connected to, for example, a mobile phone including various wireless communication devices. The communication control unit 24 communicates with an information providing station that provides data relating to traffic information such as road congestion and traffic regulation in addition to telephone calls over telephone lines, and karaoke data used for in-car communication karaoke. It is possible to communicate with the information providing station that provides the. Further, it is also possible to transmit / receive learning data, a scenario data file, and the like regarding the agent function via the communication control unit 24. In the agent processing unit 11 of this embodiment,
An electronic mail with a scenario attached can be received via the communication control unit 24. Further, the agent processing unit 11 is provided with browser software for displaying a home page on the Internet, and can download data including a scenario from the home page via the communication control unit 24.
The communication control unit 24 may have a built-in wireless communication function such as a mobile phone.

The voice output device 25 is composed of a plurality of loudspeakers arranged in the vehicle, and the voice controlled by the voice control unit 14, for example, a guidance voice for voice route guidance and a driver by an agent. A voice or sound is output according to a normal conversation for communication or a question for acquiring driver information of the present embodiment.
The audio output device 25 may also be used as an audio speaker. The voice output device 25 and the voice control unit 14 together with the engine processing unit 11 constitute an inquiry means,
When an emergency call is made, an emergency question by the agent is output for each scene specified in the emergency question scenario.

The microphone 26 inputs a voice which is a target of voice recognition in the voice control unit 14, for example, an input voice such as a destination in a navigation process, a conversation between an agent and a driver (including a response by the driver), and the like. It functions as a voice input means for outputting. As the microphone 26, a dedicated microphone having directivity is used in order to accurately collect the driver's voice. The voice output device 25 and the microphone 26 may form a hands-free unit so that telephone communication can be performed without using a mobile phone.
The microphone 26 and the voice recognition unit 142 function as a conversation detection unit that detects whether or not the driver is in conversation with the fellow passenger. In this case, the microphone 26 and the voice recognition unit 142 detect the situation of the driver. It functions as a detection means. Further, the microphone 26 and the voice recognition unit 142 function as a passenger detection means by detecting whether or not there is a passenger from the conversation, and further recognize the siren sound of the ambulance vehicle to confirm that the ambulance crew has arrived. It functions as a means to detect the arrival of emergency personnel.

On the display device 27, a road map for route guidance and various image information by the processing of the navigation processing unit 10 are displayed, and various actions (moving images) of the agent by the agent processing unit 11 and parts of the screen configuration are displayed. It is supposed to be displayed. In addition, the imaging device 28
The images of the inside and outside of the vehicle, which are picked up in, are also displayed after being processed by the image processing unit 13. In the display device 27, according to the emergency question scenario of the present embodiment, a plurality of emergency question scene images displayed when an emergency agent agent in the appearance of an emergency agent asks an emergency question, and after the question is completed, the emergency agent arrives. A call scene image that is displayed until that time is displayed, a notification scene screen that notifies the information information of the patient collected to the ambulance crew, and the like are displayed. As the display device 27, various display devices such as a liquid crystal display device and a CRT are used. The display device 27 may have a function as the input device 22, such as a touch panel.

The image pickup device 28 is a C for picking up an image.
It is composed of a camera equipped with a CD (charge coupled device), and in addition to an in-vehicle camera for imaging the driver, each out-of-vehicle camera for imaging the front, rear, right side and left side of the vehicle is arranged. The image captured by each camera of the image capturing device 28 is supplied to the image processing unit 13 and subjected to processing such as image recognition, and each recognition result (presence / absence of passenger, recognition of driver, etc.) is communicated to the agent. It is supposed to be reflected.

The storage device 29 is connected to the storage device controller 17 so that data and programs can be read and written under the control of the storage controller 17. The storage device 29 stores agent data 30 and navigation data 31 as various data (including programs) necessary for realizing various agent functions and navigation functions according to this embodiment. The storage device 29 includes, for example, a floppy disk, a hard disk, a CD-ROM, an optical disk, a magnetic tape, an IC card, an optical card, a DVD (digit).
Various storage media such as an al versatile disc) and a drive device therefor are used. In this case, for example,
The learning item data 304, the response data 305, the driver information 307, and the scenario data file 302 are composed of a portable IC card or a floppy disk, and other data are composed of a DVD or a hard disk. It consists of a storage medium and a drive,
You may make it use those storage media as a drive device.

The agent data 30 includes an agent program 301, a scenario data file 302,
Voice data 303, learning item data 304, response data 305 composed of voice data, image data 306 for displaying the appearance and behavior of the agent, driver information 307, patient information 308, and other processing required by the agent Various types of data are stored.

The agent program 301 stores an agent processing program for realizing the agent function. For example, when it is determined in the condition determination processing that determines whether or not the activation condition of each scenario is satisfied, the condition determination processing determines that the activation condition is satisfied, the scenario corresponding to the activation condition is activated, and the agent is executed according to the scenario data. A process program for executing a scenario execution process that causes an action and various other processes is stored.

Learning item data 304 and response data 30
5 is data that stores the result learned by the agent according to the driving operation and response of the driver. Therefore, the learning item data 304 and the response data 305 are stored / updated (learned) for each driver. The learning item data 304 stores, for example, items to be learned by the agent, such as the total number of ignitions, the number of times of turning on per day, and the data of the remaining fuel amount at the time of refueling the previous five times. According to the learning content stored in the learning item data 304, for example, the greeting content at the time of appearance of the agent changes according to the number of times the ignition is turned on, or the fuel remaining amount becomes less than or equal to the average value of the fuel remaining amounts of the previous five times. In some cases, the agent makes a refueling proposal. The response data 305 stores a history of user responses to agent actions for each predetermined scenario. Response data 3
In 05, response date and time and response content are stored a predetermined number of times for each response item. As the content of the response, each case of ignored, rejected, accepted (accepted) is judged from the voice recognition and the input result of the input device 22 and stored.

The scenario data file 302 stores the data of the scenario in which the action of the agent in each situation and scene is defined, and also the emergency question scenario activated at the time of the emergency call of this embodiment. The scenario data file 302 in this embodiment is DV
It is stored in D. FIG. 3 conceptually shows the data structure and data contents of the scenario data file 302. In the scenario data file 302, a plurality of scenario data defining each scene are collected to form one file. The scenario data file 302 includes a file header, a scenario management table, an automatic start condition table, a list of manually startable scenarios, each scenario data 1 to n, and additional resource data.

The file header is a header of the scenario data file and stores information about the file. The scenario management table stores data for managing the scenario data recorded in the scenario data file, for example, data such as a priority order when executing each scenario data.

In the automatic start condition table, condition data for automatically starting the scenario data recorded in the scenario data file is defined and stored for each scenario data. As the automatic start condition, for example, a specific point and distance data regarding a specific scenario to be executed when a point at a predetermined distance from the specific point A, or an ignition on condition for executing a scenario in which an agent greets at startup is turned on. Stores various automatic start conditions such as a lapse of a predetermined time after starting. Further, as the automatic start prohibition condition for prohibiting the automatic start, for example, (A) manual start is prioritized, (B) automatic start is not performed while another scenario is being executed, (C) execution is performed within 30 minutes, for example. Some scenarios do not start, (D) do not start when listening to music, (E) do not start while turning the curve to the left or right (during steering operation), (F) do not start during sudden deceleration or sudden acceleration , (G) does not start while talking with a passenger, (H) does not start while operating various devices such as navigation device, audio device, air conditioner device, shift lever, side brake, wiper, turn signal,
(I) Do not start while using audio (condition for not disturbing listening to music or broadcasting: audio is not on), (J) Do not start during guidance guidance of the travel route by the navigation processing unit 10, etc. The automatic start prohibition condition of is also stored. However, the priority order is defined in the scenario management table so that the emergency question scenario or the like at the time of emergency call according to the present embodiment is automatically activated even when these automatic activation prohibition conditions are satisfied. The automatic start prohibition condition includes a condition commonly applied to each scenario and a condition applied to an individual scenario.

In this embodiment, the condition for activating the question scenario when the agent asks a question in order to collect the driver information is a condition for judging that the driver's load condition is a low load condition. The following conditions and other conditions are specified. (A) Do not execute a scenario for asking questions within one hour (conditions for not asking too many questions) (b) 15 minutes or more have passed since ignition was turned on (immediately after starting driving (C) There is no conversation in the vehicle (by collecting sound from the microphone 26) (d) There is no speed change for a predetermined time on a straight road (detected from the navigation data 31 and the current position). (E) Waiting for a signal (navigation data 3
1. Judgment from current position and vehicle speed) These question activation conditions are determined as to whether any one of the indispensable conditions for activation should be satisfied. For example, limited to the above conditions (a) to (e),
When all of (a) to (c) are satisfied and (d) or (e) is satisfied, the activation condition of the question scenario is satisfied, and the question scenario is activated. Even in this case, if the automatic activation prohibition conditions (A) to are satisfied, activation of the question scenario is prohibited. The start determination routine based on the automatic start condition including the question start condition is, for example, polled every one second.

Of the above conditions, condition (E),
(F), (H), (J), (d), (e) determines the load on the driving operation, and conditions (C), (D),
From (G), (I), (J), (a), (b) and (c), the degree of annoyance felt by the driver is determined.

The manually-startable scenario list stores list data of scenarios that can be manually started in the scenario data recorded in the scenario data file. The additional resource data stores audio data, image data, etc. to be added to the scenario data for expanding the storage device.

Each scenario data 1 to n is composed of a scenario header, a voice recognition dictionary DB, an image data management table, a scene management table, each scene data 1 to m, and actual image data. Each scenario consists of multiple scenes. The scenario header is a header section of scenario data and stores information about scenarios. The voice recognition dictionary DB is a DB of a voice recognition dictionary used in a scenario and stores voice recognition dictionary data. The image data management table stores data for designating an image used in a scenario. The image of the agent is stored in the image data 306, and the image unique to the scenario is stored in the actual image data at the end of the scenario data. The scene management table stores data for managing the scene data recorded in the scenario.

Each scene data 1 to m is a scene header,
It is composed of screen configuration data, character action instruction data, various processing instruction data, and a scene branch table.
The scene header is the header section of the scene data,
Information about a scene and data for managing each data section belonging to the scene data are stored. The screen configuration data is a section that defines the screen configuration displayed in the scene, and stores data of each part of the screen configuration displayed on the display device 27. The character action instruction data is instruction data regarding the action instruction of the character in the scene and the content to be spoken (the voice data 303 to be used).
Is stored. As the various processing instruction data, data for requesting a processing instruction to another module (for example, navigation) in the scene is stored. The scene branch table is a section that stores branch information from the scene to the next scene, and stores data that defines the next scene when an event is received in the certain scene.

FIG. 4 shows an example of a scene screen displayed on the display device 27 based on the scene data. The scene screen shown in FIG. 4 is a scene screen (question number 0x) of a question scenario in which a driver is asked a question in order to acquire a hobby preference (meal) which is uninput driver information.
0001). As shown in FIG. 4, the scene screen includes an agent display screen 51 on which an agent image (still image, moving image) is displayed, a balloon screen 52 on which characters corresponding to the agent's voice are displayed, a title screen 53, and , A scene display screen 54 on which image data specific to each scene (image of actual image data, answer selection button, etc.) is displayed.

When the hobby / preference (meal) question scenario is activated, the agent processing section 11 first reads the screen configuration data of the scene designated by the scene header from the scenario data file 302 and displays the scene screen on the display device 2
7, the question voice corresponding to the question sentence is output from the voice output device 25. Figure 4
In the scene screen of the question scenario of (a), “Which genre of meal do you like?” Is displayed on the balloon screen 52. The voice output device 25 outputs a voice corresponding to the display of the balloon screen 52. In addition, the scene display screen 5 in the scene screen of FIG.
In 4, the four answer selection buttons 54a of "Japanese food", "Western food", "Chinese food", and "None" are displayed.

A plurality of scenes corresponding to the driver's answer branch off and follow the scene of the question to the driver according to the scene management table. That is,
When the driver selects the answer selection button “Japanese food” on the scene screen (scene number 0x0001) of FIG. 4A, the agent processing unit 11 is branched and displayed on the scene screen (b) corresponding to the answer. In this scene screen (b), the selected "Japanese food" is displayed on the title screen 53, and "I like Japanese food" is displayed on the balloon screen. In the scene screen of Japanese food after branching, An actual image of Japanese food is read from the scenario data and displayed on the scene display screen 54. Then, the agent processing unit 11 stores the driver's answer, for example, “Japanese food” as driver information in the hobby / preference data of the driver information 307. In the case of the emergency question scenario of the present embodiment, an emergency question regarding the patient's condition or the like is asked for each scene, and each answer to the question is stored in the patient information 310. In this way, each scene image and sound specified in the scenario are continuously displayed and output until the last scene, whereby the action of the agent in one scenario is completed.

Voice data 303 in the storage device 29 (FIG. 1)
Stores voice data for the agent to have a conversation with the driver according to the scene of the selected scenario. As the voice data of the conversation by the agent, the voice data of the emergency question of the agent according to the present embodiment is also stored. Each data of the voice data 303 is designated by the character motion instruction data of the scene data.

The image data 306 stores a still image showing the state of the agent used in each scene designated by the scenario, a moving image (animation) showing the action, and the like. For example, a video in which the agent bows, a nod video, a video in which the right hand is raised, and the like are stored. An image code is attached to each of these still images and moving images. The appearance of the agent stored in the image data 306 does not have to be a human (male, female) appearance. For example, as a non-human agent,
It may be the appearance of animals such as octopus, chick, dog, cat, frog, rat, etc., or the appearance of animals that are humanly designed (illustrated), and even robotic appearance, floor stands, trees, etc. It may be the appearance such as or the appearance of a specific character. In addition, the age of the agent does not have to be constant, and as the learning function of the agent, the appearance of the child is initially set, and the appearance grows and changes over time (the appearance of an adult changes, and It will change to your appearance). Image data 306
Stores the images of the appearances of these various agents, and can be selected from the input device 22 or the like according to the driver's preference.

The driver information 307 is information relating to the driver and is used to make the action by the agent more suitable to the driver's wishes and hobbies. FIG. 5 conceptually shows the configuration of the driver information 307. As illustrated in FIG. 5, the driver information 307 includes driver ID (identification information), name, age, sex, marriage (married or unmarried), and child (presence / absence, number, age). Basic driver data, hobby and preference data, and health management data (not shown) are stored. The hobby and preference data is composed of major items such as sports, eating and drinking, and travel, and detailed items included in the concept of these major items. For example, the large-item sport stores detailed data such as a favorite soccer team, a favorite baseball team, and interest in golf. The health management data is data for health management, and if there is a chronic disease, the name of the disease, the symptom, the name of the family hospital, etc. are stored. In the present embodiment, priorities are determined for each of these pieces of driver information, and the agent asks the driver questions in descending order of priority among the driver information that has not yet been stored. . The driver basic data has a higher priority than the hobby and preference data.

The driver information 307 is created for each driver when there are a plurality of drivers who drive the vehicle. Then, the driver is specified and the corresponding driver information is used. The driver is specified by, for example, when the ignition is turned on, an agent common to all the drivers appears, inquires of the driver, and specifies from the answer. For the driver's inquiry, a button for selecting the name of the driver who has already entered and other information is displayed on the display device, and a voice prompting the selection is output. If other is selected, the new user registration screen is displayed. In addition, weight, fixed position of driver's seat (front and rear position, angle of backrest), angle of rearview mirror,
At least one driver-specific information such as the height of the line of sight, the data obtained by digitizing the face photograph, and the characteristic parameters of the voice is stored in the driver information 307, and the driver is specified from these information. Good.

The patient information 308 stores the patient's answer to the contents of the agent's question to the patient according to the emergency question scenario at the time of emergency call. This patient information 308
The patient information stored in (1) is transmitted to the emergency agency that has made an emergency call via the emergency notification device 21 or the communication control unit 24, and becomes the notification information after the emergency personnel arrive.

The navigation data 31 is a communication area data file, a drawing map data file, an intersection data file, a node data file, a road data file, a search data file, and a photo data file as various data files used for route guidance and the like. Various data such as is stored.

In the communication area data file, a mobile phone which is connected to the communication control unit 24 or is not connected and is used in the car displays the communication area on the display device 27 or routes the communication area. Communication area data to be used for searching is stored for each type of mobile phone. The drawing map data file contains the display device 2
7 stores drawing map data to be drawn. This drawing map data stores a hierarchical map, for example, map data for each layer such as Japan, Kanto region, Tokyo, Kanda from the highest layer. A map code is attached to the map data of each layer.

In the intersection data file, the intersection number for identifying each intersection, the name of the intersection, the coordinates (latitude and longitude) of the intersection, the number of the road where the intersection is the starting point and the ending point, and the presence or absence of a signal are included. It is stored as data. The node data file stores node data including information such as latitude and longitude that specify the coordinates of each point on each road. That is, this node data is data relating to one point on the road, and when connecting the nodes is called an arc, the road is represented by connecting each of the plurality of node strings by an arc. In the road data file, the road number that identifies each road, the intersection number that is the start point and the end point, the road number of the road that has the same start point and the end point, the thickness of the road, prohibition information such as entry prohibition, The photo number etc. are stored. Road network data composed of intersection data, node data, and road data respectively stored in the intersection data file, the node data file, and the road data file is used for route search.

The search data file stores intersection sequence data, node sequence data, etc., which form the route generated by the route search. The intersection row data is composed of information such as an intersection name, an intersection number, a photograph number showing a characteristic landscape of the intersection, a corner, and a distance. In addition, the node string data includes information such as east longitude and north latitude indicating the position of the node. The photograph data file stores photographs of each intersection and characteristic landscapes that can be seen while going straight ahead in a digital, analog, or negative film format corresponding to the photograph number.

Next, the operation of the agent device thus configured will be described. FIG. 6 is a flowchart showing the processing from the emergency call to the activation of the rescue agent. The agent processing unit 11 monitors whether the state of the vehicle or the like satisfies the automatic start condition of each scenario. Then, the agent processing unit 11 outputs a collision detection signal from the collision sensor 432, when the emergency call key is selected, when the hazard switch of the emergency detection device 43 remains on for a predetermined time t or longer. In this case, it is determined that an emergency call is necessary and the emergency agency (119) is notified via the emergency call device 21 (step 11).

Next, the agent processing section 11 determines whether or not the vehicle is in a safe place (step 12).
In the present embodiment, if the vehicle does not move for a certain period of time after making an emergency call (if the certain period of vehicle speed = 0 km / h),
The agent processing unit 11 determines that the vehicle is in a safe place (step 12; Y), activates the rescue agent (step 14), and ends the process. On the other hand, if it cannot be determined that the vehicle is in a safe place (step 1
2; Y), waiting for the vehicle to be moved by the driver (step 13), returning to step 12 to continue the determination on safety.

FIG. 7 is a flow chart showing the flow of the emergency inquiry scenario performed by the rescue agent. When the emergency question scenario is executed, in the first scene, the emergency agent appears on the screen of the display device 27 and introduces himself (step 21). Then, the process shifts to the next scene, and patient information is collected by an emergency question (steps 22 to 26). As the question items for the emergency question, for example, the name, age, sex, address, hospital of the visit, symptoms, blood type, etc. are targeted, and the scenes corresponding to these question items are defined.

The agent processing section 11 confirms whether or not the information to be collected by the emergency question is stored in the driver information 307 (step 22). If the answers to the question items are stored in the driver information 307 (step 2
2; Y), the emergency agent has the passenger "Yes"
Ask and confirm a question that can be answered (affirmative) or "no" (negative). For example, if the driver information 307 stores "8-?-X Nishi-Shinjuku, Shinjuku-ku, Tokyo" as the address information, the ambulance agent will ask, "The address of Mr. XX is 8-Shinjuku-ku, Shinjuku-ku, Tokyo. ? -X? "And ask questions in a format that can be answered with yes or no.
In this way, the information stored in the driver information 307 is queried in a confirmation format that can be answered with “yes” and “no”, so the burden on the patient can be reduced.

On the other hand, the information to be collected is the driver information 307.
Is not stored in (step 22; N), and
When a negative answer such as "No" is given in the confirmation in step 23 (step 23; No), the combined emergency agent asks the emergency question corresponding to the relevant question item (step 24). For example, if the question item is address information, an emergency question such as "Please tell Mr. XX's address" is asked. Confirmation of these question items (Step 2
3) and the question (step 24) are output by voice output of the emergency personnel and text display on the balloon screen 52 of the scene screen. If the confirmation by the emergency agent (step 23) is not answered for a certain period of time, the question in step 24 is asked. If the question in step 24 is not answered for a certain period of time, step 25 is skipped. Two
Go to 6.

Then, the confirmation contents for the question item and the answer to the emergency question are recorded (step 25). The recording of this answer is mainly performed by recording audio data. And when notifying the emergency personnel who arrived,
The voice of the agent and the recorded voice of the answer are connected and output. For example, “Mr. XX's address is” is output as a synthetic voice of the agent, the stored information “Shibuya-ku, Tokyo ...” is output, and the voice “is” is output.

Next, the agent processing section 11 judges whether or not the questions about all the emergency question items have been completed (step 26), and if not completed, the procedure returns to step 22 and the patient is asked by the emergency question of the next question item. Continue to collect information. On the other hand, when all the questions are completed (step 26;
Y), the agent processing unit 11 transmits the collected patient information to the emergency agency that made the emergency notification via the emergency notification device 21 or the communication control unit 24 (step 27), and then ends the processing.

FIG. 8 shows one of the calling scenarios activated after the patient information is collected according to the emergency question scenario.
It shows one scene screen. The calling scenario may be incorporated in the emergency question scenario.
That is, each scene of the calling scenario may be a scene following the last scene of the emergency question scenario. Figure 8
In the calling scenario, the emergency response agent 51a uses the voice output device 25 to maintain the patient's consciousness (maintain the awake state) even after the completion of the patient information in the emergency question scenario, as shown in FIG. Output a call. This call is for the purpose of avoiding the patient's loss of consciousness, so the voice output of the ambulance agent becomes the center, but as shown in FIG. 8, the call is also displayed in text on the balloon screen 52. Then, in order to maintain the visual awareness of the patient, the rescue agent 51a is operated in a large size so as to draw the patient's attention not by a still image but by a moving image.

When the ambulance agent 51a makes a voice call, the voice recognition unit 142 receives a response from the patient.
When it is recognized in step 1, the next call is made after a predetermined time (for example, 1 minute) has passed without continuously calling the call. When there is no response (reply) from the patient, the same call (in the example of Fig. 8, "Please secure Mr. ○○") is called continuously, and when there is a response, "Ambulance will be coming soon. Is it okay? "And make another call. In this case also, the content of the balloon screen 52 is changed in response to the change in the call. The voice recognition unit 14
If a call from a third party such as a passenger is recognized according to 2, the call from the ambulance agent will not be made.

During the call by the ambulance agent, the agent processing unit 11 measures the time after the emergency call, and the navigation data 31
The traveled distance from the location of the emergency engine to the vehicle is calculated, the estimated time until the emergency vehicle arrives is calculated, and the estimated arrival time 54d is displayed on the scene display screen 54.
By displaying the estimated arrival time and making a call based on the estimated arrival time, the patient can be encouraged.

The patient information key 54 is displayed on the scene display screen 54 on all scene screens in the calling scenario. When the patient information key 54e is selected (pressed or input by voice), the agent processing unit 11 outputs the patient information collected by the emergency question scenario.

FIG. 9 shows a scene screen according to a patient information notification scenario for outputting patient information. This patient information notification scenario is activated when the patient information key 54e in FIG. 8 is selected and when the siren sound of the ambulance is recognized by the voice recognition unit 142. In the patient information notification scenario, as shown in FIG. 9, the agent processing unit 11 arrives by reading the contents of the patient information stored in the patient information 308 sequentially from the speaker 25 with the voice of the rescue agent 51a, for example. Notify the members. In this scene screen, as shown in FIG. 9, the agent processing unit 11 displays characters corresponding to the voice content of the emergency agent on the balloon screen 52, and the scene display screen 54 displays all the collected contents. Sequential display is performed for each range that can be displayed on the screen. Scene display screen 5
An end key 54g is displayed on 4f, and the agent processing unit 11 repeatedly gives a voice notification of the collected patient information and a screen display notification until the end key 54g is selected by the rescue staff.

The patient information collected by the agent processing unit 11 and stored in the patient information 308 can be copied to a floppy disk, an IC card or the like via the storage medium driving device 23 by an operation requested by the emergency personnel. You may

As described above, according to the present embodiment, the emergency question scenario is activated after the emergency state is notified, and an appropriate emergency question is made based on the emergency knowledge.
Since the patient information such as the condition of the patient is collected from the response, it is possible to immediately provide the appropriate patient information when the rescue staff arrives. Further, the ambulance agent can ask the patient for an emergency question and call the patient even after the emergency question is completed, so that the patient can stay awake for a long time without losing consciousness.

Further, in the present embodiment, after the emergency question scenario is completed, the agent processing section 11 transmits the collected patient information from the communication control section 24 or the emergency notification device 21 to the emergency agency. Therefore, the ambulance organization can transmit the patient information received by the ambulance to the ambulance before the arrival at the site. This allows the paramedics to know the patient's condition and make the necessary preparations before arriving at the scene.

Although the embodiment of the agent device of the present invention has been described above, the present invention is not limited to the described embodiment, and various modifications can be made within the scope of the claims. is there. For example, in the above-described embodiment, the case of asking a confirmation question for the question items stored in the driver information 307 (step 23) has been described, but the driving collected by the dialogue with the driver (depending on the question scenario). Regarding the personal information, it is possible not to make a confirmation or a question again. Alternatively, the confirmation regarding the question item stored in the driver information 307 may be performed after the emergency question of the question item not stored or the question item other than the storage target of the driver information 307 is completed. Good.

Further, in the embodiment described, the case has been described in which the emergency agent is unilaterally notified to the emergency personnel of the patient information collected. On the other hand, based on the collected patient information, an emergency response agent answers questions to the patient's condition etc. from the emergency response personnel, creates an answer scenario, and activates it by inquiring from the emergency response personnel. You may

In the present embodiment, the case has been described in which the 119 call is made to the fire department as an emergency agency, but an emergency call may be made to its own emergency center. In this case, the emergency center that received the emergency call reports 119. The 119 call from the emergency center may be made immediately after receiving the emergency call, or the 119 call may be made after receiving the patient information collected by the ambulance agent and reviewing the patient information.

In this embodiment, the case where the scenario data file 302 including the emergency scenario (emergency question scenario, call scenario, notification scenario) is stored in the DVD has been described.
It may be executed by receiving from an emergency call destination (emergency agency or emergency center) by communication.

Although not processed in this embodiment, an image of the state inside the vehicle may be picked up by the image pickup device 28 and saved in the storage device 30 by an emergency call from the emergency call device 21. As a result, the condition of the patient after the emergency call can be confirmed by the actual image, and it can be used as important patient data for emergency activities. This image data is patient information 3
It is possible for the ambulance crew to take it back to a hospital or the like by copying it out from the storage medium driving device 23 to a predetermined storage medium together with the patient information stored in 08 and collected according to the question scenario.

For a certain period of time after making an emergency call, the ambulance agent agent may be manually activated (emergency scenario activation) on the display screen of the display device 27, or the ambulance agent activation key may be displayed on the screen. Good. This activation key may be displayed in the agent menu. As a result, even if the emergency scenario is not completed to the end, the patient (driver) etc. can call the ambulance agent again and start the scenario again.

[0077]

As described above, according to the present invention, it is possible to collect and provide accurate information in an emergency when it is necessary to dispatch emergency personnel.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an agent device according to an embodiment of the present invention.

FIG. 2 is a configuration diagram of an agent processing unit in the agent device.

FIG. 3 is an explanatory diagram conceptually showing the data structure and data contents of a scenario data file in the agent device.

FIG. 4 is an explanatory diagram showing a scene screen displayed on a display device based on scene data of a scenario.

FIG. 5 is an explanatory diagram conceptually showing the configuration of driver information in the agent device.

FIG. 6 is a flowchart showing the processing from the emergency call to the activation of the rescue agent in the agent device.

FIG. 7 is a flowchart showing a flow of an emergency inquiry scenario performed by the emergency agent in the agent device.

FIG. 8 is an explanatory diagram showing a scene screen of one of the calling scenarios activated after collecting patient information according to the emergency question scenario in the agent device.

FIG. 9 is an explanatory diagram showing a scene screen according to a patient information notification scenario for outputting patient information in the agent device.

[Explanation of symbols]

9 Overall processing unit 10 Navigation processing unit 11 Agent processing unit 12 External I / F section 13 Image processing unit 14 Voice control unit 15 Situation Information Processing Department 16 Input control unit 17 Storage device control unit 21 Emergency call device 22 Input device 24 Communication control unit 25 audio output device 26 microphone 27 Display 28 Imaging device 29 storage 30 agent data 31 Navigation data 40 Various status detectors 41 Current position detector 42 Status detector 43 Emergency detection device

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Kazuhide Adachi             2-19-12 Sotokanda, Chiyoda-ku, Tokyo Stock             Inside the company Equus Research F term (reference) 2F029 AA02 AC12 AC18                 5C087 AA02 AA03 AA09 AA10 AA24                       AA25 AA37 BB21 BB32 BB64                       BB65 BB73 BB74 DD03 DD14                       DD31 EE05 EE16 FF01 FF05                       FF17 FF19 FF20 GG07 GG11                       GG19 GG70                 5H180 AA01 EE08 EE15 FF04 FF05                       FF10 FF13 FF25 FF27 FF33                       FF40

Claims (4)

[Claims] 1. An emergency call means for making an emergency call to the emergency agency regarding the current position of the vehicle and the occurrence of an emergency in the event of an emergency requiring the dispatch of ambulance personnel; An inquiry means for causing an agent, which is an artificial artificial life object, to appear in the room, and asking the passenger about the passenger's condition; and an answer storage means for saving an answer from the passenger to the question by the inquiry means. And a status output unit that outputs the stored answer as patient information. 2. The agent device according to claim 1, wherein the inquiry unit makes an inquiry about an emergency question item for which the next question is determined according to an answer from the passenger. 3. The agent device according to claim 1, wherein the state output unit transmits the stored answer as patient information to an emergency agency which is the emergency call destination. 4. The storage device according to claim 1, further comprising storage means for storing information about passengers, wherein the inquiry means asks whether or not the information stored in the storage means is correct. Agent device.