JP2005283531A - Vehicle-mounted device and data-preparing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce the sense of incongruity for a passenger, with respect to a vehicle to outputted voice content. <P>SOLUTION: When a scenario preparer can assume the person who sits on each seat, speech (polite and frank expression) differing for each seat is set. When a person who sits on the seat cannot be foreseen, a scenario editor sets the type of a passenger (age, sex, social status), and speech corresponding to each type is created for each scene. An agent device specifies the type and seat position of a passenger, in advance, for example by asking questions and obtaining responses to the questions. A scenario for satisfying the automatic start conditions of the scenario is executed. When there are a plurality of speeches outputted at each scene and the seat is specified for each speech, speech is outputted from a loudspeaker at a position, corresponding to the specified seat. When the type of passengers to each speech is set, speech is outputted from a loudspeaker, corresponding to the type and seat position of the passenger that are specified, in advance. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an on-vehicle device and a data creation device, and for example, relates to an on-vehicle device having an agent function for carrying out a conversation or autonomously operating a device by communicating with a vehicle occupant, and the data creation device.

The following Patent Document 1 proposes an agent device that communicates with the passengers by interacting with the passengers by guiding the operation of the navigation device and other equipment in the passenger compartment and by asking questions and making suggestions according to the situation. Has been.
In this agent device, communication such as greeting of the agent and notification of refueling time is performed, and an image and a moving image corresponding to the content of the communication are displayed on the display device.

Patent Document 2 proposes a data creation device (scenario editor) that can easily create scenario data for various processes performed by such an agent device (on-vehicle device) regardless of the presence or absence of knowledge of a program. Yes.
In this data creation device, it is assumed that the processing is instructed by scenario data (which may include a part of the program) that specifies a scenario in which each scene is continuous, and the scenario data format is standardized. The contents of images and sounds are defined for each scene.
In the in-vehicle device, the scenario that satisfies the activation condition is automatically activated, and the character defined in the scenario is displayed as an image or output as audio.

JP 11-37766 A JP 2004-28720 A

In the conventional scenario creation device, the content of the agent's dialogue is defined by a text sentence. However, the content of the defined dialogue is one type in each scene, and the target of listening to the voice is not distinguished by anyone. The same lines are provided to the passengers (users).
However, while there are users of various ages, genders, and social status, from the elderly to children, the vehicle's passengers can speak only one type of agent's dialogue, so for some users, The meaning of dialogue may be difficult to understand or may be uncomfortable.

  An object of the present invention is to reduce a sense of discomfort of a vehicle occupant with respect to output audio content.

(1) In the invention described in claim 1, the screen configuration setting means for setting the screen configuration displayed by the in-vehicle display device, the voice setting means for setting the output voice for each type of vehicle occupant, and the setting Screen element creation means for creating a screen element as a format in which both the screen composition and the set sound are output, and screen element transition body data configured by continuously combining the created screen elements A screen element transition body creation means to be created is provided in the data creation device to achieve the object.
(2) In the invention described in claim 2, a screen element transition configured by continuously combining screen elements as a format in which a screen configuration and a sound defined for each type of vehicle occupant are output together. Screen element transition body storage means for acquiring and storing body data from outside the vehicle, a display device having a display screen, a passenger identification means for identifying the type of the vehicle passenger and the boarding seat position of the passenger, and the vehicle A plurality of audio output devices arranged on the screen, and a screen element transition body executing means for executing the screen element transition body data. Is displayed on the display device, and voice corresponding to the identified passenger type is output from the voice output device in correspondence with the boarding seat position of the passenger. .
(3) In the invention described in claim 3, the vehicle-mounted device according to claim 2, further comprising: question means for asking a question to the passenger; and response receiving means for receiving a response to the question from the passenger. The passenger identification means identifies the boarding seat position of the passenger and the type of the passenger according to the content of the response by the response receiving means.
(4) The invention described in claim 4 is the vehicle-mounted device according to claim 2, wherein the type of the passenger is at least one of age, sex, and social status.

According to the first aspect of the present invention, since the output voice is set for each type of vehicle occupant in the data creation device, the vehicle occupant's uncomfortable feeling with respect to the output voice content can be reduced. it can.
According to the invention described in claim 2 to claim 4, the type of the vehicle occupant and the boarding seat position of the occupant are specified, and the voice corresponding to the type of the passenger is sent to the boarding seat position of the passenger. Corresponding output from the audio output device can reduce the vehicle passenger's discomfort with respect to the output audio content.

Hereinafter, an agent device which is a preferred embodiment of the in-vehicle device of the present invention will be described in detail with reference to FIGS.
(1) Outline of Embodiment In this embodiment, as in Patent Document 2, a scenario composed of a plurality of continuous scenes is created by a scenario editor (data creation device), and the created scenario is executed by an in-vehicle device. .
In the present embodiment, a series of processing performed by the agent device according to the scenario will be described as an agent's action and operation.

Each scenario is composed of one or a plurality of continuous scenes with a scene (screen element) in which processing contents executed in synchronization with screen display are defined as a minimum unit.
Scenarios are developed from transition conditions (including conditions for scene branching) for transitioning from a predetermined scene to the next scene, and transition destination data that identifies the transition destination scene for the matched transition conditions. Configuration is defined.
In addition, in order to automatically execute each scenario, the autonomous activation condition is composed of a logical combination of date, time, position, road type, vehicle state, navigation device operating state, and individual conditions based on user data. The

In this embodiment, the scenario editor has a function of designating a seat of a vehicle and setting a dialogue for each seat for each scene.
For example, in a scenario assuming that an adult sits in the front seat and a child sits in the back seat, a polite line is set for the front seat and a frank line is set for the back seat.
Specifically, when setting the dialogue meaning “Today's good weather”, set “Today is good weather” for the front seat, and “Today is good weather” for the rear seat. Is set.

  When the scenario creator cannot assume a person sitting on the seat, the scenario editor sets the type of passenger (age, gender, social status), and creates dialogues corresponding to each type for each scene.

On the other hand, in the agent device (on-vehicle device), when the scenario is executed, the speech set for each seat position and passenger type is output from the speaker of the corresponding seat.
That is, the agent device specifies the passenger type and seat position in advance by asking a question and obtaining a response.
Then, when a scenario that satisfies the scenario automatic start condition is executed and there are multiple lines to be output in each scene, and a seat is specified for each line, a speaker at a position corresponding to the specified seat Output dialogue.
On the other hand, when the passenger type is set for each line, the line is output from the speaker corresponding to the passenger type and seat position specified in advance.

In this way, dialogue corresponding to the type of the passenger is created by the scenario editor, and the agent device provides a speech of an appropriate language to each passenger (user) by outputting from the speaker at the seat position of the passenger. be able to.
For example, even a child in the back seat who cannot understand the meaning of the word “weather” can understand the content of the line “weather”.
In particular, in the case of an agent device installed in a vehicle such as a 1BOX car where the distance between the front seat and the rear seat is long, the audio output from the speakers at each position does not interfere so much, so the content of the dialogue between the front seat and the rear seat By changing the output, it is possible to convey in an easy-to-understand manner to the front seat and rear seat users with different phrases.

(2) Details of Embodiment FIG. 1 shows an overall system configuration including an agent device (on-vehicle device), a scenario creation device (data creation device), and a server.
In this system, a scenario creation device (computer) 2 (2a, 2b,...) Incorporating a scenario editor, which is a scenario creation program, and servers 3 (A, B,...) That distribute scenarios via a network such as the Internet. ) And an example of the configuration of the agent device 1.
The scenario creation device 2 creates scenario data according to a standard specified in accordance with a scenario creation program by an operation of a scenario data creator who is a user or a third party.

The scenario creator can create scenario data in a predetermined format using the scenario editor 2a using the scenario editor, post it on the homepage (upload to the server 3A), and download it from the user with the agent device 1 To.
The server uploaded from the scenario creation device 2 is not limited to the server 3A, and may be any server 3A, 3B,... On the Internet, such as a provider contracted by the scenario creator. Further, another scenario creator creates the scenario with the scenario creation device 2b, posts it on the homepage, uploads it to the server B, and makes it downloadable from the user who has the agent device 1.
In this way, various scenario creators upload their created scenarios to various servers.
The user of the agent device 1 uses the browser of the agent device 1 to browse the scenario he / she wants from the server 3 group (A, B,...), Downloads the scenario he / she likes, By incorporating it into the device, the downloaded scenario data can be operated on the agent device 1.

Further, the user of the agent device 1 browses and downloads the scenario he / she wants from the server 3 (A, B,...) Using the browser of the scenario creation device 2a he has. May be.
In this case, the downloaded scenario data or self-made scenario data is stored in a semiconductor storage device or other storage medium such as a DVD-ROM or an IC card, and delivered to the agent device 1. The agent device 1 that has received the scenario data reads the scenario data from the storage medium by the storage medium driving device and incorporates it, so that the downloaded scenario data can be operated on the agent device 1.

Next, the configuration and operation of the agent device 1 in which an agent autonomously starts according to a scenario created by a developer or a user will be described.
FIG. 2 is a block diagram showing the configuration of the agent device 1 in the present embodiment.
The agent device 1 according to the present embodiment is mounted on a vehicle and travels to a user in addition to an agent function such as a function of communicating with a user in the vehicle and a vehicle control function of performing predetermined processing on the vehicle. It also has a navigation function for route guidance.

The agent function of the agent device 1 according to the present embodiment includes a passenger identification function that identifies a passenger when the presence or change of the passenger is detected.
As a passenger identification function in the present embodiment, when a new passenger is detected in the passenger seat, a question such as “Who is the passenger in the passenger seat?” Is identified, and the type of the passenger is identified from the answer. . For example, if the user is a registered user, the type is specified from the user information and answer such as name, and if the user is not registered, the type is specified from the question and answer about age, gender, and social status. .

  Further, in the agent function of the agent device 1 in the present embodiment, when a plurality of lines and a seat position or a passenger type are set in the scenario scene, a speaker corresponding to the seat position or the passenger type is specified. And a function to output a corresponding line from the specified speaker.

  In the agent device of this embodiment, the central processing unit (1), the display device (2), the voice output device (3), the voice input device (4), the input device (5) for realizing the agent function and the navigation function. ), Various status detection devices (6), various in-vehicle devices (7), a communication control device (8), a communication device (9), and an information storage device (10).

  The central processing unit (1) includes a CPU (1-1) that executes various arithmetic processes, a flash memory (1-2) that reads and stores a program from the information storage device (10), and a flash memory (1-2) ROM (1-3) that stores the program (program reading means) that performs the program check and update processing of the RAM, and RAM (1-4) that temporarily stores the data being processed as the working memory by the CPU (1-1) ), Clock (1-5), image memory (1-7) that stores image data used for screen display on display device (2), based on display output control signal from CPU (1-1) Image processor (1-6) that extracts image data from image memory (1-7), performs image processing and outputs it to display device (2), and converts audio output control signals from CPU (1-1) to analog signals Conversion and output to the audio output device (3) and conversion of the analog signal input from the audio input device (4) into a digital audio input signal To receive information from the audio processor (1-8), the input device I / F unit (1-9) that receives input from the input device (5), and detectors for detecting various situations Various input I / F units (1-10), communication I / F units (1-11) for exchanging information with other devices, information storage media such as CD-ROMs, IC cards, and hard disks (10-2) ) Includes an information storage device I / F unit (1-12) for reading information such as data and programs from / to the information storage device (10) for writing information.

This central processing unit (1) is a route search process, a display guidance process necessary for route guidance, and other processes necessary for the entire system, such as browsing the Internet and downloading scenarios using mail, in this embodiment. Agent processing (various communication between the agent and the driver, operation proxy, situation determination, and autonomous processing according to the result) is performed.
All the programs executed by the CPU (1-1) including the program in the present embodiment may be stored in a CD-ROM or the like as the information storage medium (10-2), or a part of the programs Alternatively, all may be stored in the ROM (1-3) or the flash memory (1-2) on the main body side.
Data and programs stored in the information storage medium (10-2) are input as external signals to the central processing unit (1) and processed to realize various agent functions and navigation functions. It has become.

  The central processing unit (1) of the present embodiment determines whether or not the input from various status detection devices satisfies the activation condition according to the autonomous activation determination program stored in the ROM (1-3). It functions as a judgment means.

The central processing unit (1) functions as an inquiry unit and a response reception unit by specifying the seat position and type of the passenger in accordance with the passenger identification processing program.
In addition, the central processing unit (1), in accordance with the output speaker determination processing program, based on a plurality of lines defined in each scene and a seat (sound output position) corresponding to each line ) To function as a sound output position determining means.

Further, the central processing unit (1) executes a scenario satisfying the autonomous activation condition according to the scenario execution program stored in the ROM (1-3), and executes the screen element transition body data at that time. The screen element transition body is displayed by displaying a screen defined in each scene and outputting a speech (voice) corresponding to the identified passenger type from the speaker in correspondence with the boarding seat position of the passenger. It functions as an execution means.

The display device (2) displays various image information such as a route map for route guidance and operation keys for navigation by the processing of the central processing device (1), and various actions (moving images) of characters and screen configurations. A screen element transition body (scenario) composed of parts is displayed.
As this display device (2), various display devices such as a liquid crystal display device and a CRT are used.
The display device (2) may have a function as an input device (5) such as a touch panel.

The voice output device (3) is a guide voice when performing route guidance by voice by the processing of the central processing unit (1), a conversation for normal communication with the driver by the agent, and a question for obtaining passenger information. Voices and sounds according to (including questions for specifying the passenger type and passenger seat position) are output.
The audio output device (3) is composed of a plurality of speakers arranged in the vehicle.
Each speaker of the audio output device (3) is disposed in the driver's seat, the passenger seat, and the rear seat, and can be set on and off independently. These may also be used as audio speakers.

In the voice input device (4), the input voice of the driver is converted from an analog signal to a digital signal, and voice recognition processing is executed by the CPU (1-1).
Examples of voices that are subject to voice recognition include input voices such as destinations in navigation processing, driver conversations with agents (including responses by drivers), and the like.

The input device (5) is a response means for the driver to respond to inquiries from the agent in communication with the agent by the agent function in addition to the destination setting, route search, route guidance request It is supposed to function as well.
As the input device (5), various devices such as a touch panel (functioning as a switch), a keyboard, a mouse, a light pen, and a joystick can be used.

Various situation detection devices (6) are not particularly shown, but as a device operation situation detection means, a current position detection device that detects the absolute position of the vehicle (by latitude and longitude), a road congestion situation, etc. Traffic condition information receiving device, brake detector, side brake (parking brake) detector, accelerator opening detector, A / T shift position detector, wiper detector, direction indication to detect the situation such as driving operation Detector detector, hazard detector, ignition detector, vehicle speed detector that detects vehicle speed, light detector that detects the operating status of lamps such as headlamps and room lamps, and detection of driver's seat belt attachment / detachment operation It has a seat belt detector and various other detectors.
Current position detection devices include, for example, a GPS (Global Positioning System) receiver that measures the position of a vehicle using an artificial satellite, a data transmitter / receiver that receives GPS correction signals, an orientation sensor, a steering angle sensor, a distance sensor, etc. Is used.
As the traffic information receiving apparatus, for example, a beacon receiving apparatus that receives information from beacons arranged on the road, an apparatus that receives information using FM broadcast radio waves, and the like are used.

In addition, a communication control device (8) can be connected to the communication device I / F unit (1-11). The communication control device (8) is connected to a communication device (9) (such as a mobile phone made up of various wireless communication devices).
In addition to telephone line communication using these, communication with information providing stations that provide traffic information, communication with information providing stations that provide scenario data used for agent processing, communication device (9) and communication control device ( It is also possible to carry out via 8).

In the present embodiment, the central processing unit (1) can receive an electronic mail to which a scenario is attached via the communication control unit (8).
In addition, the central processing unit (1) can incorporate browser software that displays homepages on the Internet and can be processed by the CPU (1-1). You can download the data including.
The communication control device (8) may be integrated with the communication device (9).

The information storage device (10) includes an information storage medium driving unit (10-1) and its information storage medium (10-2). The information storage device (10) controls the information storage medium driving unit through the information storage device I / F unit (1-12) according to an instruction from the CPU (1-1), and the information storage device (10-2) Data and programs are read, and data and programs are written to the information storage medium (10-2).
As the information storage medium (10-2), for example, various storage media such as a flexible disk, a hard disk, a CD-ROM, a DVD-ROM, an optical disk, a magnetic tape, an IC card, an optical card, and the like are used. Each information storage medium driving device (10-1) is used.

  CPU (1-1) is a program (10-2-1) that implements various agent functions and navigation functions, as well as agent data (10-2-3) and navigation data (10-2-2) used for arithmetic processing. Is stored (installed) in another information storage device (for example, a hard disk device) from the DVD-ROM or IC card shown in the above configuration example, and necessary programs are stored in the flash memory (1-2). The data may be read (loaded) and executed, or data necessary for the arithmetic processing may be read (loaded) from the storage device into the RAM (1-4) and executed.

Next, the configuration of software to be executed will be described.
The agent device according to the present embodiment includes an agent processing unit that realizes an agent function, and an overall processing unit that controls the entire device and mainly implements a navigation function. Between the agent processing unit and the overall processing unit, The mutual processing data can be acquired.
For example, when the agent processing unit acquires the destination data from communication with the driver according to the scenario data, the agent processing unit supplies the acquired target value data to the overall processing unit.
The overall processing unit searches for a route based on the supplied destination data and performs route guidance based on the generated travel route data. In this route guidance processing, data necessary for guidance can be supplied from the overall processing unit to the agent processing unit, and the agent can guide in accordance with scenario data obtained by converting a scenario for guiding the traveling route into data.

Although not shown, the overall processing unit includes a map drawing unit, a route search unit, a route guidance unit, a current position calculation unit, a destination setting operation control unit, etc., and an application unit that performs navigation signal output processing, as well as map display and route guidance. It is composed of an OS unit and the like for a program for performing display output control necessary for voice and voice output control necessary for voice guidance.
The overall processing unit also includes a speech recognition processing unit that performs speech recognition and a processing unit that converts text data into speech data.

The overall processing unit detects the presence of a passenger according to the passenger identification processing program, identifies the seat position and type (age, gender, etc.) of each passenger, and temporarily stores them in the RAM (1-4).
The passenger seat position and type temporarily stored in the RAM are used when the agent processing unit determines the speaker position corresponding to the dialogue when executing the scenario.

Next, the configuration of the agent processing unit will be described.
FIG. 3 shows the configuration of the agent processing unit (101).
The agent processing unit (101) includes a scenario driving unit (101-1), an autonomous activation determination unit (101-2), a learning unit (101-3), a character psychology unit (101-4), a drawing / A voice output unit (101-5), a voice recognition unit (101-7), an agent OS unit (101-8), and an external I / F unit (101-9) are provided.

  The scenario driver (101-1) reads the scenario data (10-2-3-4) and instructs each processing unit using message communication based on the scenario data (functions provided by each processing unit). use. The scenario driving unit (101-1) performs central processing of the agent processing unit such as managing scenario execution and providing various agent functions to the driver.

The autonomous activation determination unit (101-2) holds the autonomous activation condition data of each scenario in the scenario data (10-2-3-4), and the periodic activation issued by the agent OS unit (101-8) Various conditions such as time, position, and state are compared with various situations in accordance with an activation determination instruction, and determination is performed.
When the conditions are matched, the autonomous activation determining unit (101-2) issues an instruction to execute the scenario having the matched conditions to the scenario driving unit (101-1).
Various situations for comparison with the autonomous activation conditions are obtained from the agent OS unit (101-8) and the learning unit (101-3).
In addition to the periodic autonomous activation determination instruction, if the change in the situation is considered to be large, the autonomous activation determination instruction is issued from the agent OS unit (101-8). ) Performs autonomous activation determination processing. For example, when the driver makes a destination setting, when the driver leaves the driving guidance route using the navigation function, when scenario data is added, or when scenario data is deleted Etc.

The learning unit (101-3) displays the items (execution results and execution history) obtained by the driver's selection and response in communication with the agent as passenger information data (10-2-3-6) and learning item data. And response data (10-2-3-7).
The character psychology unit (101-4) obtains the current situation managed by the agent OS unit (101-8), and based on the mental model change condition data, the five parameters that represent the character's psychological state (energetic and friendly) , Autonomous, self-confidence, morals).

  The drawing / sound output unit (101-5) creates a control signal for displaying a screen composed of parts such as a selection button and a title in response to an instruction from the scenario driving unit (101-1). Further, in response to an instruction from the scenario driving unit (101-1), a control signal for displaying various actions (motions) of the character corresponding to the display state based on the scene data is also created.

The drawing / speech output unit (101-5) also creates a control signal for outputting a dialogue when the agent communicates with the driver in response to an instruction from the scenario driving unit (101-1).
The drawing / sound output unit (101-5) outputs speech corresponding to each of the speakers determined by the output speaker determination processing of the scenario drive unit (101-1).

  The voice recognition unit (101-7) issues a control signal for causing the voice recognition processing unit in the overall processing unit to create a voice recognition dictionary in response to an instruction from the scenario driving unit (101-1).

  The agent OS section (101-8) acquires changes in the situation (including addition of scenarios) such as time, place, and various inputs, manages the current situation, and sends a message to the situation change as necessary Notify each processing unit by communication. The change of the situation is obtained from the entire processing unit through the external I / F unit (101-9) or obtained through an inquiry.

  The agent OS unit (101-8) regularly issues an autonomous activation determination instruction to the autonomous activation determination unit (101-2). This periodic autonomous activation determination instruction is issued every predetermined time. The predetermined time may be as short as possible within a range in which the autonomous activation determination process periodically processed by the autonomous activation determination instruction issued periodically does not affect other processes of the entire central processing unit (1). Desirably, the interval is set to 5 seconds in this embodiment. The predetermined time may be arbitrarily changed by the user by an operation from the input device (5).

  The agent OS unit (101-8) also issues an autonomous activation determination instruction to the autonomous activation determination unit (101-2) even when it is determined that the change in the situation is large. Cases where the change in the situation is considered to be large include, for example, when the driver has set a destination, the vehicle has been removed from the guide route, scenario data has been added, scenario data has been deleted, etc. Yes, relevant items are defined in advance and stored in RAM (1-4) or the like.

  The external I / F unit (101-9) is an interface between the agent processing unit (101) and the overall processing unit (the entire processing unit has an agent I / F unit as a receiver). Acquisition of various types of information such as navigation information used in agent processing, and transmission of control signals from the agent processing unit to the entire processing unit control navigation.

Next, a data structure (including a program) will be described. In the present embodiment, these are stored in the information storage medium (10-2).
FIG. 4 conceptually shows the information collected in the information storage medium (10-2).
The information storage medium (10-2) includes a program (10-2-1) for realizing various agent functions and navigation functions according to the present embodiment, and agent data (10-2-3) and navigation as necessary various data. Data (10-2-2) is stored.

  The navigation data (10-2-2) is composed of various data necessary for map drawing, route search, route guidance, destination setting operation, and the like. For example, map data (road map, house map, building shape map, etc.) necessary for route guidance and other data files are stored, and all data necessary for the navigation device is stored.

  Agent data (10-2-3) includes mental model data (10-2-3-1), scenario data (10-2-3-4), character data (10-2-3-5) Passenger information data (10-2-3-6), learning item data and response data (10-2-3-7), and genre / output position correspondence table (10-2-3-8) It is configured. In addition, there are also recommended suggestion data, knowledge data, etc. for making recommended restaurant proposals in the agent data (10-2-3).

The mental model data (10-2-3-1) is composed of five parameters (friendliness, obedience, confidence, morality, spirit) indicating the character's psychological state and mental model change condition data. .
The learning item data and the response data (10-2-3-7) are data for storing the results learned by the agent by the driver's selection and response in communication with the agent.

FIG. 5 shows a configuration of scenario data executed by the in-vehicle device.
Scenario data (10-2-3-4) consists of multiple scenarios. It consists of acquisition scenario management data for managing them and data (scenario itself) indicating the contents of each scenario. ing.

  The acquisition scenario management data includes information such as the expiration date of the scenario data, date of creation, creator, etc., and data for overall management of each scenario recorded in the scenario data (scenario Number, scenario name, priority (priority)), and autonomous activation condition data of the scenario recorded in the scenario file are recorded.

As shown in FIG. 5, the data indicating the contents of each scenario includes management data for managing each scenario and scene data indicating the contents of individual scenes constituting the scenario.
Scenario management data for managing each scenario includes scenario information, text information for creating a speech recognition dictionary used in this scenario, and data for overall management of each scene data constituting the scenario. Is marked.

The scene data includes scene management data for managing a scene, screen configuration data, character motion data, various processing data, and development management data.
The scene management data includes information relating to the scene and data for managing each data section belonging to the scene data.

  In the scene management data, when a plurality of dialogues to be output in each scene are set by the scenario creation device, and the output position or passenger type of each dialogue is set, the output set for each dialogue in the scene Information of position or passenger type is stored.

In the screen configuration data, the data defining the configuration of the scene components such as the character image and the balloon screen displayed on the display device (2) in this scene, and the size and display position of each scene component are described. .
The character action data includes instruction data for actions performed by the character in this scene, and instruction data related to the content to be spoken. In the instruction data of the action, the instruction data is written in one of two types: scenario data that is directly instructed by means of expressing each character, and that that is instructed in a state that the character wants to express.

Various processing data includes information for controlling (processing) external devices in this scene, information for controlling navigation, instructions for executing other scenarios, timer setting information, and mental models that indicate character psychology. Information for changing the parameters is described.
The development management data describes information such as whether to end the scenario, what is the next scene, or nothing to be developed when an event occurs in this scene.

In FIG. 4, character data (10-2-3-5) stores data of a plurality of characters, and can be selected from the input device (5) or the like according to the driver's preference. Yes.
The character data (10-2-3-5) includes character image data 102351, character voice data 102352, and character image selection data 102353 for each character A, B,.

The passenger information data (10-2-3-6) in Fig. 4 is mainly information related to the driver and is used to make the agent's communication more suitable for the driver's wishes, hobbies and preferences. The However, not only the driver but also information related to passengers in the passenger seat and the rear seat is stored.
The passenger information data (10-2-3-6) contains the driver ID (identification information), name, age, gender, marriage (married or unmarried), child, for storing information for each passenger. Passenger basic data including the presence / absence, number, age, social status, etc., and hobby preference data such as sports and food and drink are stored.

The other passenger information data (10-2-3-6) may store the number of seating positions as a passenger and the weight of the passenger. The weight of the passenger can be stored by automatically measuring the weight of the passenger from a pressure gauge or the like placed on the seat. The passenger's weight is used to estimate the passenger and their seat position, and the estimated passenger is inquired by name such as “Is the passenger seat? Can be used to identify the occupant.
In addition, as means for specifying the passenger, in addition to the weight, the passenger for each seat may be photographed by a camera, and the passenger may be specified by image recognition. In this case, image data obtained by photographing the passenger's face in advance is stored in the passenger data.

FIG. 6 shows the transition of the scene screen according to the guidance scenario transmitted from the inn to the prospective guest for each scene.
This guidance scenario is composed of scene screens (a) to (f) among a plurality of scene screens.
The next scene screen is branched into 4 and 6 depending on the user's selection result for the scene screen (c). Although not branched in the example of FIG. 6, the scene screen may be branched so that dishes corresponding to the selected dish type are displayed on the scene display screen 54 in the scene screen (d).

First, the screen configuration of the scene screen displayed on the display device (2) based on the scene data of the scenario will be described.
As shown in the scene screen (a), an agent display screen 51 on which an agent image (still image, moving image) is displayed, a balloon screen 52 on which characters corresponding to the voice of the agent are displayed, a title screen 53, and It consists of a scene display screen 54 that displays image data unique to each scene (images of actual image data, answer selection buttons, etc.).
The agent displayed on the agent display screen 51 is a character selected by the user or a default character.

Hereinafter, each action of the agent according to the reservation scenario will be described with reference to FIG.
The agent operations and screen displays described below corresponding to each scene screen are displayed according to data, images, and instructions stored in the scenario data of the external scenario. Further, although described as an agent operation, the scenario driving unit (101-1) of the agent processing unit (101) actually performs the processing.

When the scenario driving unit (101-1) of the agent processing unit (101) starts the guidance scenario, it first reads the screen configuration data of the number 1 scene specified by the scene header from the scenario data and displays it (2). To display. In this scene, the agent of the character managed by the agent OS section (101-8) appears on the agent display screen 51, bows and greets with voice. The content of the voice greeting is the same as the text displayed on the balloon screen 52.
The greeting by voice is performed on behalf of the inn by the agent, but it is expressed that the inn is a greeting from the inn by displaying a photo image of the general of the inn on the scene display screen 54.

The voice by the agent including this greeting is output from a speaker at a position determined for each line when a plurality of lines and a seat position to be output or a passenger type are defined for the scene.
In this scenario example, a case where only one type of dialogue is set for each scene will be described. In this case, the speech is output from all speakers.

The image of the landlady in scene (a) is an image received and added as part of the external scenario, and is stored as actual image data of scenario data (10-2-3-4).
The instruction for the action of the agent follows the instruction stored in the character action instruction data.
When the greeting by the agent ends, transition to the next scene 2 (transition).

In the next scene 2, an open-air bath image is displayed on the scene display screen 54. Then, the agent points to the picture of the outdoor bath, and the agent explains the specialty of the inn (that it is for sale) by displaying the dialogue (voice) and the balloon screen 52.
When the agent's story ends, the scene transitions to the next scene 3, and the image of today's meal (an image of kaiseki cuisine) is displayed on the scene display screen 54. The agent explains the dish and whether or not this dish is acceptable. Question.

It is assumed that the scene data of scene 3 defines a timer setting time and a timer setting condition “set only during running”. In this case, counting by a timer is started at the start of the scene on condition that the vehicle is running. The vehicle speed sensor (6-11) or the distance sensor (6-1-5) determines whether the vehicle is running or not when the vehicle speed v = 0 is detected, and the vehicle speed v ≠ 0 is detected. It is determined that the vehicle is traveling.
If the user selects “Yes” as an answer to the question as to whether or not the displayed dish is acceptable, the process branches to Scene 4, and if “No” is selected, the process branches to Scene 6.

On the other hand, if the user gives a timer notification (elapsed set time) without answering by voice or selecting a selection button displayed on the screen within the timer set time, it is specified by the scene 3 scene data. The scenario is terminated according to the transition condition at the time of timer notification.
In this way, even when there is no answer from the user, it is determined that no answer has been selected, and the process shifts to the next scene (end in the example of FIG. 6) using no answer as a transition condition. It is possible to make the communication with the character converted closer to the communication between humans.

In the scene 4, a selectable list other than kaiseki cuisine is displayed on the scene display screen 54. The agent points to the list on the scene display screen 54 and asks which dishes are good.
Then, when the user selects any one, the scene 5 is transitioned to.
In scene 5, a list of the number of people to be changed from kaiseki cuisine is displayed on the scene display screen 54, and the agent points to this list and asks the number of people.
When the user selects any one, the screen transitions to the scene 6.

In scene 6, an external appearance photo image of the inn is displayed on the scene display screen 54, and the agent bows and greets.
Then, as a result of the selection made by the user, the agent is connected to the communication control device (8) from the communication device I / F unit (1-11), in the case of the guidance scenario of FIG. The external scenario being executed is transmitted to the third party (inn) that has been transmitted via the communication device (9).

In this way, when the user wants to obtain information about the user, the creator of the external scenario creates a scenario in which a scene of a question from which the desired information can be obtained is provided in the scenario and the response is sent by e-mail. To do. If it is necessary to send an answer, the e-mail address of the creator is included in the scenario data.
When the agent's story in the last scene (scene 6 in FIG. 6) ends, the scenario ends.
In this way, the scenario driving unit (101-1) sequentially displays and outputs each scene image and sound specified in the scenario up to the last scene.
When the activated scenario ends, the scenario driving unit (101-1) determines whether there is an activation request for executing another scenario.

Processing operations in the agent device 1 configured as described above will be described.
FIG. 7 is a flowchart showing passenger identification processing by the overall processing unit of the agent device 1.
The entire processing unit of the agent device 1 monitors whether or not a passenger has boarded the vehicle (step 71). When the passenger is detected (step 71; Y), the passenger is identified to identify the passenger. (Step 72).

That is, the overall processing unit outputs a question that asks the passenger about at least one of age, gender, and social status from the voice output device (speaker) 3 and provides a selectable answer on the display device. List display.
If the weight of the passenger is measured and the passenger of the corresponding weight is estimated from the passenger information data 10-2-3-6, the passenger at the seat position where the weight is measured is estimated by the passenger. Output a question to check if there is any.

  The overall processing unit monitors the response to the question (speech or designation from the touch panel of the display device), and if there is a response (step 73; Y), the passenger seat position and type (age, gender) corresponding to the response Etc.) are temporarily stored in the RAM (1-4), and the process returns to the main routine.

Next, agent processing executed by the agent processing unit (101) will be described.
FIG. 8 is a flowchart showing the operation of the agent process.
In the agent processing, the autonomous activation determination unit (101-2) acquires the current status information from the agent OS unit (101-8) via the agent I / F to obtain the current status information. Status information is acquired (step 80).
Then, the autonomous activation determination unit (101-2) determines whether or not there is a scenario that satisfies the autonomous activation condition from the acquired situation information (step 81).

When there is an autonomous activation condition that satisfies the condition from the current situation information (step 81; Y), the autonomous activation determination unit (101-2) sends a scenario execution request message corresponding to the autonomous activation condition, The scenario driver (101-1) issues scenario data to be executed from the scenario data (10-2-3-4) to the work memory (RAM (1- 4)) (step 82).
When the reading of the scenario data is completed, the scenario driving unit (101-1) performs an initialization process (scenario start process) for starting the scenario (step 83).

Next, the scenario driving unit (101-1) executes scene processing for processing character drawing and sound according to the contents of the scenes constituting the scenario (step 84).
That is, in the scene processing, the scenario driving unit (101-1) refers to the RAM (1-4) in which the scenario data read in step 82 is temporarily stored, and displays the screen configuration to be displayed, the character motion instruction, and the like. To analyze.
Then, in accordance with the rules for each scene data, the scenario drive unit (101-1) creates output speech (voice data) and character drawing data and instructs the drawing / voice output unit (101-5) to draw.

At that time, the scenario driving unit (101-1) determines whether or not there are a plurality of lines to be output in conjunction with the character drawing data created based on the scene data, and if there is only one, outputs the line. The drawing / sound output unit (101-5) is instructed to output all speaker positions (sound output positions) as speakers as output positions for the scene.
On the other hand, when there are a plurality of lines for the scene being processed, the scenario driving unit (101-1) displays the information on the voice output position or the passenger type stored in the scene management data (see FIG. 5). read.

When the voice output position is stored, the speaker position corresponding to the voice output position (seat position) set corresponding to each line is determined for each line, and is drawn together with the character drawing data. Instructs the audio output unit (101-5).
On the other hand, when the passenger type is stored in the scene management data, the passenger type set in each line is associated with the passenger specified in advance in the passenger specifying process (FIG. 7). The speaker position of the corresponding passenger position is determined, and the drawing / audio output unit (101-5) is instructed.

  In accordance with the character drawing data from this scenario drive unit (101-1) and the instruction of the speaker position of the output dialogue, the drawing / sound output unit (101-5) bows the character or changes the right direction or left direction. A scene is developed in which the user points at the hand or the user talks with a different line depending on the passenger.

When the scene processing is completed, the scenario driving unit (101-1) confirms whether the scenario is finished (step 85).
If the scenario is not finished (step 85; N), that is, if the scenario still continues, the scenario driving unit (101-1) returns to step 84 until the scenario is finished, and the next scene, the next scene,. Repeat the process.

  In the case of scenario end (step 85; Y), the scenario driver (101-1) performs scenario end processing (step 86). In this scenario end process, the learning unit (101-3) obtains an end ID indicating how to end, stores it in the response data (10-2-3-7), and returns to the main routine.

Next, the configuration and operation of the scenario creation device 2 in which a user or a third party creates an original scenario will be described.
FIG. 9 shows the configuration of the scenario creation device.
The scenario creation device includes a control unit (200), an input device (210), an output device (220), a communication control device (230), a storage device (240), a storage medium drive device (250), Input / output I / F (260). These devices are connected by a bus line such as a data bus or a control bus.

The control unit (200) includes a CPU (200-1), a memory (200-2), and the like, and controls the entire scenario creation device.
The CPU (200-1) is a processor that executes various arithmetic processes.
The memory (200-2) is used as a working memory when the CPU (200-1) executes various arithmetic processes.
The CPU (200-1) can write and erase programs and data in the memory (200-2).
In the memory (200-2) in the present embodiment, an area for the CPU (200-1) to create, edit, and store scenario data according to the scenario editor (scenario editing program) can be secured.

The input device (210) is a device for inputting characters, numbers, and other information to the scenario creation device, and is composed of, for example, a keyboard and a mouse.
The output device (220) is, for example, a display device such as a CRT display or a liquid crystal display, a printing device, or the like. The display device displays various screens such as a main screen for creating a scenario and a screen for selecting a screen configuration including a display area of scene component parts in each scene. In addition, selected information and input information are displayed on each screen.

The communication control device (230) is a device for transmitting / receiving various data and programs to / from the outside. The communication control device (230) uploads the created scenario data to any of the servers 3 connected via these networks.
The scenario data created by the scenario creation device 2 can be written in a storage medium such as an IC card and taken into the agent device 1.

The storage device (240) includes a readable / writable storage medium and a drive device for reading / writing programs and data from / to the storage medium. A hard disk is mainly used as the storage medium, but other storage media that can be read and written, such as a magneto-optical disk, a magnetic disk, and a semiconductor memory, can also be used.
The storage device (240) stores a scenario editing program (240-1), scenario editing data (240-2), and other program data (240-3). Other programs include, for example, a communication program that controls the communication control device (230) and maintains communication with the terminal device and server device connected to the scenario creation device and the network, and scenario creation such as memory management and input / output management An OS (Operating System), which is basic software for operating the device, is also stored in the storage device (240).
The storage medium driving device (250) is a driving device for reading and writing data by driving a removable storage medium. Examples of the removable storage medium include a magneto-optical disk, a magnetic disk, a magnetic tape, an IC card, a paper tape on which data is punched, and a CD-ROM.

The scenario creation device 2 acquires a scenario from the storage medium storing the scenario data by driving the storage medium by the storage medium drive device (250), or stores the created scenario data from the storage medium drive device. Or it can be stored on a medium.
The input / output I / F (260) is composed of, for example, a serial interface or other standard interface.
By connecting an external device corresponding to the interface to the input / output I / F (260), the function of the scenario creation device can be expanded. Examples of such external devices include a storage device such as a hard disk, a communication control device, a speaker, and a microphone.

Next, the configuration of the scenario editing program (240-1) and scenario editing data (240-2) will be described.
FIG. 10 conceptually shows the configuration of the scenario editing program and data.
The scenario editing program (240-1) includes a scenario editor (240-1-1), a scenario compiler (240-1-2), and a DB editing tool (240-1-3).
Scenario edit data (240-2) is the common definition DB (240-2-1), local definition DB (240-2-2), and SCE scenario data (240-2-3) created with the scenario editor. And real machine format (NAV format) scenario data (240-2-4) converted by the scenario compiler exists.
The scenario editor (240-1-1) is an application program that creates scenario data.
The scenario compiler (240-1-2) converts the scenario data (240-2-3) created in the scenario editor (240-1-1) into scenario data (240-2-3) that can be used on the agent device ( It is an application program that converts to 240-2-4) and functions as a conversion means.

FIG. 11 conceptually shows a state in which the data format of scenario data is changed by the scenario compiler (240-1-2).
As shown in FIG. 11, the scenario compiler (240-1-2) converts one or more SCE format scenario data (240-2-3) into one actual machine format (NAV format) scenario data ( Convert to 240-2-4).

In FIG. 10, a DB editing tool (240-1-3) is an application program for editing / updating data stored in the common definition DB (240-2-1).
The common definition DB (240-2-1) stores definition data when creating scenario data. The common definition DB (240-2-1) stores, in addition to automatic start item data, which will be described later, action items for scene development, additional determination items, a character display state instruction table, and the like. This common definition DB (240-2-1) may exist on a server connected by a local area network (LAN) instead of the storage device of the scenario creation device.

The local definition DB (240-2-2) stores the screen configuration defined by the scenario creator while creating scenario data.
The SCE format scenario data (240-2-3) is data created by the scenario editor (240-1-1).
Real machine format (NAV format) scenario data (240-2-4) is converted from SCE format scenario data (240-2-3) to data format for use on agent devices by scenario compiler (240-1-2) Data.

FIG. 12 illustrates items that can be set as automatic start items stored in the common definition DB (240-2-1).
This automatic activation item is a conceptual list of samples of each item type that can be detected, recognized, and confirmed by the agent device.
This automatic start item is described in the common definition DB (240-2-1). When creating a scenario with the scenario editor (240-1-1), it is automatically started to set the autonomous start condition. Items are read from the common definition DB (240-2-1) and displayed in a list (presentation means). The creator selects an automatic activation item from the list display (list display) (selection means).
A window for inputting a numerical value or a window for selecting from a list is displayed depending on the contents described in the type of each selected item, and the determination condition for the automatic activation item is input. This operation is repeated one or more times, and data for autonomous activation conditions, which are determination conditions for autonomously activating a scenario, is created (activation condition setting means).

FIGS. 12B and 12C illustrate selectable items that can be selected as autonomous activation conditions for the automatic activation items.
Selectable items are also described in the common definition DB (240-2-1). In the table showing the automatic activation items illustrated in FIG. 12A, items that can be selected as a lower concept for the items indicated as selection from the list in the type column are shown as selectable items in FIG. b), as specified in FIG. The group defined in the selectable item and the item of the automatic activation item are associated with the leftmost No. item.
A combination of the selected automatic activation item, the selected selectable item, and the input numerical value, time, distance, and the like becomes an autonomous activation condition for each scenario. For example, when the selection by the user is the automatic activation item “acceleration” and the selectable item “rapid deceleration state”, the autonomous activation condition is “acceleration-rapid deceleration”.
Note that this sample is just a sample and the definition may be changed.
For example, the vehicle speed input may be selected from a list and selected from items separated every 10 km / h.

The common definition DB (240-2-1) in FIG. 10 further stores transition conditions (development conditions) and branch conditions for expanding from one scene (screen element) to the next scene.
Each item of the development condition is read out when creating the development configuration of each scene, and is displayed in a list in the branch condition designation window. By selecting a development condition item from the list displayed, a scene development configuration is created as illustrated from (a) to (b) and (b) to (c) in FIG. The
In addition, it is possible to select a condition item when judging a condition from each scene and branching to a plurality of scenes from the judgment result. In the example of FIG. 6, a scene that branches from (c) to (d) and (f) is developed.
In this way, by continuing a plurality of branch scenes (in series and in parallel) after the normal scene, it is possible to develop a plurality of normal scenes that branch under various conditions with respect to one normal scene.

In the common definition DB (240-2-1), other settings are made for each scene, including voice recognition data used for voice recognition, data used for character movement instructions (separate line instruction data also exists), and so on. Character image data and character dialogue data for previewing and confirming the designated instructions, a conversion table to the expression method of each character for a unified instruction independent of characters, each part data to be displayed on the display device (2), and those Screen configuration data describing how to arrange the items and items that can be selected as processing contents in the scene, for example, an action that can be processed by the agent, on / off of an audio device, channel selection, air conditioner device Various processing content item data such as on / off and temperature setting, setting of a destination to be supplied to the entire processing unit, and the like are stored.
All these definition data can be changed and added using the DB editing tool (240-1-3) as well as each definition data.
Character image data for previewing and confirming the instruction set in each scene stores image data of various characters stored in the agent device.

Next, each operation of scenario creation by the scenario creation device configured as described above will be described according to the transition of the screen.
FIG. 13 shows the configuration of the main window displayed on the display device when the scenario editor (240-1-1) is activated.
As described below, the screen element transition body data configured by combining the screen elements in which the processing contents executed in synchronization with the display screen of the in-vehicle device are defined is created by various settings from the main window. A screen element transition body creation means is configured.
Note that the various processes for creating a scenario described below are executed by the scenario editor (240-1-1), unless it is explicitly stated that the operation is a scenario creator operation.

  As shown in FIG. 13, the main window includes a scene screen 301 on which a scene screen being created (a scene screen (see FIG. 6) displayed on the display device (2) of the agent device 1) is displayed. A setting screen 303 on which setting items to be set are displayed, a scene development screen 305 in which a scene development configuration (branch state) is displayed by a tree structure of scene icons 307 representing each scene, and a processing icon display unit Has been.

When the scenario editor (240-1-1) is activated, a start point 308 is displayed on the scene development screen 305 of the main window. When this start point 308 is selected, scenario properties can be edited. The selection is made by, for example, matching the point position by the mouse cursor to the corresponding location and double-clicking the mouse.
The screen configuration change button 309 is a button for selecting a screen configuration to be displayed, and the sound effect setting button 310 is a button for displaying a screen for setting sound effects for each scene of the scenario.
When the agent display screen 311 is selected, an agent (character) action editing screen is displayed.

  The dialogue editing button 313 is a button for editing a dialogue instruction of the character. By selecting this dialogue editing button 313, as will be described later, dialogue corresponding to the type of passenger can be set for each scene.

When the button part and the background speech recognition dictionary setting 315 are selected, the speech recognition dictionary to be used can be edited. The name of the word to be recognized is displayed on the scene screen when the one displayed with the answer selection button 315a mark on the scene screen 301 is selected, and when the person 315b to be recognized in the background is selected, it is recognized as a voice recognition target. The name of the word to be displayed is not displayed.
The timer setting button 317 is a button for setting and changing timer setting information.

The voice recognition start control instruction 320a sets a voice recognition instruction that defines how to start voice recognition when voice recognition is performed in the scene being created. As an instruction for voice recognition, one of “start automatically”, “do not start automatically”, and “judgment by agent device (onboard device) (automatic)” can be selected. Yes.
In the callback control instruction 320b, an instruction as to whether or not to perform a callback for confirming the result of voice recognition is set. The callback instruction is one of “call back”, “do not call back”, or “agent device determines (automatic)” that determines whether or not the agent device determines whether or not to make a callback. Can be selected.

The AMM change setting change button 321 is a button for changing each long-term emotional element of the agent in the scene being created.
The scene development display unit 322 displays a development condition item and an additional condition item that are defined for a scene (active state) specified on the scene development screen, and a scene that is continued (connected) when the condition item is satisfied. Is displayed.
On the left side of the scene development display unit 322, as shown in FIG. 13, the development conditions set for the active scene and the classification of additional conditions are displayed in a tree structure. In addition, on the right side of the scene development display portion, the contents of the transition condition and the connection destination (the scene number of the development destination) are displayed.

In the processing icon display section (upper part of FIG. 13) of the main window, there are a scene creation button 323, a branch scene creation button 324, an end ID button 327, an insert button 329, a scene playback button 331, a build button 332, and other processing buttons. It is displayed.
The scene creation button 323 is used when a new normal scene is created.
Clicking the scene creation button 323 allows you to edit the scenario flow (create the next scene). When the scene creation button 323 is clicked, a normal scene to be developed next to the currently selected scene can be created.
By branching the flow of the scenario with the scene creation button 323, a development configuration for each normal scene is created. For example, in the scene development configuration displayed on the scene development screen 305 in FIG. 13, when the scene creation button 323 is clicked with the normal scene icon 5 selected (actively displayed), the scene 5 is displayed. The icon of the following scene is displayed on the lower layer side, and the normal scenes 7, 8,... Developed after the scene 5 are branched and created by clicking a plurality of times (a plurality of creation operations are performed).

That is, when the scene creation button 323 is clicked with the scene m (normal scene or branch scene) selected, the next normal scene m1 following the scene m is created. When the scene creation button 323 is clicked while the scene m is selected again, the next normal scene m2 following the scene m is created by branching in parallel with the normal scene m1. Similarly, when the scene creation button 323 is clicked with the scene m selected again, a normal scene m3 is created.
If you want to further expand the scene that follows the created normal scene m1, click the scene creation button 323 with the normal scene m1 selected, and the next normal scene m1-1 that follows the normal scene m1 will be displayed. Created. When another scene branched from the normal scene m1 is created, the scene m1 subsequent to the scene m1 is created by selecting the scene m1 again and clicking the scene creation button 323.

Further, when the scene creation button 323 is clicked in a state where the created normal scene m1-1 is activated, a normal scene m1-1-1 following the normal scene m1-1 is created.
Branch scene creation button 324, which is used to create a new branch scene.
Click the branch scene creation button 324 to edit the scenario flow (create the next branch scene). When the branch scene creation button 324 is clicked, a branch scene to be developed next to the currently selected scene can be created.
By using the branch scene creation button 324, branching is performed under a plurality of additional conditions following the development condition, so that a development configuration for each normal scene can be created by a logical operation (logical sum, logical product) of the transition conditions.

  For example, in the scene development configuration displayed on the scene development screen 305 in FIG. 13, when developing from the normal scene 1 to the normal scene 2, by inserting the branch scene 4 and the branch scene 6 between the two normal scenes, When the state change defined in the normal scene 1 is performed and both the branch condition 4 and the branch condition 6 are satisfied, the normal scene 2 is developed following the normal scene 1. In this way, by using a plurality of branch scenes, it is possible to create scenarios that perform various developments with various condition settings.

In FIG. 13, the branch scene is denoted by reference numeral 333. A branch scene can be created following a normal scene or a branch scene. For example, a branch scene 4 is created by selecting the branch scene creation button 324 with the normal scene 1 on the scene development screen 305 of FIG. 13 activated, and a branch scene creation button with this branch scene activated. Branch scene 6 is created by selecting 324.
The method for creating the branch scene hierarchically is the same as the method for creating the normal scene described above.

When the end position creation button 327 is clicked, a scenario end position 340 can be created. An end number is assigned as an end ID to the end position 340 of each created scenario.
When the end position 340 of the created scenario is selected, an end property editing screen (see FIG. 40) is displayed, and each short-term emotion element of the agent can be set and changed on this screen.

The insert button 329 is a button for inserting a normal scene and a branch scene before each active scene (normal scene, branch scene) or end mark. Select a button for each scene type.
The scene playback button 331 is a button for playing back an active normal scene.
The build button 332 is a button for compiling the created scenario into an actual machine format (NAV format) for use by the agent device.

  The main window shown in FIG. 13 is an example of a scenario being created, and the initial screen when the scenario editor (240-1-1) is started displays only the start point 308 on the scene development screen 305. Nothing is displayed on the scene screen 301, and the setting screen 303 is not set (the default value is displayed).

When a branch scene, for example, branch scene 4 in FIG. 13 is selected and activated on the scene development screen 305, an additional condition classification display field and an additional condition item field are displayed in the area of the scene screen 301.
The branch condition classification display field displays the classification of the additional condition item selected for the active branch scene, and the branch condition item field displays the additional condition item for designating the branch destination.

In the main window shown in FIG. 13, when the start point 308 displayed on the scene development screen 305 is double-clicked, a scenario property editing window (not shown) is displayed over the main window.
In this scenario property edit window, scenario name input, kana name input, icon selection, genre selection, priority setting, expiration date (upper limit of time lag from start condition to actual start) setting, running Setting of medium execution condition, setting of scenario start condition (separate window), setting of voice output position for each scenario, setting of genre information, creator name input, and comment input can be performed. The scenario name input and kana name input entered on this screen are management data in the scenario data in the actual machine format.

FIG. 14 is an explanatory diagram showing the flow of the screen operation for editing the scenario activation condition.
When the start condition setting button 401 is selected in the scenario property edit window, the main edit window for the scenario start condition (automatic start condition) shown in FIG. 14A is displayed.
An activation condition setting means for setting an activation condition for activating the screen element transition body data is configured by setting processing in the main editing window of the scenario start condition described below.
The main editing window (FIG. 14A) of the scenario start condition can be set so that the user can start the scenario manually. In this example, the check box 406 is unchecked and set to not start manually.

Conditions for the system to automatically start a scenario are displayed in the list of automatic start conditions (autonomous start conditions) on the left side of the main editing window (a) for this scenario start condition. In the state of FIG. 14 (a), nothing has been set yet, so it is a blank state.
When a new creation button 405 is clicked in the main editing window for scenario start conditions (FIG. 14A), an automatic start condition selection window (FIG. 14B) is displayed, and a new start condition can be edited.

In the automatic start condition selection window (FIG. 14 (b)), the judgment condition item (category) to be set is selected, and when the decision is clicked, the process proceeds to the condition range selection window (FIG. 14 (c)) for automatic start. In the example of FIG. 14B, since it is desired to automatically start (autonomous activation) a scenario while traveling on a highway, “select type” in “select when to activate the road state” Select the item and click OK.
Click Cancel to return to the main editing window (FIG. 14 (a)) of the scenario start condition.

Items that can be displayed and selected in the automatic start condition selection window (FIG. 14B) are the automatic start items displayed in FIG. In FIG. 14B, when the “Select when to start” folder is selected, the condition items No. 1 to No. 10 in FIG. 12A are displayed one level below.
Similarly, if you select the “Select where to start” folder, No. 10 to 16 will be selected. If you select the “Select when to start when road condition” folder, No. 21 to 23 will be displayed. , When you select the folder “Select when to start the car” No.17-20, when you select the folder “Select when to start the navigation” When No. 21 to 28 select a folder “select when the user activates”, No. 29 to 30 are displayed in the next lower level.

In the condition range selection window (FIG. 14C) to be automatically started, the window configuration changes depending on the judgment condition item (category) selected in the previous window (b). In the illustrated example, an item window for selecting a road type is displayed.
Items that can be selected in the automatic start condition range selection window (FIG. 14C) are selectable items corresponding to the automatic start items selected in the automatic start condition selection window (FIG. 14B) (FIG. 14). 12 (b)). This selectable item is displayed in a pull-down menu by clicking the mark on the right side of the selection item column 408.

Select a condition range that may be started automatically from the list (or enter a number), and click the Add button to set the selected item and display it in the bottom column. In the illustrated example, the case where “highway” is selected and the add button is clicked is displayed.
When the determination button is clicked in the condition range selection window (FIG. 14C) to be automatically started, the setting state is determined, and the scenario editing condition main editing window (FIG. 14C) returns.
Click Cancel to return to the automatic start condition selection window (FIG. 14B).
In the main editing window of the scenario start condition in FIG. 14 (d), the automatic start condition list set by the above operation is displayed in the left side automatic start condition list (starts when the road type is a highway). .
When an automatic start condition displayed on the automatic start condition list screen is selected and the edit button is clicked, an automatic start condition selection window (FIG. 14 (b) for adding additional condition settings to the selected condition is displayed. )) Is displayed.

Next, various operations for creating a scenario other than the autonomous activation condition will be described.
FIG. 15 shows setting information in a dialogue setting window for setting dialogue in the scene being set for each type of passenger.
When the dialogue editing button 313 is selected in the main window shown in FIG. 13, a dialogue output seat setting window shown in FIG. 14A is displayed separately.

  In this window, the scenario creator selects any one other than all seats when the type and seat position of the vehicle passenger can be assumed in advance. When the determination button is pressed after any one other than all seats is selected, a balloon edit window shown in FIG. 15C is displayed.

The scenario creator inputs a dialogue corresponding to the type of passenger assumed for each seat in the balloon edit window.
When the enter button is pressed, the input dialogue and each seat position selected in FIG. 14A are set as dialogue information in the scene.
Then, the scenario creator repeats the setting of the seat position of the passenger that can be assumed in advance and the input of the corresponding dialogue as many times as the expected number of passengers, thereby setting a plurality of dialogues and seat positions. The

On the other hand, when the seat position of the passenger cannot be assumed in advance, the scenario creator sets all seats and presses the enter button in the dialogue output seat setting window (FIG. 15A).
Then, as shown in FIG. 15 (b), a user type editing window is displayed, and the type of the passenger to be listened to is set.
As shown in FIG. 15B, an age group, gender, and social status (social layer) can be set as the type of passenger. By selecting the right end of any item, a selectable item is displayed in a pull-down manner, and the scenario creator selects one item from the displayed items.

As selection items to be pulled down, in this embodiment, the age group is 12 years old or younger, 13 to 18 years old, 19 to 60 years old, 4 items of 60 years old or older, gender is 2 items for men and women, and the social layer is general And two items of advanced level are displayed in a list. The social layer is displayed when the age is over 19 years old.
The list may be displayed by classifying more detailed items.

After the passenger type is selected in the user type edit window, when the decision button is pressed by the scenario creator, a balloon edit window shown in FIG. 15C is displayed.
The scenario creator inputs a dialogue corresponding to the type of the selected passenger in the balloon edit window.
When the enter button is pressed, the input dialogue and the passenger type selected in FIG. 15B are set as dialogue information in the scene.
Then, the scenario creator repeats the passenger type and input of the corresponding dialogue for the number of assumed passengers (arbitrary), thereby setting a plurality of dialogues and passenger types.

When the passenger type and dialogue are set, as shown in FIG. 15D, the set type and the text of the inputted dialogue are displayed in a balloon on the scene screen 301 of the main window. In this way, the input dialogue is output as audio data and displayed as text in a balloon on the scene screen 301.
Then, the information on the seat position or type of the set passenger is set in the scene management data (see FIG. 5) corresponding to each line for the scene being set.

If the type of passenger is set, a type ID is defined for possible combinations of age group, gender, and social group set as the type of passenger, and this type ID is set as scene management data. You may make it store in.
For example, in the case of the above-mentioned classification, the classification ID of a male under 12 years old is 1, the classification ID of a female under 12 years old is 2, the classification ID of a male between 13 and 18 years old is 3, and the classification ID of a male between 13 and 18 years old The male type is 4, 19 to 60 years old, the general type is 5, 19 to 60 years old, the senior type is 6,. A type ID of a type is defined.

When the agent display screen 311 is double-clicked with the mouse in the main window (FIG. 13) showing the editing state of the scene screen, an action editing dialog for editing a character action (agent action) instruction is displayed.
In this action editing dialog, a list of individual actions such as bowing, pointing to the right, looking at the right, etc., and a list of expressions such as thanks, denial, praise, greetings, etc. are displayed. Specify the action.

FIG. 16 shows a flow of screen operations for compiling the created scenario into a format of a real machine format (NAV format) that can be used by the agent device.
When the scenario compilation button 325 is clicked in the main window (a), the scenario compiler (240-1-2) is activated and the scenario compiler window (b) is displayed.
In this scenario compiler window (b), specify the name of the file to which the compiled data is output, select the scenario to be converted at the same time (convert the scenario checked in the scenario list), and click the compile button to select the data Start conversion. The data conversion status is displayed on the result display section.
When the scenario compiler finishes the data conversion, the scenario data (240-1-3) converted into the actual machine format (NAV format) is converted into the scenario editing data (240-2) in the storage device 240. Store.

As mentioned above, although one embodiment in the in-vehicle device and data creation device of the present invention was described, the present invention is not limited to the described embodiment, and various modifications can be made.
For example, in the data creation apparatus described, different dialogues are set for each type of passenger, but one type of dialogue and a plurality of passenger types may be set.
In this case, if a plurality of passenger types are set in the in-vehicle device, a plurality of words corresponding to the passenger type are created from one line.

That is, the drawing / sound output unit (101-5) of the in-vehicle device is provided with a function (phrase changing means) for creating a plurality of lines in which only the wording is changed without changing the meaning of the word.
To change the wording, for example, prepare a wording dictionary in advance to change the expression at the end of the sentence to masculine expression, feminine expression, polite expression, concise expression, and change the expression at the end according to the type. Make changes.
For example, when “good” and similar expressions are used as the end of the dialogue, the wording expression corresponding to various end-of-sentence expressions, such as the polite expression “good” and the simple expression “like” Are prepared according to the type.

1 is an overall system configuration diagram including an agent device, a scenario creation device, and a server according to an embodiment of the present invention. It is a block diagram which shows the structure of the agent apparatus in one Embodiment of this invention. It is explanatory drawing showing the structure of the agent process part. It is explanatory drawing which represented the information currently collected on the external storage medium notionally. It is explanatory drawing showing the structure of real machine format scenario data. It is the screen transition diagram showing the transition of the scene screen by the guidance scenario which the inn transmitted to the prospective guest for each scene. It is a flowchart showing the passenger specific process by the whole process part of an agent apparatus. It is a flowchart showing an example of the flow of scenario execution processing. It is a block diagram of a scenario creation apparatus. It is explanatory drawing which represented the scenario edit program and the structure of data notionally. It is explanatory drawing which represented conversion of the data format notionally. It is explanatory drawing which illustrated the item which can be set as an automatic starting item. It is explanatory drawing showing the structure of the main window displayed on a display device when a scenario editor is started. It is explanatory drawing showing the flow of the screen operation which edits a scenario start condition from the main edit window of a scenario start condition. It is explanatory drawing of the flow which sets the dialog in the scene under setting for every kind of passenger. It is explanatory drawing showing the flow of the screen operation for compiling the created scenario into the format of the real machine format which can be used by navigation.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Agent apparatus 2 Scenario creation apparatus 3 Server (1) Central processing unit (2) Display apparatus (3) Audio | voice output apparatus (4) Audio | voice input apparatus (5) Input apparatus (6) Various condition detection apparatuses (7) Various vehicle equipment (8) Communication control device (9) Communication device
(10) External storage device
(200) Control unit
(210) Input device
(220) Output device
(230) Communication control device
(240) Storage device
(250) Storage medium drive
(260) Input / output I / F

Claims (4)

A screen for acquiring and storing screen element transition body data configured by continuously combining screen elements as a format in which a screen configuration and a sound defined for each type of vehicle occupant are output together. Element transition body storage means;
A display device having a display screen;
A passenger identification means for identifying the type of the vehicle passenger and the boarding seat position of the passenger;
A plurality of audio output devices arranged in the vehicle;
Screen element transition body executing means for executing the screen element transition body data,
By executing the screen element transition body data, the screen configuration is displayed on the display device, and the voice corresponding to the identified passenger type is associated with the boarding seat position of the passenger. An in-vehicle device that is output from an audio output device. Questioning means for asking passengers,
A response receiving means for receiving a response to the question from the passenger,
The in-vehicle device according to claim 1, wherein the passenger identification unit identifies a boarding seat position of the passenger and a type of the passenger based on a response content of the response reception unit.   The in-vehicle device according to claim 1, wherein the type of the passenger is at least one of age, sex, and social status. Screen configuration setting means for setting the screen configuration displayed by the in-vehicle display device;
Voice setting means for setting the voice to be output for each type of vehicle occupant;
Screen element creating means for creating a screen element as a format in which the set screen configuration and the set audio are output together;
A screen element transition body creation means for creating screen element transition body data configured by continuously combining the created screen elements.

Images