JP2000203465A - Information recording device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide information widely and frequently utilized without needing expert knowledge. SOLUTION: This information processing device is provided with a central processing part 1 to obtain data regarding operation of a vehicle based on a situation sensor part 40 or the like in a vehicle and select a typical sentence based on data from a typical document data 295. In a case of the typical sentence being blank, the blank is filled with words based on the data to produce a sentence. A produced sentence is stored at an agent data memory device 29 and displayed on a display device 27 according to an input command from a driver. Data basad on data of a vehicle situation is converted into a sentence, and a content is easily grasped and utilized without needing exert knowledge.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information recording apparatus, and more particularly, to an information recording apparatus for processing and providing information so that it can be used without requiring specialized knowledge.

[0002]

2. Description of the Related Art Heretofore, as an information recording device for recording the status of a device such as a vehicle, information on changes in the operating posture of the vehicle and the gravitational acceleration based on outputs from sensors such as an angular velocity meter and an accelerometer of the vehicle. A driving recorder that acquires and records the data, and an operation analyzer that corrects information recorded in such a driving recorder to generate operation history information have been proposed (Japanese Patent Laid-Open No. 10-63905). Such a driving recorder or operation analysis device is for acquiring data generated due to the operation of a vehicle, accurately reproducing and analyzing the operation history in the event of a failure or accident, and analyzing and investigating the cause.

[0003]

Since the above-mentioned conventional driving recorders and operation analyzers are intended for technical analysis, the values obtained from the sensors are directly recorded or corrected. Things are displayed visually as they are. Therefore, the provided information cannot be used much except for accidents and breakdowns, and requires specialized knowledge for use.

[0004] The present invention has been made to solve the above-described problems, and provides an information recording apparatus for processing and providing information so that it can be used without requiring specialized knowledge. The purpose is to.

[0005]

According to the first aspect of the present invention, there is provided a sensor for detecting a condition of a predetermined device,
Storage means for storing a plurality of document elements constituting the document,
Based on the output from the sensor, a document element related to the situation detected by the sensor is selected from the plurality of document elements stored in the storage unit, and a document acquisition unit that acquires a document, and the document acquisition unit The first object is achieved by providing an information recording device with a document output unit that outputs an acquired document.

The predetermined device may be any device capable of acquiring information on the status of the device from inside or outside of the device using a sensor. For example, the predetermined device may include a home appliance such as a vehicle, a vacuum cleaner and a refrigerator. can do. The status of the predetermined device includes both an internal status of the device and an environment of the device (external status). As the situation, when the device is a vehicle, the situation of the vehicle itself, the presence or absence of a passenger, the situation of the vehicle including oncoming vehicles, etc.,
It can include the driver's response and response. When the device is a home electric appliance or the like, it may be the time for which a standby current is supplied during a predetermined period of the device, the elapsed time after purchase, the temperature of the room where the device is installed, or the like.

The sensor for detecting the condition of the predetermined device includes a sensor as an internal environment detecting means for detecting a condition inside the device and a sensor as an external environment detecting means for detecting a condition outside the device. Including. Sensors for detecting these predetermined conditions include an internal temperature sensor, a main power ON / OFF detection sensor, an external temperature sensor, a timer, a camera, and the like. And when the device is a vehicle, including a current position current detection means for detecting the current position of the vehicle, including an in-vehicle sensor for detecting the status of each part of the vehicle,
Alternatively, a sensor for detecting an environment outside the vehicle can be included. Operation detection means for detecting the input time and location of the switch operated by the driver may be included. Furthermore, in the case of a vehicle equipped with an agent that performs a communication action such as making a proposal to the driver based on various situations of the vehicle or performing various control actions of the vehicle, the driver's operation corresponding to the action performed by the agent is not performed. A decision means for discriminating whether or not there has been provided, or a classification means for detecting which of a plurality of types of classification the driver's response and reaction to the action performed by the agent is included. You may.

[0008] The document element stored in the storage means refers to a sentence or a part of the sentence constituting the document. Part of the sentence includes a sentence in which the name, numerical value, and other parts are left blank, a phrase, a word, and the like. The document acquisition means,
Based on the output from the sensor, one or a plurality of sentences stored in the document storage unit is selected (sentence selection unit), and in the case of a plurality, the selected sentences are arranged in a predetermined order (permutation acquisition unit). A document may be obtained. Also,
Based on the output from the sensor, select and combine phrases, select a name or numerical value or other part that is blank, obtain a name or numerical value, and fill in the name or numerical value in the blank space to fill in the sentence. Documents can be obtained by preparing them (sentence preparing means) and arranging them in a predetermined order (single permutation obtaining means) alone or in combination with a similarly prepared sentence or a sentence selected as described above.

The document acquisition means may acquire one sentence or multiple sentences based on data obtained from one sensor. When acquiring multiple sentences, a sentence based on data and a sentence not based on data may be acquired. Also,
A single sentence may be acquired based on data obtained from a plurality of sensors, or a plurality of sentence units may be acquired. The document acquired by the document acquisition means is
The document may be in the form of a diary by a predetermined device or a letter from the predetermined device to the operator or the like. The document output means includes a means for outputting a document by sound from a sound output device such as a sound speaker, a means for displaying the document on an image display device, and a means for outputting character data or image data to an external device.

According to a second aspect of the present invention, in the information recording apparatus according to the first aspect, there is provided learning means for learning an output result from the sensor. The document is obtained based on the output from the sensor.

[0011] The learning means learns an output result from the sensor. Then, the document acquisition unit acquires the document based on the past situation that is learned and output by the learning unit in addition to the situation that is currently detected and output by the sensor.
In the learning by the learning means, in addition to directly storing and outputting the result from the sensor, the result from the sensor is calculated for a predetermined period or the number of times to obtain an average or sum, and the calculated result is output. Things. Further, a situation detecting means for detecting a predetermined situation based on an output from the sensor may be provided, and a predetermined learning result may be output according to the number of times the situation means detects the same situation. The output of the learning result can be performed at predetermined time intervals, at the start of running of the vehicle, or the like.

According to a third aspect of the present invention, in the information recording apparatus according to the first or second aspect, the document output unit displays the document acquired by the document acquisition unit on a display device. Means, a sound output means for outputting the sound from the sound output device, and a document data output means for outputting the document data.

According to a fourth aspect of the present invention, in the information recording apparatus according to any one of the first to third aspects, an image data storage means for storing image data; Image data obtaining means for obtaining image data stored in the image data storage means based on the output of the image data, and outputting the image data obtained by the image data obtaining means together with a document obtained based on the data. Image data output means. The image data acquisition unit selectively selects one or a plurality of image data related to a document output by the document output unit from image data stored in an image data storage unit based on an output from the sensor. get. The image data acquired by the image data acquisition means includes image data of an image photographed by a driver or the like with a digital camera, image data of an image photographed by a vehicle-mounted camera, and a CD or DVD of a car navigation device. It can be image data or the like stored in the data storage device. Therefore, the image data storage means includes an image data storage unit of a digital camera or an image reader,
It can include a storage device that reads and stores image data from an image data storage unit of a digital camera or an image reader, a CD or DVD of a car navigation device, a driver thereof, and the like. The image data output means includes a means for outputting an image to an image display device such as a display, and a means for outputting image data as it is to an external device. Further, even if the image data output means always outputs the document and the image data output by the document output means at once, the image data is output only under a predetermined condition such as when requested by an operator. It may be output together with the document.

Further, in order to achieve the above object, the information recording apparatus according to the present invention is based on a signal from a sensor attached to a vehicle (including a vehicle-mounted device such as a car navigation device for a vehicle and a machine such as an engine). An information recording device for a vehicle that stores obtained data, a storage device for a fixed phrase,
Selecting means for selecting a fixed sentence to be read from the storage device based on a signal from the sensor; synthesizing the fixed sentence selected by the selecting means to create a sentence; and a sentence creating means for creating the sentence And a sentence storage device for storing the sentence.

Further, instead of the text creating means, a fixed sentence selected by the selecting means and data obtained based on a signal from a sensor attached to the vehicle (for example, a destination name set in the car navigation device) And a text creating means for creating a sentence by synthesizing the data.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the information recording apparatus of the present invention will be described below in detail with reference to FIGS. (1) Outline of Embodiment An information recording apparatus according to the present embodiment is provided and used in a vehicle, and some of the means include a car navigation device for performing route guidance and an agent for causing an agent to appear in the vehicle. Also serves as part of the device. The information recording device according to the present embodiment is configured to control the vehicle position, the elapsed time, and the like based on the situation sensor unit 40, the current position detecting device 21, the voice input from the microphone 26, the input from the input device 22, and the like. Obtain data related to the operation of Then, when the condition of the vehicle determined based on the data satisfies a predetermined condition, a fixed phrase is selected from the fixed document data 295 based on these data. If the fixed phrase has a blank, a sentence is created by applying a word based on data to the blank. The prepared sentences are arranged in the fixed-form document data 295 according to the priority order stored corresponding to each fixed-form sentence, and stored in the agent data storage device 29 as travel diary data 296 or mail data 297 for each operation. As a result, data based on the vehicle status at the time of operation is acquired and stored as a diary or a document in a mail format. The stored document is displayed on the display device 27 according to an input command from the driver. Thus, in the present invention,
Data relating to vehicle conditions is documented and easily displayed and made available without requiring specialized knowledge. In the present embodiment, an anthropomorphic agent appears in the vehicle, and judgment and learning of the situation of the vehicle including the vehicle itself, a driver, a fellow passenger, an oncoming vehicle, and the like (not only learning of the situation but also the driver). Response and reaction, etc.), and based on the vehicle situation at each point in time and the learning results up to that point, the agent responds to the driver and the vehicle with various variations (communication) Has become. The situation of the vehicle also includes the result of learning by the agent. The fixed form that is the basis of the travel diary and e-mail formed as described above has a stylistic style as written by this agent, and the driver has a vehicle in conjunction with the agent's communication function. It feels even more attached. Here, an anthropomorphic agent has an identity with a specific person, creature, cartoon character, or the like, and the creature with the identity has a certain tendency to maintain the identity and continuity ( Operation, voice response). In addition, identity and continuity can be expressed as a personality having a unique personality, and can be regarded as a kind of pseudo-creature in an electronic device. The agent according to the present embodiment that appears in the vehicle is a pseudo-personalized (virtual personalized) subject that is determined in the same manner as a human.

(2) Details of Embodiment First, an information recording apparatus according to a first embodiment of the present invention will be described. FIG. 1 is a block diagram showing the configuration of the first embodiment of the information storage device of the present invention. The information recording apparatus according to the present embodiment is provided in a vehicle, and has an overall processing unit 1 that controls the entire communication function with a driver or the like.
It has. The overall processing unit searches for a route to a set destination and provides guidance by voice or image display, an agent processing unit 11, an I / F unit 12 for the navigation processing unit 10 and the agent processing unit 11, Image processing unit 1 that outputs images and characters such as map images, road condition images, operation diaries, etc., and processes input images
3. It has a voice control unit 14 for controlling voice output and input voice such as agent voice and route guidance voice, and a situation information processing unit 15 for processing detection data of various situations concerning the vehicle and the driver. The agent processing unit 11
The situation of the vehicle itself and the situation of the vehicle such as a response from the driver are acquired from the situation information processing unit 15 and learned, and based on the learning result and the situation from the situation information processing unit 15, a document about the situation of the vehicle is obtained. Is created and saved as a document in the operation diary of the agent (travel diary) or a document in the form of a letter from the agent to the driver (mail). Also, as part of the agent processing, these travel diaries and mails are displayed on the display device.

The navigation processing unit 10 and the agent processing unit 11 include a CPU (central processing unit) for controlling data processing and operation of each unit, a ROM connected to the CPU by a bus line such as a data bus and a control bus, and the like. RAM,
A timer and the like are provided. The two processing units 10 and 11 are connected to a network, and can acquire processing data of each other. The ROM is a read-only memory in which various data and programs for controlling by the CPU are stored in advance, and the RAM is a random access memory used by the CPU as a working memory.

In the navigation processing unit 10 and the agent processing unit 11 of the present embodiment, the CPU reads various programs stored in the ROM and executes various processes. The CPU is a recording medium driving device 23.
The computer program is read from an external recording medium set in the storage device, and stored (installed) in another storage device such as an agent storage device 29, a navigation data storage device, or a hard disk (not shown). The program may be read (loaded) into the RAM and executed. Further, a necessary program or the like may be directly read from the recording medium driving device 23 into the RAM and executed.

The navigation processing unit 10 is connected to a current position detecting device 21 and a navigation data storage device 30, the agent processing unit 11 is connected to an agent data storage device 29, and the I / F unit 12 is connected to an input device 22. , A storage medium driving device 23, and a communication control device 24, a display device 27 and an imaging device 28 are connected to the image processing unit 13, and the audio processing device 2 is connected to the audio control unit 14.
5 and the microphone 26 are connected, and the situation sensor 40 is connected to the situation information processing section 15.

The current position detecting device 21 is for detecting the absolute position (depending on latitude and longitude) of the vehicle, and uses a GPS (Global Positioning System) for measuring the position of the vehicle using artificial satellites.
Positioning System) Receiver 211 and bearing sensor 2
12, a steering angle sensor 213, a distance sensor 214, a beacon receiving device 215 for receiving position information from a beacon arranged on the road, and the like. GPS receiver 2
11 and the beacon receiving device 215 can perform position measurement independently, but the GPS receiving device 211 and the beacon receiving device 2
In a place where reception by the receiver 15 is impossible, the direction sensor 212
The current position is detected by dead reckoning navigation using both the distance sensor 214 and the distance sensor 214. Orientation sensor 212
For example, a gyro such as a gas rate gyro or an optical fiber gyro that detects a geomagnetism and obtains the azimuth of the vehicle, detects a rotational angular velocity of the vehicle and integrates the angular velocity to obtain the azimuth of the vehicle, and a left and right wheel sensor. A wheel sensor or the like is used in which the displacement of the azimuth is calculated by detecting the turning of the vehicle based on the output pulse difference (difference in moving distance). The steering angle sensor 213 detects the steering angle α by using an optical rotation sensor, a rotation resistance volume, or the like attached to a rotating part of the steering. As the distance sensor 214, for example, various methods such as a method of detecting and counting the number of rotations of a wheel, or a method of detecting acceleration and integrating twice are used.

The input device 22 is for inputting information (eg, age, gender, hobby, personality, etc.) relating to the user as the situation of the vehicle. In addition, the information about these users is not limited to the case where the user inputs from the input device 22.
You may make it acquire from the answer content of a user. The input device 22 is also one means for the driver to respond to all other inquiries and the like of the agent according to the present embodiment. The input device 22 includes a current location (departure point) and a destination (arrival point) at the start of traveling in the navigation processing, a predetermined traveling environment (transmission condition) of a vehicle to which a request for information such as traffic congestion information is transmitted to an information providing station, It is also used to input the type (model) of the mobile phone used in the vehicle. The input device 22 includes a touch panel (functioning as a switch), a keyboard, a mouse, a light pen,
Various devices such as a joystick, a remote controller using infrared rays, and a voice recognition device can be used. Further, a remote control using infrared rays or the like and a receiving unit for receiving various signals transmitted from the remote control may be provided. On the remote control,
In addition to a joystick for moving the cursor displayed on the screen and the like, various keys such as a menu designation key (button) and numeric keys are arranged.

The recording medium driving device 23 is a driving device used for reading a computer program for the navigation processing unit 10 and the agent processing unit 11 to perform various processes from an external recording medium. The computer programs recorded on the recording medium include various programs and data. Here, the recording medium refers to a recording medium on which a computer program is recorded, and specifically, a magnetic recording medium such as a floppy disk, a hard disk, a magnetic tape, a semiconductor recording medium such as a memory chip or an IC card, and a CD-ROM. Recording media such as ROM, MO, and PD (phase change rewritable optical disk) for optically reading information; paper cards and paper tapes; and paper such as printed materials for reading programs using a character recognition device (and paper). And a recording medium in which a computer program is recorded by various methods.

The recording medium driving device 23 reads the computer program from these various recording media and, when the recording medium is a writable recording medium such as a floppy disk or an IC card, the navigation processing unit 10. And data in the RAM of the agent processing unit 11 and the storage devices 29 and 30 can be written to the recording medium. For example, an IC card stores learning contents (learning item data, response data) and user information relating to the agent function, and data such as travel diary data and mail data, which will be described later, and stores them even when driving another vehicle. By reading and using the data from the IC card, it becomes possible to communicate with the agent learned according to the situation of the past response of the user and to refer to the past travel diary.

The communication control device 24 is connected to a portable telephone composed of various wireless communication devices. The communication control unit 24 communicates with an information providing station that provides data related to traffic information such as traffic congestion conditions and traffic regulations in addition to telephone calls, and karaoke data used for karaoke communication in the vehicle. Can be communicated with an information providing station that provides the information. Further, it is also possible to transmit / receive learning data relating to the agent function, past travel diaries, e-mails, and the like via the communication control device 24.

The voice output device 25 is composed of a plurality of speakers arranged in the vehicle, and is controlled by the voice control unit 14, for example, a voice for providing route guidance by voice, or a voice for reading a travel diary. Etc. are output. The audio output device 25 may also be used as an audio speaker. Note that the voice control unit 14 can control the tone color, accent, and the like of the voice output from the voice output device 25 in response to the driver's input of a tuning instruction. The microphone 26 serves as a voice input unit for inputting / outputting a voice to be subjected to voice recognition in the voice control unit 14, for example, an input voice of a destination in a navigation process, a conversation (response or the like) of a driver with an agent, and the like. Function. The microphone 26 may be used also as a microphone for performing karaoke such as a communication karaoke, or a dedicated directional microphone may be used to accurately collect a driver's voice. Is also good. Note that a hands-free unit may be formed by the audio output device 25 and the microphone 26 so that a telephone call can be made without using a mobile phone.

The display device 27 displays a road map and various kinds of image information for route guidance by the processing of the navigation processing unit 10, and displays a travel diary and mails by the agent processing unit 11. . Also,
Images inside and outside the vehicle captured by the image capturing device 28 are also displayed after being processed by the image processing unit 13. As the display device 27, various display devices such as a liquid crystal display device and a CRT are used. Note that the display device 27 may have a function as the input device 22 such as a touch panel, for example.

The image pickup device 28 has a C
It is composed of a camera equipped with a CD (Charge Coupled Device). In addition to an in-vehicle camera for imaging the driver, an out-of-vehicle camera for imaging the front, rear, right and left sides of the vehicle are arranged. The image captured by each camera of the imaging device 28 is supplied to the image processing unit 13, where processing such as image recognition is performed, and each recognition result is used by the agent processing unit 11 to determine the action of the agent. It has become.

The agent data storage device 29 is a storage device for storing various data (including programs) necessary for realizing the document creation function and the agent function according to the present embodiment. As the agent data storage device 29, for example, various recording media such as a floppy disk, hard disk, CD-ROM, optical disk, magnetic tape, IC card, and optical card, and their driving devices are used. In this case, for example, the learning item data 292,
Response data 293, travel diary data 296, and mail data 297 are constituted by a portable IC card or floppy disk, and the other data is constituted by a plurality of different recording media and drive devices, such as a hard disk. Alternatively, those driving devices may be used as the driving devices.

The agent data storage device 29 includes an agent program 290, a program selection table 291, learning item data 292, response data 293, agent image data 294 for displaying the appearance and behavior of the agent illustrated in FIG. Various types of data necessary for agent processing and information recording processing are stored in the form document data 295, travel diary data 296, mail data 297, and the like.

Learning item data 292 and response data 29
Reference numeral 3 denotes data for storing a result learned by the agent based on a driver's driving operation or response. Therefore, the learning item data 292 and the response data 293 are stored and updated (learned) for each driver. The agent image data 294 includes the display device 27
Is stored in the image of the agent. The appearance of the agent does not need to be a human (male, female) appearance, for example, a chick, a dog, a cat, a frog, a mouse, or other animal itself, or a human figure (illustrated). Appearance, a robot-like appearance, a specific character's appearance, and the like. Also, the age of the agent does not need to be constant,
The learning function of the agent may be such that the child looks like a child at first, grows over time, and changes its appearance (changes to the appearance of an adult and further to the appearance of an elderly person). . The image data 294 stores images of the appearances of these various agents, and can be selected from the input device 22 or the like according to the driver's preference.

In the agent program 290, an agent processing program for realizing the agent function and detailed actions of the agent in the communication processing in which the agent communicates with the driver are displayed on the display device 27 as an image and corresponding to the actions. Communication programs for outputting a conversation from the audio output device 25 are stored in the order of the program numbers. This agent program 290 includes
A plurality of types of voice data are stored for the voice of each program number, and the driver can select the voice from the input device 22 or the like in addition to the selection of the appearance of the agent. Agent voices include male voices, female voices, child voices, mechanical voices, animal voices, voices of specific voice actors and actors, voices of specific characters, and the like. The driver chooses. The selection of the voice and the appearance can be changed as needed.

The program selection table 291 is a table for selecting a communication program stored in the agent program 290. FIG. 2 shows the program selection table 291, and FIG. 3 shows the action (action and utterance) of the agent corresponding to each program number selected in the program selection table 291. The program numbers shown in FIGS. 2 and 3 correspond to the numbers of the respective communication programs stored in the agent program 290.

FIG. 4 shows the program number 00 of FIGS. 2 and 3.
001 shows several screens of the agent's “cleverly bowing” action displayed on the display device 27. As shown in FIG. 4, it is expressed that the agent E bows while tightening the lip and putting his / her hand on the knee while bowing.

Each item displayed in FIG. 2 represents a selection condition for selecting each program number, and is determined from various conditions of the vehicle and the driver detected by the state sensor 40 (time (time)). , Starting location, cooling water temperature, shift position, accelerator opening, etc.), learning item data 29
2 and items determined from the learning content stored in the response data 293 (the number of IG ONs today, the elapsed time since the previous end, the total number of activations, etc.). In the program selection table 291, a program that satisfies all these items is always uniquely determined. In the table, a mark “○” indicates an item that must be satisfied in order for the program number to be selected, and a blank mark indicates an item that must not be satisfied in order for the program number to be selected. Marks indicate items that are not considered in the selection of the program.

In FIG. 1, both the learning item data 292 and the response data 293 are data stored and updated by learning of the agent. FIG. 5 shows learning item data 2
FIG. 6 is an explanatory diagram conceptually showing the contents of the response data 92, and FIG. 6 is an explanatory diagram conceptually showing the contents of the response data 293. As shown in FIG. 5, the learning item data 292 includes the total number of startups for determining the selection conditions of the program selection table 291 (FIG. 2), the previous end date and time, and the today's ignition O
N times, the last five refueling remaining times, etc. are stored, and the number of rests / date and time, the default value to determine whether to start the program selected according to the selection conditions (whether to take a rest) , And other data. Further, the learning item data 292 includes, as data for creating a request mail, the number of executions of a specific command such as opening / closing of a power window and moving a wiper, the number of voice inputs, the average number of voice inputs, the number of insufficient voices, and the like. Data is stored.

The total number of activations stores the total number of times the ignition has been activated, and is counted up each time the ignition is turned on. The last end date and time is stored each time the ignition is turned off. The number of ignition ONs today stores the number of ignition ONs on that day and the end time of the day. The count is incremented each time the ignition is turned on. When one day is over, the data is initialized to "0". As the end time of one day, 24:00 is stored as a default value. This time can be changed according to the life pattern of the user (driver). When the time is changed, the time after the change is stored.

The fuel amount (gasoline) includes
The remaining fuel amount detected immediately before refueling is stored. Each time fuel is newly refueled, each data is shifted to the left (the oldest leftmost data is deleted). Stored on the right. This data indicates that when the detection value G1 of the fuel detection sensor 415, which will be described later, becomes equal to or less than the average value G2 (G1 ≦ G2) of the refueling remaining amount for all five times, the agent E appears on the display device 27 and refuels. The prompting action is displayed on the display device 27, and a voice such as “I am hungry! I want gasoline!” Is output from the voice output device 25.

In the number of rests / date and time, the number of rests without executing even if the corresponding communication program is selected is stored for each program number.
The number of times of sleep / date and time is, for example, the action of an agent (program number 00
As in the case of 123), an agent action in which a sleep item is set as a learning item is stored. If the driver's response to the agent's proposal or conversation was rejected (rejected) or ignored (or no response)
“Closed” is selectively set according to the communication program.

The number of specific instructions stores, for each type of instruction, the number of instructions issued by the driver to the agent via the microphone 26 or the like during the operation of the vehicle from ignition on to ignition off. This command is a command for controlling various devices by voice input, and examples of the command include opening and closing of a power window, static movement of a wiper, and the like. The number of voice inputs stores the number of voices input by the driver during the operation of the vehicle from ignition on to ignition off. The number of times the volume is insufficient is stored as the number of times that the voice input by the driver during the operation of the vehicle was not correctly recognized due to the insufficient volume. This value is rewritten when the ignition is turned off.

The default value stores an initial set value for each item such as time, number of times, temperature, vehicle speed, date and time, and the value changed in the learning item like the end time of the day described above. Used to reset to the initial value. Other data stored in the learning item data 292 include, for example, birthdays of the driver and its related persons (this is a user input item), holidays and the like, and events such as Christmas, Valentine's Day, and White Day. The date is stored. There is also a special menu communication program for each event day. For example, an agent disguised as Santa Claus appears on Christmas Eve.

The response data 293 of FIG. 6 stores a history of the user's response to the agent's action for each communication program number whose user response is a learning item. The user response data corresponds to the communication program numbers 00123 and 00125 of FIG.
The latest response date and time and response content are stored for a predetermined number of times (program number 00123 is twice) as shown in FIG.
Stored in batches (so updated each time there is a response)
And the case where only the latest response content is stored for a predetermined number of times, the one where the latest date and time and the response content are stored for one time,
In some cases, only the latest date and time is stored once or for a predetermined number of times. The symbols A, B, and C displayed in FIG. 6A represent the contents of the response. As shown in FIG. 6B, when the symbol A is ignored, when the symbol B is rejected, Symbol C
Represents the case where was received. The content of the driver's response is determined from the result of voice recognition for the driver's voice input from the microphone 26 and the input result from the input device 22.

FIG. 7 is an explanatory diagram conceptually showing the contents of the fixed form document data 295. As shown in FIG. 7, the fixed form document data 295 stores a fixed form sentence which is a source of a document (a travel diary, a request mail, a warning mail, etc.) created by the present embodiment. These boilerplates are
It is stored according to the classification of documents used, such as a travel diary, a request mail, and a warning mail. Standard document data 295
Some of the fixed phrases stored in the column contain some names and numerical values, etc., which are blank.In this blank portion, information based on data obtained from in-vehicle devices etc. is embedded and the Is formed. For example, "Today,
Went out with. The fixed form sentence is used to analyze the voice input from the driver via the microphone, to specify the driver from the weight detected by the weight sensor of the situation sensor unit 40, or to input the driver's input from the screen to the driver. By obtaining the name, the driver name is entered in a blank and a sentence such as "I went out with Ichiro today" is formed.

Each of the fixed sentences stored in the fixed document data 295 is selected based on the information based on the data from the situation sensor section 40 or the like when the information is output from the vehicle-mounted device or machine. In addition, as described above, when the selected fixed phrase includes a space or other specific character indicating a position (field) where the character or data is to be replaced, the character or data is filled in the field based on the same information, A sentence is formed. The standard document data 295 includes a condition (recording condition column in FIG. 7) to be acquired in order to create and record each standard sentence, and a determination whether the condition is satisfied or not satisfied. Necessary information and information for filling in blanks of fixed phrases (name information such as place names and driver names and numerical information such as elapsed time) (information fields obtained from on-board devices and machines in FIG. 7), and these information (In-vehicle device, machine column in FIG. 7) are stored corresponding to each fixed phrase. Then, when information is obtained based on data from a sensor provided at a location where the information is obtained, the information is temporarily stored in a RAM, and then a fixed phrase is selected based on the information and each sentence is selected. It is formed and stored in the travel diary data 296 or the mail data 297 as a document. For example, when the driver name is obtained from the navigation device, the driver name is stored in a predetermined area of the RAM, and arrives at the destination and travels from the departure point to the destination in the navigation processing unit 10. When the elapsed time T is obtained, the elapsed time T is stored in a predetermined area of the RAM. Then, at the end of the agent processing, based on the fact that the driver name has been acquired, "I went out with Mr. XX today."
Is selected, the obtained driver name is embedded in the place of "Mr. XX", and a sentence "I went out with Ichiro today" is formed. Further, based on the fact that the elapsed time T is obtained, a standard time (= threshold value T1) to be taken on the road from the same departure point to the destination when the average vehicle speed is 60 km / h is calculated. If the elapsed time T is greater than the standard time T1,
A fixed phrase such as "It took a long time."
The acquired elapsed time T is embedded in the place of ○ to form, for example, a sentence “It took 5 hours”.

Further, the fixed form document data 295 stores the travel diary of each fixed form sentence, the priority order of the records in the request mail and the warning mail, and the formed sentence is stored in one travel diary or the request mail. The travel diary data 296 or the mail data 297 are stored in this order.

FIG. 8 shows the navigation data storage device 3.
0 (FIG. 1) represents the contents of the data file. As shown in FIG. 8, in the navigation data storage device 30, as various data files used for route guidance and the like, a communication area data file 301, a drawn map data file 302, an intersection data file 3
03, a node data file 304, a road data file 305, a search data file 306, and a photograph data file 307.

This navigation data storage device 4
For example, floppy disk, hard disk, CD-
Various recording media such as a ROM, an optical disk, a magnetic tape, an IC card, and an optical card, and their driving devices are used. Note that the navigation data storage device 4 may be configured by a plurality of types of different recording media and drive devices.
For example, a recording medium (for example, a flash memory or the like) that can read and write the search data file 46 is used, and the other files are configured by a CD-ROM, and these drive devices are used as drive devices.

The communication area data file 301 displays, on the display device 5, an area where the portable telephone used in the vehicle connected to or without the communication control device 24 can communicate from the inside of the vehicle, and displays the area where the communication can be performed. Communication area data for use in route search is stored for each type of mobile phone. Each communication area data for each type of mobile phone is numbered and managed so that it can be easily searched, and the area where communication is possible can be represented by the inside surrounded by a closed curve. And is specified by the position data of the inflection point. Note that the communication area data may be obtained by dividing a communicable area into various large and small square areas and converting the data into two pieces of diagonal coordinate data. Communication area data file 30
It is desirable that the contents stored in 1 can be updated with the expansion or contraction of the area where the mobile phone can be used. , And the contents of the communication area data file 301 can be updated with the latest data. The communication area data file 30
1 may be constituted by a floppy disk, an IC card, or the like, and may be rewritten with the latest data. The drawing map data file 302 stores drawing map data to be drawn on the display device 27. This drawing map data stores a hierarchical map, for example, map data for each layer such as Japan, the Kanto region, Tokyo, and Kanda from the highest layer. Map data of each layer is provided with a map code.

The intersection data file 303 includes an intersection number specifying each intersection, an intersection name, coordinates of the intersection (latitude and longitude), a number of a road at which the intersection is a start point and an end point, and the presence or absence of a signal. It is stored as intersection data. The node data file 304 stores node data including information such as latitude and longitude specifying coordinates of each point on each road. That is,
The node data is data relating to one point on a road. When a node connecting nodes is called an arc, a road is represented by connecting each of a plurality of node arrays with an arc. The road data file 305 includes a road number specifying each road, an intersection number serving as a start point and an end point, a number of a road having the same start point and end point, road thickness, prohibition information such as entry prohibition, and photographic data described later. The photo number and the like are stored. Intersection data file 30
3. Road network data including intersection data, node data, and road data stored in the node data file 304 and the road data file 305, respectively, is used for route search.

The search data file 306 stores intersection row data, node row data, and the like that constitute a route generated by the route search. The intersection column data is
The information includes information such as an intersection name, an intersection number, a photograph number showing a characteristic scenery of the intersection, a corner, a distance, and the like. Also,
The node string data includes information indicating the position of the node, such as east longitude and north latitude. The photo data file 307 contains
The photographs taken at each intersection and the characteristic scenery seen while traveling straight ahead are digital, analog,
Or stored in negative film format.

FIG. 9 shows various sensors constituting the situation sensor section 40. As shown in FIG. 9, the situation sensor unit 40 includes an ignition sensor 401, a vehicle speed sensor 402, an accelerator sensor 403, and a brake sensor 40.
4. Side brake detection sensor 405, shift position detection sensor 406, turn signal detection sensor 407, wiper detection sensor 408, light detection sensor 409, seat belt detection sensor 410, door open / close detection sensor 411, passenger detection sensor 412, indoor temperature detection Sensor 413, outdoor temperature detection sensor 414, fuel detection sensor 415, water temperature detection sensor 416, ABS detection sensor 417, air conditioner sensor 418, weight sensor 419, front vehicle distance sensor 4
20, rear inter-vehicle distance sensor 421, body temperature sensor 422, heart rate sensor 423, perspiration sensor 424, brain wave sensor 42
5. Eye tracer 426, infrared sensor 427, and other sensors (tire air pressure drop detection sensor, belt looseness detection sensor, window open / closed state sensor, horn sensor, indoor humidity sensor, outdoor humidity sensor, oil temperature detection sensor, Various sensors for detecting a vehicle situation, a driver situation, a vehicle interior situation, and the like, such as a hydraulic pressure detection sensor 428, are provided. These various sensors are arranged at predetermined positions according to the respective sensing purposes. Note that the case where these sensors do not exist as independent sensors includes the case where sensing is performed indirectly from other sensor detection signals. For example, a tire air pressure drop detection sensor indirectly detects a drop in air pressure based on a change in a signal from a wheel speed sensor.

The ignition sensor 401 detects whether the ignition is ON or OFF. Vehicle speed sensor 402
For example, a conventionally known vehicle speed sensor such as one that detects the rotational angular velocity or the number of rotations of a speedometer cable to calculate the vehicle speed can be used without any particular limitation. The accelerator sensor 403 detects the amount of depression of the accelerator pedal. The brake sensor 404 detects the amount of depression of the brake, and detects whether or not sudden braking has been applied based on the depression force, the depression speed, and the like. The side brake detection sensor 405 detects whether the side brake is applied. The shift position detection sensor 406 detects a shift lever position. Turn signal detection sensor 40
7 detects the blinking direction of the blinker. The wiper detection sensor 408 detects a drive state (speed or the like) of the wiper. The light detection sensor 409 detects a lighting state of each lamp such as a head lamp, a tail lamp, a fog lamp, and a room lamp. The seat belt detection sensor 410 is provided for the driver and the passenger (assistant seat, rear seat)
Detects whether the user is wearing a seat belt. When not wearing, an agent appears as appropriate (to the extent that it is not disliked) and gives warnings, cautions, comments, etc. (changes the level by learning).

The door open / close detection sensor 411 detects the open / closed state of the door, and in the case of a so-called half-door, an agent notifies that fact. The door open / close detection sensor 411 is
The opening and closing of each door such as a driver's seat door, a passenger's seat door, a rear driver's seat side door, a rear passenger's seat side door, and the like according to a vehicle type can be detected. The passenger detection sensor 412 is a sensor that detects whether or not a passenger is in the passenger seat or the rear seat. It is detected by a pressure sensor or a weight scale. The indoor temperature detection sensor 413 detects the air temperature inside the room, and the outdoor temperature detection sensor 414 detects the air temperature outside the vehicle. The fuel detection sensor 415 detects the remaining amount of fuel such as gasoline and light oil. The detected values of the past five times immediately before refueling are stored in the learning item data 292, and when the average value is reached, the agent notifies that it is time to refuel.

The water temperature detection sensor 416 detects the temperature of the cooling water. If the detected temperature is low immediately after the ignition is turned on, the agent often acts like a sleepy. On the other hand, if the water temperature is too high, the agent informs the user with "sloppy" behavior before overheating. The ABS detection sensor 417 detects whether or not the ABS that operates to prevent the tire from being locked by the sudden braking and to ensure the maneuverability and the vehicle stability is operated. The air conditioner sensor 418 detects an operation state of the air conditioner.
For example, ON / OFF of an air conditioner, a set temperature, an air volume, and the like are detected. The weight sensor 419 is a sensor that detects the weight of the driver. The driver is identified from the weight or from the weight and the image of the imaging device 28, and an agent learned in relation to the driver is caused to appear. That is, by using the learning item data 292 and the response data 293 learned by the agent for the specified driver, an agent dedicated to the driver is caused to appear. The front inter-vehicle distance sensor 420 detects a distance to another vehicle or an obstacle in front of the vehicle, and outputs a rear inter-vehicle distance sensor 421.
Detects the distance to another vehicle or obstacle behind.

A body temperature sensor 422, a heart rate sensor 423,
The perspiration sensor 424 provides the driver's body temperature, heart rate,
A sensor for detecting the state of perspiration, for example, by arranging each sensor on the handle surface and detecting from the state of the driver's hand. Alternatively, the temperature distribution of each part of the driver may be detected by thermography using an infrared detecting element as the body temperature sensor 422. The electroencephalogram sensor 425 detects a driver's electroencephalogram, and detects, for example, an α-wave or a β-wave to check the driver's arousal state. Eye tracer 42
6 detects the movement of the user's line of sight, and determines during normal driving, searching for a target outside the vehicle, searching for a target inside the vehicle, awake state, and the like. The infrared sensor 427 detects movement of the user's hand or face.

Next, the operation of the present embodiment configured as described above will be described. FIG. 10 is a flowchart showing main operations of the information recording process and the agent process by the information recording device of the present embodiment. As shown in FIG. 10, when the ignition sensor 401 detects that the ignition has been turned on, the agent processing unit 11 first performs initialization (step 1). Initial settings include clearing the RAM, setting a work area for each process in the RAM,
(FIG. 7) Loading into the RAM, and rewriting of predetermined items such as the number of voice inputs, the number of specific commands, and the number of insufficiency of volume in the learning data 292 (the number of voice inputs, the number of specific commands, and the insufficiency of volume) Processing such as loading the program selection table 291 (FIG. 2) into the RAM, setting a flag to OFF, and the like is performed. In the information recording process of the present embodiment, the start of the process is set to ignition ON. .

Next, the agent processing section 11 specifies a driver (step 2). That is, when a greeting is first given by the driver, the agent processing unit 11 analyzes the voice to identify the driver, identifies the driver by analyzing a captured image, specifies the driver,
The driver is identified from the weight detected in step 9 or the driver is identified from the set seat position and the angle of the rearview mirror. In addition, for the specified driver, a special communication program for inquiring, such as "Is XXX?" Is activated separately from the agent processing described below, and the driver is confirmed.

When the driver is specified, the agent processing section 11 grasps the current situation (step 3).
That is, the agent processing unit 11 detects the detection value supplied from each sensor of the situation sensor unit 40 in the situation information processing unit 15, the processing result of the image captured by the imaging device 28,
Data such as the current position of the vehicle detected by the current position detection device 21 is acquired, stored in a predetermined area of the RAM, and the current situation is grasped from the stored data. The current situation includes the current position of the vehicle detected by the current position detecting device 21, the elapsed time after the ignition is turned on from a timer (not shown) included in the overall processing unit 1, the number of voice inputs from the microphone 26, The volume of the voice, the presence or absence of a travel diary creation request, and the like are listed. Also, as the current situation,
In addition, a driver's request that has been voice-recognized based on an input from the microphone 26, for example, "call me to the number XX.", "Display a restaurant in this area." Requests such as "Please display if you have an e-mail." Etc. are also grasped as the current situation. In this case, the words “CD” and “Kakeru” included in the recognized voice also become selection conditions (horizontal axis items) of the program selection table 291 (FIG. 2) in the agent processing. Further, the agent processing unit 11 sets the learning condition data 292 and the response data 2 in the agent data storage device 29 as the current situation.
By checking 93, the state (learning data) that the agent has learned so far is grasped.

Upon grasping the current situation, the agent processing section 11 performs an agent process according to the grasped situation (step 4). The agent processing here includes various processes such as judgment by the agent, communication action (action + speech), control, learning, and inspection, but also includes a case where no operation is performed depending on the current situation grasped. Also, as this agent process,
An information recording process for acquiring, storing, and displaying a document based on the condition of the vehicle is performed. This information recording process includes a mail creation process for creating and storing a warning mail for notifying that the vehicle has a failure and needs repair, and a request mail for giving advice to a driver and the like. It is.
In addition, when a driver makes a request for creating a travel diary, information corresponding to information fields obtained from the on-board equipment and the machine of the fixed form document data 295 shown in FIG. 7 is obtained. A travel diary creation process for creating and storing a travel diary based on the travel diary is included. Examples of the information corresponding to the information column include information on a traveling history such as a departure place and a destination, information on traffic congestion, a use history of the voice recognition device, and a history of cooling water temperature change. The display of the warning e-mail, the request e-mail, and the travel diary is performed according to a command from the driver.

Subsequently, the agent processing section 11 determines whether or not to end the processing of the main operation (step 5). If not (step 5; N), the processing returns to step 13 and repeats the processing. . On the other hand, when the operation is to be ended (step 5; Y), that is, when the ignition is turned off.
When the ignition sensor 401 detects that the F has been pressed (step 3), an end process such as turning off the interior light or updating the learning data as necessary is performed (step 6).
The operation of the main processing ends.

FIG. 11 is a flowchart showing the operation of the communication process as one of the agent processes. Based on the program selection table 291 shown in FIG. 2, a communication program (number of the communication program that can be started in the current state, based on the grasped current situation (number of starts, current weather, time, etc.) ) Is determined (step 11). If there is no corresponding program (Step 11; N),
Return to the main routine. On the other hand, when there is a communication program that can be started (step 11;
Y), and determine the program number. Then, the driver's response history to the determined program number is confirmed from the response data 293, and it is confirmed whether or not the activation of the communication program of the program number should be rested (step 12).

When not in a rest state (step 12;
N), the agent processing unit 11 activates the communication program corresponding to the determined program number, and displays an image according to the action (action and voice) of each agent shown in FIG. 3 on the display device 27. At the same time, audio is output from the audio output device 25 (step 1).
3). As a result, it is possible to perform communication with the agent not only based on the current situation of the vehicle and the driver, but also on the past situation and the learning result of the response.

Then, the agent processing section 11 obtains a response of the driver to the agent action by activating the communication program from a voice recognition result based on an input from the microphone 26 or an input result from the input device 22 (step 14). . Next, the agent processing unit 11
Determines whether the communication program started in step 16 is a control target program (step 15). Here, whether or not to control the program is defined for each program. For example, "Let's turn on the radio?" For example, a communication program or the like when an agent proposes an action that can be processed (power ON, restaurant guidance, etc.) is defined as a control target program.

If the program is not the control target program (step 15; N), the process proceeds to step 27. If the program is the control target program (step 15; Y), the control program corresponding to the driver's response obtained in step 24 is generated. It starts up and performs control (step 16). For example, if a response for accepting a proposal such as “put on”, “OK”, or “yes” is recognized in response to the proposal communication for turning on the radio, the agent processing unit 11 performs control according to the response. To make the agent respond (action and voice) and turn on the radio.

Then, the agent processing section 11 causes the agent to learn by accumulating data relating to the current communication program (step 1).
7) Return to the main routine. As the accumulation of data, for example, when the activation of the communication program is absent (step 12; Y), the number column of the corresponding program number in the learning item data 292 is counted up. However, the number of times stored in the number of rests / date and time column of the learning item data 292 is set to Ka times, and the response data 293 up to the previous time for the program number is used.
Assuming that the number of rests determined from the history of
If = Kb-1, it means that this rest has taken a specified number of rests. Therefore, the data (stored at the corresponding position) in the program number column of the learning item data 292 and the response data 293 is cleared. In other cases (step 15; in the case of N, after step 16), if there is a learning item in the grasped current situation (step 3), the value of the learning item data 292 is updated and the response content is recorded in the history. If the program number is to be stored as, the response content acquired in step 7 is stored in the response data 293 (FIG. 6). If data of a predetermined number of times defined for each program number has already been stored in the response history, the oldest data is discarded and new data is stored.

FIG. 12 shows an example of the contents of a specific communication process while the vehicle is running.

As shown in FIG. 12 (a), the agent processing unit 11
The state detected at 18 is “ON”, and the room temperature T detected by the indoor temperature detection sensor 413 and the outdoor temperature detection sensor 414
1 and the outdoor temperature T2. Also, by checking the response data 293 of each program number, the two previous driver responses to the program number 00xxx are C (acceptance).
Therefore, the default value (T3
= 2 degrees, T4 = 24 degrees) are read from the learning item data 292. From the threshold values T3 and T4, the relationship between the room temperature and the outdoor temperature, (T1−T2) ≦ T3 is “Yes”, and the outdoor temperature T
The situation in which the relationship T2 ≦ T4 between “2” and the threshold T4 is “Yes” is finally grasped. (FIG. 12 (a)).

From the above processing, the agent processing unit 11
Selects the communication program of the program number 00xxx from the program selection table 291 (step 11), confirms that the program is not a sleep target (step 12; N), and starts the communication program of the number (step 13). ).

Then, by starting the communication program of the program number 00xxx, FIG.
As shown in FIG. 7, a plurality of images (or moving images) of the agent E are displayed on the display device 27, and the voice output device 25 indicates that the agent E is "cool outside. Is output?

Subsequently, the agent processing section 11 acquires the driver's response (step 14). Then, since the program number 00xxx is the control target program (step 15; Y), if it is accepted, the power supply of the air conditioner is turned off as the control corresponding to the response, and the windows on the driver's seat side and the passenger's seat side are reduced by half. Open control (Step 2)
6).

After the control in response to the response, the agent processing unit 11, as shown in FIG. ,
It is stored in the response data 293 corresponding to the program number 00xxx together with the response date and time. In this case, the response data of the last two times is deleted, and the previous response and the current response become the storage contents of the response data 293. If the stored response content is “ignore A”, the next threshold values T3 and T4 are reduced by one time (T
3-1 = 1 degree, T4-1 = 23 degrees) is used, and one rest is performed. If the stored response content is rejection B, the next threshold values T3 and T4 are reduced by one at a time (T3-1 = 1).
Degrees, T4-1 = 23 degrees), and rest five times. In addition, as the threshold value in the case of one rest, the temperatures T3 = T3-1 and T4 = T4-1 after being lowered are used. If the stored response content is acceptance C, the previously used threshold T3,
The same value as T4 is used.

The agent processing section carries out, as one of the agent processes (step 4 shown in FIG. 10), an information recording process for creating, storing and displaying a travel diary, a request mail, and a warning mail. FIG. 13 is a flowchart showing the flow of the main operation of the information recording process. This figure 1
As shown in FIG. 3, in the agent processing (step 4), the agent processing unit 11 performs various processings such as voice recognition recording processing, cooling water temperature change history recording processing, and other mail target recording processing (step 20). ). In each of these processes, information based on data acquired by the situation sensor unit 40 and the current position detection device 21 is acquired from the situation information processing unit 15 and the navigation processing unit 10 and stored. It should be noted that, among the information to be acquired, the information acquired in the current situation grasping operation in step 3 of the main routine shown in FIG. 10 is used without being acquired again. Furthermore, the agent processing unit 11 determines whether or not there is a travel diary creation command by an input operation such as a voice input from the microphone 26 as the situation of the vehicle (step 2).
1). If a travel diary creation command has been issued (step 21; Y), a recording process of the traveling history and a recording process of the traffic congestion information are performed (step 22). Then, it is determined whether the vehicle has arrived at the destination (step 2).
3) If it has not arrived at the destination (step 23;
N), the operation from the mail object recording process (step 20) is repeated again. Therefore, if there is a travel diary creation command, the mail object recording process,
The recording process of the traveling history and the recording process of the traffic jam information are performed. If there is no travel diary creation instruction (Step 2
1; N), it is determined whether or not the vehicle has arrived at the destination (step 23). If the vehicle has not arrived at the destination, the mail object recording process is again performed (step 2).
The operation from 0) is repeated. Therefore, if there is no travel diary creation command, only the mail object recording process is repeated until the destination arrives. When it is detected that the vehicle has arrived at the destination (Step 23; Y), the agent processing unit performs processing based on the information acquired by the recording processing of the traveling history, the recording processing of the traffic congestion information, and the recording processing of the mail target. Then, a fixed form sentence is selected from the fixed form document data 295, and if there is a blank in the selected sentence, the blank is filled in and the document is arranged and documented in accordance with the priority of recording (step 24).
Trip diary data, request email, and warning email
96 or mail data 297 (step 2
5).

FIG. 14 is a flowchart showing a destination setting for navigation and a start operation of a route search process in this embodiment. FIG. 15 is a flowchart showing one of information recording processes according to the grasped situation. It is a flowchart showing the operation of the traveling history recording process. In the present embodiment, when route guidance is performed by the navigation processing unit 10, a process of recording a travel history is performed. As shown in FIG. 14, the agent processing unit 1
1 and the navigation processing unit 10 check whether the destination setting switch is turned on (step 30). Then, the driver operates the input device 22 or the microphone 27.
If the destination setting switch is turned on by voice or the like (step 30; Y), the current position is acquired from the current position detecting device 21 as the current situation (step 3).
1), A transit point and a destination are acquired by an input from the driver (step 32). And the navigation processing unit 10
Performs a route search (step 33). Subsequently, when there is a guidance start instruction by voice or button input from the driver (Step 34; Y), the agent processing unit 11 turns on the guidance start flag and starts the route guidance (Step 3).
5). If the destination setting switch is not on (step 30; N), the process returns to the main routine.

The on / off of the guidance start flag is also monitored in the traveling history recording processing (step 3).
51), the guidance start flag is off (step 35)
1; N), the process directly returns to the main routine. When the guidance start flag is ON (step 351;
In Y), the on / off of the elapsed time measurement flag is further checked (step 36). Then, if the elapsed time measurement flag is turned off, the elapsed time measurement flag is turned on, and the measurement of the elapsed time is started (step 37). During the route guidance, the navigation processing unit 10 always obtains the current position from the current position detection device 21, and this current position is output to the agent processing unit 11 (step 38).

During route guidance, the agent processing unit 11 calculates and monitors the vehicle speed based on the output from the vehicle speed sensor 402 of the situation sensor unit 40 (step 39), and monitors the vehicle speed (step 40). If the position is a preset transit point or destination at the start of route guidance, a stored parking area (PA), or the like, the transit point or P.A. A. Etc., or it is determined that the vehicle has arrived at the destination. The destination is stored as information on the travel history.

That is, when the vehicle speed becomes 0 for a predetermined time (step 40; Y), the agent processing section 11 determines that the vehicle has stopped. Then, it is determined whether or not the current position is the same as the set transit point (step 41). If the current location is a transit point (step 41; Y), it is checked whether the stop time measurement flag is on (step 4).
2) If it is not turned on (step 42; N), the stop time measurement flag is turned on (step 43), the name of the waypoint is stored in a predetermined work area of the RAM (step 44), and the main Return to routine. When the stop time measurement flag is ON (step 42;
In the case of Y), it is determined that the vehicle has stopped at the time when the vehicle speed 0 was previously detected, and the process returns to the main routine. If the current location is not a stopover (step 41;
N) includes a parking area and a restaurant stored in advance in a file in the navigation data storage device,
It is determined whether it is the same as a convenience store or the like (step 45).

If the current location is a parking area or the like (step 45; Y), it is checked whether or not the stop time measurement flag is on (step 46). If not, the stop is stopped (step 46; N). The time measurement flag is turned on (step 47), the name of the transit point is stored in a predetermined work area of the RAM (step 48), and the process returns to the main routine. If the stop time measurement flag is ON (step 46; Y), it is determined that the vehicle is stopped as it was when the vehicle speed was detected 0 last time, and the process returns to the main routine.

If the current location is not a transit point or a parking area previously stored in a file of the navigation data storage device (step 41;
N, 45; N), the agent processing unit 11 checks whether the current position is the same as the set destination (step 49). If the current position and the destination are the same (step 49; Y), it is determined that the vehicle has arrived at the destination, the guidance start flag is turned off, the route guidance is ended (step 50), and the elapsed time measurement flag is turned off, and the departure point is set. (Step 51). Then, the elapsed time and the destination are stored in a predetermined work area of the RAM (step 5).
2, step 53), and return to the main routine.

If the vehicle speed is 0 for a predetermined time (step 4
0; Y), when the current position of the vehicle is not any of the set transit point, the stored parking area, etc., and the set destination (Step 41; N, Step 45;
N, step 49; N), the process directly returns to the main routine.

If the vehicle speed is not 0 (step 40; N)
Checks whether the stop time measurement flag is on (step 60). If the stop time measurement flag is on (step 60; Y), the vehicle stops at a transit point, a parking area, or the like. Since it can be determined that the vehicle has left and started running again, the stop time measurement flag is turned off (step 61). Then, the measurement time is stored (step 62), and the process returns to the main routine. When the stop time measurement flag is off (step 60;
In N), it is determined that the vehicle is traveling, and the process returns to the main routine.

In this embodiment, when the travel diary creation command has been acquired, congestion information recording processing is performed as agent processing together with the above-described travel history recording processing. FIG. 16 is a flowchart showing the operation of the traffic jam information recording process as one of the information recording processes according to the grasped situation. As shown in FIG. 16, in the traffic jam information recording process, when the beacon receiving device 215 of the current position detecting device receives the traffic jam information as a situation (step 66; Y), the name of the traffic jam location is acquired from this information. Is stored in the work area of the RAM (step 6).
7). Then, the process returns to the main routine. If the traffic congestion information has not been received, the process returns to the main routine, and the current situation is continuously monitored.

The information acquired and stored by the above-described traveling history recording processing, traffic congestion information recording processing, and other information recording processing is documented after the arrival of the vehicle at the destination is detected, and travels to the agent data storage device 29. It is stored as diary data 296. FIG. 17 is an explanatory diagram showing a specific example of a process of creating a travel diary based on the information acquired by the above-described travel history recording processing and traffic congestion information recording processing. As shown in FIG. 17 (a), the driving history recording processing and the traffic congestion information recording processing store information such as driver name (Ichiro), departure place (home), and destination (Shuzenji) in a predetermined area of the RAM. Arrived), elapsed time T = 5 hours 2
It is assumed that 0 minutes is stored and no record of traffic congestion information is stored.

In this case, the agent processing unit 11 detects that the vehicle has arrived at the destination, stores the destination name (step 53), and then, when the average vehicle speed is set to 60 km / h, from the same departure point. The standard time (= threshold T1; 4 hours and 10 minutes) to be taken on the way to the destination via the ground is calculated. Then, the standard document data 295
With reference to the recording condition column (FIG. 7), a fixed phrase formed from the information stored in the RAM and the operation result is selected. That is, as shown in FIG. 17 (b), since the driver name has been acquired, the fixed phrase (1) shown in the fixed phrase column of FIG. 7 is selected, and since the driver has arrived at the destination, the fixed phrase is obtained. Sentence (2) is selected, and fixed sentence (3) is selected because it has arrived at the destination and the elapsed time T (5 hours and 20 minutes)> threshold value T1 (4 hours and 10 minutes). Furthermore, since the elapsed time T (5 hours and 20 minutes) after arriving at the destination> the threshold value T2 (4 hours, which is a constant value regardless of the distance in this case), the fixed phrase (4) is selected. You. And FIG.
As shown in (c), the driver name "Ichiro" is embedded in the blanks of the fixed phrase (1), the destination "Shuzenji" is embedded in the fixed phrase (2), and the fixed phrase (3) is Elapsed time "5
"Time 20 minutes" is embedded, and a total of four sentences are acquired together with the standard sentence (4). Subsequently, the agent processing unit 11
Is, as shown in FIG. 17D, the fixed form document data 295
Then, the priorities of the records of these four fixed phrases (1) to (3) are checked, and as shown in FIG. In the state of being arranged according to the order, it is stored as travel diary data 296 in the agent data storage device 29. At this time, each trip diary data is stored together with the created date and time.

The travel diary data 296 obtained as described above and stored in the agent data storage device 29 is output to the display device 27 as a travel diary according to a command from the driver. FIG. 18 is an explanatory diagram illustrating an operation for outputting a travel diary to a display device. As shown in FIG. 18A, in this embodiment, a menu selection screen is displayed on the display device as an initial screen, and any one of “TV”, “navigation”, and “record” is pressed. You have to choose. Then, on this screen, "Record"
Is selected, the screen shown in FIG. 18B is displayed,
One of "travel diary" and "mail" is selected. And when "Travel Diary" is selected,
The latest travel diary data is output from the travel diary / mail data 296, and the latest travel diary as shown in FIG. 18C is displayed. When a date is input by voice input or the input device 22 while the latest travel diary is displayed, data on the date is read and displayed.

FIG. 19 is a flowchart showing the operation of recording the voice recognition history in the mail object recording process as one of the information recording processes according to the grasped situation. In the present embodiment, the agent processing unit 11
When the volume of voice input from the microphone 26 is low and it is difficult to recognize the voice correctly, a request mail is generated and stored in the mail data 297 so that the voice is input at a higher volume. Also, if the number of voice input is small, create a request email prompting voice input,
It is stored in the mail data 297. Further, when there are few commands (specific commands) that can control various devices by voice input such as opening and closing of a power window, driving of a wiper, and the like, a request mail indicating that control can be given is created, and mail data is generated. 297. This request mail is displayed by selecting the mail while the screen shown in FIG. 18B is displayed on the display device 27 in the same manner as the above-described travel diary.

As shown in FIG. 19, the agent processing unit 11 monitors the presence or absence of a voice input from the voice input device (microphone) 26 as a vehicle status (step 71). When a voice input is detected in step 15, the number of voice inputs of the learning item data 292 is added (step 72). Next, agent processing unit 1
1 obtains the volume of the input voice from the voice control unit 14 or the situation information processing unit 15, stores it in a predetermined area of the RAM (step 73), and recognizes the input voice using a voice recognition dictionary (step 74). . If there is a corresponding word in the voice recognition dictionary (step 75; Y), the recognition result is output from the voice output device 25 (callback).
Then, the correctness of the recognition result is obtained from the driver (step 7).
6). If a response indicating that the recognition result is correct is obtained or if there is no response, the voice recognition result is determined to be correct (step 77; Y), and it is determined whether the content of the input voice is a specific command (step 78). Then, in the case of a specific instruction (Step 78; Y), the number of specific instructions in the learning item data 292 is added. After adding the number of specific instructions, and when the recognition result is correct and the content of the input voice is not the specific instruction (step 78; N), the process directly proceeds to the agent processing routine to execute the agent processing corresponding to the recognition result. Do.

When the input speech cannot be recognized because there is no word corresponding to the speech recognition dictionary (step 75; N), and when a response indicating that the speech recognition result is incorrect is obtained (step 77; N). The agent processing unit 11 checks whether the volume of the input voice stored in step 73 is equal to or higher than a predetermined value (step 80). If the sound volume is equal to or higher than the predetermined value (step 80; Y), the process returns to the main routine. If the sound volume is lower than the predetermined value, the number of times the sound volume is insufficient in the learning item data 292 is added, and the process returns to the main routine.

The information (the number of specific commands, the number of voice inputs, and the number of insufficient volumes) obtained by the voice recognition history recording process is documented after arriving at the destination of the vehicle, and is mailed to the agent data storage device 29. This is stored as data 297. That is, when it is detected that the vehicle has arrived at the destination and the traveling history recording process is completed and the process returns to the main routine, the agent processing unit 11 determines the number of specific commands and the number of voice inputs stored in the learning item data 292. , And the number of insufficient volumes, and compares these values with the thresholds set for each. Then, based on the standard document data 295 (FIG. 7), if the condition is satisfied, the corresponding standard sentence is selected, and a request mail sentence is created. If the number of specific instructions is less than the threshold value, the standard sentence (5) is selected, and an operation corresponding to this specific instruction is embedded in the blank of the standard sentence (5) to create a sentence. If the number of voice inputs is smaller than the threshold value, the standard sentence (6) is selected. When the number of times of volume shortage is smaller than the threshold of the number of times of volume shortage, the fixed phrase (7) is selected, the driver name stored in the RAM is acquired, and the driver name is entered into the fixed phrase (7). ) To fill in the blanks to create a sentence. The fixed phrase used in the e-mail has a phrase like an e-mail from an agent.

Then, the obtained sentence is stored as mail data 297 in the agent data storage device 29. At this time, the mail data 297 is stored together with a title indicating that the mail is a request mail to the driver saying "I am in trouble", the driver name, and the date and time when the mail was created.

The mail data 297 obtained and stored in the agent data storage device 29 as described above
By selecting “mail” while the screen shown in FIG. 8B is displayed, the mail is displayed on the display device 27 as mail from the agent (agent mail). FIG. 20 is an explanatory diagram showing an operation in which the agent mail is displayed on the display device 27. When “mail” is selected by voice input from the microphone 26 or input from the input device 22 in the state shown in FIG. 18B, the display device 27 displays, as shown in FIG. The title of an unread mail (a mail created and stored in the agent data storage device 29 and not displayed on the display device 27) for the acquired driver name is displayed. Then, when the title of the mail is selected by voice input from the microphone 26 or input from the input device 22, as shown in FIG. This is output together with the creation date and time, and a mail format document is displayed on the display device 27.

FIG. 21 is a flow chart showing the operation of the cooling water temperature change history recording process in the mail object recording process as one of the information recording processes according to the grasped situation. FIG. 21 is a diagram showing a state in which a warning mail based on the data obtained by the process 21 is displayed on the display device 27. In the present embodiment, the agent processing unit 11 creates a warning mail indicating that the engine coolant needs to be repaired when the temperature of the engine cooling water is too high, and stores the warning mail in the mail data 297. This warning mail is displayed by selecting a title while the screen shown in FIG. 20A is displayed on the display device 27, similarly to the above-described request mail.

As shown in FIG. 21, the agent processing section 11 monitors the temperature of the engine cooling water as the condition of the vehicle, and sends the condition information to the situation information processing section 15 from the water temperature detection sensor 416 of the situation sensor section 40. Is output, and information on the temperature of the cooling water is detected (step 91). And the agent processing unit 11
Then, the temperature of the cooling water is compared with a threshold value stored in advance (step 92). If the temperature of the cooling water is equal to or higher than the threshold value (step 92; Y), the temperature of the cooling water is set to R
It is stored in a predetermined area of the AM (step 93), and the process returns to the main routine. If the temperature of the cooling water is less than the threshold value (step 92; N), the process returns to the main routine.

When it is detected that the vehicle has arrived at the destination, the agent processing unit 11 determines that the coolant temperature stored in the predetermined area of the RAM since the ignition has been turned on has been detected. Standard document data 295
Select the fixed phrase (8) from (FIG. 7). Then, a sentence is created by embedding the contact information set and stored in advance in the blank, and the mail data 2 is stored in the agent data storage device 29.
97. At this time, the mail data 297
Is stored together with a title indicating that it is a warning mail to the driver saying "It's hard!"

The mail data 297 obtained in this way and stored in the agent data storage device 29 is displayed on the display device 27 as shown in FIG. 22 by selecting a title on the screen shown in FIG. Will be displayed. The warning mail is displayed on the screen shown in FIG. 20A for all drivers irrespective of the driver name for selecting a title.

As described above, in the information recording apparatus of the present embodiment, the data acquired by the vehicle situation sensor unit 40, the current position detecting device 21 and the like are used by the agent processing unit 11 functioning as data analysis means. The analysis is performed by comparing the magnitude with a threshold value, and the result is documented and output as the analysis result. Therefore, according to the present embodiment,
Information on the condition of the vehicle can be widely and frequently available to drivers and the like without requiring specialized knowledge.

According to the present embodiment, a document based on the analysis result of the data acquired by the vehicle status sensor unit 40, the current position detecting device 21 and the like is displayed on the display device 27, so that the document is missed like a voice output. It is possible to easily and easily obtain information about the vehicle without any hassle such as difficulty in hearing or hearing.

According to the present embodiment, a document based on the analysis result of the data acquired by the vehicle situation sensor unit 40, the current position detecting device 21, and the like is displayed as a travel diary or mail of an anthropomorphic agent in the vehicle. Therefore, the driver and the like feel that the vehicle is more attached to the driver, in combination with the communication function of the agent. In addition, a strong impression is given to the driver and the like, and the information can be clearly transmitted.

Next, a description will be given of a second embodiment of the information recording apparatus according to the present invention. Note that, in the information recording device of the present embodiment, the same devices as those of the above-described information recording device of the first embodiment, and parts, data, members, and the like are denoted by the same reference numerals as those of the first embodiment. Description is omitted.

FIG. 23 is a block diagram showing the configuration of the information recording apparatus of this embodiment. FIG. 24 is a diagram showing an example of a travel diary displayed on the display device 27 by the information recording apparatus of this embodiment. is there. As shown in FIG. 23, in the information recording device of the present embodiment, travel image data 298 is stored in the agent data storage device 29. The travel image data 298 includes image data of an image captured by a driver using a digital camera, image data of an image captured by a vehicle-mounted camera, and navigation data among image data stored in the navigation data storage device 30. The image data of the destination and the waypoint set as the destination and the waypoint of the apparatus, and the correspondence between the image data and the travel diary data 296 are provided. The image data stored in the travel image data 298 is image data such as a landscape image, a traffic jam image, and an image of a person who has met before at the destination. The correspondence between the image data and the travel diary data 296 includes the date and time when the image data of the image captured by the driver using the digital camera and the image data of the image captured by the vehicle-mounted camera are captured. For the image data stored in the navigation data storage device, the travel diary data 2 includes the same destination and transit point as the imaging position of the image data.
96 are supported.

[0100] When displaying the travel diary on the display device 27, the agent processing section 11 transmits the travel image data 29
8, the travel diary data 296 of the travel diary displayed is searched for, and as shown in FIG. 24, the image of this image data is displayed on the display device 27 together with the travel diary. It has become. At this time, when a plurality of image data stored in the travel image data 298 correspond to one travel diary, each image data is displayed for a predetermined time in a sliding manner.

In the present embodiment, the travel diary data 296 stores, in addition to the created date and time, the position data of the destination if the destination has been acquired. Then, when approaching the destination in the past travel diary while the vehicle is traveling, the agent processing unit 11 outputs the travel diary including the destination via the voice control unit 14 from the voice output device 25 as a voice. Diary reading is performed.

FIG. 25 is a flowchart showing the flow of the operation of the travel diary reading-out process according to this embodiment. As shown in FIG. 25, the agent processing unit 11
During the operation of the vehicle, the current position detecting means 2
1 is obtained from the navigation processing unit 10 (step 1).
10). The agent processing unit 11 refers to the position data of the destination in the travel diary data 296, detects the distance between the current position and each of the past destinations in the travel diary data 296, and compares the distance with a predetermined value. (Step 111).

If there is a destination whose distance is equal to or less than the predetermined value (step 112; Y), the travel diary data 296 including this destination is obtained (step 114), and then the reading execution flag is turned on. As a result, the travel diary data is converted into voice data, and the travel diary is output by voice of the agent (step 116). Then, after the sound output ends, the process returns to the main routine. If none of the past destinations in the travel diary data 296 has a distance to the current position equal to or less than the predetermined value (step 112; N), the process returns to the main routine.

According to this embodiment, in addition to the operation and effect of the first embodiment, an image related to the operation of this trip diary is displayed together with the document of the trip diary, so that more and more specific information can be obtained. Can be provided. According to the present embodiment, in addition to the actions and effects of the first embodiment,
During the operation of the vehicle, a travel diary having a record of the current position and the vicinity is automatically searched and read out, so that a past travel diary can be reliably read and information can be provided by voice.

The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the gist of the present invention. For example, in each of the embodiments described above, the vehicle is a vehicle provided with an agent device and a navigation device, and the entire processing unit 1 including the arithmetic processing unit of the information recording device of the present invention includes the navigation processing unit 10 and the agent processing unit 11 However, the vehicle may not include the agent device or the navigation device. In this case, the arithmetic processing unit may serve as a processing unit of another device or may be a unique processing unit. In the above-described embodiment, in the information recording process, the names of the destination, the waypoint, the parking area, and the like are obtained from data stored in the navigation storage device that is input to the car navigation device or used for route guidance of the car navigation device. A vehicle that has been acquired but does not have a car navigation device, or a vehicle that has a car navigation device, may also have a unique destination acquisition means for information recording processing. The destination and the like may be obtained by voice from the driver using the microphone 26 or the like or input from the input device 22, or may be obtained from the current position detection means and map data similar to the car navigation storage device. Can be.

In each of the above-described embodiments, data for selecting a fixed phrase for a travel diary from the fixed document data 296 (a destination, a stopover, etc.) is stored in the work area of the RAM. It may be stored in the data storage device 29 or the like. In each of the above embodiments, the travel diary data 296 and the mail data 297 are obtained at the time of arrival at the destination for each operation. At the time of arrival at the destination, data for selecting a fixed phrase is stored in the agent data. The document may be stored by storing it in the apparatus 29 or the like, and selecting a fixed form sentence from the fixed form document data based on the data each time a travel diary or an e-mail is displayed to create a document.
The warning mail and the request mail may be prepared and displayed as soon as data for generating the mail is obtained, or may be displayed or sounded to notify that the mail is present.

In each of the above-described embodiments, the data (the number of specific commands, the number of voice inputs, the number of times of insufficient sound volume, etc.) for selecting a fixed form sentence for mail from the fixed form document data 296 is the latest one-time operation. Is stored as the learning item data 292, but the trip diary and the mail are acquired based on the learning result as data on the latest plural times of operation, average of the latest plural times of data, and the like. It may be. In each of the above-described embodiments, data for selecting a fixed phrase for a travel diary or mail from the fixed document data 296 is included in a predetermined area of the RAM or the learning item data 22. Alternatively, a fixed phrase may be selected based on the response content from the driver, such as the response history stored in the response data 293. For example, the total number of responses from the driver is stored for each content, and if the number of positive responses to a favorable response or an agent's proposal exceeds a predetermined value, a familiar fixed phrase is used. For example, a travel diary or an e-mail may be acquired based on the learning result, such as selection.

In each of the above-described embodiments, the travel diary and the mail are displayed in response to a command input from the driver, but are automatically displayed when the condition of the vehicle meets predetermined conditions. You may make it. Further, it may be displayed immediately when the travel diary data or the mail data is acquired. In particular, in the case of a warning mail, if an urgent repair is required, the mail or the like may be displayed immediately or read aloud without displaying it, so that the driver can be promptly dealt with. In each of the above-described embodiments, the travel diary and the mail are displayed and output on the display device 27. However, the present invention is not limited to this, and is not limited to the display on the display device 27 or the display on the display device. External devices or ICs through voice output or data through a cable or wireless communication.
You may output to a card or other recording media. in this case,
The data of the travel diary and the mail can be converted and output as document data in various text formats such as HTML format, rich text format, and various word processor formats, or as image data.

In each of the embodiments described above, the operation record data is stored and displayed and reproduced as a travel diary or mail. However, the present invention is not limited to this. 23:00 from Tokyo station 23: 4
Rent to Mizonokuchi Shopping Street. Two passengers. 246 is a little congested. 6300 yen. ”, Etc., and the like. In each of the above embodiments,
The fixed phrases stored in the fixed document data 295 and the travel diary created based on these fixed phrases are a travel diary mainly composed of the agent and spelled by the agent.
The present invention is not limited to this, and a document mainly composed of a driver or a passenger may be formed at all times or by selection. As a result, it is possible to greatly reduce the labor and burden on the driver or the like when the driver or the like prepares a travel report.

In each of the above-described embodiments, the situation of the vehicle is detected and the document is obtained from the data of the vehicle. However, the situation may be detected in various devices other than the vehicle to create the document. . For example, in the case of home appliances such as televisions, if the energization time of the standby current per day is longer than the specified time, "A lot of standby current is used. You can save it. "Or if the number of times the vacuum cleaner is turned on is less than or equal to the threshold within a predetermined period, the message"Let's do more frequent cleaning. " If the elapsed time after the purchase exceeds a predetermined value, a sentence for recommending replacement such as "I am a good year" is displayed.

In the above-described second embodiment, the agent processing section 11 automatically detects the text-to-speech processing by detecting travel diary data recorded at a location near the traveling position (recorded document detection means). The travel diary data is read aloud, but before you read it, you will be given a notice such as "Speaking of which, I have been here before. I will read the diary at that time." ,
"Let's read the record of coming here before?"
May be read out (read-out confirmation means). Also, when displaying an image, the image may not always be displayed together with the document, but may not be displayed by an input from the driver.

[0112]

As described above, according to the information recording apparatus of the present invention, it is possible to process and provide information so that it can be used without requiring specialized knowledge.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a first embodiment of an information storage device of the present invention.

FIG. 2 is an explanatory diagram conceptually showing the contents of a program selection table in the embodiment.

FIG. 3 is an explanatory diagram showing an action (action and voice) of an agent corresponding to each program number in the embodiment.

FIG. 4 shows the program number 000 in the embodiment.
FIG. 13 is an explanatory diagram showing several screens of an agent's “cleverly bowing” action displayed on the display device upon activation of 01.

FIG. 5 is an explanatory diagram conceptually showing contents of learning item data in the embodiment.

FIG. 6 is an explanatory diagram conceptually showing the contents of response data in the embodiment.

FIG. 7 is an explanatory diagram conceptually showing the contents of fixed form document data in the embodiment.

FIG. 8 is an explanatory diagram conceptually showing the contents of a data file stored in the navigation data storage device in the embodiment.

FIG. 9 is an explanatory diagram showing various sensors constituting the situation sensor unit in the embodiment.

FIG. 10 is a flowchart showing main operations of an information recording process and an agent process according to the embodiment.

FIG. 11 is a flowchart illustrating an operation of a communication process according to the embodiment.

FIG. 12 is an explanatory diagram showing the contents of a specific communication process during running of the vehicle according to the embodiment.

FIG. 13 is a flowchart showing a main operation flow of an information recording process according to the embodiment.

FIG. 14 is a flowchart showing a destination setting for navigation and a start operation of a route search process according to the embodiment.

FIG. 15 is a flowchart illustrating an operation of a traveling history recording process according to the embodiment.

FIG. 16 is a flowchart showing an operation of a traffic jam information recording process according to the embodiment.

FIG. 17 is an explanatory diagram showing a specific example of a process of creating a travel diary based on information acquired by the travel history recording process and the traffic jam information recording process according to the embodiment.

FIG. 18 is an explanatory diagram showing an operation for outputting a travel diary to a display device.

FIG. 19 is a flowchart illustrating an operation of recording processing of a speech recognition history according to the embodiment.

FIG. 20 is an explanatory diagram showing an operation of displaying an agent mail on a display device in the embodiment.

FIG. 21 is a flowchart illustrating an operation of a cooling water temperature change history recording process according to the embodiment.

FIG. 22 is a diagram showing a state where a warning mail is displayed on the display device in the embodiment.

FIG. 23 is a block diagram illustrating a configuration of a second exemplary embodiment of the present invention.

FIG. 24 is a diagram showing an example of a travel diary displayed on the display device in the second embodiment.

FIG. 25 is a flowchart showing an operation flow of a travel diary reading process according to the embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Whole processing part 10 Navigation processing part 11 Agent processing part 12 I / F part 13 Image processing part 14 Voice control part 15 Situation information processing part 21 Current position detection device 22 Input device 23 Storage medium drive device 24 Communication control device 25 Voice output Device 26 Microphone 27 Display device 28 Imaging device 29 Agent data storage device 30 Navigation data storage device 40 Status sensor unit

Claims (4)

[Claims] 1. A sensor for detecting a condition of a predetermined device, a storage unit storing a plurality of document elements constituting a document, and a plurality of storage units stored in the storage unit based on an output from the sensor. A document acquisition unit for selecting a document element relating to the situation detected by the sensor from the document elements and acquiring a document, and a document output unit for outputting the document acquired by the document acquisition unit. Information recording device. 2. A learning device for learning an output result from the sensor, wherein the document obtaining device obtains the document based on a learning result of the learning device and an output from the sensor. The information recording apparatus according to claim 1, wherein 3. The document output unit includes: a display unit that displays a document acquired by the document acquisition unit on a display device; an audio output unit that outputs audio from an audio output device as audio; and document data that is output as document data. 2. The method according to claim 1, further comprising one of output means.
Alternatively, the information recording device according to claim 2. 4. An image data storage unit for storing image data; an image data acquisition unit for acquiring image data stored in the image data storage unit based on an output from the sensor; and an acquisition unit based on the data. 4. The image processing apparatus according to claim 1, further comprising: an image data output unit configured to output the image data acquired by the image data acquisition unit together with the obtained document. Information recording device.