JP2002190098A - Information processing device, operation instruction device, server device, information processing method, operation instruction method, operation instruction system - Google Patents

Abstract

(57) [Summary] [Problem] To provide operation instructions based on the current external environment. SOLUTION: Each of automobiles 50 (af) is provided with an operation instruction device 1 (af) so that operation information (environment information, operation information) 75 can be transmitted and received via a network 60. I do. When a significant driving operation such as a course change is performed in the own vehicle 50a, the operation information related to the driving operation is transmitted to the other vehicle 50 (b,
c, d, e, f). That is, the operation information of the own vehicle 50a is transmitted to the other vehicle 50 (b, c, d,
e, f) are reflected in the driving operation.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information processing apparatus for instructing driving operation of an automobile, an operation instruction apparatus, and the like.
The present invention relates to a server device, an information processing method, an operation instruction method, and an operation instruction system.

[0002]

2. Description of the Related Art When driving an automobile (own vehicle) on a public road (road), the driver drives the vehicle in consideration of the operation status of another automobile (other vehicle) running on the same road. It is desired to perform the operation. That is, by performing the same driving operation as that of another vehicle, it is possible to realize a smooth traffic condition on the road.

[0003]

However, there are cases where a beginner of driving cannot judge the condition of the road on which he is driving, and it is difficult to drive smoothly. In addition, even for a skilled driver, for example, when driving on an unfamiliar road to which one is not usually used, it may be difficult to make a correct situation determination. Therefore, it is desired that the driver be instructed to perform a driving operation based on, for example, the current operation status of the road on which the driver is traveling.

[0004]

SUMMARY OF THE INVENTION In view of such circumstances, the present invention provides a detecting means capable of detecting an external environment, and environmental information capable of accumulating environmental information detected by the detecting means. A storage unit, an operation detection unit that can detect an operation performed by a required operation unit, and an operation information generation unit that can generate operation information based on a detection signal detected by the operation detection unit. An operation identification unit that identifies an operation performed by the operation unit based on the latest environment information in the environment information storage unit and the operation information generated by the operation information generation unit; Based on the identification result, the information comprising transmission means capable of transmitting operation information including the latest environment information and the operation information to a network To configure the management apparatus.

[0005] Further, a receiving means capable of receiving operation information including at least first environmental information and operation information via a network, and an operation information storage means capable of storing the operation information received by the receiving means. A detection unit that can detect an external environment, and a search unit that searches for the operation information stored in the operation information storage unit based on the second environment information detected by the detection unit, An operation instruction device includes an operation instruction information generation unit that can generate operation instruction information based on the operation information retrieved by the retrieval unit.

[0006] Further, a detecting means capable of detecting an external environment, and the latest second environment information detected by the detecting means are managed by managing operation information comprising at least first environmental information and operation information. Transmitting means for transmitting to the server device, receiving means for receiving the operation information corresponding to the latest second environment information transmitted from the server device, and operation information received by the receiving means The operation instruction device is provided with an operation instruction information generating means that can generate the operation instruction information based on the operation instruction information.
As a server device, a receiving unit capable of receiving operation information including at least first environment information and operation information; an operation information storage unit capable of storing the operation information received by the receiving unit; Receiving means capable of receiving the environment information, search means for searching for the operation information stored in the operation information storage means based on the second environment information, and A transmission unit capable of transmitting operation information is provided.

A detecting step of detecting an external environment;
An environment information storage step of storing environment information detected by the detection step; an operation detection step of detecting an operation performed by a required operation unit; and operation information based on a detection signal detected by the operation detection step. An operation information generating step of generating the operation information, the latest environment information accumulated in the environment information accumulating step, and the operation performed by the operation means based on the operation information generated in the operation information generating step. The information processing method comprises an operation identification step and a transmission step of transmitting the latest environment information and the operation information to a network based on an identification result of the operation identification step.

[0008] Further, a receiving step of receiving operation information including at least first environment information and operation information via a network, an operation information storing step of storing the operation information received in the receiving step, and an external environment. A detection step of detecting, an environment information accumulation step of accumulating the second environment information detected by the detection step, and the operation based on the latest second environment information accumulated by the environment information accumulation step. An operation instruction method comprising: a search step of searching for the operation information accumulated in an information accumulation step; and an operation instruction information generation step of generating operation instruction information based on the operation information retrieved in the search step. Is configured.

A detecting means for detecting an external environment;
Environment information storage means for storing environment information detected by the detection means, operation detection means for detecting an operation performed by a required operation means, and operation information based on a detection signal detected by the operation detection means Operation information generating means for generating an operation information, operation identification means for identifying an operation performed by the operation means based on the latest environment information in the environment information storage means and the operation information generated by the operation information generation means Based on the identification result of the operation identification unit, a transmission unit that transmits the latest environment information and operation information including the operation information to a network, a reception unit that receives the operation information via the network, Operation information storage means for storing the operation information received by the reception means, based on the environment information detected by the detection means; A search means for searching for the operation information stored by the operation information storage means, and an operation instruction information generation means capable of generating operation instruction information based on the operation information searched by the search means. Construct an operation instruction system.

According to the present invention, the action taken by a driver (driving operation) and the external environment can be detected and used on a network. Operation instruction can be performed by following the operation example.

[0011]

Embodiments of the present invention will be described below. FIG. 1 is a schematic diagram illustrating a configuration example of an operation instruction system according to the present embodiment. Cars 50a, 50b, 5
The vehicles 0c, 50d, 50e, 50f,... Are vehicles that can travel on a road or the like based on, for example, a driver's driving operation, and travel on an arbitrary road. In the present embodiment, each of the automobiles 50 (af) is provided with an operation instruction device 1a, 1b, 1c, 1d, 1e, 1f,... Operation instruction device 1 provided in each automobile 50
(A-f) are, for example, wireless networks 60.
, And can transmit and receive operation information (environment information and operation information) to be described later. For example, a car that drives the car 50a (own car), the cars 50b, 50c, 50
Cars in which d, 50e, and 50f are driven by another driver (other vehicles)
In this case, the own vehicle 50a is connected to another vehicle 50 (b, c, d, e,
Operation information can be obtained from f). Therefore, in the own vehicle 50a, the guidance of the driving operation can be performed based on the operation information of the other vehicle 50 (b, c, d, e, f). Further, when a significant driving operation such as a course change is performed in the own vehicle 50a, for example, the operation information related to the driving operation is transmitted to the other vehicle 50 (b, c, d, e, f). Can be. That is, the operation information of the own vehicle 50a can be reflected on the driving operation of the other vehicle 50 (b, c, d, e, f).

FIG. 2 is a block diagram illustrating a configuration example of the operation instruction device 1 (af) provided in each of the automobiles 50 (af). The transmission / reception unit 2 is provided as a communication unit for performing data communication via the network 60 with the operation instruction device provided in another vehicle. The operation information memory 3 is capable of storing operation information transmitted from the operation instruction device of another vehicle and composed of the first environment information and operation information received by the transmission / reception unit 2. Since the operation information is transmitted at an arbitrary timing from the operation instruction device of another vehicle, the operation information is accumulated in the operation information memory 3 irregularly. Therefore, for example, at the timing when the storage capacity of the operation information memory 3 becomes insufficient, the operation information that has been stored for a certain period of time can be deleted to obtain a capacity for storing new operation information. I have to. As a result, only the new operation information accumulated within a certain time is accumulated in the operation information memory 3.

The operation sensor 4 can detect various operations performed by the operation section 5 and output a detection signal corresponding to the performed operation. Operation unit 5
Are various operation means such as a steering wheel, an accelerator, a brake, and a turn signal switch provided for performing a driving operation in the automobile 50, for example. Therefore, the operation sensor 4 is provided separately for the various operation means. The operation information processing unit 6 includes the operation sensor 4
The operation information corresponding to the operation performed by the operation unit 5 can be generated based on the detection signal output from the operation unit 5. This operation information includes the operating angle of the steering wheel, the degree of depression of the accelerator, brake, etc.
For example, the information is indicated by a numerical value or the like. The operation information memory 7 is provided as a buffer memory that can store the operation information generated in the operation information processing unit 6.

The external sensor 8 can detect the environment outside the automobile 50 as needed and can output a detection signal corresponding to the external environment. That is, the car 5
The vehicle body 0 is provided at a plurality of locations where the distance between the front and rear vehicles, the position of another vehicle in the adjacent lane, and the like can be detected. The external environment information processing unit 9 includes an external sensor 8
Based on the detection signal output from the vehicle 50, it is possible to generate environmental information indicating the inter-vehicle distance in front of and behind the vehicle 50 and the position of another vehicle in an adjacent lane. This environment information is information indicating the inter-vehicle distance or the like by a numerical value, for example, similarly to the operation information described above.
The environment information memory 10 can store the second environment information generated by the external environment information processing unit 9. As described above, since the external sensor 8 detects the external environment at any time, the environment information is also stored in the environment information memory 10 at any time. However, since the environmental information changes in real time, new information is useful. Therefore, in the environment information stored in the environment information memory 10, information after a required time has passed
Delete them as unnecessary. In the present embodiment, since the external environment is related to the operation of the automobile, it is sufficient that the environment information includes, for example, a period of about one minute in the past. The storage amount of the environment information can be set arbitrarily as needed.

The system controller 11 is constituted by, for example, a microphone computer and the like, and is capable of performing, for example, communication control in the transmission / reception unit 2, accumulation of information in each memory, control of read timing, and the like. The data transfer in this case is performed via the bus 12, for example. Further, it is possible to perform a process of generating operation instruction information for instructing the driving operation based on each information stored in the operation information memory 3, the operation information memory 7, and the environment information memory 10. Have been.
In the network 60, communication is performed using data of a required communication format.
Of operation information to be transmitted by the transmission / reception unit 2
It is possible to perform processing such as decoding of the operation information received by the user. Therefore, the system controller 11 has a work memory 11 for performing various processes.
a is provided.

In the configuration example shown in this figure, the information processing shows the operation information processing unit 6 and the external environment information processing unit 9 individually, but the processing executed by these units is performed by the system controller 11. May be made. Further, the operation information memory 3, the operation information memory 7,
The system controller 11 generates the operation instruction information based on each information stored in the environment information memory 10. For example, the system controller 11 includes a storage unit that forms and stores the operation instruction information in advance. Based on each information,
The stored operation instruction information may be selectable.

The operation finger south 13 can be instructed for driving operation under the control of the system controller 11, for example. That is, based on the operation instruction information generated by the system controller 11, the driver of the vehicle can be instructed, for example, to change lanes, accelerate, or decelerate. For this reason, for example, it is configured by lighting means such as an LED (Light Emission Diode), display means such as an LCD (Liquid Crystal Display), and the like. Therefore, the operation instruction information is, for example, an LED, LCD drive signal, or the like. In the case where the operating finger south 13 is constituted by, for example, a speaker device, and the operating finger is instructed by voice, the operating finger south information is required voice information or the like.

The known information memory 14 is constituted as a storage means capable of storing information (known information) already known, for example. As the known information, for example, information that it is dangerous to perform the operation in a certain environment, and information such as rules to be followed at least when driving the automobile 50 are stored. The known information may be stored as preset information at the time of shipment of the operation instruction device 1, for example, or the driver may read the information from an external recording medium such as a disk as needed after shipment. It may be. For example, when reading from a disk or the like, known information for performing a driving operation according to the driver's preference can be selected. Further, the form of the known information may be, for example, environmental information and operation information as in the case of the operation information. That is, the environment and operation that can be predicted in advance can be stored as known information.

FIG. 3 is a flowchart for explaining an example of processing steps executed by, for example, the system controller 11 when the external environment of the vehicle 50 is detected by the external sensor 8. When the operation instruction device 1 is in the operating state, the external sensor 8 starts detecting the external environment (S0).
01). As a result, the external environment is detected at every predetermined timing. Then, environmental information is generated based on the detection signal detected by the external sensor 8 (S
002), the generated environment information is stored in the environment information memory 10
(S003). Through such processing steps, the environment information is accumulated in the environment information memory 10. Further, since the new environment information is handled as useful, the old environment information stored in the environment information memory 10 for example one minute or more ago is deleted (S004). Thus, the environment information memory 10 has
For example, new environment information within one minute from the present can be stored. Note that the old environment information may be deleted when the storage capacity becomes insufficient, for example, in consideration of the storage capacity of the environment information memory 10.

By going through the processing steps shown in FIG.
Environment information is accumulated in the environment information memory 10, for example, as shown in FIG. This environment information includes, for example, information indicating the inter-vehicle distance (front), the inter-vehicle distance (rear), the position of a vehicle in an adjacent lane, and the like. 1, # 2
.. Are stored in the environment information memory 10 in units of. That is, as newer environment information is stored, the stored environment information becomes older. When the environment information #n is the oldest information, the environment information #n is stored in the environment information memory 10 and then deleted in the present embodiment, for example, when one minute elapses. Therefore, the environment information memory 10 stores, for example, environment information corresponding to the external environment within one minute from the present.

FIG. 5 is a flowchart for explaining an example of processing steps executed by, for example, the system controller 11 when the operation performed by the operation unit 5 by the operation sensor 4 is detected. First, the operation sensor 4 starts detecting an operation performed by the operation unit 5 (S101). Then, it is determined whether or not an operation has been detected (S102). If it is determined that the operation has been detected, operation information is generated based on the detection signal (S103). Further, the environmental information memory 10
The latest environmental information stored in the server is read out (S10).
4) Based on the environment information and the operation information generated in step S103, it is determined whether a significant change in the external environment or a significant driving operation has been performed (S10).
5). The factors of the determination in step S105 are as shown in FIG. For example, “YES” is determined when there is a change in the external environment and when it is determined that there is a large change in the driving operation. For example, when it is determined that there is no change in both the external environment and the driving operation, “NO” is determined. The change in the external environment is, for example, when another vehicle approaches from behind or approaches another vehicle ahead. Further, regarding the change in the driving operation, it is assumed that there is no change in the driving operation when a delicate steering operation or accelerator operation is performed, which is not an operation such as acceleration for changing lanes or passing.

In this way, step S1 shown in FIG.
If it is determined that the determination result in step 05 is “NO”, the process returns to step S102 and waits for a driving operation to be detected. If it is determined that the determination result is “YES”, the operation information generated in step S103 and the environment information read in step S104 are encoded as operation information (S106), and the encoded operation information is transmitted to the network. 60 (S107). That is, according to such a processing step, when a significant environmental change or significant driving operation change occurs in the own vehicle, the operation information at that time can be transmitted to another vehicle.

FIG. 7 is a flowchart for explaining an example of processing steps executed by, for example, the system controller 11 when receiving operation information transmitted from another vehicle.
When the operation instruction device 1 is in the operating state, it is determined that the operation instruction device 1 is on standby for receiving the operation information (S201). If it is determined that the operation information has been received, the received operation information is decoded (S202), and it is determined whether or not the capacity of the operation information memory 3 has room (S203). If determined, the operation information is stored in the operation information memory 3 (S204). If it is determined that the capacity of the operation information memory 3 is not enough, the operation information memory 3
The old operation information is deleted from the operation information stored in the operation information (S205), and the decoded operation information is stored in the operation information memory 3 (S204).

The operation information transmitted and received by the operation instruction device 1 is accumulated in the operation information memory 3 as shown in FIG. 8, for example. Operation information
As shown in FIG. 8, the information includes environment information and operation information corresponding to the environment information. That is, one piece of operation information is set as operation information # 1, # 2,... #N, and is transmitted from the operation instruction device 1 of another vehicle for each unit. The operation instruction device 1 of the vehicle receives the operation information for each unit, and accumulates the operation information in the order in which the operation information was received as shown in FIG. The environment information constituting the operation information is the same as the configuration shown in FIG. 4, and the operation information is obtained from information detected by the operation sensor 4 such as a steering operation, an accelerator operation, a brake operation, a shift lever operation, and a traveling speed. Become.

This operation information is stored in step S105 of FIG.
Is transmitted from the operation instruction device 1 when it is determined that a significant change in the external environment or a significant driving operation has been performed in another vehicle, and the operation instruction device 1 of the own vehicle that has received the operation information # 1, Stored in the operation information memory 3 in units of # 2. Therefore, the operation instruction device 1 of the own vehicle can grasp and model a significant change in the external environment of the other vehicle or a significant driving operation, and when a similar environment occurs for the own vehicle. At the same time, the driver can be instructed in the driving operation. Further, as new operation information is stored, the operation information already stored becomes older. When the operation information #n is the oldest information, the received operation information is accumulated. For example, when the capacity of the operation information memory 3 runs out, the operation information #n is deleted.

FIG. 9 is a flow chart for explaining an example of processing steps executed by the system controller 11 when performing a driving operation instruction based on the current external environment.
First, the latest environment information is read from the environment information memory 10 (S301), and the read latest environment information (second environment information) is used as key information to store the environment information (first information) stored in the operation information memory 3. A search for operation information corresponding to (environment information) is performed (S302). Then, it is determined whether or not the environment information corresponding to the key information is detected from the operation information memory 3 by this search (S303). If it is determined that the corresponding information (environment information) has not been detected, the process returns to step S301. As a result, newer environment information is read from the environment information memory 10, and a search process is performed using the environment information as key information. If it is determined in step S303 that the corresponding information has been detected, the operation information memory 3 generates operation instruction information based on the operation information corresponding to the information, and provides guidance for the driving operation (S304). .
Further, the operation information that constitutes the operation instruction information of the operation instruction and the environment information stored in the environment information memory 10 are transmitted as operation information (S305).

By obtaining such a process, it is possible to give an instruction to the driver of the own vehicle based on the current external environment, based on the driving operation performed by the driver of the other vehicle. become able to. In addition, by being able to transmit operation information (operation information and environmental information) when the operation instruction is performed, the operation information when the operation instruction is performed by the own vehicle can be transmitted to the operation instruction performed by another vehicle. Can be reflected.

The relevant information detected in step S303 may be information that matches the key information or information that approximates the key information. Further, a plurality of driving operations may be instructed by using the key information and operation information that is similar to the key information as the corresponding information. in this case,
For example, the operating finger south 13 is configured by a display unit and the like, and a plurality of operating finger information is displayed, so that the driver can select information considered appropriate from the plurality of operating finger information. As a result, the driver can perform a driving operation based on, for example, guidance information corresponding to his or her own driving operation skill level. Therefore, even when the driving skill level is improved, it is possible to select the operation instruction information according to the level. Further, when displaying a plurality of operation instruction information in this manner, by managing the history of the driver based on which instruction information the driver has performed in the past, based on the history and operation information, It is possible to perform operation instructions frequently performed by the driver.

In the same manner as in the processing steps shown in the flowchart of FIG. 9, it is also possible to give an operation instruction based on known information recorded in the known information memory 14, for example. In this case, as shown in the flowchart of FIG. 10, search for operation information corresponding to the environment information stored in the known information memory 14 is performed using the latest environment information read from the environment information memory 10 as key information. Performed (S401-402). Then, it is determined whether or not the environment information corresponding to the key information is detected by this search (S403). If it is determined that the relevant information is detected, the process returns to step S401. Step S403
If it is determined that the corresponding information is detected in step (4), operation guidance information is generated based on the operation information corresponding to the environment information detected in the known information memory 14, and guidance of the driving operation is performed (S404). Thus, it is possible to give a driving operation instruction based on the operation information indicated in the known information based on the current external environment. In other words, regardless of what kind of driving operation the other vehicle is performing, it is possible to perform necessary operation instructions based on the external environment of the own vehicle.

Further, it is possible to give an operation instruction based on both the operation information and the known information. FIG. 11 is a flowchart illustrating an example of processing steps executed by the system controller 11 when performing a driving operation instruction based on both operation information and known information. Note that this figure shows a case where dangerous operation information is used as known information. In this figure, steps S501, S502,
In step S503, steps S301 and S302 illustrated in FIG.
This corresponds to S303. That is, the environment information memory 1
The operation information corresponding to the environment information stored in the operation information memory 3 is searched using the latest environment information at 0 as key information. Then, it is determined whether or not the environment information corresponding to the key information is detected by the search. If it is determined that the relevant information is not detected, the process proceeds to step S5.
Return to 01. If it is determined that the corresponding information is detected in the operation information memory 3, the dangerous information stored in the known information memory 14 is determined as the key information using the operation information corresponding to the environment information as the relevant information. Operation information is searched (S504). Then, it is determined whether or not the corresponding information has been detected (S505). If it is determined that the corresponding information has been detected, the operation indicated in the operation information corresponding to the environment information searched in step S502 is a dangerous operation. If it is determined that there is a driving operation instruction, step S
Return to 501. If it is determined in step S505 that the corresponding information has not been detected from the known information memory 14, the operation information memory 3 is determined in step S502.
It is determined that the operation corresponding to the operation information corresponding to the environment information retrieved from the operation information is not a dangerous operation, and the operation instruction is generated based on the operation information and the operation instruction is performed (S50).
6).

As described above, the operation instruction is performed based on both the operation information and the known information, so that it is possible to prevent the operation instruction to prompt a dangerous operation, for example. That is, it is possible to invalidate the operation information transmitted from the operation guidance device 1 of the other vehicle that has performed the dangerous operation.

As described above, the operation information is transmitted and received by the operation instruction device 1 provided in the automobile 50, so that the operation information is updated on the network 60 constituted by the operation instruction devices 1 (af) in real time. An operation information database will be constructed. That is, the own vehicle 50
Each time a significant operation is performed, operation information corresponding to the operation is generated and reflected in the database.
For example, as shown in FIG. 12, when a significant environment has occurred for the own vehicle 50a or when the driver has performed a significant operation, from the own vehicle 50a, the environmental information and operation information at that time are used. The operation information 70 is transmitted to the other vehicles 50b, 50c, 50d, 50e, and 50f via the network 60. Therefore, the other vehicles 50 (b to f) can receive the operation information 70 and use the operation information 70 as information for performing operation instructions. However, other vehicles 50 (b ~
If f) does not perform the driving operation with the operation instruction based on the operation information 70, the operation information 70 is not transmitted from the other vehicles 50 (b to f). That is, the operation information 70 is the other vehicle 5
It is determined that the information is not required for 0 (b to f), and when it becomes old information thereafter, it is deleted from the operation information memory 3.

As shown in FIG. 13, for example, in the other vehicles 50 (b to f) that have received the operation information 75 transmitted by the own vehicle 50 a, the driving operation is performed by operating instructions based on the operation information 75. If you go, other car 50 (b-f)
, The operation information 75 is transmitted. Therefore, when a driving operation is performed in a large number of automobiles 50 by operating instructions based on the operation information 75, the operation information 75 remains on the network 60 without being deleted. In other words, the operation information 75 remaining on the network 60 in this manner is based on environmental information and operation information of many automobiles 50, and based on the operation information 75, the operation instruction based on the operation status of many automobiles. Will be able to do.

By performing such communication of the operation information, for example, wirelessly, the unique operation information for each communicable area is reflected on the network 60. Therefore,
A driver who enters from another area can be instructed to operate the vehicle based on the operation information of the area. As a result, even a driver who drives on an unfamiliar road can be guided by a driving operation similar to other vehicles,
The driver can be provided with a sense of security, and a smooth traffic condition can be maintained.

The information for instructing the driving operation is as follows.
Since the information is generated by performing the driving operation at the site where the driving is performed, it is not necessary to prepare in advance detailed data assuming the operation status. That is, the operation information can be automatically generated based on the operation of the vehicle without the need for labor for creating data corresponding to the operation status.

Hereinafter, an actual road condition will be described as an example. FIGS. 14A and 14B are schematic diagrams illustrating an example in which the own vehicle 50a and the other vehicles 50b and 50c are traveling on a two-lane road, for example. For example, as shown in FIG. 14A, the inter-vehicle distance to another vehicle 50b traveling ahead of the vehicle 50a in the traveling lane is narrow, and the lane change is performed for the adjacent passing lane. If there is enough space, most drivers can expect to make a lane change. In other words, if another vehicle (not shown) has changed lanes in such a situation in the past, the own vehicle 50
The operation information memory 3a stores operation information when another vehicle changes lanes. Therefore, the operation guidance device 1 of the own vehicle 50a performs the operation guidance based on the inter-vehicle distance to the other vehicle 50b (environment information as key information) detected by the external sensor 8. The operation instruction information in this case is information for instructing a turn signal switch operation, a steering wheel operation, an accelerator operation, and the like when changing lanes.

Further, when the own vehicle 50a performs an accelerator operation, for example, and the inter-vehicle distance with the other vehicle 50b is further reduced, the driver is instructed to change lanes more strongly. That is, since the external sensor 8 intermittently detects the external environment such as the inter-vehicle distance at a predetermined timing, the operation instruction can also be performed stepwise according to the inter-vehicle distance that changes in real time.
Thereby, for example, in the situation where the lane change is performed most frequently, the strongest guidance is performed. Note that various examples are conceivable for the expression of the intensity of the finger. For example, when a display unit is used, the color of the character to be displayed may be changed or blinked. When the audio output means is used, the volume of the displayed audio may be changed.

As shown in FIG. 14 (b), when there is no other vehicle traveling ahead of the own vehicle 50a, it is sufficient to keep the running state as it is. That is, it is conceivable that another vehicle travels without changing lanes. In other words, in the own vehicle 50a, the operation information memory 3 of the operation instruction device 1 does not store the operation information in which the course is changed in such a situation. Therefore, in the state shown in FIG. 14B, the operation guidance relating to the lane change is not performed by the operation guidance device 1 of the own vehicle 50a.

In the example of the configuration of the operation instruction device 1 shown in FIG. 2, the operation information memory 3 for storing operation information transmitted from another vehicle is provided in the device. It is also possible to manage with a device. For example, FIG.
As shown in FIG. 1, a server device 80 for managing operation information on the network 60 is provided, and the operation information transmitted from the operation instruction device 90 is collectively managed by the server device 80. Therefore, the operation instruction device 1 does not include the operation information memory 3 as shown in FIG. In FIG. 16, the same parts as those in FIG. 2 are denoted by the same reference numerals. The server device 80 is shown in FIG.
It is configured as shown in FIG. The transmission / reception unit 81 can perform data communication with the operation instruction device 90 via a network. Database part 8
2, the operation information transmitted from the operation instruction device 90 can be stored. The system controller 83 can perform various controls for performing data communication in the server device 80 via the bus 84.

As described above, when the operation information is managed by the server device 80, the operation instruction device 9 provided in the automobile 50 is used.
0 indicates key information (environmental information) if operation information is required
May be transmitted to the server device 80. In the server device 80, when the key information is transmitted from the operation instruction device 90, the system controller 83 searches for the operation information based on the transmitted key information, and returns the search result to the operation instruction device 90. That is, when environment information corresponding to the key information is detected, the server device 80 returns operation information associated with the environment information. Thereby, the operation instruction device 90 can perform the operation instruction based on the operation information transmitted from the server device 80.

The server device 80 includes the operation instruction device 1.
The operation information is transmitted and accumulated from, but it is sufficient to delete the old operation information and always manage the new operation information. In such a case, the system controller 83 of the server device 80 performs the operation information update processing step as shown in FIG. 18, for example. When the server device 80 is in the operating state, it is waiting to receive the operation information transmitted from the operation instruction device 1 (S601). If it is determined that the operation information has been received, the received operation information is decoded (S602), and it is determined whether or not there is room in the capacity of the database unit 82 (S603). If so, the operation information is stored in the database unit 82 (S604). The database unit 8
If it is determined that the capacity of No. 2 has no room, old operation information is deleted from the operation information stored in the database unit 82 (S605), and the decoded operation information is stored in the database unit 82 (S604). ).

By the way, in FIGS. 3, 5, 7, and 9,
The processing steps of detecting the external environment, detecting the operation, receiving the operation information, and instructing the driving operation have been described. As shown in Note that the flowchart shown in FIG. 19 does not necessarily correspond to a procedure that follows a temporal flow. That is, the processing steps shown in each step may be performed in parallel or may be performed by interruption.

When the operation instruction device 1 is in the operating state, the external sensor 8 starts to detect the external environment, generates environment information based on the detection signal detected by the external sensor 8, and generates the generated environment information. The information is stored in the environment information memory 10 (S701 to S703). Then, the environment information memory 10
The old environment information stored in the server is deleted (S70).
4). Further, the operation sensor 4 is caused to start detecting the operation performed by the operation unit 5, and when it is determined that the operation is detected, operation information is generated based on the detection signal (S705).
To S707). Further, the latest environment information stored in the environment information memory 10 is read out, and a significant change in the external environment or a significant driving operation is performed based on the environment information and the operation information generated in step S707. It is determined whether or not it has been performed (S708 to S709). The discriminating process in step S709 is a process corresponding to step S105 shown in FIG. If it is determined that the determination result in step S709 is “NO”, the process returns to step S706 and waits for the detection of the driving operation. If it is determined that the determination result is “YES”, the operation information generated in step S707 and the environment information read in step S708 are encoded as operation information and transmitted to the network 60 (S60).
710-S711).

In this way, when a significant environmental change or significant change in driving operation occurs in the own vehicle, the operation information at that time can be transmitted to another vehicle, but at the same time, the operation information is transmitted from the other vehicle. Operation information can be received.
That is, when the operation instruction device 1 is in the operating state, the operation instruction device 1 waits for the operation information, and when it is determined that the operation information has been received, the received operation information is decoded and the capacity of the operation information memory 3 is stored. It is determined whether or not there is enough room (S7).
12 to S714). If it is determined that the operation information memory 3 has room, the operation information is stored in the operation information memory 3 (S715). If it is determined that the capacity of the operation information memory 3 is not enough, the old operation information is deleted from the operation information stored in the operation information memory 3 and the decoded operation information is stored in the operation information memory 3. It is stored (S716 to S715).

Further, the operation instruction is performed based on the operation information driving stored in the operation information memory 3 corresponding to the current external environment. In this case, the latest environment information is read from the environment information memory 10 and operation information corresponding to the environment information stored in the operation information memory 3 is searched using the latest environment information as key information. It is determined whether or not the environment information corresponding to the key information has been detected from the operation information memory 3 (S717 to S71).
9). If it is determined that the relevant information (environment information) has not been detected, the process returns to step S717. If it is determined in step S719 that the relevant information is detected, the operation information is generated in the operation information memory 3 based on the operation information corresponding to the relevant information, and the driving instruction is performed (S720). .

Here, the transmission processing of the operation information shown in step S711 and the reception processing shown in step S712
Communication processing between the operation instruction devices 1 may be performed, or FIG.
5, the communication process with the server device 80 may be performed. When the operation instruction is performed using the known information, for example, in step S718, the operation information stored in the known information memory 14 is searched, and the operation instruction is performed based on the operation information corresponding to the search. Information may be generated to guide the driving operation.

In the present embodiment, an example is given in which an operation instruction is given when driving an automobile. However, this is merely an example, and the present invention can adopt other configurations.
The present invention can be applied to a case in which guidance for performing a smooth operation is performed according to the surrounding situation.

[0048]

As described above, according to the present invention, the driving operation performed by the driver and the external environment can be detected and used as operation information on the network. Then, using the operation information, the driver is instructed to perform a driving operation based on a driving operation performed by another driver. As a result, a driver who is difficult to determine a road condition or a driver who drives on an unfamiliar road can also perform a driving operation based on the operation of another driver. In addition, since the driving instruction can be provided based on the known information, it is possible to perform a predetermined driving instruction corresponding to the current external environment regardless of the driving operation of another vehicle. In addition, since the operation information can be generated based on the driving operation performed by the driver and the external environment, it is not necessary to prepare detailed data assuming the operation state in advance. That is, there is an advantage that the operation information can be automatically generated based on the operation of the vehicle without requiring the labor for creating data corresponding to the operation status.

Further, by managing the operation information in the server device on the network, the operation information transmitted from many operation instruction devices can be collectively managed by the server device.

[Brief description of the drawings]

FIG. 1 is a schematic diagram illustrating an outline of a driving operation guidance system according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration example of an operation instruction device according to the present embodiment.

FIG. 3 is a flowchart illustrating an example of a process of detecting an external environment by an external sensor.

FIG. 4 is an explanatory diagram of environment information stored in an environment information memory.

FIG. 5 is a flowchart illustrating an example of a process of detecting an operation performed on an operation unit by an operation sensor.

6 is a diagram for explaining a significant external environment change or a significant driving operation determination criterion in the flowchart shown in FIG. 5;

FIG. 7 is a flowchart illustrating an example of a processing step of receiving operation information transmitted from another vehicle.

FIG. 8 is an explanatory diagram of operation information stored in an operation information memory.

FIG. 9 is a flowchart illustrating an example of a process of performing driving instruction based on the current external environment.

FIG. 10 is a flowchart illustrating an example of a process of performing a driving operation instruction based on known information.

FIG. 11 is a flowchart illustrating an example of a process of performing a driving operation instruction based on both operation information and known information.

FIG. 12 is a schematic diagram illustrating a database constructed on a network configured by the operation instruction device.

FIG. 13 is a schematic diagram illustrating a database constructed on a network configured by the operation instruction device.

FIG. 14 is a schematic diagram illustrating an example of a case where driving instruction is given by taking an actual road situation as an example.

FIG. 15 is a schematic diagram illustrating a modified example of the present invention.

FIG. 16 is a block diagram illustrating a configuration example of an operation instruction device according to a modification.

FIG. 17 is a block diagram illustrating a configuration example of a server device according to a modification.

FIG. 18 is a flowchart illustrating an example of an operation information update process performed in the server device.

FIG. 19 is a flowchart illustrating processing steps performed by the system controller of the operation instruction device for detecting an external environment, detecting an operation, receiving operation information, and instructing a driving operation.

[Explanation of symbols]

1, 90 operation instruction device, 2 transmission / reception section, 3 operation information memory, 4 operation sensor, 5 operation section, 6 operation information processing section, 7 operation information memory, 8 external sensor, 9 external environment information processing section, 10 environment information memory , 11 system controller, 13 operating finger south, 14 known information memory, 50 car, 60 network, 80 server device

Claims (15)

[Claims] A detection unit configured to detect an external environment; an environment information storage unit configured to store environment information detected by the detection unit; and an operation performed by a required operation unit. Operation information generating means capable of generating operation information based on a detection signal detected by the operation detecting means; the latest environment information in the environment information accumulating means; An operation identification unit that identifies an operation performed by the operation unit based on the operation information generated by the information generation unit; and the latest environment information and the operation information based on an identification result of the operation identification unit. An information processing apparatus, comprising: a transmission unit configured to transmit operation information to a network. 2. Receiving means capable of receiving operation information including at least first environmental information and operation information via a network, and operation information accumulating means capable of accumulating the operation information received by the receiving means. A detection unit that can detect an external environment; a search unit that searches for the operation information stored in the operation information storage unit based on the second environment information detected by the detection unit; An operation instruction information generation unit that can generate operation instruction information based on the operation information retrieved by the retrieval unit. 3. The operation instruction device according to claim 2, further comprising an operation instruction device that can perform operation instruction based on the operation instruction information generated by the operation instruction information generation device. 4. A system according to claim 1, further comprising a known information storage unit configured to store known information including at least predetermined operation information, wherein the operation instruction information generation unit is configured to store the operation information retrieved by the retrieval unit. The operation instruction device according to claim 2, wherein the operation instruction information can be generated based on the known information based on the information. 5. When the operating instruction information is generated by the operating instruction information generating means, the operating information comprising the operating instruction information and the second environment information is transmitted. The operation instruction device according to claim 2, further comprising a transmission unit configured to perform the operation. 6. A detecting means capable of detecting an external environment, and managing the latest second environment information detected by the detecting means as operation information including at least the first environment information and operation information. Transmitting means for transmitting the operation information corresponding to the latest second environment information transmitted from the server apparatus; and operation information received by the receiving means. An operation instruction information generating means capable of generating operation instruction information based on the operation instruction information. 7. The operation instruction device according to claim 6, further comprising an operation instruction device that can perform operation instruction based on the operation instruction information generated by the operation instruction information generation device. 8. A receiving means capable of receiving operation information including at least first environmental information and operation information; an operation information accumulating means capable of accumulating the operation information received by the receiving means; Receiving means capable of receiving the environmental information of: a search means for searching for the operation information stored in the operation information storage means based on the second environment information; and A server device, comprising: transmission means capable of transmitting operation information. 9. An update unit which is capable of updating the operation information stored in the operation information storage unit with the received operation information when the operation information is received. Item 9. The server device according to item 8. A detecting step of detecting an external environment; an environmental information storing step of storing environmental information detected by the detecting step; an operation detecting step of detecting an operation performed by a required operating means; An operation information generation step of generating operation information based on the detection signal detected by the operation detection step, and the latest environment information accumulated in the environment information accumulation step,
An operation identification step of identifying an operation performed by the operation unit based on the operation information generated in the operation information generation step; and the latest environment information and the operation based on an identification result of the operation identification step. A transmitting step of transmitting information to a network, an information processing method comprising: 11. A receiving step of receiving operation information including at least first environment information and operation information via a network, an operation information storing step of storing the operation information received in the receiving step, A detection step of detecting; an environment information accumulation step of accumulating second environment information detected by the detection step; and the operation based on the latest second environment information accumulated by the environment information accumulation step. A search step of searching for the operation information stored in the information storage step; and an operation instruction information generation step of generating operation instruction information based on the operation information searched in the search step. An operation instruction method. 12. The operation instruction method according to claim 11, further comprising an operation instruction step of performing operation instruction based on the operation instruction information generated in the operation instruction information generation step. 13. A detecting means for detecting an external environment, an environment information storing means for storing environment information detected by the detecting means, an operation detecting means for detecting an operation performed by a required operating means, Operation information generation means for generating operation information based on a detection signal detected by the operation detection means; latest environment information in the environment information storage means; and operation information generated by the operation information generation means. An operation identification unit that identifies an operation performed by the operation unit, a transmission unit that transmits operation information including the latest environment information and the operation information to a network based on an identification result of the operation identification unit, Receiving means for receiving the operation information via the network, and operation information storage means for storing the operation information received by the receiving means If, based on the environmental information detected by said detecting means,
Search means for searching for the operation information stored by the operation information storage means, and operation instruction information generation means capable of generating operation instruction information based on the operation information searched by the search means. Operating instruction system. 14. An operating instruction device that can perform an operation instruction based on the operation instruction information generated by the operation instruction information generating device.
Operation instruction system according to the above. 15. The operation instruction according to claim 13, wherein said transmitting means and said receiving means are capable of performing data communication with a server device managing said operation information. system.