JP2009059229A - Operation support method and operation support system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation support method capable of eliminating a factor of disturbing the concentration of a driver, for example, such as selection of necessary information from a plurality of contents displayed on a display and execution of a complicated operation, or an operation support system for executing the method. <P>SOLUTION: An information processor 3 estimates an operation to be performed by an occupant in a vehicle, the content of the estimated operation is output on the display 2 as support information. A database 35 stores the contents of operations performed in the past by the occupant, and the information processor 3 estimates the operation to be performed by the occupant, out of the stored contents of operations. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an operation support method capable of estimating an operation to be performed by an occupant with respect to an operation detected by an in-vehicle device, and outputting information indicating the content of the estimated operation, and an operation support system for executing the method.

  Conventionally, the operation of a vehicle such as an ordinary passenger car or a wagon car has been limited to an operation for driving such as a steering operation, a winker instruction, a brake operation or an accelerator operation. However, in recent years, vehicles have been equipped with many devices such as air conditioners, radios, televisions, CD players, DVD players, and navigation systems. For this reason, the driver is forced to perform a number of operations other than driving the vehicle. For example, the driver can not concentrate on driving the vehicle by visually checking the operation panel during driving and hinders safe driving. It came to be.

Therefore, ingenuity has been made so that the driver can concentrate on driving the vehicle. For example, an operation support method has been proposed in which the driver's line of sight can be held forward by displaying the operation content on a head-up display (for example, Patent Document 1). In addition, an operation support method has been proposed in which instructions for all operations are performed by a single reception device (for example, Patent Document 2).
JP 2004-262237 A JP 2002-149324 A

  However, in the method described in Patent Document 1, when a plurality of operation contents are displayed on the head-up display, the operator is distracted by selecting necessary information from the displayed contents and concentrates on driving. Had the problem of being unable to. Further, in the method described in Patent Document 2, since a plurality of operations are integrated into one operating device, the driver is distracted by the complexity of the operation, for example, operating the operating devices hierarchically. It had the problem of being unable to concentrate.

  In addition to the method described above, a method of accepting an operation instruction by a driver's voice has been proposed. However, this method has a problem that the driver is required to memorize voice commands corresponding to each operation in advance, and a device that emits voice, such as a radio or a navigation system, cannot be used. .

  The present invention has been made in view of such circumstances, and an object of the present invention is to detect an operation performed by a vehicle occupant with an in-vehicle device and estimate an operation to be performed by the occupant with respect to the detected operation. By outputting the contents of the estimated operation, for example, the necessary information is selected from a plurality of contents displayed on the display, or the driver's concentration is obstructed by performing a complicated operation. An object of the present invention is to provide an operation support method capable of eliminating the factor or an operation support system for executing the method.

  In order to solve the above-described object, an operation support method according to the present invention detects an operation performed by a vehicle occupant with an in-vehicle device, and outputs an information indicating the content of the detected operation. It is characterized in that an operation to be performed by a passenger is estimated with respect to the operation, and operation support information indicating the content of the estimated operation is output.

  Further, an operation support system according to the present invention is an operation support system including a detection unit that detects an operation performed by a vehicle occupant and an information output unit that outputs information indicating the content of the operation detected by the detection unit. An estimation means for estimating an operation to be performed by a passenger with respect to the operation detected by the detection means, and the information output means outputs operation support information indicating the content of the operation estimated by the estimation means. It is characterized by being.

  In the present invention, an operation to be performed by a vehicle occupant is estimated, and the content of the estimated operation is output as operation support information, so that necessary information can be quickly acquired. As a result, the driver can concentrate on driving.

  The operation support system according to the present invention further includes storage means for storing a plurality of operation contents sequentially detected by the detection means, and the estimation means stores the operation contents stored in the storage means. One of the operations is to be performed by the occupant.

  In the present invention, the contents of operations performed by the occupant in the past are sequentially stored, and any of the stored operation contents is estimated as an operation to be performed by the occupant. The occupant acquires the contents of the operation that is likely to be performed.

  The operation support system according to the present invention further includes a specifying unit that specifies a time and / or day of the week, and the storage unit stores the time and / or day of the week specified by the specifying unit at the time of operation. It is stored as an attribute, and the estimation means is configured to make any of the operations stored in the storage means based on the attribute an operation to be performed by the occupant at the same time and / or day of the week. It is characterized by that.

  In the present invention, the operation to be performed by the occupant is estimated according to the time and / or day of the week, so that the content of the operation that is likely to be desired by the occupant at the same time and / or day of the week. Let the crew member get it.

  The operation support system according to the present invention further includes position detection means for detecting the travel position of the vehicle, and the storage means uses the travel position detected by the position detection means during operation as an attribute of the content of the operation. The estimation means stores the operation content stored in the storage means based on the attribute as an operation to be performed by the occupant at the same travel position. .

  In the present invention, by estimating the operation to be performed by the occupant in accordance with the traveling position of the vehicle, the occupant acquires the contents of the operation that is likely to be desired by the occupant at the same traveling position. Let

  The operation support system according to the present invention further includes state detection means for detecting the state of the occupant, and the storage means uses the state of the occupant detected by the state detection means during operation as an attribute of the content of the operation. The estimation means stores the contents of the operation stored in the storage means based on the attribute as an operation to be performed by the occupant in the same state.

  In the present invention, the operation to be performed by the occupant is estimated according to the occupant's state, thereby causing the occupant to acquire the content of the operation that is likely to be desired by the occupant in the same state.

  In addition, the operation support system according to the present invention further includes an occupant identification unit for identifying an occupant, and the storage unit is associated with the occupant identified by the occupant identification unit and the content of the operation detected by the detection unit. And the estimation means is configured to perform an operation to be performed by an occupant identified by the occupant identification information, which is one of the contents of the operation stored in the storage means.

  In the present invention, for each identified occupant, the operation to be performed by the occupant is estimated. For example, when different occupants drive the same vehicle, such as a father, mother, and son, for each occupant Get different information quickly.

  In the operation support system according to the present invention, when the estimation unit stores a plurality of operation contents related to the same attribute in the storage unit, the estimation unit gives priority to the most operation contents. It is characterized by the above.

  In the present invention, when a plurality of operation contents related to the same attribute are stored, the largest number of the operation contents is preferentially estimated, and thus the most in the past. The occupant is made to acquire the performed operation as an operation that the occupant is likely to desire.

  The operation support system according to the present invention further comprises warm-up determining means for determining whether or not the vehicle is in a warm-up state, and the estimating means is configured to determine whether the vehicle is in a warm-up state by the warm-up determination means. In the case where it is determined that there is an operation, priority is given to the largest number of operations stored in the storage means.

  In the present invention, when the vehicle is in a warm-up state, it is possible to presume the most frequently-stored operation content by preferentially estimating the occupant in the idling state. Let the occupant acquire the contents of highly specific operations.

  In addition, the operation support system according to the present invention includes a driving state of a driver who drives the vehicle, a driving state of the vehicle, or a state detecting unit for detecting an external state of the vehicle, and the driving of the driver detected by the state detecting unit. It further comprises output determination means for determining whether or not to output the operation support information based on the situation, the operation state of the vehicle, or the external situation of the vehicle.

  In the present invention, the operation support information is not output according to the driving situation of the driver, the operation situation of the vehicle or the external situation of the vehicle, for example, when the vehicle is turning a sharp curve, The operation support information is not output when the driver has a heavy driving load, such as when the driver is turning the vehicle to the right or left, or when another vehicle is traveling in front of the vehicle. As a result, driver concentration is not hindered.

  In the operation support system according to the present invention, the situation detection means detects at least a steering amount of the steering operated by the driver, and the output determination means sets in advance the steering amount detected by the situation detection means. If the difference from the threshold value exceeds a predetermined value, it is determined that the operation support information is not output.

  In the present invention, the operation support information is not output according to at least the steering operation amount operated by the driver, so that, for example, the operation load is increased when the vehicle turns a sharp curve. Does not output information.

  In the operation support system according to the present invention, when the situation detection unit detects at least a winker signal operated by the driver, and the output determination unit detects the output of the winker signal by the situation detection unit, It is characterized in that it is determined not to output the operation support information.

  In the present invention, since the operation support information is not output at least in response to the output of the blinker signal, for example, when the driver tries to turn the vehicle to the right or left, the operation load is increased. Do not output support information.

  In the operation support system according to the present invention, the situation detection means detects the presence of an obstacle at least around the vehicle, and the output determination means detects the presence of an obstacle by the situation detection means. In this case, it is determined that the operation support information is not output.

  In the present invention, the operation support information is not output at least according to the presence of obstacles around the vehicle, so that, for example, when another vehicle is traveling near the vehicle, the driving load Does not output operation support information.

  In addition, the operation support system according to the present invention further includes travel determination means for determining whether or not the vehicle is in a travel state, and the output determination means determines that the vehicle is in the travel state by the travel determination means. In such a case, it is determined whether or not to output the operation support information.

  In the present invention, when the vehicle is in a running state, the operation support information is not output according to the driving situation of the driver, the operating situation of the vehicle, or the external situation of the vehicle. The operation support information is not output when the driving load of the driver is heavy. As a result, driver concentration is not hindered.

  The operation support system according to the present invention comprises: a receiving unit that receives an operation instruction indicated by the operation support information output by the information output unit; and a unit that outputs a signal of the instruction received by the receiving unit. It is characterized by providing.

  Further, the operation support system according to the present invention is characterized in that the receiving means is installed on a steering wheel.

  In the present invention, since the operation instruction indicated by the operation support information is received, the operation instruction to be performed by the occupant can be performed by one simple operation without performing a complicated operation. As a result, driver concentration is not hindered.

  The operation support system according to the present invention is characterized in that the information output means is provided in a head-up display or a display installed in a center console.

  In the present invention, the driver looking at the front can quickly obtain the operation support information without moving the line of sight as much as possible.

  ADVANTAGE OF THE INVENTION According to this invention, a driver | operator or a passenger | crew can be made to perform safe driving | running | working of a vehicle so that concentration of the driver | operator or passenger | crew who drives a vehicle may be prevented as much as possible. In addition, it is possible to allow the driver or the occupant to perform safe driving of the vehicle without applying a driving load to the driver and the occupant as much as possible. Further, it is not necessary to perform a complicated operation, and an instruction for an operation to be performed by the occupant can be performed by one simple operation. In addition, the driver and the occupant can safely drive the vehicle without applying a load such as memorizing a special voice command. In addition, the driver or the occupant can grasp the current operation state of the vehicle without causing complete automation, and the driver and the occupant can perform safe driving of the vehicle.

  Hereinafter, an operation support method according to the present invention and an operation support system for executing the method will be described with reference to the drawings illustrating embodiments. FIG. 1 is a block diagram showing the overall configuration of an operation support system according to the present invention, FIG. 2 is a schematic diagram showing an on-vehicle example of the operation support system, and FIG. 3 is a schematic diagram showing an example of display of operation support information on a display device. 4 is a conceptual diagram for explaining operation content information stored in a database.

  As shown in FIG. 1, the operation support system according to the present invention includes an operation detection sensor 1 including an operation detection unit, a display device 2 including an information output unit, an information processing device 3 including an estimation unit, and a situation detection unit. A steering angle detection sensor 40, a shift position detection sensor 41, an access operation amount detection sensor 42 and a winker signal detection sensor 43, a navigation device 51 including a position detection means, a timer 52 including a specifying means, and an occupant identification means An occupant identification device 53 provided, a seating detection sensor 54 and an occupant state detection device 55 provided with state detection means, an obstacle detection device 56 for detecting an external situation of the vehicle, and an instruction button 6 provided with instruction reception means. ing. Each hardware is connected to each other via a signal line 30.

  The operation detection sensor 1 is installed in an in-vehicle device such as an air conditioner 1a, a radio 1b, a television receiver 1c, a CD player 1d, and a DVD player 1e, and detects an operation of the installed in-vehicle device, and detects the detected operation signal. Is transmitted to the information processing device 3. For example, the operation detection sensor 1 installed in the air conditioner 1a detects an operation of starting, stopping, or setting the temperature of the air conditioner 1a. The operation detection sensor 1 installed in the CD player 1d detects an operation of music playback, stop, pause, fast forward, rewind, cueing or volume adjustment of the CD player 1d. The operation buttons of the in-vehicle device are arranged on the center console 7. Center console 7 is located in the center which bisects a driver's seat and a passenger seat among in-vehicle devices. Each operation button arranged on the center console 7 is pressed, rotated, moved, or the like by the occupant, thereby receiving an input of an operation of the in-vehicle device.

The display device 2 is a device for outputting operation support information indicating the content of the operation estimated by the information processing device 3. The display device 2 is, for example, a liquid crystal display or a CRT display. The display device 2 is installed on the upper stage of the center console 7 (see FIG. 2). The upper part of the center console 7 is a place where a driver looking forward can visually recognize the line of sight with little movement. Further, the display device 2 may be a head-up display. A head-up display is a display in which a reflective liquid crystal panel is installed on a windshield (not shown), and operation support information is displayed on the windshield so as to form an image at a point at infinity. is there. Thus, when the head-up display is used, the driver who is looking forward can visually recognize the operation support information without moving the line of sight at all.
For example, the display device 2 displays, as operation support information, the contents of the operation to be performed by the occupant in the next operation, the content of the previous operation performed by the occupant and the content of the current operation performed by the occupant in time series Output (see FIG. 3).

  The information processing apparatus 3 is an apparatus for controlling the system, and includes storage means for storing the contents of the detected operation, estimation means for estimating an operation to be performed by the occupant, warm-up determination means, output determination means, and travel determination. Means, receiving means and the like. The information processing apparatus 3 is built in, for example, a dashboard near the passenger seat with respect to the center console 7 (see FIG. 2).

  The information processing apparatus 3 includes a first LAN interface 31, a second LAN interface 32, a RAM 33, a ROM 34, a database 35, an input interface 36, an output interface 37, and a CPU 38. Each hardware is connected to each other via a signal line 30.

  The first LAN interface 31 is a window for communicating with the operation detection sensor 1, the steering angle detection sensor 40, the shift position detection sensor 41, the accelerator operation amount detection sensor 42, and the winker signal detection sensor 43. The first LAN interface 31 and these in-vehicle devices are connected to each other via a signal line 30.

  The second LAN interface 32 is a window for communicating with the navigation device 51, the timer 52, the occupant identification device 53, the seating detection sensor 54, the occupant state detection device 55, and the obstacle detection device 56. The second LAN interface 32 and these in-vehicle devices are connected to each other via the signal line 30.

  The RAM 33 is a main storage device that records a plurality of information and can read them regardless of recording order, recording position, etc., and is classified as SRAM or DRAM. The RAM 33 stores, for example, a program read from the ROM 34, various data generated by executing the program, various signals received from the outside, and the like are appropriately read out by the CPU 38.

  The ROM 34 is a main storage device that records a plurality of information and can read them regardless of recording order, recording position, etc., and the stored contents are not erased even when the power is turned off. The ROM 34 is composed of, for example, a semiconductor element and is classified as a mask ROM, PROM, or flash memory. The ROM 34 stores, for example, various programs and data for causing the information processing apparatus 3 to execute predetermined processing, and these are appropriately read out by the CPU 38.

The database 35 corresponds to, for example, a magnetic storage type hard disk. The database 35 stores a plurality of pieces of operation content information D, and these are appropriately read according to instructions from the CPU 38.
The operation content information D stored in the database 35 is configured to associate the operation content with the remarks. The contents of the operation are, for example, activation, stop or temperature setting of the air conditioner 1a, music reproduction by the CD player 1d, stop, pause, fast forward, rewind, cueing or volume adjustment, etc., which are transmitted from the operation detection sensor 1. Analysis is performed based on the operation signal. Attributes include, for example, warm-up or running status, operation time, day of operation, vehicle travel position, occupant status, driver driving status, vehicle operating status, vehicle external status, occupant identification ID and priority P.

  The input interface 36 is connected to the instruction button 6 and serves as a window for receiving the instruction signal transmitted from the instruction button 6. The input interface 36 transmits the received instruction signal to the CPU 38.

  The output interface 37 is connected to the display device 2 and serves as a window for transmitting the operation support information estimated by the information processing device 3 to the display device 2.

  The CPU 38 controls each hardware of the information processing apparatus 3. Further, the CPU 38 performs control to estimate an operation to be performed by the occupant and to output operation support information indicating the content of the estimated operation to the display device 2.

  The steering angle detection sensor 40 is installed in the steering mechanism of the steering 40a. The steering angle detection sensor 40 detects the neutral position (neutral position) and the steering angle of the steering 40 a operated by the occupant, and transmits the detected steering angle signal to the first LAN interface 31. The rudder angle detection sensor 40a includes, for example, an LED that emits light, a phototransistor that converts received light into an electric signal (steering angle signal), and a slit disk sandwiched between them. The slit disk follows the steered steering 40a. The slit disk transmits or blocks light from the LED by rotating freely. The phototransistor outputs a steering angle signal when light transmitted through the slit disk is received.

  The shift position detection sensor 41 is installed in the operation mechanism of the shift lever 41a. The shift position detection sensor 41 detects the position of the shift lever 41 a operated by the occupant, and transmits the detected shift position signal to the first LAN interface 31. The shift position detection sensor 41 includes, for example, an LED that emits light, a phototransistor that converts received light into an electric signal (shift position signal), and a slit plate sandwiched between the phototransistors. The slit plate follows when the shift position of the shift lever 41a moves back and forth. The slit plate transmits or blocks light from the LED by moving back and forth. The phototransistor outputs a shift position signal when receiving light transmitted through the slit plate.

  The accelerator operation amount detection sensor 42 is installed in the operation mechanism of the accelerator 42a. The accelerator operation amount detection sensor 42 detects the operation amount of the accelerator 42 a operated by the occupant, and transmits the detected operation amount signal to the first LAN interface 31. The accelerator operation amount detection sensor 42 converts the movement amount of the accelerator 42a into an electric signal (detection amount signal), and outputs the converted detection amount signal.

  The blinker signal detection sensor 43 is installed in the mechanism of the blinker switch 43a. The winker signal detection sensor 43 detects a winker signal of the winker switch 43 a operated by a passenger, and transmits the detected winker signal to the first LAN interface 31. The blinker switch 43a is installed, for example, on the right side of the steering 40a (see FIG. 2).

  The navigation device 51 receives the traveling position of the host vehicle measured by a GPS satellite or a vehicle speed sensor, such as “near Nishisuehiro-cho, Yokkaichi City”, and superimposes the received traveling position on the map. Then, the map image is transmitted to the second LAN interface 32. The navigation device 51 is built in, for example, the center console 7.

  The timer 52 has a clock function and a calendar function. The timer 52 measures a predetermined time using a clock function such as “14:30:50”, and transmits the time signal to the second LAN interface 32. The timer 52 specifies a predetermined day of the week by a calendar function such as “Monday”, and transmits the specified day of the week signal to the second LAN interface 32.

The occupant identification device 53 corresponds to, for example, a weight sensor or a current sensor installed in the seating surface of each seat. The occupant identification device 53 detects the weight, body fat, and the like of the seated occupant, and transmits an occupant identification signal based on the detected weight and body fat to the second LAN interface 32. The occupant identification device 53 may use, for example, an in-vehicle camera. The occupant identification device 53 images a seated occupant with an in-vehicle camera, and extracts feature points of the captured image. Then, a seated occupant's face and physique may be detected based on the extracted feature points, and an occupant identification signal based on the detected face and physique may be transmitted to the second LAN interface 32.
The information processing device 3 extracts the content of the operation to be performed by the frost victim occupant from the database 35 by comparing the occupant identification signal with the occupant identification ID of the operation content information.

  The seating detection sensor 54 corresponds to, for example, a weight sensor or a current sensor installed in the seating surface of each seat. The seating detection sensor 54 detects the weight, static electricity, and the like applied to the seat surface for each seat, and transmits a seating signal based on the detected weight and static electricity to the second LAN interface 32 together with the seat ID. Then, the information processing device 3 determines whether or not an occupant is seated in each seat based on the seating signal.

  The occupant state detection device 55 uses, for example, an in-vehicle camera. The occupant state detection device 55 captures an occupant seated with the in-vehicle camera and detects a difference in motion between the two time points of the occupant being imaged. Then, an occupant state signal based on the motion difference is transmitted to the second LAN interface 32. The information processing device 3 specifies whether the occupant seated is based on the occupant state signal, such as “sleeping state, fatigue state, sweat state, trembling state”, or the like. The occupant state detection device 55 may be configured to detect the occupant's state comprehensively using, for example, an in-vehicle temperature by a temperature sensor, an occupant's body temperature by infrared irradiation, and the like.

  The obstacle detection device 56 is a device for detecting the external situation of the vehicle, and is installed, for example, on the back side of the rearview mirror in the vehicle and on the bumper outside the vehicle. The obstacle detection device 56 irradiates infrared rays or laser light, and detects infrared rays reflected by obstacles around the vehicle. The obstacle detection device 56 transmits the detected obstacle signal to the second LAN interface 32. The information processing device 3 determines whether there is an obstacle ahead of the vehicle based on the obstacle signal.

  The instruction button 6 generates an instruction signal for instructing an operation indicated by the operation support information output to the display device 2 when pressed, and transmits the instruction signal to the CPU 38 via the input interface 36. The CPU 38 controls the in-vehicle device according to the received instruction signal. The instruction button 6 is installed on the steering 40a (see FIG. 2). As described above, the instruction button 6 does not require a complicated operation and can input an instruction of an operation to be performed by the occupant in one operation (direct), so that the occupant's operation can be prevented as much as possible.

  Next, the procedure of the operation content storage process executed by the information processing apparatus 3 will be described. FIG. 5 is a flowchart showing the procedure of the operation content storing process executed by the information processing apparatus 3. When an occupant operates an in-vehicle device such as an air conditioner 1a, a radio 1b, a television receiver 1c, a CD player 1d, or a DVD player 1e, each operation detection sensor 1 detects an operation, and the detected operation signal is transmitted to the first LAN interface. To 31.

  The CPU 38 of the information processing device 3 determines whether or not the operation signal transmitted from the operation detection sensor 1 has been received via the first LAN interface 31 (S101). As a result, if the CPU 38 determines that the operation signal has not been received (NO in S101), the operation content storing process is completed assuming that there is no operation to be detected.

  On the other hand, when determining that the operation signal has been received (YES in S101), the CPU 38 analyzes the content of the operation from the received operation signal (S102). At this time, the CPU 38 receives the shift position signal transmitted from the shift position detection sensor 41 via the first LAN interface 31.

  The CPU 38 determines whether or not the shift position at the time of operation is P (parking) or N (neutral) based on the received shift position signal (S103). As a result, when the CPU 38 determines that the shift position is P or N (YES in S103), it adds the warm-up state to the attribute (S104). On the other hand, when determining that the shift position is not P or N (NO in S103), the CPU 38 adds the running state to the attribute (S105).

The CPU 38 executes attribute generation processing (S106). The procedure of attribute generation processing will be described later. The CPU 38 stores the information about the operation content analyzed in step 102 in the database 35 in association with the attribute (S107), returns to step S101, and repeats the operation content storage process.
As described above, the information processing apparatus 3 stores the contents of the operation performed by the occupant in the database 35. Then, as will be described later, the information processing device 3 estimates the operation to be performed by the occupant by referring to the contents stored in the database 35.

  Next, the procedure of attribute generation processing executed by the information processing apparatus 3 in step S106 will be described. FIG. 6 is a flowchart showing the procedure of attribute generation processing.

  The timer 52 measures the time at the time of operation by a clock function, and transmits the time signal thus measured to the second LAN interface 32. The CPU 38 receives the time signal transmitted from the timer 52 via the second LAN interface 32. CPU38 specifies the time at the time of operation based on the received time signal (S201), and adds the specified time to the attribute (S202).

  The timer 52 specifies the day of the week at the time of operation by the calendar function, and transmits the specified day of the week signal to the second LAN interface 32. The CPU 38 receives the day of the week signal transmitted from the timer 52 via the second LAN interface 32. The CPU 38 identifies the day of the week at the time of operation based on the received day of the week signal (S203), and adds the identified day of the week to the attribute (S204).

  The navigation device 51 detects the traveling position where the vehicle is traveling during operation, and transmits the detected traveling position signal to the second LAN interface 32. The CPU 38 receives the travel position signal transmitted from the navigation device 51 via the second LAN interface 32. The CPU 38 identifies the traveling position of the vehicle at the time of operation based on the received traveling position signal (S205), and adds the identified traveling position to the attribute (S206).

  The occupant state detection device 55 detects the state of the occupant during operation, and transmits the detected occupant state signal to the second LAN interface 32. The CPU 38 receives an occupant state signal transmitted from the occupant state detection device 55 via the second LAN interface 32. The CPU 38 identifies the occupant state at the time of operation based on the received occupant state signal (S207), and adds the identified occupant state to the attribute (S208). The CPU 38 ends the attribute generation process and waits until it is restarted.

  Next, the procedure of the operation estimation process executed by the information processing device 3 will be described. FIG. 7 is a flowchart showing a procedure of operation estimation processing executed by the information processing apparatus 3. The information processing device 3 executes the operation estimation process by referring to the operation content information D stored in the database 35. Further, the information processing device 3 transmits the content of the operation selected by the operation estimation process to the display device 2.

  When the engine of the vehicle is activated, an engine control device (not shown, the same applies hereinafter) outputs a support request signal to the information processing device 3. On the other hand, when the engine of the vehicle stops, the engine control device stops outputting the support request signal.

  The CPU 38 of the information processing device 3 determines whether a support request signal is received from the outside (S301). As a result, when determining that the support request signal has not been received (NO in S301), the CPU 38 completes the operation estimation process on the assumption that no support is required.

  On the other hand, when determining that the support request signal has been received (YES in S301), the CPU 38 executes an attribute generation process (S302). At this time, the CPU 38 receives the shift position signal transmitted from the shift position detection sensor 41 via the first LAN interface 31. Note that the procedure of the attribute generation process is the same as the procedure of the attribute generation process executed in step S106 described above, so the description of the procedure is omitted.

  The CPU 38 determines whether or not the shift position at the time of operation is P or N based on the received shift position signal (S303). As a result, when determining that the shift position is P or N (YES in S303), the CPU 38 adds the warm-up state to the attribute (S304). The CPU 38 extracts the operation content from the database 35 based on the attribute (S305), and determines whether or not a plurality of operation contents are extracted from the database 35 (S306). As a result, when it is determined that a plurality of CPUs 38 are extracted (YES in S306), the CPU 38 executes priority order alignment processing (S307) and outputs the content of the operation with the highest priority P (S308). The CPU 38 returns to step 301 and repeats the operation estimation process. The CPU 38 transmits the content of the output operation to the display device 2. The display device 2 outputs an image of the received operation content as operation support information. The procedure of the priority order alignment process will be described later.

  On the other hand, if it is determined in step S306 that a plurality of extractions have not been performed (NO in S306), the CPU 38 outputs the contents of the operation extracted in step 305 without executing the priority order alignment process (S308), and step S301. Return to, and repeat the operation estimation process. The CPU 38 transmits the content of the output operation to the display device 2. The display device 2 outputs an image of the received operation content as operation support information.

  On the other hand, if the CPU 38 determines in step S303 that the shift position is not P or N (NO in S303), it adds the running state to the attribute (S309). Further, the CPU 38 executes an output determination process (S310), and determines whether or not a determination signal is output based on the determination (S311). As a result, when it is determined that the CPU 38 has not output the determination signal (NO in S311), the CPU 38 returns to step S302 and repeats the operation estimation process. The procedure of the output determination process will be described later.

  On the other hand, if it is determined that the determination signal has been output (YES in S311), the CPU 38 executes a content selection process (S312), and outputs the content of the operation selected in the process (S308). The procedure of the content selection process will be described later. In addition, the CPU 38 transmits the content of the output operation to the display device 2. The display device 2 outputs an image of the received operation content as operation support information.

  Next, the procedure of the priority order alignment process executed by the information processing apparatus 3 in step S307 will be described. FIG. 8 is a flowchart showing a procedure of priority order alignment processing.

  The CPU 38 of the information processing device 3 determines whether or not there is an operation content having the attribute of the same time in the extracted operation content (S401). As a result, if the CPU 38 determines that there is an operation content having the same time attribute (YES in S401), the CPU 38 adds 1 to the priority P of the operation content (S402), and has the same day attribute. It is determined whether or not there is an operation content (S403).

  As a result, if the CPU 38 determines that there is an operation content having the attribute of the same day of the week (YES in S403), the CPU 38 adds 1 to the priority P of the content of the operation (S404), and sets the attribute of the same traveling position. It is determined whether there is a content of the operation that has (S405).

  As a result, if the CPU 38 determines that there is an operation content having the same travel position attribute (YES in S405), the CPU 38 adds 1 to the priority P of the operation content (S406), In the contents, it is determined whether or not there are unprocessed contents (S407). As a result, if the CPU 38 determines that there is unprocessed content (YES in S407), the CPU 38 returns to step S401 and repeats the priority order alignment process.

  On the other hand, when determining that there is no unprocessed content (NO in S407), the CPU 38 arranges the contents of the extracted operations in descending order of priority P (S408). The CPU 38 waits until the priority order sorting process is finished and resumed.

  On the other hand, if the CPU 38 determines in step S401 that there is no operation content having the same time attribute (NO in S401), the operation content having the same day of the week attribute is not added. It is determined whether or not there is (S403).

  On the other hand, if the CPU 38 determines in step S403 that there is no operation content having the same day of the week attribute (NO in S403), the CPU 38 adds the priority P and adds the operation having the same driving position attribute. It is determined whether there is content (S405).

  On the other hand, if the CPU 38 determines in step S405 that there is no operation content having the same travel position attribute (NO in S405), the CPU 38 determines whether there is unprocessed content without adding the priority P. Is determined (S407).

As described above, when a plurality of operation contents related to the same attribute are stored, the CPU 38 counts the operation contents related to the same attribute and preferentially outputs the operation contents having the largest number.
In this embodiment, an example in which the operation contents are arranged in descending order of priority P has been described. However, the present invention is not limited to this, and the operation contents are arranged in ascending order of priority P. You may make it align. Further, in the present embodiment, the sameness is determined for all of the time, day of the week, and travel position, but the present invention is not limited to this, and is the same for any one of time, day of the week, or travel position. You may make it judge sex.

  Next, the procedure of the output determination process executed by the information processing apparatus 3 in step S310 will be described. FIG. 9 is a flowchart showing the procedure of the output determination process.

  The turn signal switch 43a outputs a turn signal when turned on to turn the vehicle to the right or left. When the winker signal detection sensor 43 detects the winker signal output from the winker switch 43 a, the winker signal detection sensor 43 transmits the detected winker signal to the first LAN interface 31. When the CPU 38 receives the winker signal transmitted from the winker signal detection sensor 43, the CPU 38 determines that the winker signal has been output.

  When the obstacle detection device 56 detects an obstacle present in front of the vehicle, the obstacle detection device 56 transmits the detected obstacle signal to the second LAN interface 32. When the CPU 38 receives the obstacle signal transmitted from the obstacle detection device 56, the CPU 38 determines that there is an obstacle ahead of the vehicle.

  The steering 40a is operated by the occupant and plays a role of turning the vehicle to the right or left according to the operated steering angle. The steering angle detection sensor 40 transmits the detected steering angle signal to the first LAN interface 31 when detecting the steering angle of the steering 40 a operated by the occupant. When the CPU 38 receives the steering angle signal transmitted from the steering angle detection sensor 40, the CPU 38 derives the steering angle of the steering 40a indicated by the received steering angle signal.

  The CPU 38 determines whether or not a winker signal has been output (S501). If it is determined that a winker signal has been output (YES in S501), the CPU 38 terminates the output determination process without outputting a determination signal, and restarts. Wait until.

  On the other hand, if the CPU 38 determines that the blinker signal is not output (NO in S501), it determines whether there is an obstacle ahead of the vehicle (S502). As a result, if the CPU 38 determines that there is an obstacle ahead of the vehicle (YES in S502), the CPU 38 ends the output determination processing without outputting a determination signal, and waits until it is restarted.

  On the other hand, when it is determined that there is no obstacle ahead of the vehicle (NO in S502), the CPU 38 determines whether or not the steering angle of the steering 40a exceeds a preset threshold (S503). As a result, if the CPU 38 determines that the steering angle of the steering 40a exceeds the threshold (YES in S503), the CPU 38 ends the output determination process without outputting a determination signal, and waits until it is restarted.

  On the other hand, if the CPU 38 determines that the steering angle of the steering 40a is equal to or less than the threshold value (NO in S503), the CPU 38 outputs a determination signal (S504), ends the output determination process, and waits until it is restarted. As described above, when the determination signal is output in the output determination process, the CPU 38 determines that the driving load is low and determines that the operation support information should be output to the occupant. On the other hand, if the determination signal is not output, the CPU 38 determines that the driving load is large and determines that the operation support information should not be output to the occupant.

  As described above, the CPU 38 outputs the operation support information when the driving load is small, based on the detected driving situation of the driver, the operating situation of the vehicle, or the external situation of the vehicle. As a result, the driver can concentrate on driving.

Example 1.
Next, the procedure of content selection processing executed by the information processing apparatus 3 in step S312 will be described. FIG. 10 is a flowchart illustrating a procedure of content selection processing according to the first embodiment.
In the first embodiment, for example, when music is played on the CD player 1d, an example of selecting the content of the operation according to the operation state of the vehicle will be described.

  The CPU 38 of the information processing apparatus 3 extracts the operation content from the database 35 based on the attribute (S601). The CPU 38 determines whether or not the operating CD player 1d finishes the music reproduction (S602). If the CPU 38 determines that the music reproduction is not finished (NO in S602), the content selection process is terminated and restarted. stand by. Then, the CPU 38 outputs the content of the operation extracted in step S601 (see S308).

  On the other hand, when determining that the music reproduction is to be ended (YES in S602), the CPU 38 determines whether or not the contents of the operation extracted in step S601 include an operation for music reproduction (S603). As a result, when it is determined that the operation for music reproduction is not included (NO in S603), the CPU 38 ends the content selection process and waits until it is restarted. Then, the CPU 38 outputs the content of the operation extracted in step S601 (see S308).

  On the other hand, if the CPU 38 determines that the operation for music playback is included (YES in S603), the CPU 38 preferentially selects the operation for music playback (S604), ends the content selection process, and waits for resumption. To do. And CPU38 outputs the content of operation about the extracted music reproduction (refer S308).

Example 2
In the above-described first embodiment, an example in which the content of an operation according to the operation state of the vehicle is selected, such as when music is played on the CD player 1d, has been described. However, the present invention is not limited to this, and the content of the operation according to the operation state of other vehicles may be selected. Therefore, in the second embodiment, for example, an example of selecting the content of the air conditioner operation according to the seating situation of the passenger on the seat will be described. FIG. 11 is a flowchart illustrating a procedure of content selection processing according to the second embodiment.

  The CPU 38 of the information processing device 3 extracts the content of the operation from the database 35 based on the attribute (S701). The CPU 38 determines whether or not the air conditioner 1a is operating (S702), and if it is determined that the air conditioner 1a is not operating (NO in S702), whether or not the rear seat air conditioner 1a is operating. Is determined (S703). As a result, when determining that the air conditioner 1a for the rear seat is stopped (NO in S703), the CPU 38 further determines whether or not an occupant is seated in the rear seat (S704). As a result, if the CPU 38 determines that no occupant is seated in the rear seat (NO in S704), the CPU 38 ends the content selection process and waits until restart. Then, the CPU 38 outputs the content of the operation extracted in step S701 (see S308).

  On the other hand, if the CPU 38 determines that an occupant is seated in the rear seat (YES in S704), the CPU 38 preferentially selects the activation operation of the rear seat air conditioner 1a (S705), ends the content selection process, and resumes. Wait until. Then, the CPU 38 outputs the content of the selected activation operation (see S308). In this way, the CPU 38 prompts the occupant to activate the air conditioner 1a for the rear seat that is stopped.

  On the other hand, if it is determined in step S703 that the air conditioner 1a for the rear seat is operating (YES in S703), the CPU 38 further determines whether or not an occupant is seated in the rear seat (S706). As a result, if the CPU 38 determines that an occupant is seated in the rear seat (YES in S706), the CPU 38 ends the content selection process and waits until restart. Then, the CPU 38 outputs the content of the operation extracted in step S701 (see S308).

  On the other hand, if the CPU 38 determines that no occupant is seated in the rear seat (NO in S706), the CPU 38 preferentially selects the stop operation of the rear seat air conditioner 1a (S707), and ends the content selection process. Wait for it to resume. Then, the CPU 38 outputs the content of the selected stop operation (see S308). In this way, the CPU 38 prompts the occupant to stop the operating air conditioner 1a for the rear seat.

  On the other hand, if the CPU 38 determines in step S702 that the air conditioner 1a is operating (YES in S702), the in-vehicle temperature exceeds the preset threshold value, and the setting of the air conditioner 1a becomes the inside air circulation. It is determined whether or not (S708). As a result, when it is determined that the in-vehicle temperature is equal to or lower than the threshold value or the setting of the air conditioner 1a is not the inside air circulation (NO in S708), the CPU 38 ends the content selection process and waits until the restart. Then, the CPU 38 outputs the content of the operation extracted in step S701 (see S308).

  On the other hand, if the CPU 38 determines that the in-vehicle temperature exceeds the threshold and the setting of the air conditioner 1a is the inside air circulation (YES in S708), the CPU 38 preferentially selects the switching operation to the outside air intake (S709), End the content selection process and wait for it to resume. Then, the CPU 38 outputs the content of the switching operation to the selected outside air intake (see S308).

Example 3 FIG.
In the above-described first and second embodiments, an example of selecting the content of an operation according to the operation state of the vehicle has been described. However, the present invention is not limited to this, and the content of the operation according to the state of the occupant may be selected. Therefore, in the third embodiment, for example, an example in which the content of the operation is selected when the occupant's doze is detected will be described. FIG. 12 is a flowchart illustrating a procedure of content selection processing according to the third embodiment.

  The occupant state detection device 55 transmits, for example, an occupant state signal based on the detected difference to the second LAN interface 32 when detecting a difference in motion between two times of the occupant imaged by the in-vehicle camera. When the CPU 38 of the information processing device 3 receives the occupant state signal transmitted from the occupant state detection device 55 via the second LAN interface 32, the CPU 38 identifies the occupant state based on the received occupant state signal (S801). The CPU 38 determines whether or not the specified occupant state is a doze state (S802). If the CPU 38 determines that the specified occupant state is not a doze state (NO in S802), the CPU 38 ends the content selection process and waits for a restart. To do.

  On the other hand, if the CPU 38 determines that the specified occupant state is a doze state (YES in S802), the CPU 38 extracts the content of the operation related to the attribute of the doze state (S803), ends the content selection process, and waits for a restart. To do. And CPU38 outputs the content of operation extracted based on the attribute of a dozing state (refer S308).

  In the above-described embodiment, an example in which a support request signal is output to the information processing device 3 when the engine is started has been described. However, the present invention is not limited to this, and for example, a support request signal may be output to the information processing device 3 when an arbitrary input from the occupant is received.

  In the above-described embodiment, an example in which the operation content information D related to the same attribute is accumulated in the database 35 has been described. However, the present invention is not limited to this. For example, the operation content information D related to the same attribute may be overwritten on the database 35.

  In the above-described embodiment, the CPU 38 may delete or update the operation content information D that is not selected every predetermined period. Further, the CPU 38 may execute a priority order arrangement process every time it is called or updated to change the priority order of the operation content information D. Further, the CPU 38 may arrange the operation content information D in an arbitrary order so that the operation support information is output in the order of driving and operation desired by the occupant.

It is a block diagram which shows the whole structure of the operation assistance system which concerns on this invention. It is a schematic diagram which shows the vehicle-mounted example of an operation assistance system. It is a schematic diagram which shows the example of a display of the operation assistance information by a display apparatus. It is a conceptual diagram for demonstrating the operation content information memorize | stored in the database. It is a flowchart which shows the procedure of the operation content storage process which information processing apparatus performs. It is a flowchart which shows the procedure of an attribute production | generation process. It is a flowchart which shows the procedure of the operation estimation process which an information processing apparatus performs. It is a flowchart which shows the procedure of a priority order alignment process. It is a flowchart which shows the procedure of an output determination process. 6 is a flowchart illustrating a procedure of content selection processing according to the first embodiment. 12 is a flowchart illustrating a procedure of content selection processing according to the second embodiment. 12 is a flowchart illustrating a procedure of content selection processing according to the third embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Operation detection sensor 1a Air conditioner 1b Radio 1c Television receiver 1d CD player 1e DVD player 2 Display apparatus 3 Information processing apparatus 31 1st LAN interface 32 2nd LAN interface 33 RAM
34 ROM
35 Database 36 Input Interface 37 Output Interface 38 CPU
40 steering angle detection sensor 40a steering 41 shift position detection sensor 41a shift lever 42 accelerator operation amount detection sensor 42a accelerator 43 winker signal detection sensor 43a winker switch 51 navigation device 52 timer 53 occupant identification device 54 seating detection sensor 55 occupant state detection device 56 obstacle Object detection device 6 Instruction button 7 Center console

Claims (17)

In an operation support method for detecting an operation performed by a vehicle occupant with an in-vehicle device and outputting information indicating the content of the detected operation.
An operation support method characterized by estimating an operation to be performed by an occupant with respect to an operation detected by an in-vehicle device, and outputting operation support information indicating the content of the estimated operation. In an operation support system comprising detection means for detecting an operation performed by a vehicle occupant and information output means for outputting information indicating the content of the operation detected by the detection means,
An estimation means for estimating an operation to be performed by a passenger with respect to the operation detected by the detection means;
The operation support system, wherein the information output means outputs operation support information indicating the content of the operation estimated by the estimation means. A storage means for storing a plurality of contents of operations sequentially detected by the detection means;
The operation support system according to claim 2, wherein the estimation unit is configured so that any of the operations stored in the storage unit is to be performed by a passenger. And further comprising a specifying means for specifying the time and / or day of the week,
The storage means stores the time and / or day of the week specified by the specifying means at the time of operation as an attribute of the content of the operation,
The estimating means is characterized in that any of the contents of the operation stored in the storage means based on the attribute is an operation to be performed by a passenger at the same time and / or day of the week. The operation support system according to claim 3. It further comprises position detection means for detecting the traveling position of the vehicle,
The storage means stores the travel position detected by the position detection means during operation as an attribute of the content of the operation,
4. The estimation means is configured such that any of the operations stored in the storage means based on the attribute is an operation to be performed by an occupant at the same travel position. The operation support system described in 1. It further comprises state detection means for detecting the state of the occupant,
The storage means stores an occupant state detected by the state detection means during operation as an attribute of the content of the operation,
4. The estimation unit according to claim 3, wherein any one of the contents of the operation stored in the storage unit based on the attribute is an operation to be performed by the occupant in the same state. The operation support system described. Further comprising an occupant identification means for identifying the occupant,
The storage means stores the contents of the operation detected by the detection means in association with the occupant identified by the occupant identification means,
7. The estimation means is configured to perform an operation to be performed by an occupant identified by the occupant identification information for any of the operation contents stored in the storage means. The operation support system according to any one of the above.   The said estimation means, when the content of the operation which concerns on the same attribute is memorize | stored in the said memory | storage means, gives priority to the most thing of the content of this operation, It is characterized by the above-mentioned. The operation support system according to any one of 4 to 7. Further comprising warm-up determination means for determining whether or not the vehicle is warm-up,
The estimation means gives priority to the most operation contents stored in the storage means when the warm-up determination means determines that the vehicle is in a warm-up state. The operation support system according to claim 8. A situation detecting means for detecting a driving situation of a driver driving the vehicle, an operating situation of the vehicle or an external situation of the vehicle;
Output judgment means for judging whether or not to output the operation support information based on the driving situation of the driver, the operation situation of the vehicle or the external situation of the vehicle detected by the situation detection means. The operation support system according to any one of claims 2 to 9. The situation detection means detects at least the steering amount of the steering operated by the driver,
The output judging means judges that the operation support information is not outputted when the difference between the steering amount detected by the situation detecting means and a preset threshold exceeds a predetermined value. The operation support system according to claim 10. The situation detection means detects at least a winker signal operated by the driver,
11. The operation support system according to claim 10, wherein the output determination unit determines that the operation support information is not output when the situation detection unit detects the output of the winker signal. The situation detection means detects the presence of an obstacle at least around the vehicle,
The operation support system according to claim 10, wherein the output determination unit determines that the operation support information is not output when the situation detection unit detects the presence of an obstacle. The vehicle further comprises travel determination means for determining whether the vehicle is in a travel state,
14. The output determination unit determines whether or not to output operation support information when the travel determination unit determines that the vehicle is in a travel state. The operation support system according to any one of the above. Receiving means for receiving an operation instruction indicated by the operation support information output by the information output means;
The operation support system according to any one of claims 2 to 14, further comprising: a unit that outputs an instruction signal received by the reception unit.   The operation support system according to claim 15, wherein the reception unit is installed in a steering.   The operation support system according to any one of claims 2 to 16, wherein the information output unit includes a head-up display or a display installed in a center console.

Images