JP2005047327A - Command input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a command input device not inducing the guidance of the line of view. <P>SOLUTION: The command input device is equipped with a sensing means 1 installed on a vehicle, receiving the input of a command expressed by the shape and/or motion of the hand(s) of a driver to drive the vehicle, and sensing the shape and/or motion of an object existing in the specified sensing region, an extracting means 2 to extract the shape and/or motion of the hand(s) from the information sensed by the sensing means 1, a judging means 3 to judge the command corresponding to the shape and/or motion of the hand(s) extracted by the extracting means 2, and an executing means 4 to execute the command judged by the judging means 3, wherein the arrangement further includes an air blowout means 6 to blow out the air toward the sensing region of the sensing means 1. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
【Technical field】
The present invention relates to a command input device that is mounted on a vehicle and that receives an input of a command given to an in-vehicle computer by the shape and / or movement of a passenger's hand.
[0002]
[Background]
With the diversification of in-vehicle devices mounted on vehicles, input operations performed by drivers have become complicated. In order to reduce the burden on the driver during driving, there has been proposed an input device that inputs commands according to hand shape and hand movement (see Patent Document 1). According to this operation input device, an input operation can be performed without visually checking an input button or the like. Patent Document 2 describes a control device that detects a human movement using an infrared sensor.
[0003]
However, since this type of input device detects the shape of the hand and the movement of the hand to determine the command, there is a problem that the driver's hand cannot be recognized or misrecognized unless it is in the detectable region. It was. In other words, in order to accurately input a command, the driver must be aware of the position of the detectable region and indicate the command after confirming that the hand is within the detectable region. There was the inconvenience of inducing induction.
[0004]
[Prior art]
[Patent Document 1]
JP 2001-216069 A [Patent Document 2]
JP-A-8-123544
DISCLOSURE OF THE INVENTION
It is an object of the present invention to provide a command input device that does not induce gaze guidance.
According to the present invention, there is provided a command input device that is mounted on a vehicle and accepts an input of a command expressed by the shape of an occupant's hand and / or the movement of a hand, and the shape of the object in a predetermined detection area and / or Alternatively, detection means for detecting the movement of the object, extraction means for extracting the hand shape and / or hand movement from the information detected by the detection means, and the hand shape and / or extracted by the extraction means Alternatively, an air blowing unit that includes a determination unit that determines a command corresponding to the movement of the hand and an execution unit that executes the command determined by the determination unit, and that blows air toward a detection area of the detection unit. The provided command input device can be provided.
[0006]
Accordingly, the occupant can recognize the detectable area of the command expressed by the shape of the hand and / or the movement of the hand without searching the detectable area, and accurately input the command without moving the line of sight. be able to.
[0007]
BEST MODE FOR CARRYING OUT THE INVENTION
DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, a first embodiment of the invention will be described with reference to the drawings.
The command input device 100 according to the present embodiment is a device that receives input of a hand command expressed by the shape and / or hand movement of a vehicle occupant, specifically, a driver driving. The hand command of the present embodiment is a command given by a passenger, for example, a driver to a computer that controls the in-vehicle device. is there. These in-vehicle devices and the command input device 100 are connected so as to be able to exchange information via an in-vehicle LAN. That is, the command received by the command input device 100 is sent to each device for command execution via the in-vehicle LAN. The operation of the command input means 100 is not limited to the driver, and it is also possible to accept an input of an occupant's hand command that can reach the command input device 100.
[0008]
A block configuration of the command input device 100 of the present embodiment is shown in FIG. As shown in FIG. 1, the command input device 100 includes a detection unit 1, an extraction unit 2, a determination unit 3, an execution unit 4, and an air blowing unit 5. Specifically, a ROM that stores a program for detecting at least the shape and / or movement of the occupant's hand and determining the content of the command based on an image extracted from the detection result, and the ROM stored in the ROM By executing the program, the CPU includes a CPU functioning as the extraction unit 2, the determination unit 3, and the execution unit 4, and a RAM that stores necessary information.
[0009]
The detecting means 1 detects the shape of the target object and / or the movement of the target object in a predetermined detection area. In this embodiment, an infrared sensor that detects the temperature of the object is used. The infrared sensor of this embodiment detects the temperature and temperature distribution of each point in a predetermined two-dimensional detection region. The “predetermined detection area” is set at a position where the shape of the driver's (occupant) hand and / or movement of the hand, which is the object of detection, is easy to detect.
Moreover, it is preferable to set the detection region so that there is no other object that generates heat in the background of the detection object. The infrared sensor 1 used in the command input device 100 is not particularly limited, and may be a thermal sensor or a quantum sensor. In this embodiment, a thermocouple type infrared sensor is used, but a thermoelectromotive force type infrared sensor or a pyroelectric type infrared sensor may be used. Further, the “predetermined detection area” may be a three-dimensional predetermined space.
[0010]
A driver who wants to input a command places his hand over the detection area of the infrared sensor 1 and shows a specific hand shape and / or a specific hand movement in the detection area.
The hand shape and / or hand movement shown in the detection area is detected by the infrared sensor 1 as a distribution of hot spots or a change in the distribution of hot spots. Further, the area value of the object in the detection region can be obtained from the distribution of hot spots detected by the infrared sensor 1. In the present embodiment, an infrared sensor is used as the detection means 1, but a hand shape and / or hand movement may be detected using a CCD camera.
[0011]
The detection area is formed in the vehicle interior space, and the driver cannot perceive the boundary of the detection area. For this reason, the driver has to visually confirm the detection area. In the present embodiment, the air blowing means 5 for blowing air toward the detection area is provided. The air blown out from the air blowing means 5 is perceived by the sense of touch of the driver's hand. The driver recognizes the position of the detection area based on the perceived location of the air. The air supplied from the air blowing means 5 has directivity and gives a predetermined pressure to the object. Although not particularly limited, the air blowing means 5 of the present embodiment supplies the air so that the pressure when the air collides with the object (driver's hand) is 0.1 MPa or less. The driver can recognize the position of the detection area using the air supplied from the air blowing means as a clue.
[0012]
The air blowing means 5 of the present embodiment takes in air used for air conditioning in the vehicle interior and blows out air toward the detection area. The air blowing means 5 has a blowing port 51 for blowing out air. The outlet 51 is provided at the end of the air flow path for taking in air used for air conditioning. The air flow path is narrowed as it approaches the blowout port 51, and air constricted from the blowout port 51 is blown out. The form of the outlet 51 is not particularly limited, and is appropriately designed according to the position of the detection means 1 or the detection region. Preferably, the air outlet 51 is narrowed so that air flows in an area narrower than the detection area, and the direction of the air outlet 51 is set so that air flows in a predetermined area narrower than the detection area. In addition, it is preferable to set the position, direction, and aperture of the air outlet 51 so that air is blown out toward a position corresponding to the position of the hand when the driver's hand is positioned within the detection region.
[0013]
An example in which the detecting means 1 and the air blowing means 5 are arranged in a vehicle is shown in FIG. As shown in FIG. 2, in this embodiment, the air blowing means 5 and the air blowing port 51 are provided in the vicinity of the infrared sensor 1. With such an arrangement, the driver can accurately recognize the positions of the detection region and the infrared sensor using the directional air blown from the air blowing port 51 as a clue.
[0014]
The air blowing means 5 of the present embodiment blows air toward a predetermined area narrower than the detection area. The driver recognizes the detection area by using the air blown to a predetermined area within the detection area and narrower than the detection area. For this reason, the detection area recognized by the driver does not exceed the extension of the actual detection area, and the object (driver's hand) can be guided into the detection area.
[0015]
The air blowing means 5 of the present embodiment blows air toward the area corresponding to the position of the hand when positioned in the detection area. It is preferable that the air to be blown out is blown out so that the driver's hand can perceive the air in a state where the spread hand fits in the detection region. The “hand position” is not particularly limited, and may be a fingertip position or a palm position. The air blowing means 5 of the present embodiment blows air toward the center of the palm when the spread hand fits in the detection area.
[0016]
Furthermore, the air blowing means 5 of the present embodiment has a heating device 52 that gives heat to the air. The heating device 52 operates independently of an air conditioner that cools and heats the interior of the vehicle, and can be controlled independently. The detection means 1 of the present embodiment is an infrared sensor 1. Since this infrared sensor 1 detects the temperature of the object to be detected, the detection accuracy is lowered unless the temperature of the object is maintained. In the present embodiment, air having a temperature higher than the temperature of the object to be detected is blown out. Specifically, air is heated so that the skin temperature does not decrease at least with reference to the skin temperature (32 to 33 ° C.) of the human hand to be detected. The heating device 52 of the present embodiment warms the air blown from the outlet 51 to 28 to 40 ° C, preferably 30 to 38 ° C. The heated air contacts the driver's hand and gives heat to prevent the skin temperature of the hand from lowering. Thereby, the skin temperature of the driver's hand to be detected is maintained, and the detection accuracy can be maintained or improved.
[0017]
The air blowing means 5 of this embodiment has an air blowing control unit 53 that controls on / off of air blowing. The air blowing control unit 53 starts air blowing when the area occupied by the object detected by the detecting means becomes equal to or larger than a predetermined area value. Moreover, the air blowing control part 53 stops air blowing, when the area which the target object detected by the detection means becomes less than a predetermined area value. The driver moves his hand to search for the exact position of the detection area. When the driver's hand reaches the detection area and a part of the hand enters the detection area, when the area of the approached hand is equal to or larger than the predetermined area, air blowing is started. By starting air blowing, the driver recognizes that his / her hand is located in the vicinity of the detection area, and can accurately recognize the detection area based on the direction and pressure of the blown air. it can.
[0018]
The extraction unit 2 extracts the hand shape and / or hand movement from the information detected by the detection unit 1. Although not particularly limited, the distribution of hot spots included in the temperature band based on the human epidermis temperature (32 to 34 ° C.) is extracted, and the shape of the human hand and / or the movement of the human hand is extracted from this temperature distribution. Extract as an image.
[0019]
The determination unit 3 determines the content of the command based on the hand shape and / or hand movement extracted by the extraction unit 2. The determination method is not particularly limited, and the extracted hand shape and / or hand movement may be recognized from its characteristics, or may be determined by a pattern matching method. In the present embodiment, the extracted hand shape and / or hand movement is compared with the hand shape and / or hand movement previously assigned to the command, and Determine hand movement commands. The determination unit 3 acquires correspondence information in which the content of the command is associated with the hand shape and / or hand movement in advance from a readable storage unit (RAM or ROM). In the correspondence information, a predetermined command associated in advance from the hand shape and / or hand movement is specified. A predetermined hand shape (for example, the number of fingers) or the like may be associated with a predetermined command (for example, device ON / OFF), or a predetermined hand shape (for example, a finger A combination of the number (number), etc., and a predetermined command (for example, volume UP / DOWN after audio selection) may be associated.
[0020]
The command may include a command for selecting a control target such as “the control target is the navigation device 200” or “the control target is the audio device 300”. Further, a command for selecting a mode such as “set audio device 300 in radio mode” or “set audio device 300 in CD playback mode” may be included. Further, a command for adjusting a changeable parameter such as “increase the volume of CD playback” or “decrease the set temperature of the air conditioner” may be included.
[0021]
The execution unit 4 causes the command determined by the determination unit 3 to be executed. The execution means 4 sends the command to the device controlled by the determined command. Each device (200 to 500) that has acquired the command executes the acquired command.
[0022]
The operation of the command input device 100 having the above configuration will be described with reference to FIGS.
FIG. 3 is a flowchart for explaining a control procedure of the command input device 100 according to the present embodiment.
[0023]
After the activation, the command input device 100 initializes the process (S1). The infrared sensor 1 which is a detection means detects the shape of the target object and / or the movement of the target object in a predetermined detection area. The extraction means 2 acquires a thermal image from the detected information (S2), and further extracts a hot spot mass in a predetermined temperature range as a thermal image of the driver's hand (S3).
[0024]
The air blowing control unit 53 determines whether or not the area of the hand thermal image acquired from the extracting unit 2 (the area occupied by the hand) is equal to or larger than a predetermined area (S4). If the area of the thermal image of the hand is equal to or larger than the predetermined area Sa, the air blowing control unit 53 starts blowing air (S5). If the area of the thermal image of the hand is less than the predetermined area Sa, air stoppage determination is performed without starting air blowing (S8).
[0025]
The air start process is shown in FIG. 4A to 4C are conceptual diagrams showing detection states in the detection region. FIG. 4A shows a state where no heat source is detected in the detection region. In this state, the air blowing control unit 53 does not start air blowing. FIG. 4B shows a state in which a part of the hand moving in the direction of the arrow is located in the detection region and the area of the thermal image of the hand is equal to or larger than the predetermined area Sa. At this timing, the air blowing control unit 53 starts air blowing. The blowout port 51 blows out air toward the region α in FIG. This area α is narrower than the detection area, and is set so as to be in contact with the center of the driver's palm widened in the detection area. The driver inputs a command at a position where the blown air hits the palm. As shown in FIG. 4C, the hand that inputs the command at this position is located in the detection region.
[0026]
After the air blowing is started, the determination unit 3 acquires correspondence information on the hand shape and / or hand movement previously assigned to the predetermined command, and reads the definition of the command. Further, the determination unit 3 compares the hand shape and / or hand movement extracted by the extraction unit 2 with the hand shape and / or hand movement associated with the command. Then, the extracted hand shape and / or hand movement command is determined (S6). The execution means 4 sends the command determined by the determination means 4 to the device (200 to 500) corresponding to the command, executes it (S7), returns to S2, and continues the detection process.
[0027]
On the other hand, when it is determined in S4 that the area of the thermal image of the hand is less than the predetermined area Sa, the air blowing control unit 53 determines that the area of the acquired thermal image of the hand (area occupied by the hand) is less than the predetermined area Sb. It is determined whether or not there is (S8). When the area of the thermal image of the hand is less than the predetermined area Sb, the air blowing control unit 53 ends the blowing of air (S9), returns to S2, and continues the detection process. If the area of the thermal image of the hand is not less than the predetermined area Sb, the blowing of air is not stopped, the process returns to S2, and the detection process is continued. The predetermined areas Sa and Sb can be set as appropriate, and may be the same value or different values as long as Sa ≧ Sb.
[0028]
The air stopping process is shown in FIG. 5A to 5C are conceptual diagrams showing detection states in the detection region. FIG. 5A is a diagram illustrating a detection state of a command input by the driver. In this case, the air blowing control unit 53 continues the blowing of air. FIG. 5B shows a state where the driver's hand moves in the direction of the arrow and a part of the hand is out of the detection area. That is, only a part of the hand is located in the detection area. FIG. 5B shows a state in which the area of the thermal image of the hand is less than the predetermined area Sb. At this timing, the air blowing control unit 53 stops air blowing.
[0029]
Since the command input device 100 of the present embodiment is configured and functions as described above, the following effects can be obtained.
[0030]
Since the air blowing means 5 for blowing out air toward the detection area of the detection means 1 is provided, the position of the detection area can be indicated to the driver. The driver can recognize the position of the detection region using the position where the air flows as a mark. That is, a command can be input in the detection area without allowing the driver to visually check the position of the detection area. Thereby, the input command can be received correctly without inducing the driver's line-of-sight guidance.
[0031]
Since the air is blown toward a predetermined area narrower than the detection area, the range within the detection area is indicated, and the driver's hand inputting the command does not come out of the detection area. The command can be shown in
[0032]
Since the air is blown out toward a predetermined area corresponding to the position of the hand when the driver's hand is located within the detection area, the driver can perceive the air with the palm of the hand or the hand, The position of the detection area can be recognized by the perceived air.
[0033]
Since air on / off is controlled according to the area of the driver's hand (object) detected in the detection area, if a part of the driver's hand enters the detection area, the driver will try to input a command. The position of the detection area can be indicated by air. Further, when the driver's hand leaves the detection area, it is predicted that the driver's command input has been completed, and the air indicating the detection area is stopped to prevent waste of energy.
[0034]
Next, a second embodiment will be described.
The second embodiment is basically in common with the command input device 100 described in the first embodiment. Here, description of common parts is omitted, and different parts are mainly described.
[0035]
The command input device 100 ′ according to the second embodiment further includes a function of notifying the driver of the timing when the input command is confirmed. The configuration of the command input device 100 ′ of the second embodiment is the same as that of the command input device 100 of the first embodiment shown in FIG. 1, and includes a detection unit 1, an extraction unit 2, a determination unit 3, and an execution unit 4. have. The air blowing means 5 of this embodiment has at least an air blowing control unit 53. The air blowing control unit 53 according to the present embodiment performs control to temporarily stop the air blowing according to the timing when the determination unit 3 determines the command.
[0036]
This control procedure will be described based on the flowchart of FIG.
[0037]
After the activation, the command input device 100 ′ initializes the process (S11). The infrared sensor 1 which is a detection means detects the shape of the target object and / or the movement of the target object in a predetermined detection area. The extracting means 2 acquires a thermal image from the detected information (S12), and further extracts a hot spot mass in a predetermined temperature range as a thermal image of the driver's hand (S13).
[0038]
The air blowing control unit 53 determines whether or not the area of the acquired thermal image of the hand (area occupied by the hand) is a predetermined area or more, and further determines whether or not the position of the hand is appropriate ( S14). When the area of the thermal image of the hand is equal to or larger than the predetermined area and the position of the hand is appropriate, the air blowing control unit 53 starts air blowing (S15).
[0039]
The determination means 3 determines the content of the command (S16). When the determination result of the command is confirmed (Yes in S17), the air blowing control unit 53 temporarily stops the blowing of air (S18). The time for temporarily stopping the air is 1 second or less, preferably about 0.3 to 0.8 seconds. The driver can perceive that the command has been determined by temporarily stopping the air. As means for making the driver perceive that the command has been determined, means for moving the wiper of the vehicle or ejecting the washer liquid on the windshield of the vehicle can be used.
[0040]
The execution means 4 sends it to each device (200 to 400) in order to execute the confirmed command (S19).
[0041]
When the command is not fixed (No in S17), the command detection process and the determination process are performed (S12 to S16) until the predetermined time Ts or more has elapsed (No in S20). On the other hand, if the command is not finalized (No in S17), the process waits for a predetermined time Ts or longer (Yes in S20), and stops the air blowing (S21).
[0042]
According to the present embodiment, the driver can perceive that the hand command indicated by the driver has been determined. Also, the driver can confirm that the input of the command has been determined, and can input the next command following the input command. As a result, even in the case of hierarchically structured commands, the driver can continuously input commands, and the command input device 100 ′ can accurately determine the continuously input commands.
[0043]
The embodiment described above is described for facilitating the understanding of the present invention, and is not described for limiting the present invention. Therefore, each element disclosed in the above embodiment is intended to include all design changes and equivalents belonging to the technical scope of the present invention.
[Brief description of the drawings]
FIG. 1 is a block configuration diagram of a command input device according to a first embodiment and a second embodiment.
FIG. 2 is a diagram showing an example of arrangement of detection means 1 and air blowing means 5;
FIG. 3 is a flowchart showing a control procedure in the first embodiment.
FIGS. 4A, 4B, and 4C are diagrams for explaining air on control. FIG.
FIGS. 5A, 5B, and 5C are diagrams for explaining air off control. FIG.
FIG. 6 is a flowchart showing a control procedure in the second embodiment.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 100,100 '... Command input device 1 ... Detection means, infrared sensor 2 ... Extraction means 3 ... Determination means 4 ... Execution means 5 ... Air blowing means 51 ... Outlet 52 ... Heating Device 53 ... Air blowing control unit 200 ... Navigation device 300 ... Audio device 400 ... Air conditioner control device 500 ... Communication device

Claims (7)

A command input device that is mounted on a vehicle and receives a command input expressed by the shape and / or movement of a passenger's hand,
Detection means for detecting the shape of the object and / or movement of the object in a predetermined detection area;
Extraction means for extracting a hand shape and / or hand movement from the information detected by the detection means;
Determining means for determining a command corresponding to the hand shape and / or hand movement extracted by the extracting means;
Execution means for executing the command determined by the determination means,
A command input device provided with air blowing means for blowing air toward the detection area of the detecting means. The command input device according to claim 1, wherein the air blowing means blows air toward a predetermined area narrower than the detection area. The command input device according to claim 1, wherein the air blowing unit blows air toward a predetermined area corresponding to a position of a hand when the occupant's hand is positioned in a detection area. The detection means is an infrared sensor that detects infrared rays from an object,
The command input device according to claim 1, wherein the air blowing means includes a heating device that heats the blown-out air. The detection means detects an area occupied by the object in the detection region;
The command input device according to any one of claims 1 to 4, wherein the air blowing means starts air blowing when the area occupied by the object detected by the detecting means becomes a predetermined area value or more. The detection means detects an area occupied by the object in the detection region;
The command input device according to claim 1, wherein the air blowing means stops air blowing when the area occupied by the object detected by the detecting means becomes less than a predetermined area value. The command input device according to claim 1, wherein the air blowing means temporarily stops air blowing according to the timing at which the determination means determines a command.

Images