JP2021098481A - Vehicle control device - Google Patents

Abstract

To realize a vehicle control device capable of improving recognition accuracy of gesture operation by an occupant in a vehicle.SOLUTION: A vehicle control device (1) which causes a predetermined mechanism mounted on a vehicle to operate comprises: a detection section (2) which detects a gesture of an occupant in a vehicle interior; a setting section (3) which sets a gesture detection region, which is a three-dimensional region, where the detection section (2) detects the gesture of the occupant; a recognition section (4) which recognizes a trajectory of the gesture detected in the set gesture detection region; and a generation section (5) which generates operation information to identify operation content of the predetermined mechanism on the basis of the recognized trajectory of the gesture. The vehicle control device uses the generated operation information to cause the predetermined mechanism to operate.SELECTED DRAWING: Figure 1

Description

The present invention relates to a vehicle control device.

Conventionally, a technique for manipulating an object by a user performing a predetermined gesture on a device including a sensor is known.

Patent Document 1 discloses an input device capable of easily manipulating an image displayed on a display unit based on a change over time in the distance from a sensor to a part of the body. In the input device, the motion recognition unit acquires the distance information from the rider and recognizes the motion such as a click operation on the operation image displayed on the display surface based on the time course of the distance from the rider to the finger of the person. To do. Then, based on the recognition result of the motion recognition unit, a process corresponding to a click operation or the like is performed on the operation image displayed on the display surface.

JP-A-2019-191947

In the prior art disclosed in Patent Document 1, there is a possibility that an operation other than the finger operation intended by the user staying in the predetermined space may be erroneously recognized as an operation such as a click operation on the operation image.

One aspect of the present invention has been made in view of the above problems, and an object of the present invention is to realize a vehicle control device capable of further improving the recognition accuracy of a gesture operation by an occupant staying in the vehicle.

In order to solve the above problems, the vehicle control device according to one aspect of the present invention is a vehicle control device that operates a predetermined mechanism mounted on the vehicle by recognizing a gesture by an occupant staying in the vehicle interior space. A detection unit that detects a gesture by an occupant staying in the vehicle interior space, and a gesture that is a three-dimensional region in which the detection unit detects a gesture by the occupant in the vehicle interior space with respect to the detection unit. Based on the setting unit that sets the detection area, the recognition unit that recognizes the locus of the gesture detected by the detection unit in the gesture detection area set by the setting unit, and the locus of the gesture recognized by the recognition unit. The predetermined mechanism is provided with a generation unit for generating operation information for specifying the operation content of the predetermined mechanism, and the predetermined mechanism is operated using the operation information generated by the generation unit.

According to the above configuration, the corresponding operation content is reflected in the predetermined mechanism only for the gesture performed in the gesture detection region. As a result, it is possible to realize a vehicle control device capable of further improving the recognition accuracy of the gesture operation by the occupant staying in the vehicle.

In the vehicle control device according to one aspect of the present invention, the setting unit includes seat information which is information about a seat on which the occupant sits and occupant information which is information about at least one of the physique or posture of the occupant. The gesture detection region may be set based on at least one of them.

According to the above configuration, a suitable gesture detection area can be set according to the seat information or the occupant information.

The vehicle control device according to one aspect of the present invention may further include a transmission unit that transmits the operation information generated by the generation unit to the control unit that operates the predetermined mechanism.

According to the above configuration, the control unit can be realized separately from the vehicle control device.

The vehicle control device according to one aspect of the present invention may further include a control unit that operates the predetermined mechanism using the operation information generated by the generation unit.

According to the above configuration, it is possible to realize a vehicle control device capable of operating a predetermined mechanism by itself.

In the vehicle control device according to one aspect of the present invention, the seat information, which is information about the seat on which the occupant sits, is information representing at least one of the position and angle of the seat, and is the physique or posture of the occupant. The occupant information, which is information about at least one of them, is information representing at least one of the height and body orientation of the occupant, and the setting unit is in the case where at least one of the seat information and the occupant information is changed. In addition, the setting of the gesture detection area may be updated.

According to the above configuration, the gesture detection region can be updated to a suitable region when the above-mentioned seat information or occupant information changes.

The vehicle control device according to one aspect of the present invention may further include a display control unit that displays a display screen that guides the occupant to make a gesture by the occupant.

According to the above configuration, the occupant can perform the gesture operation while checking the display screen, which contributes to the improvement of convenience.

In the vehicle control device according to one aspect of the present invention, the display screen may be a screen displayed on a display installed in the vehicle interior space so that the occupant can see it.

According to the above configuration, the occupant can perform the gesture operation while checking the screen displayed on the display, which contributes to the improvement of convenience.

In the vehicle control device according to one aspect of the present invention, the display screen may be a screen projected in the vehicle interior space so that the occupant can see it.

According to the above configuration, for example, the display screen can be displayed even in a place where a physical display is difficult to install, and the gesture operation by the occupant can be guided.

The vehicle control device according to one aspect of the present invention may further include a voice output unit that outputs a voice for inducing a gesture by the occupant to the occupant.

According to the above configuration, the gesture operation can be guided even to the visually impaired occupant.

In the vehicle control device according to one aspect of the present invention, the predetermined mechanism is a mechanism related to at least one of seat equipment, window equipment, air conditioning equipment, lighting equipment, sound equipment, and door equipment mounted on the vehicle. It may have a certain configuration.

According to the above configuration, it is possible to realize a vehicle control device capable of operating each of the above-mentioned facilities.

In the vehicle control device according to one aspect of the present invention, the setting unit sets the gesture detection region by using at least one of a predetermined gesture by the occupant and a predetermined voice input by the occupant as a trigger. May be configured to start.

According to the above configuration, it is possible to further prevent the predetermined mechanism from malfunctioning due to a gesture not intended by the occupant.

According to one aspect of the present invention, it is possible to realize a vehicle control device capable of further improving the recognition accuracy of the gesture operation by the occupant staying in the vehicle.

This is an example of a functional block diagram of a system including a vehicle control device according to the first embodiment. It is a figure which shows an example of the area which shows a radio wave area, and a gesture detection area. This is an example of a functional block diagram of a system including a vehicle control device according to the first embodiment. It is a figure which shows an example of the dynamic gesture by an occupant. It is a flowchart which shows the flow of processing when the predetermined mechanism is operated by a dynamic gesture. It is a figure which shows an example of the static gesture by an occupant. It is a flowchart which shows the flow of processing when the predetermined mechanism is operated by a static gesture. It is a flowchart which shows the flow of the process which the setting of a gesture detection area is updated. It is a flowchart which shows the flow of the process which the setting part updates the setting of a gesture detection area according to the change of sheet information. It is a flowchart which shows the flow of the process which the setting part updates the setting of a gesture detection area according to the change of the occupant information. It is a functional block diagram of the system including the vehicle control device which concerns on Embodiment 3. It is a figure which shows an example of the display screen displayed on the display. It is a figure which shows an example of the display screen displayed on the display. It is a figure which shows an example of the display screen projected in the passenger space.

Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS. 1 to 14. However, the configuration described in the present embodiment is not intended to limit the scope of the present invention to the present invention unless otherwise specified, and is merely an example of explanation.

[Embodiment 1]
Hereinafter, an embodiment of the present invention will be described. In the present embodiment, an example of a system that operates a predetermined mechanism in response to an occupant performing a predetermined gesture in a specific area in the vehicle interior space will be described. As an example, the predetermined mechanism will be described as a seat facility in which an occupant sits, but the present invention is not limited to this, and may be window equipment, air conditioning equipment, lighting equipment, audio equipment, door equipment, and the like. The operation content of the predetermined mechanism is not particularly limited, and for example, in the case of door equipment, opening and closing of a vehicle door and the like can be mentioned.

[1. Vehicle configuration]
FIG. 1 is a functional block diagram of a system included in a vehicle according to the present embodiment, which includes a vehicle control device 1, a seat ECU (Electronic Central Unit) 20, and a seat facility 40.

(Vehicle control device 1)
The vehicle control device 1 is an ECU that operates a predetermined mechanism mounted on the vehicle by recognizing a gesture by an occupant staying in the vehicle interior space. The vehicle control device 1 includes a detection unit 2, a setting unit 3, a recognition unit 4, a generation unit 5, a storage unit 6, a reception unit 7, and a transmission unit 8.

The detection unit 2 detects at least one of the gesture by the occupant staying in the passenger compartment space and the physique or posture of the occupant. The detection unit 2 is realized as, for example, a millimeter-wave radar that detects the movement of an occupant in a radio wave area formed by itself, LiDAR (Light Detection And Ranging), or the like. In this configuration, the detection unit 2 acquires the shape of the object by measuring the time (TOF: Time Of Flight) until the irradiated radio wave returns.

As another aspect, the detection unit 2 may be configured to detect at least one of the occupant's gesture and the occupant's physique or posture by referring to an image taken by a camera (not shown). Further, in the configuration, an existing machine learning method using a neural network such as CNN (Convolutional Neural Network) or RNN (Recurrent Neural Network) may be used. Further, the camera (not shown) may be a TOF camera.

Further, the detection unit 2 outputs information indicating the gesture by the occupant to the recognition unit 4, and outputs the occupant information which is information on at least one of the physique or the posture of the occupant to the setting unit 3.

The setting unit 3 sets a gesture detection area, which is a three-dimensional area in which the detection unit 2 detects a gesture by an occupant in the vehicle interior space, with respect to the detection unit 2. Further, the setting unit 3 may set the gesture detection area based on at least one of the seat information 51 regarding the seat on which the occupant sits and the occupant information. Here, the seat information 51 is information acquired by the setting unit 3 from the seat ECU 20 that controls the seat equipment 40 via the receiving unit 7. As shown in FIG. 1, the seat information 51 may be information indicating, for example, the position and angle of the seat surface, the backrest, or the headrest of the seat.

FIG. 2 is a diagram showing an example of a region showing a radio wave area that can be detected by the detection unit 2 and a gesture detection region. In FIG. 2, the area 61 indicates an area that is the radio wave area in which the detection unit 2 can detect the movement of the occupant. Area 62 shows the area occupied by the passenger's body. The area 63 indicates a gesture detection area set by the setting unit 3 in the area 61. The detection unit 2 does not detect the movement of the occupant including the gesture performed in the area other than the area 63, which is the gesture detection area, even if the movement of the occupant is performed in the area 61. Further, it is desirable that the gesture detection area is set in front of the area 62 so that the occupant can move his / her finger.

In FIG. 2, the detection unit 2 is provided on the ceiling of the passenger compartment and targets the occupant seated in the rear seat, but the detection unit 2 is not limited to this, and the detection unit 2 is located in front of the seat equipment 40. It may be provided, or the occupant seated in the front seat may be the detection target.

Further, the setting unit 3 may be configured to start setting the gesture detection area by triggering at least one of a predetermined gesture by the occupant and a predetermined voice input by the occupant. That is, the detection unit 2 may not start detecting the gesture by the occupant unless the action that triggers the above is performed by the occupant. Further, the detection unit 2 may detect the voice input by the occupant, and the recognition unit 4 may recognize the input voice.

The recognition unit 4 recognizes the locus of the gesture detected by the detection unit 2 in the gesture detection area set by the setting unit 3. Here, the configuration in which the recognition unit 4 recognizes the trajectory of the gesture may be realized by using an existing motion sensor device or the like.

Further, the recognition unit 4 outputs the result of recognizing the locus of the gesture to the generation unit 5. Although the details will be described later, the gestures of the occupant recognized by the recognition unit 4 in the present disclosure include static gestures (for example, the shape of a hand) represented by the posture of the occupant's body and the movement of the occupant's body. Includes dynamic gestures represented (eg, hand movements).

The generation unit 5 generates operation information for specifying the operation content of the predetermined mechanism in the vehicle interior space based on the locus of the gesture recognized by the recognition unit 4. The operation information may be an identification number or an identification code associated with each operation content of the predetermined mechanism. For example, the generation unit 5 is configured to generate operation information by referring to information stored in the storage unit 6 and indicating a table in which the recognition result of the recognition unit 4 and the operation information are associated with each other. May be good.

The storage unit 6 is a storage device that stores various types of information. The storage unit 6 stores, for example, information indicating the above-mentioned table, coordinate information defining a gesture detection area, and the like.

The receiving unit 7 acquires the sheet information 51 input to the setting unit 3 from the seat ECU 20. The transmission unit 8 transmits the operation information generated by the generation unit 5 to the seat ECU 20. Further, the transmitted operation information is referred to by the control unit 23 of the seat ECU 20. From another aspect, it can be said that the transmission unit 8 is configured to transmit the operation information generated by the generation unit 5 to the control unit 23 that operates the predetermined mechanism.

Since the predetermined mechanism is not limited to the seat equipment 40 as described above, the transmission unit 8 can transmit the corresponding operation information to each of the ECUs that control the predetermined mechanism other than the seat equipment 40.

(Seat ECU 20)
The seat ECU 20 is a device that controls the seat equipment 40 based on the operation information transmitted from the vehicle control device 1, and is a receiving unit 21, an operation request determination unit 22, a control unit 23, a seat state input unit 24, and a seat state. It includes a determination unit 25 and a transmission unit 26.

The receiving unit 21 receives the operation information transmitted from the transmitting unit 8 of the vehicle control device 1 and outputs it to the operation request determination unit 22.

The operation request determination unit 22 determines whether or not the operation content of the predetermined mechanism indicated by the operation information can be reflected in the state of the predetermined mechanism at the time when the operation information is input. For example, when the operation request determination unit 22 acquires the operation information instructing the backrest of the seat equipment 40 to be tilted when the backrest of the seat equipment 40 is tilted to the maximum, the operation information is transmitted to the seat equipment 40. This may be discarded as something that cannot be reflected. Further, the operation request determination unit 22 may be included in the control unit 23 or may be integrated with the control unit 23.

The control unit 23 is a control device that operates a predetermined mechanism using operation information. Specifically, the control unit 23 identifies the operation content to be reflected in the predetermined mechanism with reference to the operation information, and outputs a control signal for the operation to the predetermined mechanism. For example, in a configuration in which the operation information is an identification number or an identification code as described above, the control unit 23 is a storage unit (not shown) included in the seat ECU 20, and the identification number or the identification code and the operation to be reflected in the predetermined mechanism. The operation content to be reflected in the predetermined mechanism may be specified by referring to the information indicating the table associated with the content.

The seat state input unit 24 acquires the seat information 51 related to the seat equipment 40 from the seat equipment 40 and outputs it to the seat condition determination unit 25.

The seat state determination unit 25 refers to the seat information 51 input from the seat state input unit 24, and refers to the positions and angles of the seat surface, the backrest, the headrest, and the like of the seats constituting the seat equipment 40, and which of them are. Determine if it has changed.

The transmission unit 26 transmits the determination result by the seat state determination unit 25 to the vehicle control device 1.

(Seat equipment 40)
The seat equipment 40 is one or a plurality of seats (seats) provided in the vehicle interior space, and includes a drive unit 41 and a mechanism for outputting seat information 51 to the seat ECU 20.

The drive unit 41 operates each part of the seat equipment 40 based on the control signal input from the control unit 23 of the seat ECU 20, and changes the position of the seat surface, the angle of the backrest, and the like. The drive unit 41 is realized as, for example, a seat slide motor 42, a seat reclining motor 43, or the like.

(Additional notes)
In addition to the configuration shown in FIG. 1, the seat ECU 20 may be integrated with the vehicle control device 1. FIG. 3 is a functional block diagram showing the configuration. It can be said that the vehicle control device 1a shown in FIG. 3 is further provided with members such as a control unit 23 that operates a predetermined mechanism using the operation information generated by the generation unit 5 from the configuration shown in FIG.

[2. Process flow]
The flow of each process in the vehicle control device 1 according to the present embodiment will be described for each item.

(Control of a predetermined mechanism by dynamic gesture)
The flow of processing for operating a predetermined mechanism in the passenger compartment space by a dynamic gesture represented by the movement of the occupant's body will be described.

First, the above-mentioned dynamic gesture will be supplemented with reference to FIG. FIG. 4 is a diagram showing an example of a dynamic gesture caused by the occupant turning his / her fingertip. When using dynamic gestures, a predetermined mechanism is activated in response to the occupant transitioning a part of the body from one shape to another. For example, when operating the window equipment with the gesture shown in FIG. 4, the window of the vehicle opens only while the finger is rotated to the right, and when the finger is stopped, the opening and closing of the window stops and the finger is rotated to the left. It may be configured such that the window of the vehicle is closed only.

Subsequently, the flow of processing when the predetermined mechanism is operated by a dynamic gesture will be described with reference to FIG. FIG. 5 is a flowchart showing the flow of the process. In the example shown in the flowchart of FIG. 5, the setting unit 3 sets the gesture detection area only for a predetermined time by using at least one of a predetermined gesture by the occupant and a predetermined voice input by the occupant as a trigger. Set. The same applies to the example shown in the flowchart of FIG. 7 described later.

In step S101, the setting unit 3 does not set the gesture detection area before the above-mentioned trigger action of the occupant is performed.

In step S102, it is determined whether or not the recognition unit 4 has recognized the behavior of the occupant that is the trigger. When the recognition unit 4 recognizes the above action, the process of step S103 is subsequently executed, and when it is not recognized, the process based on the flowchart of FIG. 5 ends. The determination process in each step including step S102 may be performed by the operating entity itself in the step, or may be performed by each part of the vehicle control device 1 other than the operating entity in the step. ..

In step S103, the setting unit 3 sets the gesture detection area. That is, the detection unit 2 can detect the gesture of the occupant.

In step S104, it is determined whether or not the recognition unit 4 has recognized the start of a predetermined gesture that activates the predetermined mechanism. If the recognition unit 4 recognizes the start of the gesture, the process of step S105 is subsequently executed, and if it is not recognized, the process of step S106 is subsequently executed.

In step S105, the predetermined mechanism operates due to the generation unit 5 generating the operation information.

In step S106, it is determined whether or not a predetermined time has elapsed since the setting unit 3 set the gesture detection area. When the predetermined time has elapsed, the process based on the flowchart of FIG. 5 is completed, and when the predetermined time has not elapsed, the process of step S104 is repeated.

In step S107, it is determined whether or not the recognition unit 4 has recognized the end of the predetermined gesture. If the recognition unit 4 recognizes the end of the gesture, the process of step S109 is subsequently executed, and if it is not recognized, the process of step S108 is subsequently executed.

In step S108, it is determined whether or not a predetermined time has elapsed since the setting unit 3 set the gesture detection area. When the predetermined time has elapsed, the process of step S109 is subsequently executed, and when the time has not elapsed, the process of step S107 is repeated. In this step S108, it may be configured that the recognition unit 4 recognizes the start of the predetermined gesture in step S104 and determines whether or not a predetermined time has elapsed.

In step S109, the operation of the predetermined mechanism that has been operating from step S105 is stopped due to the generation unit 5 generating the operation information for stopping the operation of the predetermined mechanism.

It should be noted that the vehicle control device 1 stops the transmission of the operation information as a signal for operating the predetermined mechanism in real time, instead of the configuration in which the generation unit 5 generates the operation information explicitly instructing the stop of the operation of the predetermined mechanism. The operation of the predetermined mechanism may be stopped by the above.

(Control of a predetermined mechanism by static gesture)
The flow of processing for operating a predetermined mechanism in the passenger compartment space by a static gesture represented by the posture of the occupant's body will be described.

First, the static gesture described above will be supplemented with reference to FIG. FIG. 6 is a diagram showing an example of a static gesture caused by the occupant raising his / her fingertip. When using static gestures, the process of how a predetermined mechanism operates in response to a part of the body being shaped by the occupant and how the body is moved to that shape is questioned. Absent.

Subsequently, the flow of processing when the predetermined mechanism is operated by a static gesture will be described with reference to FIG. 7. FIG. 7 is a flowchart showing the flow of the process.

The flowchart of FIG. 7 is different from the flowchart of FIG. 5 in that the process of step S204 is executed instead of the process of step S104 and the process of step S109 is executed following the process of step S105. Further, the degree to which the predetermined mechanism operates in step S105 is predetermined. The process of step S204 is as follows.

In step S204, it is determined whether or not the recognition unit 4 has recognized a predetermined static gesture that activates the predetermined mechanism. If the recognition unit 4 recognizes the start of the gesture, the process of step S105 is subsequently executed, and if it is not recognized, the process of step S106 is subsequently executed.

(Setting of gesture detection area)
Hereinafter, the flow of the process in which the setting unit 3 updates the setting of the gesture detection area will be described. FIG. 8 is a flowchart showing the flow of the process.

In step S301, when at least one of the position and the angle changes in at least a part of the seat equipment 40, the seat state determination unit 25 detects the change.

In step S302, when at least one of the physique or posture of the occupant seated in the target seat equipment 40 changes due to, for example, the replacement of the occupants, the detection unit 2 detects the change.

In step S303, the setting unit 3 acquires the seat information 51 indicating the state and change of the seat equipment 40 and the occupant information indicating the state and change of the occupant. Further, in this step S303, the setting unit updates the setting of the gesture detection area when at least one of the seat information 51 and the occupant information is changed from the most recently acquired one.

(Update of gesture detection area according to sheet information 51)
FIG. 9 is a flowchart showing a flow of processing in which the setting unit 3 updates the setting of the gesture detection area according to the change of the sheet information 51. Further, the process shown in FIG. 9 corresponds to the process of step S303 in the flowchart of FIG.

In step S401, the setting unit 3 acquires the sheet information 51 from the seat ECU 20 via the receiving unit 7.

In step S402, the setting unit 3 determines whether or not the seat information 51 has changed from the most recently acquired one, that is, whether or not at least one of the positions and directions of the seat equipment 40 has changed. Here, the position and direction in the seat equipment 40 also include the position and direction in a part of the seat equipment 40. When the sheet information 51 changes, the setting unit 3 subsequently executes the process of step S403, and when the sheet information 51 does not change, the process based on the flowchart of FIG. 9 ends.

In step S403, the setting unit 3 determines whether or not the seat information 51 indicates that the seat equipment 40 itself has moved forward. If the seat information 51 indicates that the seat equipment 40 itself has moved forward, the setting unit 3 subsequently executes the process of step S404, otherwise the setting unit 3 subsequently performs step S405. Execute the process.

In step S404, the setting unit 3 moves the gesture detection area forward. Further, the moving distance of the gesture detection area may correspond to the moving distance of the seat equipment 40. The same applies to the case where the gesture detection area is moved according to the movement of the seat equipment 40 in the subsequent steps.

In step S405, the setting unit 3 determines whether or not the seat information 51 indicates that the seat equipment 40 itself has moved backward. When the seat information 51 indicates that the seat equipment 40 itself has moved backward, the setting unit 3 subsequently executes the process of step S406, and if not, subsequently executes the process of step S407.

In step S406, the setting unit 3 moves the gesture detection area backward.

In step S407, the setting unit 3 determines whether or not the backrest of the seat equipment 40 has moved forward, that is, whether or not the reclining of the backrest of the seat equipment 40 has occurred. If the sheet information 51 indicates that the backrest has moved forward, the setting unit 3 subsequently executes the process of step S408, and if not, subsequently executes the process of step S409.

In step S408, the setting unit 3 moves the gesture detection region forward and downward.

In step S409, the setting unit 3 determines whether or not the seat information 51 indicates that the backrest of the seat equipment 40 has moved backward, that is, whether or not the reclining of the backrest of the seat equipment 40 has been tilted. .. When the seat information 51 indicates that the backrest has moved backward, the setting unit 3 subsequently executes the process of step S410, and if not, subsequently executes the process of step S411.

In step S410, the setting unit 3 moves the gesture detection region backward and upward.

In steps S411 and S412 and thereafter, the setting unit 3 determines whether or not the seat information 51 indicates that at least one of the position and the direction has changed at the target portion of the seat equipment 40, and the change has occurred. If is indicated, the gesture detection area is moved in a predetermined direction, and if not, the process of making the same determination for the other parts is repeated for each part of the seat equipment 40.

(Update of gesture detection area according to occupant information)
FIG. 10 is a flowchart showing a flow of processing in which the setting unit 3 updates the setting of the gesture detection area according to the change of the occupant information. Further, the process shown in FIG. 10 corresponds to the process of step S303 in the flowchart of FIG.

In step S501, the setting unit 3 acquires occupant information from the detection unit 2.

In step S502, the setting unit 3 determines whether or not the occupant information has changed from the most recently acquired information, that is, whether or not at least one of the physique or posture of the occupant has changed. If the occupant information has not changed, the setting unit 3 subsequently executes the process of step S503, and if the occupant information has not changed, the process based on the flowchart of FIG. 10 ends.

In step S503, the setting unit 3 determines whether or not the occupant information indicates that the occupant's physique has increased. If the occupant information indicates that the occupant's physique has increased, the setting unit 3 subsequently executes the process of step S504, and if not, the setting unit 3 subsequently executes the process of step S505. Execute.

In step S504, the setting unit 3 moves the gesture detection area forward. Further, the moving distance of the gesture detection region may be determined according to the degree of change in the physique or posture of the occupant. The same applies to the case where the gesture detection area is moved according to the change in the physique or posture of the occupant in the subsequent steps.

In step S505, the setting unit 3 determines whether or not the occupant information indicates that the occupant's physique has become smaller. If the occupant information indicates that the occupant's physique has become smaller, the setting unit 3 subsequently executes the process of step S506, and if not, the setting unit 3 subsequently executes the process of step S507. Execute.

In step S506, the setting unit 3 moves the gesture detection area backward.

In step S507, the setting unit 3 determines whether or not the occupant information has changed to a state in which the occupant's posture is facing to the left. If the occupant information indicates that the occupant's posture has changed to the left side, the setting unit 3 subsequently executes the process of step S508, and if not, the setting unit 3 continues. The process of step S509 is executed.

In step S508, the setting unit 3 moves the gesture detection area to the left.

In step S509, the setting unit 3 determines whether or not the occupant information has changed to a state in which the occupant's state is facing to the right. If the occupant information indicates that the occupant's posture has changed to the right side, the setting unit 3 subsequently executes the process of step S510, and if not, the setting unit 3 steps. The process of S511 is executed.

In step S510, the setting unit 3 moves the gesture detection area to the right.

In steps S511 and S512 and thereafter, when the setting unit 3 determines whether or not the occupant information indicates that the item relating to at least one of the physique or posture of the occupant has changed, and indicates that the change has occurred. The gesture detection area is moved in a predetermined direction, and if not, the process of making the same determination for other items is repeated for each item.

[Embodiment 2]
A second embodiment of the present invention will be described below. For convenience of explanation, the members having the same functions as the members described in the above-described embodiment are designated by the same reference numerals, and duplicate explanations will not be repeated. The same applies to the subsequent embodiments. In the present embodiment, when there are a plurality of candidates for a predetermined mechanism to be operated by the vehicle control device 1 via the seat ECU 20 or the like, the predetermined mechanism to be operated is determined by performing a predetermined gesture triggered by the occupant. An example of the configuration to be performed will be described.

The above configuration can be realized by associating a gesture for selecting a predetermined mechanism with a predetermined mechanism in a one-to-one or many-to-one manner.

As an example, a static gesture represented by the shape of the occupant's finger is associated with each mechanism, and the seat equipment 40 may be associated with the gesture in which one finger is raised. In addition, a window equipment is associated with a gesture in which two fingers are raised, an air conditioning equipment is associated with a gesture in which three fingers are raised, and a lighting equipment is associated with a gesture operation in which four fingers are raised. Acoustic equipment may be associated with the five-finger gesture, and door equipment may be associated with the six-finger gesture operation with both hands.

In the above example, the vehicle control device 1 receives another gesture operation for the corresponding predetermined mechanism in response to the occupant raising 1 to 5 fingers. Further, when the gesture operation is completely reflected in the operation of the predetermined mechanism, the vehicle control device 1 shifts to the state of waiting for the occupant to perform the gesture of raising 1 to 5 fingers again.

As another aspect, a predetermined mechanism for operating the vehicle control device 1 may be determined by triggering the occupant to input a predetermined voice, or a gesture trigger and a voice trigger may be used. It may be used in combination.

Further, the configuration of the present embodiment may be applied to the behavior of the occupant as the trigger in step S102 of FIGS. 5 and 7 described above in the first embodiment. For example, in step S102, when the recognition unit 4 recognizes that the occupant has made a gesture of raising 1 to 5 fingers as a trigger action of the occupant, the setting unit 3 sets the gesture detection area in step S103. However, in the subsequent steps, the predetermined mechanism corresponding to the gesture may be operable.

[Embodiment 3]
A third embodiment of the present invention will be described below. In the present embodiment, an example of a configuration in which the vehicle control device displays a display screen for guiding a gesture by an occupant will be described.

FIG. 11 is a functional block diagram of a system included in the vehicle according to the present embodiment, which includes a vehicle control device 1b, a seat ECU 20, and a seat. As shown in FIG. 11, the vehicle control device 1b according to the present embodiment is configured to further include a display control unit 11 from the configuration of the vehicle control device 1 shown in FIG.

The display control unit 11 causes the occupant to display the display screen 12 for inducing the gesture by the occupant.

The display screen 12 displayed by the display control unit 11 may be a screen displayed on a display installed in the vehicle interior space so that the occupant can see it. FIG. 12 is a diagram showing an example of a display screen 12 displayed on the display.

In the example of FIG. 12, the display is provided behind the seat, and a passenger seated behind the seat visually recognizes the display. The display may be provided in front of the front seat, for example.

Further, on the display screen 12 of FIG. 12, it is suggested that the passenger can select the music in the audio equipment by performing the gesture of turning the knob with his / her finger.

Further, FIG. 13 shows the above-described configuration in the second embodiment in which the gesture is guided in a configuration in which a predetermined mechanism for operating the vehicle control device 1b is determined by a gesture in which the occupant raises 1 to 6 fingers as a trigger. The display screen 12 to be displayed is shown. However, in the example of FIG. 13, the display of the door equipment is omitted.

Further, the display screen 12 according to the present embodiment may be displayed on the touch panel. In FIG. 13, "the shape of the hand can also be selected" suggests that the occupant can determine the predetermined mechanism to be operated by the vehicle control device 1b by touching and selecting the user interface objects 71 to 75 on the touch panel. ing.

[Modification 1 of Embodiment 3]
The display screen 12 displayed by the display control unit 11 may be a screen projected in the vehicle interior space so that the occupant can see it.

Recent techniques for projecting a display screen in the air include the following examples.
"Sakitore | Latest use cases of" aerial display "that is also expanding into the entertainment industry", [online], Dentsu Tec, [Search on December 17, 2019], Internet (URL: https://bae.dentsutec.co .jp / articles / aska3d /)
FIG. 14 shows an example of the display screen 12 projected in the vehicle interior space. Further, on the display screen 12 of FIG. 14, it is suggested that the passenger can open and close the window in the window equipment by performing an operation of turning a finger.

[Modification 2 of Embodiment 3]
The vehicle control device 1 may be configured to guide the occupant's gesture by voice instead of the display screen. Further, the vehicle control device 1 according to the present modification that realizes the above configuration may further include a voice output unit that outputs a voice for inducing a gesture by the occupant to the occupant.

[Additional notes]
The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

1,1a, 1b Vehicle control device (gesture input ECU)
2 Detection unit 3 Setting unit 4 Recognition unit 5 Generation unit 6 Storage unit 7, 21 Reception unit 8, 26 Transmission unit 11 Display control unit 12 Display screen 20 Seat ECU
22 Operation request judgment unit 23 Control unit 40 Seat equipment

Claims (11)

A vehicle control device that activates a predetermined mechanism mounted on a vehicle by recognizing a gesture by an occupant staying in the passenger compartment space.
A detector that detects gestures by occupants staying in the passenger compartment,
With respect to the detection unit, a setting unit for setting a gesture detection region, which is a three-dimensional region in which the detection unit detects a gesture by the occupant in the vehicle interior space,
In the gesture detection area set by the setting unit, a recognition unit that recognizes the trajectory of the gesture detected by the detection unit, and
It is provided with a generation unit that generates operation information for specifying the operation content of the predetermined mechanism based on the locus of the gesture recognized by the recognition unit.
A vehicle control device characterized in that the predetermined mechanism is operated by using the operation information generated by the generation unit. The setting unit
The gesture detection region is set based on at least one of the seat information which is the information about the seat on which the occupant sits and the occupant information which is the information about at least one of the physique or the posture of the occupant. The vehicle control device according to claim 1. The vehicle control device according to claim 1 or 2, further comprising a transmission unit that transmits operation information generated by the generation unit to a control unit that operates the predetermined mechanism. The vehicle control device according to claim 1 or 2, further comprising a control unit that operates the predetermined mechanism using the operation information generated by the generation unit. The seat information, which is information about the seat on which the occupant sits, is information representing at least one of the position and angle of the seat.
The occupant information, which is information on at least one of the physique or posture of the occupant, is information representing at least one of the height and body orientation of the occupant.
The setting unit according to any one of claims 1 to 4, wherein the setting unit updates the setting of the gesture detection area when at least one of the seat information and the occupant information changes. Vehicle control device. The vehicle control device according to any one of claims 1 to 5, further comprising a display control unit for displaying a display screen for inducing a gesture by the occupant to the occupant. The vehicle control device according to claim 6, wherein the display screen is a screen displayed on a display installed in the passenger compartment space so that the occupant can see the display screen. The vehicle control device according to claim 6, wherein the display screen is a screen projected into the vehicle interior space so that the occupant can see it. The vehicle control device according to any one of claims 1 to 8, further comprising a voice output unit that outputs a voice for inducing a gesture by the occupant to the occupant. The predetermined mechanism is
Any one of claims 1 to 9, wherein the mechanism is related to at least one of a seat facility, a window facility, an air conditioning facility, a lighting facility, an audio facility, and a door facility mounted on the vehicle. The vehicle control device according to. The setting unit
Any one of claims 1 to 10, wherein the setting of the gesture detection area is started by triggering at least one of the predetermined gesture by the occupant and the predetermined voice input by the occupant. The vehicle control device according to the section.

Images