CN118107589A

CN118107589A - Vehicle, image sensing device, control method, control device and control equipment

Info

Publication number: CN118107589A
Application number: CN202410232586.8A
Authority: CN
Inventors: 朱帮守
Original assignee: Shanghai Jidu Automobile Co Ltd
Current assignee: Shanghai Jidu Automobile Co Ltd
Priority date: 2024-02-29
Filing date: 2024-02-29
Publication date: 2024-05-31

Abstract

Provided are a vehicle, an image sensing apparatus, a control method and apparatus, a storage medium, and a control device. The vehicle includes a steering wheel, an image sensing device, and a control device. The steering wheel is configured to receive a steering operation. The image sensing device is arranged on a side of the steering wheel away from the face of the driver and is configured to acquire face information of the driver and to acquire hand information of the driver located on a side of the steering wheel away from the face of the driver. The control device is configured to receive face information and hand information and generate control instructions according to the face information and/or the hand information. This approach helps to improve the technological feel of the vehicle and simplify the vehicle interior. In addition, the driver's face information and hand information are taken into account together to help control the vehicle correctly, reducing the risk of false control. In addition, through an image sensing device, the face information and the hand information of the driver in the driving process are acquired simultaneously, so that the vehicle interior space is saved, and the interior decoration is simplified.

Description

Vehicle, image sensing device, control method, control device and control equipment

Technical Field

The present disclosure relates to the field of vehicle control technology, and in particular, to a vehicle, an image sensing apparatus, a control method, a control apparatus, a control device, and a non-transitory computer readable storage medium.

Background

To meet various driving and usage needs, vehicles often include a variety of actuators. For example, the actuators may include a turn signal light set, an on-board multimedia system, an on-board air conditioning system, and the like. Corresponding to these actuators, various physical operating members such as levers, buttons, knobs, and the like are generally provided in the vehicle. An in-vehicle person can control the corresponding actuator by operating a certain operating member. Taking the turn signal group as an example, the driver can operate the turn signal lever to selectively control the turning on of the left and right turn signals. However, as vehicles develop intelligently, consumers increasingly prefer vehicles with outstanding technological feel and greatly simplified interior trim. Conventional vehicles employing more physical operating components are increasingly difficult to meet consumer demands.

Disclosure of Invention

In view of this, the present disclosure improves the control manner of the vehicle, and aims to solve the problem that the conventional vehicle employing more physical operation parts is difficult to satisfy the requirement of consumers for outstanding technological feel and greatly simplifying interior decoration.

In a first aspect, the present disclosure provides a vehicle. The present disclosure provides a vehicle including a steering wheel, an image sensing device, and a control device. The steering wheel is configured to receive a steering operation. The image sensing device is arranged on a side of the steering wheel away from the face of the driver and is configured to acquire face information of the driver and to acquire hand information of the driver located on the side of the steering wheel away from the face of the driver. The control device is configured to receive the face information and the hand information and generate a control instruction according to the face information and/or the hand information.

According to the vehicle provided by the disclosure, the control device generates the control instruction according to the face information of the driver and the hand information of the driver acquired by the image sensing device. This approach helps to improve the technological feel of the vehicle and to simplify the vehicle interior, thereby helping to better meet consumer demand. Furthermore, in this way, the face information and the hand information of the driver are taken into account together, which helps to control the vehicle correctly, reducing the risk of erroneous control. Further, in this implementation, the image sensing device is arranged on a side of the steering wheel away from the face of the driver, and is configured to acquire face information of the driver and to acquire hand information of the driver's hand on the side of the steering wheel away from the face of the driver. In this way, only one image sensing device can acquire the face information and the hand information of the driver in the driving process, which is helpful for saving the space in the vehicle and simplifying the interior decoration.

With the intelligent development of vehicles, in order to highlight the sense of science and technology and greatly simplify the interior decoration, some vehicles cancel the traditional turn signal lamp deflector rod and integrate the turn signal lamp starting function on the keys of the steering wheel. However, this modification receives negative feedback from the consumer. Drivers generally prefer to turn on the turn signal lamps by dialing the turn signal lamp shift lever, and the operation mode accords with the driving habit of the drivers without paying extra learning cost. In contrast, the turn signal lamp is turned on by pressing a key on the steering wheel, which does not conform to the driving habit of the driver. The driver can not timely and correctly turn on the corresponding steering indicating lamp due to empty or wrong pressing when blind pressing, and especially in a strenuous driving process, the poor use experience is caused.

In view of this, in one possible implementation, the vehicle further comprises a turn indicator light set. The turn signal lamp group comprises a left turn signal lamp and a right turn signal lamp. The control device is configured to selectively generate a control instruction for controlling the turning-on of the left turn signal lamp or a control instruction for controlling the turning-on of the right turn signal lamp in response to the acquired face information and hand information satisfying the turning-on condition.

The method improves the turning-on mode of the turn indicator lamp, and judges the intention of the driver through the obtained face information and hand information of the driver, so that the purpose of timely and accurately turning on the left turn indicator lamp and the right turn indicator lamp is achieved. The mode that this disclosure provided has cancelled the indicator driving lever to help improving the science and technology sense of vehicle and simplified the interior trim of vehicle. In addition, whether the turn indicator lamp is started or not is determined by combining the facial information and the hand information of the driver, and which turn indicator lamp is started is determined.

In one possible implementation, the control device is configured to: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the face of the driver rotating leftwards.

The experience of using the turn signal indicator lever helps the driver develop an inherent driving habit, namely, the driver swings the left hand upwards on the left side of the steering wheel to toggle the lever so as to turn on the left turn signal indicator; the left hand is swung upwards on the left side of the steering wheel to toggle the deflector rod so as to turn on the right steering indicating lamp. In coordination with the hand information, the driver naturally turns the face to a specific side to carefully observe the road conditions. In the implementation manner, the starting time of the left and right turn signals is determined by combining the swing direction of the left hand of the driver on the left side of the steering wheel and the rotation direction of the face, so that the starting accuracy of the turn signals can be ensured, and the inherent driving habit of the driver can be met.

In one possible implementation, the control device is configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

During a lane change or turn, the driver typically does not turn the face to a large extent, but turns the face to a small extent, and observes the road condition by turning the pupil to the left or right, for careful driving. In the implementation manner, the turn-on time of the left and right turn signals is determined by combining the swing direction of the left hand of the driver on the left side of the steering wheel and the rotation direction of the pupil, so that the turn signal lamp is turned on more accurately.

In one possible implementation, the image sensing device is mounted on a steering column of a steering wheel, the image sensing device including a facial image acquisition unit and a hand image acquisition unit, the facial image acquisition unit being located above the steering column, the hand image acquisition unit being located to the left of the steering column.

The face image acquisition unit located above the steering column can be substantially faced with the face, and thus an image of the face of the driver can be accurately acquired, and further the face information of the driver can be effectively acquired. At the same time, the hand image acquisition unit located on the left side of the steering column can accurately acquire an image of the left region of the steering wheel, and further can accurately acquire the swing motion of the left hand on the left side of the steering wheel. In general, the image sensing apparatus having the above-described configuration can accurately acquire the turning motion of the whole or part of the face (i.e., the pupil) of the driver, and accurately acquire the waving motion of the hand on the left side of the steering wheel. In addition, the image sensing device fully utilizes the space of the outer periphery of the steering column, and is beneficial to fully utilizing the space in the vehicle.

In one possible implementation, the image sensing device includes a housing including a large accommodating portion, a small accommodating portion, a first arm portion, and a second arm portion, the first arm portion and the second arm portion being disposed on opposite sides of the large accommodating portion, the small accommodating portion being disposed on the first arm portion; the large accommodating part accommodates at least part of the face image acquisition unit, and the small accommodating part accommodates at least part of the hand image acquisition unit; the large receiving portion, the first arm portion and the second arm portion are entirely partially wrapped around the steering column such that the large receiving portion is located above the steering column and the first arm portion is located on the left side of the steering column.

According to the above configuration of the image sensing device, after the image sensing device is mounted on the steering column, the face image acquisition unit is located above the steering column to acquire face information of the driver, and the hand image acquisition unit is located on the left side of the steering wheel to acquire hand information of the driver, so that the accuracy of turning on the turn-on of the turn signal lamp can be ensured, and the inherent driving habit of the driver can be met. Further, according to the above-described configuration of the image sensing device, the image sensing device can be attached to or detached from the steering column more conveniently. In addition, the image sensing device with the structure is compact in structure and small in size.

In one possible implementation, the face image acquisition unit and the hand image acquisition unit share the same image signal processing chip, and the image signal processing chip is housed in the large housing portion.

Since the large housing portion has a large capacity, the image signal processing chip can be further housed in the housing portion in order to further improve the structural compactness of the image sensing device, in addition to housing the face image acquisition unit. In addition, since the face and hand image acquisition units share the same image signal processing chip, the overall cost is low.

In one possible implementation, the large housing portion is provided with a coupling protrusion on a lower side thereof, and a coupling recess is provided on an upper side thereof, into which the coupling protrusion is inserted to fix the image sensing device to the steering column.

By the cooperation of the coupling convex portion and the coupling concave portion, the image sensing device can be more conveniently fixed to the steering column and can be more conveniently removed from the steering column. Further, the mating image sensing device of the coupling convex portion and the coupling concave portion can be firmly fixed to the steering column.

In one possible implementation, the underside of the large receptacle is provided with an output port, the upper side of the steering column is provided with an input port, and the output port and the input port are coupled to provide a communication connection between the image sensing device and the control device.

In this way, the output port on the lower side of the large housing portion can be coupled with the input port on the upper side of the steering column only by mounting the image sensing device in place on the steering column. Therefore, the disassembly and assembly processes of the image sensing device with the structure are more convenient.

In a second aspect, the present disclosure provides an image sensing apparatus. The image sensing device includes a face image acquisition unit, a hand image acquisition unit, and a housing. The face image acquisition unit is configured to acquire a face image of a driver. The hand image acquisition unit is configured to acquire a hand image of a driver. The housing includes a large receiving portion, a small receiving portion, a first arm portion, and a second arm portion. The first arm part and the second arm part are arranged on two opposite sides of the large accommodating part, and the small accommodating part is arranged on the first arm part. The large housing accommodates at least part of the face image capturing unit, and the small housing accommodates at least part of the hand image capturing unit. The large receiving portion, the first arm portion and the second arm portion are integrally configured to partially surround the steering column of the steering wheel such that the large receiving portion is located above the steering column and the first arm portion is located on the left side of the steering column.

In one possible implementation, the underside of the large receptacle is provided with an output port, the upper side of the steering column is provided with an input port, and the output port and the input port are coupled to provide a communication connection between the image sensing device and a control device configured to be responsive to the image sensing device.

In a third aspect, the present disclosure provides a control method. The control method comprises the following steps: acquiring face information of a driver's face located in front of a steering wheel of a vehicle and acquiring hand information of a driver's hand located on a side of the steering wheel away from the driver's face; and generating a control instruction according to the acquired facial information and/or hand information.

In one possible implementation, generating a control instruction according to the acquired face information and hand information includes: and selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information meeting the turning-on condition.

In one possible implementation, selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information satisfying the on condition includes: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver being swung downwards at the left side of the steering wheel and the face of the driver being turned leftwards.

In one possible implementation, selectively generating a control instruction to control the left turn signal lamp to be turned on or generating a control instruction to control the right turn signal lamp to be turned on in response to the acquired face information and hand information satisfying the turn-on condition includes: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

In a fourth aspect, the present disclosure provides a control device. The control device comprises an acquisition module and a control module. The acquisition module is configured to acquire face information of a face of a driver located in front of the steering wheel and to acquire hand information of a hand of the driver located on a side of the steering wheel away from the face of the driver. The control module is configured to generate control instructions according to the acquired facial information and/or hand information.

In one possible implementation, the control module is configured to: and selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information meeting the turning-on condition.

In one possible implementation, the control module is configured to: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver being swung downwards at the left side of the steering wheel and the face of the driver being turned leftwards.

In one possible implementation, the control module is configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

In a fifth aspect, the present disclosure provides a control apparatus. The control device includes a processor and a memory. The memory has stored thereon program instructions that, when executed by the processor, cause the processor to perform the control method provided in the third aspect above, and is coupled to the processor.

In a sixth aspect, the present disclosure provides a non-transitory computer readable storage medium. The non-transitory computer readable storage medium has stored thereon program instructions that, when executed by a processor, cause the processor to perform the control method provided in the third aspect above.

In a seventh aspect, the present disclosure also provides a computer product. The computer product may comprise program instructions which, when executed by a processor, cause the processor to perform the control method provided in the third aspect above.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings that are required to be used in the embodiments will be briefly described below.

It is appreciated that the following drawings depict only certain embodiments of the disclosure and are not to be considered limiting of its scope.

It should also be understood that the same or similar reference numerals are used throughout the drawings to designate the same or similar elements.

It should also be understood that the drawings are merely schematic and that the dimensions and proportions of the elements in the drawings are not necessarily accurate.

Fig. 1 is a schematic structural view of a vehicle according to an embodiment of the present disclosure.

Fig. 2 is a schematic structural view showing the interior of the vehicle in fig. 1.

Fig. 3 is a schematic diagram of hand information of a driver in the vehicle in fig. 2.

Fig. 4 is a schematic diagram of face information of a driver in the vehicle in fig. 2.

Fig. 5 is a schematic structural view of a steering wheel and an image sensing device of the vehicle of fig. 2.

Fig. 6 is an exploded schematic view of the steering wheel and the image sensing device of the vehicle of fig. 2.

Fig. 7 is a schematic structural view of an image sensing device of the vehicle in fig. 5.

Fig. 8 is a schematic cross-sectional view taken along line A-A in fig. 7.

Fig. 9 is a schematic diagram of the image sensing apparatus of fig. 5.

Fig. 10 is a schematic structural view of an image acquisition unit according to an embodiment of the present disclosure.

Fig. 11 is an exploded schematic view of the image acquisition unit in fig. 10.

Fig. 12 is a flow chart of a vehicle control method according to an embodiment of the present disclosure.

Fig. 13 is a schematic view of a vehicle control apparatus according to an embodiment of the present disclosure.

Fig. 14 is a schematic view of a vehicle control apparatus according to an embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be illustrated below with reference to the accompanying drawings. It should be understood that the implementations of the present disclosure may be varied and should not be construed as limited to the embodiments set forth herein, which are presented only for a more thorough and clear understanding of the present disclosure.

Exemplary vehicle

The present disclosure provides a vehicle 100. Referring to fig. 1 and 2, the vehicle 100 includes an actuator 10, an image sensing device 20, a control device 30, and a steering wheel 41. The steering wheel 41 is configured for a driver to input a steering operation. The image sensing device 20 is arranged on a side of the steering wheel 41 away from the face of the driver, and is configured to acquire face information of the driver and to acquire hand information of the driver's hand on a side of the steering wheel 41 away from the face of the driver. The control device 30 is configured to receive face information and hand information and generate control instructions based on the face information and/or the hand information.

According to the vehicle 100 provided by the present disclosure, the control device 30 generates a control instruction from the face information of the driver and the hand information of the driver acquired by the image sensing device 20. This approach helps to improve the technological feel of the vehicle and to simplify the vehicle interior, thereby helping to better meet consumer demand. Furthermore, in this manner, the driver's face information and hand information are taken into account together, which helps to control the vehicle 100 correctly, reducing the risk of false control. Further, in this implementation, the image sensing device 20 is arranged on the side of the steering wheel 41 away from the face of the driver, and is configured to acquire face information of the driver and to acquire hand information of the driver's hand on the side of the steering wheel 41 away from the face of the driver. In this way, only by one image sensing device 20, the face information and the hand information of the driver during driving can be acquired at the same time, which helps to save the vehicle interior space and simplify the interior decoration.

In view of this, in some examples of the present disclosure, the performing device 10 may be a turn signal light set 10, which may include a left turn signal light 10 (10 a) and a right turn signal light 10 (10 b). The control device 30 may be configured to selectively generate a control instruction to control the turning on of the left turn signal lamp 10 (10 a) or a control instruction to control the turning on of the right turn signal lamp 10 (10 b) in response to the acquired face information and hand information satisfying the turning-on condition.

The present disclosure is not particularly limited with respect to face information and hand information satisfying the opening condition. These actions need to be easily made by the driver and they need to be easily and accurately identified. Several exemplary facial information and hand information are given below in conjunction with fig. 3 and 4.

As an example, referring to fig. 3 and 4, the hand information satisfying the opening condition may be a left hand of the driver waving up or down on the left side of the steering wheel, and the face information satisfying the opening condition may be a face of the driver turning left or right, where the face may be the entirety of the face. Specifically, as shown in fig. 3 and 4, the control device 30 may be configured to: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the face of the driver rotating leftwards.

As another example, with continued reference to fig. 3 and 4, the hand information satisfying the opening condition may be that the left hand of the driver swings up or down on the left side of the steering wheel, the face information satisfying the opening condition may be that the pupil of the driver rotates left or right, where the pupil may be regarded as a part of the face, and the pupil motion may be regarded as a partial motion of the face. Specifically, as shown in fig. 3 and 4, the control device 30 may be configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

As another example, with continued reference to fig. 3 and 4, the hand information satisfying the opening condition may be that the left hand of the driver swings upward or downward in the left side of the steering wheel, and the face information satisfying the opening condition may be that the face and the pupil of the driver simultaneously rotate left or right. Specifically, as shown in fig. 3 and 4, the control device 30 may be configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition that the left hand of the driver swings upwards on the left side of the steering wheel and the face and the pupil of the driver rotate rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the face and the pupil of the driver rotating leftwards.

The implementation mode simultaneously considers the whole rotation of the face and the rotation of the pupil, so that the turn-on accuracy of the turn-on indicator lamp is better.

Exemplary image sensing apparatus

There are various implementations of the image sensing device 20, which the present disclosure does not particularly limit. Next, the image sensing device 20 is illustrated with reference to fig. 5 to 11.

Referring to fig. 5, the image sensing device 20 may be mounted on a steering column 42 of a steering wheel 41, the image sensing device 20 including a face image acquisition unit 21 and a hand image acquisition unit 22, the face image acquisition unit 21 being located above the steering column 42, the hand image acquisition unit 22 being located on the left side of the steering column 42.

The face image acquisition unit 21 located above the steering column 42 can be substantially faced to the face, and thus an image of the face of the driver can be accurately acquired, and further the face information of the driver can be effectively acquired. At the same time, the hand image acquisition unit 22 located on the left side of the steering column 42 can accurately acquire an image of the left region of the steering wheel 41, and thus can accurately acquire the swing motion of the left hand on the left side of the steering wheel 41. In general, the image sensing device 20 having the above-described configuration can accurately acquire the turning motion of the whole or part of the face (i.e., the pupil) of the driver, and accurately acquire the waving motion of the hand on the left side of the steering wheel 41. Further, such an image sensing device 20 makes full use of the space on the outer periphery of the steering column 42, which is advantageous in making full use of the space in the vehicle.

The image sensing device 20 may also be mounted at other locations, such as at the dashboard. The present disclosure is not particularly limited as long as it is capable of accurately acquiring the turning motion of the whole or part of the face (i.e., the pupil) of the driver and accurately acquiring the swinging motion of the hand on the left side of the steering wheel 41.

Referring to fig. 5 to 8, the image sensing device 20 may further include a housing. The housing includes a large receiving portion 231, a small receiving portion 232, a first arm 233, and a second arm 234. The first arm 233 and the second arm 234 are disposed on opposite sides of the large receiving portion 231, and the small receiving portion 232 is disposed on the first arm 233. The large housing 231 houses at least part of the face image acquisition unit 21, and the face image acquisition unit 21 is configured to acquire a face image of the driver. The small housing 232 houses at least part of the hand image acquisition unit 22, and the hand image acquisition unit 22 is configured to acquire a hand image of the driver. The entire configuration of the large receiving portion 231, the first arm portion 233, and the second arm portion 234 is such as to partially wrap around the steering column 42 such that the large receiving portion 231 is located above the steering column 42 and the first arm portion 233 is located on the left side of the steering column 42.

According to the above-described configuration of the image sensing device 20, after being mounted on the steering column 42, the face image acquisition unit 21 will be located above the steering column 42 to acquire face information of the driver, and the hand image acquisition unit 22 will be located on the left side of the steering wheel 41 to acquire hand information of the driver, so that it is possible to ensure both the accuracy of turning on the turn signal lamp and to conform to the inherent driving habit of the driver. Further, according to the above-described configuration of the image sensing device 20, the image sensing device 20 can be easily attached to the steering column 42 or easily detached from the steering column 42. In addition, the image sensing device 20 having the above-described configuration is compact and small in size.

It will be appreciated that in other examples, the image sensing device 20 may comprise two separate housing portions that may be located above and to the left of the steering column 42 of the steering wheel, respectively, the housing portion located above the steering column 42 of the steering wheel may be used to mount the facial image acquisition unit 21, and the housing portion located to the left of the steering column 42 of the steering wheel may be used to mount the hand image acquisition unit 22.

Referring to fig. 8 and 11, the face image acquisition unit 21 and the hand image acquisition unit 22 may share the same image signal processing chip 50, which is advantageous in reducing the overall cost. Further, referring to fig. 8, the image signal processing chip 50 may be received in the large receiving portion 231. The large housing 231 has a large volume, and thus can further house the image signal processing chip 50 in addition to the face image acquisition unit 21, which is advantageous in improving the structural compactness of the image sensing device 20.

Referring to fig. 5 to 7, the lower side of the large receiving portion 231 may be provided with a coupling protrusion 235, the upper side of the steering column 42 may be provided with a coupling recess 421, and the coupling protrusion 235 may be inserted into the coupling recess 421 to fix the image sensing device 20 to the steering column 42. By the engagement of the engaging convex portion 235 and the engaging concave portion 421, the image sensing device 20 can be easily fixed to the steering column 42 and can be easily removed from the steering column 42. Further, the mating image sensing device 20 of the coupling convex portion 235 and the coupling concave portion 421 can be firmly fixed to the steering column 42.

It will be appreciated that there are many ways of securing the image sensing device 20 to the steering column 42, and this is not limited to the above. For example, in some alternative examples, the image sensing device 20 may be secured to the steering column 42 by bolting or direct bonding, or the like.

With continued reference to fig. 5-7, the underside of the large receptacle 231 may be provided with an output port 236 and the upper side of the steering column 42 may be provided with an input port 422, the output port 236 and the input port 422 being coupled to provide a communication connection between the image sensing device 20 and the control device 30.

In this way, the image sensing device 20 is only required to be mounted in place on the steering column 42, so that the output port 236 on the lower side of the large housing 231 can be coupled with the input port 422 on the upper side of the steering column 42. It can be seen that the disassembly and assembly of the image sensing device 20 in this configuration is more convenient.

The present disclosure is not particularly limited as to the implementation of the face image acquisition unit 21 and the hand image acquisition unit 22, as long as an image of a target portion or area can be acquired. In particular, the resolution of the facial image acquisition unit 21 may be higher than the resolution of the hand image acquisition unit 22, as more valuable motion details may be acquired from the face. For example, the resolution of the face image acquisition unit 21 may be higher than 2M, and the resolution of the hand image acquisition unit 22 may be 1M or less. Next, a specific configuration of the image acquisition unit 60 is given in conjunction with fig. 9 to 11. The image acquisition unit 60 may refer to any one of the face image acquisition unit 21 and the hand image acquisition unit 22.

As shown in fig. 9 to 11, the image acquisition unit 60 may include a lens 61, a printed circuit board 62, an image sensing device 63, an LED driver 64, an LED lamp 65, and an output terminal 66. The image sensor 63, the LED driver 64, the LED lamp 65, and the output terminal 66 may be fixed on the circuit board 62. The image acquisition unit 60 may output a signal through the output 66, which is supplied to the image signal processing chip 50.

It should be understood that the above description is merely illustrative of an image sensing device, and that in other examples of the present disclosure, other implementations of an image sensing device may also be employed. For example, in one example, the image sensing device may have only one image acquisition unit, which may be a wide-angle image acquisition unit, that is, a wide-angle camera, which may be located on a side of the steering wheel away from the face of the driver, so as to simultaneously acquire face information of the driver and hand information of the driver's hand located on a side or sides of the steering wheel away from the face of the driver in the driving state.

Exemplary vehicle control methods

The present disclosure provides a vehicle control method S100. The vehicle control method S100 may be implemented on the vehicle 100 mentioned above. Of course, the vehicle control method S100 may be implemented on a vehicle having another configuration. Referring to fig. 12, the vehicle 100 control method may include step S101 and step S102.

In step S101, face information of a face of a driver located in front of a steering wheel of a vehicle is acquired and hand information of a hand of the driver located on a side of the steering wheel away from the face of the driver is acquired. For example, the face information and the hand information of the driver may be acquired by the aforementioned image sensing device 20.

In step S102, a control instruction is generated according to the acquired face information and/or hand information. This step may be performed, for example, by the control device 30 mentioned previously.

Further, step S102 may specifically be: and selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information meeting the turning-on condition.

Further, step S102 may specifically be: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver being swung downwards at the left side of the steering wheel and the face of the driver being turned leftwards.

Alternatively, step S102 may specifically be: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

Alternatively, step S102 may specifically be: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition that the left hand of the driver swings upwards on the left side of the steering wheel and the face and the pupil of the driver rotate rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the face and the pupil of the driver rotating leftwards.

Exemplary vehicle control apparatus

The method embodiment of the present disclosure is described above with reference to fig. 12, and the apparatus embodiment provided by the present disclosure is described below. It will be appreciated that the apparatus embodiments and the method embodiments are in one-to-one correspondence, and duplicate descriptions are omitted as appropriate for the sake of brevity.

The present disclosure provides a vehicle control apparatus 200. Referring to fig. 13, the vehicle control apparatus 200 may include an acquisition module 201 and a control module 202. The acquisition module 201 may be configured to acquire face information of a face of a driver located in front of the steering wheel and to acquire hand information of a hand of the driver located on a side of the steering wheel away from the face of the driver. The control module 202 may be configured to generate control instructions based on the acquired facial information and/or hand information.

Further, the control module 202 may be specifically configured to: and selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information meeting the turning-on condition.

Further, the control module 202 may be specifically configured to: generating a control instruction for controlling the right turn signal lamp to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the face of the driver turning rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver being swung downwards at the left side of the steering wheel and the face of the driver being turned leftwards.

Alternatively, the control module 202 may also be specifically configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the rotation of the pupil of the driver to the right; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the pupil of the driver rotating leftwards.

Alternatively, the control module 202 may also be specifically configured to: generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition that the left hand of the driver swings upwards on the left side of the steering wheel and the face and the pupil of the driver rotate rightwards; and/or generating a control instruction for controlling the left turn indicator to be turned on in response to the left hand of the driver swinging downwards at the left side of the steering wheel and the face and the pupil of the driver rotating leftwards.

Exemplary device controlling apparatus

The present disclosure provides a vehicle control apparatus 300. Referring to fig. 14, the vehicle control apparatus 300 includes a processor 301 and a memory 302. The memory 302 has stored thereon program instructions that, when executed by the processor 301, cause the processor 301 to execute the vehicle control method S100 provided by the present disclosure, and is coupled to the processor 301.

Exemplary non-transitory computer readable storage Medium

The present disclosure provides a non-transitory computer readable storage medium. The non-transitory computer readable storage medium has stored thereon program instructions that, when executed by a processor, cause the processor to perform the vehicle control method S100 provided by the present disclosure.

Exemplary computer product

The present disclosure provides a computer product that may include program instructions that, when executed by a processor, cause the processor to perform the vehicle control method S100 provided by the present disclosure.

The above embodiments are only some, but not all, of the embodiments of the present disclosure. For example, in some embodiments, the executing device may be an on-vehicle air conditioner or an on-vehicle multimedia, and is not limited to the turn signal lamp set.

It should be understood that the term "include" and variations thereof as used in this disclosure are intended to be open-ended, i.e., including, but not limited to. The term "according to" is based, at least in part, on. The term "one embodiment" means "a pair of embodiments"; the term "another embodiment" means "a pair of additional embodiments".

It should be understood that although the terms "first" or "second" and the like may be used in this disclosure to describe various elements (e.g., a first arm and a second arm), these elements are not provided by these terms, which are merely used to distinguish one element from another element.

The protective scope of the present disclosure is not limited to the embodiments described above, and any person skilled in the art should conceive of changes or substitutions within the technical scope of the present disclosure, which are intended to be covered in the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A vehicle, characterized by comprising:

a steering wheel configured to receive a steering operation;

An image sensing device disposed on a side of the steering wheel away from a face of a driver and configured to acquire face information of the driver and to acquire hand information of the driver on the side of the steering wheel away from the face of the driver; and

And the control device is configured to receive the face information and the hand information and generate control instructions according to the face information and/or the hand information.

2. The vehicle of claim 1, further comprising a turn signal light set comprising a left turn signal light and a right turn signal light; the control device is configured to selectively generate a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and hand information satisfying an on condition.

3. The vehicle according to claim 2, characterized in that the control device is configured to:

generating a control instruction for controlling the right turn indicator to be turned on in response to the acquisition of the left hand of the driver swinging upwards on the left side of the steering wheel and the right turning of the face of the driver; and/or

And generating a control instruction for controlling the left turn indicator lamp to be turned on in response to the condition that the left hand of the driver swings downwards at the left side of the steering wheel and the face of the driver turns leftwards.

4. The vehicle according to claim 2, characterized in that the control device is configured to:

Generating a control instruction for controlling the right turn indicator lamp to be turned on in response to the acquisition that the left hand of the driver swings upwards on the left side of the steering wheel and the pupil of the driver rotates rightwards; and/or

And generating a control instruction for controlling the left turn indicator lamp to be started in response to the condition that the left hand of the driver swings downwards at the left side of the steering wheel and the pupil of the driver rotates leftwards.

5. The vehicle according to any one of claims 1 to 4, characterized in that the image sensing device is mounted on a steering column of the steering wheel, the image sensing device comprising a face image acquisition unit and a hand image acquisition unit, the face image acquisition unit being located above the steering column, the hand image acquisition unit being located on the left side of the steering column.

6. The vehicle of claim 5, wherein the image sensing device comprises a housing comprising a large receiving portion, a small receiving portion, a first arm portion, and a second arm portion, the first arm portion and the second arm portion being disposed on opposite sides of the large receiving portion, the small receiving portion being disposed on the first arm portion; the large housing portion accommodates at least part of the face image acquisition unit, and the small housing portion accommodates at least part of the hand image acquisition unit; the large receiving portion, the first arm portion and the second arm portion are entirely partially wrapped around the steering column such that the large receiving portion is located above the steering column and the first arm portion is located on the left side of the steering column.

7. The vehicle according to claim 6, wherein the face image acquisition unit and the hand image acquisition unit share the same image signal processing chip, the image signal processing chip being housed in the large housing portion.

8. The vehicle according to claim 6, characterized in that a coupling protrusion is provided on a lower side of the large housing portion, and a coupling recess is provided on an upper side of the steering column, the coupling protrusion being inserted into the coupling recess to fix the image sensing device to the steering column.

9. The vehicle of claim 6, wherein an underside of the large receptacle is provided with an output port and an upper side of the steering column is provided with an input port, the output port and the input port being coupled to provide a communication connection between the image sensing device and the control device.

10. An image sensing apparatus, comprising:

a face image acquisition unit configured to acquire a face image of a driver;

a hand image acquisition unit configured to acquire a hand image of a driver; and

The shell comprises a large accommodating part, a small accommodating part, a first arm part and a second arm part, wherein the first arm part and the second arm part are arranged on two opposite sides of the large accommodating part, and the small accommodating part is arranged on the first arm part; the large housing portion accommodates at least part of the face image acquisition unit, and the small housing portion accommodates at least part of the hand image acquisition unit; the large receiving portion, the first arm portion and the second arm portion are integrally configured to partially encircle a steering column of a steering wheel such that the large receiving portion is located above the steering column and the first arm portion is located on a left side of the steering column.

11. The image sensing device according to claim 10, wherein the face image acquisition unit and the hand image acquisition unit share the same image signal processing chip, the image signal processing chip being housed in the large housing portion.

12. The image sensing device according to claim 10, wherein a coupling protrusion is provided at a lower side of the large receiving portion, and a coupling recess is provided at an upper side of the steering column, the coupling protrusion being inserted into the coupling recess to fix the image sensing device to the steering column.

13. The image sensing device of claim 10, wherein an underside of the large receptacle is provided with an output port and an upper side of the steering column is provided with an input port, the output port and the input port being coupled to provide a communication connection between the image sensing device and a control device configured to be responsive to the image sensing device.

14. A control method, characterized by comprising:

acquiring face information of a face of a driver located in front of a steering wheel of a vehicle and acquiring hand information of the driver located on a side of the steering wheel away from the face of the driver; and

And generating a control instruction according to the acquired facial information and/or the acquired hand information.

15. The control method according to claim 14, wherein the generating a control instruction from the acquired face information and hand information includes:

and selectively generating a control instruction for controlling the left turn signal lamp to be turned on or a control instruction for controlling the right turn signal lamp to be turned on in response to the acquired face information and the acquired hand information meeting the turning-on condition.

16. The control method according to claim 15, wherein the selectively generating a control instruction to control turning on of a left turn signal lamp or a control instruction to control turning on of a right turn signal lamp in response to the acquired face information and hand information satisfying an on condition, comprises:

17. The control method according to claim 15, wherein the selectively generating a control instruction to control turning on of a left turn signal lamp or a control instruction to control turning on of a right turn signal lamp in response to the acquired face information and hand information satisfying an on condition, comprises:

18. A control apparatus, characterized by comprising:

An acquisition module configured to acquire face information of a face of a driver located in front of a steering wheel and acquire hand information of the driver located on a side of the steering wheel away from the face of the driver; and

And the control module is configured to generate a control instruction according to the acquired facial information and/or the acquired hand information.

19. A control apparatus, characterized by comprising:

A processor; and

A memory having stored thereon program instructions and coupled to the processor, the program instructions when executed by the processor cause the processor to perform the control method of any of claims 14 to 17.

20. A non-transitory computer readable storage medium, having stored thereon program instructions that, when executed by a processor, cause the processor to perform the control method of any of claims 14 to 17.