KR101960723B1 - Smart car control system using motion recognition - Google Patents

Abstract

Provided is a vehicle control system, increasing price competitiveness while precisely recognizing the location and motion of a user by using a three-dimensional (3D) information generator based on the LiDAR principle. The vehicle control system is disposed in a vehicle to control functions of the vehicle in accordance with 3D information on a user. Moreover, the vehicle control system comprises: a 3D information generator generating 3D information by sensing the user; and an electronic control unit controlling functions of the vehicle in accordance with the 3D information. The 3D information generator includes a case, a substrate disposed on the case, and light sources and sensors mounted on the substrate. Furthermore, the 3D information is generated by using time at which emitted light of the light sources is irradiated to the sensors after passing through the user.

Description

[0001] SMART CAR CONTROL SYSTEM USING MOTION RECOGNITION USING MOTION RECOGNITION [0002]

The present invention relates to a smart car control system using motion recognition.

With the development of automatic driving, Internet of Things (IoT) and smart car technology, the driver is able to recognize, (Smart car) that controls various functions (options) of a car by recognizing user information (user's motion; biometric information, etc.) is being released.

On the other hand, the three-dimensional information generating device refers to a device that moves the position or motion of an object or a person to the digital using a sensor. In particular, the methods of motion recognition are classified into mechanical (contact and non-contact), magnetic, and optical.

Light detection and ranging (LIDAR) is a device that measures the distance or atmospheric phenomenon by emitting pulsed laser light into the atmosphere and using the reflector or scattering body, which is also called a laser radar. The time measurement of reflected light is calculated by clock pulse, and its resolution is 5cm at its frequency of 30MHz and 1m at 150MHz, which shows superior detection efficiency than conventional cameras or sensors.

Therefore, if a smart car recognizes a user's motion by using a three-dimensional information generation device (in the past, by analyzing an image captured by a camera and recognizing the user's position and motion) using the principle of Lada, Control will be possible.

In addition, the 3D information generating device to which the principle of Lada is applied is advantageous in terms of price competitiveness because it is low in manufacturing cost compared to the conventional camera module.

The object of the present invention is to provide a vehicle control system capable of accurately recognizing the position and motion of a user and enhancing price competitiveness by using a three-dimensional information generating device to which the principle of Lada is applied.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems which are not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided an automobile control system for controlling a function of an automobile in accordance with three-dimensional information of a user, the automobile control system comprising: Dimensional information generating device; And an electronic control unit for controlling the function of the vehicle according to the three-dimensional information, wherein the three-dimensional information generating device includes a case, a substrate disposed in the case, and a light source and a sensor mounted on the substrate, The three-dimensional information can be generated using the time that the emitted light passes through the user and then irradiated to the sensor.

And a display in which a plurality of automobile control icons are displayed, wherein the three-dimensional information may include first information about motion in which the user selects at least one of the plurality of control icons.

Wherein the three-dimensional information includes third information about a location of a user in a room of an automobile, and the three-dimensional information includes at least one of a three-dimensional information about a motion for performing at least one of a plurality of automobile- 2 < / RTI > information.

The plurality of automobile control motions stored in the database may include one wake-up motion and a plurality of control signal motions connected in a time-series manner with the one wake-up motion.

The electronic control unit may use the third information to specify a user at a position stored in the database and to control the function of the vehicle according to the three-dimensional information on the motion of the specified user have.

The three-dimensional information includes fourth information on the attitude of the user, and the electronic control unit can use the fourth information to determine whether the posture of the user is in a dangerous posture and provide an alarm to the user.

The alarm may be implemented as a warning sound.

Wherein the three-dimensional information includes third information about a position of a user in a room of an automobile and fourth information about a posture of the user, wherein the electronic control unit, when an impact is detected, 4 information among the plurality of airbags according to at least one of the plurality of airbags.

The present invention provides a vehicle control system capable of accurately recognizing three-dimensional information (motion, position, posture, etc.) of a user by using a three-dimensional information generating device operating on the principle of Lada and controlling functions of the vehicle.

Further, the present invention provides an automobile control system capable of reducing an injury of a user (particularly, in an autonomous driving mode) by controlling an airbag according to a position and a posture of a user.

The effects of the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description.

1 is a conceptual diagram showing a vehicle control system of the present invention.
2 is a perspective view showing a three-dimensional information generating device of the present invention.
3 is an exploded view showing a three-dimensional information generating device of the present invention.
4 and 5 are perspective views showing a three-dimensional information generating apparatus according to the present invention.
6 is a conceptual diagram showing that an air bag to be operated is selected among a plurality of air bags according to the position of the user and the attitude of the user.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention, and the manner of achieving them, will be apparent from and elucidated with reference to the embodiments described hereinafter in conjunction with the accompanying drawings. It should be understood, however, that the invention is not limited to the disclosed embodiments, but may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, Is provided to fully convey the scope of the present invention to a technician, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms " comprises "and / or" comprising "used in the specification do not exclude the presence or addition of one or more other elements in addition to the stated element. Like reference numerals refer to like elements throughout the specification and "and / or" include each and every combination of one or more of the elements mentioned. Although "first "," second "and the like are used to describe various components, it is needless to say that these components are not limited by these terms. These terms are used only to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical scope of the present invention.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense that is commonly understood by one of ordinary skill in the art to which this invention belongs. In addition, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

The terms spatially relative, "below", "beneath", "lower", "above" and "upper" And can be used to easily describe a correlation between an element and other elements. Spatially relative terms should be understood in terms of the directions shown in the drawings, including the different directions of components at the time of use or operation. For example, when inverting an element shown in the figures, an element described as "below" or "beneath" of another element may be placed "above" another element . Thus, the exemplary term "below" can include both downward and upward directions. The components can also be oriented in different directions, so that spatially relative terms can be interpreted according to orientation.

Hereinafter, the vehicle control system 100 of the present invention will be described with reference to the drawings. 1 is a conceptual diagram showing a vehicle control system of the present invention.

The automotive control system 100 of the present invention recognizes the user's motion, position, attitude, and the like, and controls (30-1) the function of the automobile accordingly. In this case, the "user" may be a driver, a passenger, or a concept including both a driver and a passenger. The term " automobile function "may be a concept that includes all commonly known automobile functions. For example," automobile window opening and closing ", "shift of vehicle gear ", & , "Car chair driving (including tilting) "," car lamp control ", and the like.

The automotive control system 100 of the present invention may include a display 10, a three-dimensional information generating device 20 and an electric control unit 30 (ECU).

Various information can be displayed on the display 10. In one example, the display 10 communicates with the three-dimensional information generating device 20 so that various notifications can be displayed accordingly. In addition, a plurality of automobile control icons 10-1 may be displayed on the display 10. [

The display 10 may be disposed in a center fascia of the vehicle. However, the present invention is not limited thereto, and the display 10 may be disposed at various positions of the automobile. As an example, a windshield glass of a car may be used for the display 10. [ More specifically, the windshield glass is provided with an organic light emitting diode (OLED), and can provide a sight to the driver as a light-transmitting glass in a passive driving mode of the automobile. In the autonomous driving mode of the automobile, 10-1) so that the user can control the automobile by the motion selected by the user. In addition, the windshield glass may provide various contents (for example, surrounding restaurant information, etc.) as well as a plurality of automobile control icons 10-1.

Furthermore, the display 10 may be provided in the form of a head up display (HUD), a pop up display, and a hologram display.

Hereinafter, the three-dimensional information generating device 20 of the present invention will be described with reference to the drawings. FIG. 2 is a perspective view showing a three-dimensional information generating device of the present invention, FIG. 3 is an exploded view showing a three-dimensional information generating device of the present invention, and FIGS. 4 and 5 are perspective views showing a three- .

The principle of light detection and ranging (LiDAR) may be applied to the three-dimensional information generating device 20 of the present invention. That is, the position and depth information of the user, such as 3D Depth information, etc., can be obtained by using the time (ToF) that the emitted light of the light source 24 is irradiated to the sensor 25 after passing through the user And various kinds of three-dimensional information can be generated by processing (for example, applying an interaction processing technique).

The three-dimensional information generating device 20 of the present invention includes a first case 21, a second case 22, a third case 23, a light source 24, a sensor 25, a mirror 26, a motor 27, a first substrate 28, and a second substrate 29.

In this case, at least one of the first case 21, the second case 22 and the third case 23 may be collectively referred to as a "case ", and the first substrate 28 and the second substrate 29 ) May be collectively referred to as a "substrate ".

The "case" may include a first case 21, a second case 22, and a third case 23. The first case 21, the second case 22 and the third case 23 may be members forming the appearance of the three-dimensional information generating device 20 of the present invention. The first case 21, the second case 22, and the third case 23 may contain various electronic components and optical components.

The first case 21 and the second case 22 may be made of plastic injection molding and may be spaced apart from each other. The first case 21 may be positioned on the upper side and the second case 22 may be positioned on the lower side and the third case 23 may be disposed between the first case 21 and the second case 22. [ Can be disposed.

The first case 21 may include a light source 24, a sensor 25 and a first substrate 28. The second case 22 may include a motor 27 and a second substrate 29 Can be embedded. Accordingly, in the three-dimensional information generating device 20 of the present invention, the light source and the sensors 24 and 25 are separated from the motor 27, It is possible to prevent the optical alignment of the light guide plate 10 from being disturbed. Furthermore, the three-dimensional information generating device 20 of the present invention can have a size and shape suitable for carrying (portability) due to its compact arrangement.

The third case 23 may include a transparent portion 23-1, a first bracket portion 23-2, and a second bracket portion 23-3. The transparent portion 23-1 may be hollow and may include a mirror 26 and may be formed of a light transmitting material. Therefore, the light emitted from the light source 24 and the light irradiated to the sensor 25 via the user can be transmitted through the transparent portion 23-1 and directed to the user and the sensor 25, respectively.

The first bracket portion 23-2 can be disposed on one side (upper side) of the transparent portion 23-1 and can support the first case 21. [ To this end, the first bracket portion 23-2 may be formed with a plurality of support rods disposed on the inner surface of the side plate of the first case 21. [

The second bracket portion 23-3 can be disposed at the other end (lower end) of the transparent portion 23-1 and can support the second case 22. To this end, the second bracket portion 23-3 may be provided with a plurality of support rods disposed on the inner surface of the side plate of the second case 22. [

The light source 24 may be an element that emits light, and the sensor 25 may be a sensor that senses light. The light emitted from the light source 24 can be reflected by the mirror 26 and irradiated to the user. Light passing through the user may be reflected by the mirror 26 and acquired by the sensor 25 and output as a signal for three-dimensional information.

The light source 24 and the sensor 25 may be mounted on the first substrate 28 and mounted on the first substrate 28 on the side opposite to the mirror 26.

The mirror 26 may be embedded in the third case 23. The mirror 26 can be rotated by the motor 27. The light emitted from the light source 24 can be distributed by the rotation of the mirror 26 to form a wide motion recognition scanning area. On the other hand, the mirror 26 may be disposed obliquely to the optical axis of the outgoing light of the light source 24 by an optical design request. That is, the rotational axis of the mirror 26 is aligned with the optical axis of the emitted light of the light source 24, and the mirror 26 is disposed obliquely at an angle of about 45 degrees so that the outgoing light is roughly forward, As shown in FIG.

The motor 27 may be disposed in the second case 22. The motor 27 is mounted on the second substrate 29 and can be supplied with power and control signals, thereby enabling the mirror 26 to rotate.

The motor 27 may include a body 27-1, a shaft 27-2, and a support 27-3. The main body 27-1 may be disposed on a surface (lower surface) of the second substrate 29 which is located on the opposite side to the surface facing the mirror 26. [ The shaft 27-2 may extend upward from the main body 27-1 and may pass through the second substrate 29. [ That is, the shaft 27-2 may extend from the lower surface of the second substrate 29 to the upper side of the second substrate 29 through the second substrate 29. The support table 27-3 may be formed to protrude from one side (roughly backward) from the shaft 27-2.

On the other hand, the mirror 26 can be inclined to the shaft 27-2 and the support 27-3. An inclined surface for tilting the mirror 26 is formed on the support table 27-3 to support the front surface of the mirror 26. [

The "substrate" may include a first substrate 28 and a second substrate 29. The first substrate 28 may be embedded in the first case 21. The control module 28-1 may be mounted on the first substrate 28 in addition to the light source 24 and the sensor 25 described above. In this case, the control module 28-1 controls at least one of the surface (lower surface) facing the mirror 26 and the surface (upper surface) located on the opposite side to the surface facing the mirror 26 on the first substrate 28 As shown in FIG.

The control module 28-1 can receive the signal of the three-dimensional information generated by the sensor 25 and process it to generate "three-dimensional information ". In addition, the control module 28-1 can control at least one of the motor 27 and the light source 24. [ For example, the control module 28-1 can control the rotation speed of the motor 27 or the wavelength band of the emitted light of the light source 24, thereby adjusting the resolution and the like of motion recognition.

The second substrate (29) may be embedded in the second case (22). The power supply module 29-1 and the charging port 29-2 may be mounted on the second substrate 29 in addition to the motor 27 described above. The power module 29-1 can supply driving power to the light source 24, the sensor 25, and the motor 27. [ The charging port 29-2 can supply external power to the power module 29-1 to charge the battery. The charging port 29-2 may be provided in various forms. For example, the charging port 29-2 may be provided in the form of a USB port, but is not limited thereto.

In this case, the power supply module 29-1 may be disposed on a surface of the second substrate 29 opposite to the surface facing the mirror 26, and the charging port 29-2 may be disposed on the second substrate 29 29 on the side opposite to the mirror 26.

The first substrate 28 and the second substrate 29 may be provided with a conductive member 29-3 for electrically connecting the first substrate 28 and the second substrate 29 to each other. The control signal of the control module 28-1 can be transmitted to the motor 27 through the conductive member 29-3 and the power source of the power source module 29-1 is connected to the light source 24, And the control module 28-1.

At least a part of the conductive member 29-3 may be formed of a light-transmitting material so as not to block the optical path. For example, the conductive member 29-3 may be formed of a transparent electrode material.

The three-dimensional information generating device 20 of the present invention is configured such that the light source 24 and the sensor 25 which transmit and receive the control signal smoothly are connected together with the control module 28-1, (28), it is possible to reduce the moving path of the signal. The three-dimensional information generating device 20 of the present invention can reduce the moving path of the power source by mounting the motor 27 with a high power consumption amount on the second substrate 29 together with the power source module 29-1 have.

As a result, not only the conductive line is easily formed but also the size of the conductive member 29-3 electrically connecting the first substrate 28 and the second substrate 29 is reduced, It is possible to effectively prevent the light path from being blocked.

The electronic control unit 30 is capable of communicating with the three-dimensional information generating device 20 to receive the three-dimensional information generated by the three-dimensional information generating device 20 and controlling the function of the automobile according to the three- -1).

That is, the automobile control system 100 of the present invention is provided in an automobile, and can control (30-1) the functions of the automobile according to the three-dimensional information about the user. In this case, The user can be sensed to generate three-dimensional information for the user, the electronic control unit 30 can receive the three-dimensional information, and accordingly the function of the automobile can be controlled (30-1).

Hereinafter, the operation of the automotive control system 100 of the present invention will be described in detail with reference to FIG.

First, the first operation may be performed according to a motion in which the user selects at least one of the plurality of control icons 10-1 displayed on the display 10. [ To this end, a plurality of control icons 10-1 may be displayed on the display 10, and the three-dimensional information may be a motion 20-1 in which the user selects at least one of the plurality of control icons 10-1, May include first information for the first user.

More specifically, the three-dimensional information generating device 20 may be configured such that the user selects at least one of a plurality of control icons 10-1 (icons indicating driving mode, heating system, window opening / closing, lamp on / It is possible to sense the motion 20-1 (motion such as touch or click) and generate the first information 20-1. The electronic control unit 30 can receive the first information from the three-dimensional information generating device 20 and can analyze the first information to control the function of the car so as to correspond to the icon selected by the user have.

On the other hand, the plurality of control icons 20-1 may be displayed not only as characters but also as symbols, symbols, emoticons, numerals, etc., as shown in Fig.

Next, the second operation can be performed according to the motion of the user. In this case, the motion of the second operation may not require the display 10 to assist the motion of the user, unlike the motion of the first operation.

To this end, the three-dimensional information may include second information about the motion 20-2 in which the user performs at least one of a plurality of automotive control motions stored in a database.

That is, the user is not guided by the plurality of control icons 10-1 of the display 10, and the motion is not guided to the motion 20-2 that performs at least one of the motions stored so that each of the motions matches the respective function of the car , The function of the vehicle can be controlled (30-1).

As in the first operation, the electronic control unit 30 analyzes the second information and controls (30-1) the function of the vehicle so as to correspond to the motion performed by the user.

In this case, the plurality of automobile control motions may include one wake-up motion and a plurality of control signal motions connected in a time-wise manner with one wake-up motion. That is, in order to prevent the vehicle from being controlled according to the user's unconscious motion, the function of the vehicle is controlled in accordance with at least one of the plurality of control signal motions following the wake up motion after the user precedes the wake up motion -1).

Next, the third operation may be an operation to specify the user performing the motions of the first operation and the second operation in accordance with the positions 20-3 of the plurality of users in the room of the vehicle. In this case, the three-dimensional information may include third information on the position 20-3 of each of the plurality of users.

If there are a plurality of users, the electronic control unit 30 can specify the user of the position stored in the database by using the third information, and determine the function of the vehicle 30 -1). That is, when there are a plurality of users, it is possible to perform the first operation and the second operation in accordance with the motion of the user in the previously stored position.

Next, the fourth operation may be an operation of providing an alarm to the user in accordance with the user's attitude 20-4. In this case, the three-dimensional information may include fourth information on the attitude 20-4 of the user. In addition, the attitude 20-4 of the user may be a concept including not only the attitude of the user at one point in time, but also the change of the attitude of the user according to the temporal flow.

The electronic control unit 30 can use the fourth information to determine whether the posture 20-4 of the user is a dangerous posture or to provide an alarm to the user when the posture is dangerous. For example, in the case of a dangerous posture in which the user is determined to be in a drowsy state, such as repeatedly tilting the head, the user can be provided with an alarm for awakening the alertness in various ways. In this case, the alarm may be implemented as a warning sound, but is not limited thereto.

Hereinafter, with reference to Fig. 8, it is described that the plurality of airbags are selectively operated by the automotive control system 100 of the present invention. 6 is a conceptual diagram showing that an air bag to be operated is selected among a plurality of air bags according to the position of the user and the attitude of the user.

Generally, a plurality of airbags 41 are installed in each position in an automobile in order to protect each user and a passenger in an accident. In this case, if all of the plurality of airbags 41 are operated without considering the position and the posture of the user and the passenger, secondary damage due to indiscriminate inflation of the airbag may occur.

In order to prevent this, in the automotive control system 100 of the present invention, the electronic control unit 30 sets the third information on the user's position 20-3 and the fourth information on the user's attitude 20-4 Characterized in that the operating airbag is selected among the plurality of airbags (41) according to at least one.

This is because the three-dimensional information generating device 20 in the automotive control system 100 of the present invention can accurately sense the position 20-3 and the attitude 20-4 of the user, It is a unique feature.

For example, as shown in (1) of FIG. 6, when the user takes a posture (generally, a posture taken in the manual driving mode) sitting on a driver's seat located in front of the driver, the three- Thereby generating third information and fourth information on the user's position 20-3 and posture 20-4.

The electronic control unit 30 uses the third information and the fourth information to determine whether or not an impact has been detected (an accident), the driver's seat front airbag 41-1, the driver's seat rear airbag 41- 2 and the driver's seat side airbag 41-3 to selectively operate the airbag 41-3 to buffer the airbag 41. At the same time, it is possible to secure the structural path of the user and to prevent the impact applied to the user from being increased by other airbags .

Alternatively, as shown in (2) of FIG. 6, when the user takes a posture lying in the driver's seat located in the front and a passenger magnet located in the rear of the driver's seat (rest position that can be taken in the autonomous driving mode) The information generating device 20 may generate third information and fourth information about the position 20-3 and the attitude 20-4 of the user by sensing the information.

The electronic control unit 30 uses the third information and the fourth information to determine whether or not an impact has been detected (an accident), the driver's seat front airbag 41-1 and the ceiling airbag 41-4 ) Can be selectively operated to provide a full load function. At the same time, the structural path of the user can be ensured and the impact applied to the user by other air bags can be prevented from being increased.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. Therefore, it should be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims (8)

1. A vehicle control system provided in an automobile to control functions of the automobile according to three-dimensional information about the user,
A display in which a plurality of automobile control icons are displayed;
A three-dimensional information generating device for generating three-dimensional information by sensing a user; And
And an electronic control unit for controlling functions of the vehicle according to the three-dimensional information,
Wherein the three-dimensional information includes at least one of a first information for a motion in which the user selects at least one of the plurality of control icons, and a second information for motion in which the user performs at least one of a plurality of automobile- 2 information, third information on the position of the user in the room of the car, and fourth information on the attitude of the user,
Wherein the three-dimensional information generating device comprises a case, a substrate disposed in the case, a light source mounted on the substrate, and a sensor, wherein the light emitted from the light source passes through the user, Three-dimensional information is generated,
Wherein the electronic control unit specifies a user at a position stored in a database using the third information when the user has a plurality of functions and controls the function of the vehicle according to the three- When an impact is detected, selects an airbag to be operated among a plurality of airbags according to at least one of the third information and the fourth information, and when the user takes a lying posture, Control system.
delete delete The method according to claim 1,
Wherein the plurality of automobile control motions stored in the database includes one wake up motion and a plurality of control signal motions connected in a time-series manner with the one wake up motion.
delete The method according to claim 1,
Wherein the electronic control unit uses the fourth information to determine whether the posture of the user is a dangerous posture and provides an alarm to the user.
The method according to claim 6,
Wherein the alarm is implemented as a beep.
The method according to claim 1,
The three-dimensional information includes third information about a position of a user in a room of an automobile and fourth information about a posture of the user,
Wherein the electronic control unit selects an air bag to be operated among a plurality of air bags according to at least one of the third information and the fourth information when an impact is detected.

Images