KR101597531B1 - Control apparatus for vechicle and vehicle - Google Patents

Abstract

One aspect of the disclosed invention provides a vehicle control apparatus having an operation section that can be operated by a user conveniently, and a vehicle including the same.
The vehicle controller according to an embodiment includes an operation unit including an object sensing unit for sensing an object in a non-contact manner and a pad disposed on the object sensing unit and having elasticity; And a control unit for generating a control signal for controlling the vehicle based on the output signal of the operating unit.

Description

[0001] CONTROL APPARATUS FOR VECHICLE AND VEHICLE [0002]

The disclosed invention relates to a vehicle control device and a vehicle capable of receiving a command of a user.

In addition to basic driving functions, the vehicle can perform additional functions for user convenience such as audio function, video function, navigation function, air conditioning control, seat control, lighting control, and the like.

In order to perform such a function, the vehicle is provided with a menu display screen or a display for displaying a control screen, and receives a selection of a desired menu from a user according to a hard key method, a touch screen method or a gesture recognition method, And receives a control command.

However, in the case of using the hard key method, there is a problem that a large amount of physical space is consumed in order to have a plurality of hard keys, or a user's operation load is increased in order to receive a control command with a small number of hard keys.

In addition, since the touch screen method requires the driver to touch the display provided on the dashboard one by one in order to input a control command, it may affect safe driving, and the gesture recognition method may malfunction.

One aspect of the disclosed invention provides a vehicle control apparatus having an operation section that can be operated by a user conveniently, and a vehicle including the same.

The vehicle controller according to an embodiment includes an operation unit including an object sensing unit for sensing an object in a non-contact manner and a pad disposed on the object sensing unit and having elasticity; And a control unit for generating a control signal for controlling the vehicle based on the output signal of the operating unit.

The pad may be made of a gel-like elastic body.

The object sensing unit may include at least one of a capacitive proximity sensor, an ultrasonic proximity sensor, and a photoelectric proximity sensor.

The object detecting unit may include a plurality of sensors arranged in two dimensions.

The control unit may calculate a position or height of an object on the operation unit based on an output signal of the object detection unit.

The operation unit may further include a pressure sensing unit disposed under the object sensing unit to sense pressure

According to an embodiment of the present invention, a vehicle includes an operation unit including an object sensing unit for sensing an object in a non-contact manner, and a pad disposed above the object sensing unit and having elasticity;

An AVN (Audio Video Navigation) device including a display; And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit.

The pad may be made of a gel-like elastic body.

The object sensing unit may include at least one of a capacitive proximity sensor, an ultrasonic proximity sensor, and a photoelectric proximity sensor.

The object detecting unit may include a plurality of sensors arranged in two dimensions.

The control unit may calculate a position or height of an object on the operation unit based on an output signal of the object detection unit.

The operation unit may further include a pressure sensing unit disposed under the object sensing unit to sense pressure.

The display may display the pointing object at a position corresponding to the position of the object on the operation unit.

The display may display the visual characteristics of the pointing object differently according to the height of the object on the operation unit.

The display may display at least one menu button and the control unit may generate a control signal for selecting a menu button where the pointing object is located among the plurality of menu buttons when the operation unit is pressed.

The control unit may obtain a user image including a user's hand from an output signal of the object sensing unit.

The control unit may determine whether a portion of the operation unit is covered by the user's hand based on the user image.

The display may display a menu list mapped to the predetermined area when a predetermined area of the operation unit is covered by the user's hand.

The display may display a menu list mapped to the preset area if a preset area of the operation unit is covered by the user's hand for a reference time or longer.

The display may display a reference bar indicating a ratio of a time that a predetermined area of the operation unit is hidden by the user's hand to the reference time.

The display may display a menu list mapped to the predetermined area when a predetermined area of the operation unit is pressed by the user's hand.

The display may be turned off when a predetermined area of the operation unit is covered by the user's hand.

The display may be turned off when a predetermined area of the operation unit is pressed by the user's hand.

The AVN apparatus can be turned off when a predetermined area of the operation unit is pressed by the user's hand.

The display may display map data for performing a navigation function.

The control unit may calculate an angle of a finger that contacts the pad based on the user image.

The display may display map data for performing a navigation function.

The display may display the view angle of the map data differently according to the calculated angle of the calculated finger.

The display may display the map data according to a vertical view if the calculated angle of the calculated finger is equal to or greater than a reference angle.

The display may display the map data according to a bird view corresponding to the calculated angle of the calculated finger if the calculated angle of the calculated finger is less than a reference angle.

The operating portion may be connected to an end portion of an armrest provided between a driver's seat and an assistant's seat.

According to the vehicle control apparatus and the vehicle including the same, the user can easily operate the operation unit during operation to input control commands to various convenience devices provided in the vehicle.

1 is a control block diagram of a vehicle control apparatus according to an embodiment.
2 is a control block diagram of a control apparatus for a vehicle further comprising a pressure sensing unit.
3 is a side view showing a structure according to an example of an operation unit.
Fig. 4 is a plan view of the operating portion according to one example viewed from above. Fig.
5 is a circuit diagram of an LED matrix constituting an object sensing unit.
6 is a circuit diagram of a phototransistor array constituting an object sensing portion.
7 is an external view of a vehicle according to an embodiment.
8 is a control block diagram of a vehicle according to an embodiment.
9 is an external view of the vehicle control device mounted on the vehicle as viewed from the rear seat.
10 is an external view of the vehicle control device mounted on the vehicle as viewed from the passenger seat.
11 is a diagram showing an example in which a user operates the operation unit.
12 is a diagram showing an example of a user image formed by an output signal of the object detection unit when the user operates the operation unit as shown in FIG.
13 is a view showing an example of an audio reproduction screen displayed on the display of the AVN apparatus.
14 is a diagram showing an example of a screen displayed on the display of the AVN apparatus according to a user's operation.
FIG. 15 is a diagram showing an example of visually displaying the ratio of the user's operation time to the reference time.
16 is a view showing another example in which the user operates the operation unit.
17 is a view showing an example of a user image formed by an output signal of the object detection unit when the user operates the operation unit as shown in FIG.
18 is a diagram showing another example of a screen displayed on the display of the AVN apparatus according to the user's operation.
19 is a diagram showing another example of visually displaying the ratio of the user's operation time to the reference time.
20 is a diagram showing another example in which the user operates the operation unit.
21 is a diagram showing an example of an image formed by an output signal of the object detection unit when the user operates the operation unit as shown in Fig.
22 and 23 are diagrams showing still another example of a screen displayed on the display of the AVN apparatus according to a user operation.
24 is a diagram illustrating a display that displays a pointing object corresponding to a finger position;
25 is a view showing a display in which a menu list in which a plurality of menu buttons are continuously arranged is displayed.
26 is a diagram showing a drag operation for moving a menu list.
27 is a control block diagram in which a configuration of an AVN apparatus that performs a navigation function is embodied.
28 and 29 are diagrams showing examples of a map screen displayed on the display when the navigation function is performed.
30 and 31 are views showing an example of an operation for displaying a vertical view.
32 is a diagram showing an example of an operation for displaying a bird view.
33 is an example of a user image obtained when an operation for displaying a vertical view is applied.
34 is an example of a user image obtained when an operation for displaying a bird view is applied.
35 is a control block diagram of a vehicle including a vehicle control device for controlling the air conditioner.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of a vehicle control apparatus and a vehicle including the same will be described in detail with reference to the accompanying drawings.

FIG. 1 is a control block diagram of a control apparatus for a vehicle according to an embodiment of the present invention, and FIG. 2 is a control block diagram of a control apparatus for a vehicle including a pressure sensing section.

Referring to FIG. 1, a control apparatus 100 for a vehicle according to an exemplary embodiment of the present invention determines a control command of a user based on an output signal of an operation unit 110 and a control unit 110, And a control unit 120 for generating a control signal corresponding to the control command.

The operation unit 110 includes a flexible pad 111 and an object sensing unit 112 disposed below the pad 111 and sensing an object in proximity to the operation unit 110.

The pad 111 may be made of a transparent and elastic material as a part of the user's hand when the user operates the operation unit 110. [ The elastic pad 111 improves the user's sense of operation and provides tactile feedback. Specifically, a user can obtain a smooth and natural operation feeling as if pressing an actual button by applying an operation having a moving amount on a fluffy surface.

In addition, even when the user does not operate the operation unit 110, it is convenient to raise his / her hand.

For example, the pad 111 may be made of a gel state silicone compound, a gel state polyurethane, or the like, and the silicon compound may be PDMS (Polydimethylsiloxane) or the like. However, the material constituting the pad 111 is not limited to the materials, and any material that is flexible in addition to the materials may be a material constituting the pad 111.

The object detection unit 112 can detect an object in proximity to the operation unit 110 in a non-contact manner. However, this means that an object can be detected even when the object is not in contact with the operation unit 110, which does not mean that the object can not be detected. That is, the object detecting unit 112 can detect not only an object contacting the pad 111, but also an object apart from the pad 111. To this end, the object sensing unit 112 may include a proximity sensor and may include at least one of, for example, a capacitive proximity sensor, an ultrasonic proximity sensor, and a photoelectric proximity sensor. The proximity sensor in this embodiment is collectively referred to as all sensors capable of sensing not only an object contacting but also a separated object as long as it is close to the sensor.

When the object detecting unit 112 includes the capacitive proximity sensor, the distance between the object and the operation unit 110 can be determined based on the capacitance change that varies as the object approaches, and when the object includes the ultrasonic proximity sensor The distance between the object and the operation unit 110 can be determined based on the intensity of the ultrasonic signal reflected on the object and based on the intensity of the optical signal reflected on the object when the proximity sensor is included The distance between the object and the operation unit 110 can be determined. In this embodiment, the distance between the operation unit 110 and the object means the distance between the pad 111 and the object or the distance between the object sensing unit 112 and the object.

As described later, the object detection unit 112 may have a configuration in which a plurality of proximity sensors are arranged in two dimensions. When the output signal of the object detection unit 112 is used, the image of the object close to the operation unit 110 And the position of the object on the two-dimensional plane can also be determined.

The manner in which the user operates the operation unit 110 may include a method of pressing the pad 111. When the object detecting unit 112 includes a photoelectric proximity sensor or an ultrasonic proximity sensor, it is possible to determine whether the pad 111 is pressed by using only the output signal of the object detecting unit 112. Specifically, when the pad 111 is pressed, an optical characteristic such as a user's finger is closer to the object sensing portion 112 and light is dispersed while the pad 111 is pressed. Further, since the pressing operation is performed in a short time, if the instantaneous pattern change is utilized, it is possible to judge whether or not the pressure is applied without a separate device for sensing the pressure.

Alternatively, as shown in FIG. 2, the operation unit 110 may further include a pressure sensing unit 113 for sensing pressure.

The pressure sensing portion 113 may include a mechanical pressure sensor that senses pressure in a mechanical contact, such as a microswitch, and may include an electrical pressure sensor that measures the displacement therebetween from a capacitance change between the two electrodes , A semiconductor type pressure sensor that senses a pressure using a piezoelectric effect, or a resistive film that senses a pressure by measuring a change in current or resistance generated when two opposing electrodes come into contact with each other when a pressure is applied from the outside, Type pressure sensor.

However, the pressure sensors are merely examples of pressure sensors that can be included in the pressure sensor 113, and the embodiment of the vehicle controller 100 is not limited to the above examples.

The position of the object close to the operation unit 110 can be determined from the output signal of the object detection unit 112. [ Accordingly, the pressure sensing unit 113 senses only the pressure, and the position where the pressure is sensed can be determined from the output signal of the object sensing unit 112.

Alternatively, the pressure sensing unit 113 may have a configuration in which a plurality of pressure sensors are arranged in two dimensions, or a structure in which the pressure sensor itself can sense pressure at each position defined on two dimensions. Therefore, the position of the operation unit 110, which is pressed by the object, can be determined using the output signal of the pressure sensing unit 113.

An object to be sensed by the operation unit 110 or an object to press the operation unit 110 may be a hand of a user who inputs a control command. The control unit 120 controls the operation of the user based on the output signal of the operation unit 110. [ The command can be judged.

The control unit 120 includes a sensor control unit 121 for controlling the operation of the object sensing unit 112 or the pressure sensing unit 113 and a control signal generating unit 122 for generating a control signal based on the output signal of the operation unit 110 The sensor control unit 121 and the control signal generation unit 122 may include a microprocessor and a micro controller.

Meanwhile, the components shown in the control block diagram of FIG. 1 are not physically divided but functionally separated. Accordingly, the sensor control unit 121 and the control signal generation unit 122 may be physically one module or physically separate modules. Both the sensor control unit 121 and the control signal generation unit 122 may be provided on the operation unit 110. Only one of the sensor control unit 121 and the control signal generation unit 122 may be provided on the operation unit 110, (122) may be provided separately on the outside of the operation unit (110).

Fig. 3 is a side view showing a structure of an example of an operation unit, and Fig. 4 is a plan view of an operation unit viewed from above.

In this example, it is assumed that the object detection unit 112 constituting the operation unit 110 includes a photoelectric proximity sensor. Referring to FIG. 3, the object detecting unit 112 may include a plurality of light emitting units 112a and a plurality of light receiving units 112b. The light emitting portion 112a may be an infrared LED, and the light receiving portion 112b may be a phototransistor that senses infrared rays.

In the case where the light emitting unit 112a is implemented by an infrared LED, an infrared ray filter for preventing the infrared ray generated from the external light source other than the infrared ray generated from the light emitting unit 112a from being incident on the light receiving unit 112b, And an object detecting unit 112. [0033] FIG.

4, the plurality of light emitting units 112a and the plurality of light receiving units 112b may be arranged two-dimensionally on the substrate 112c, and the plurality of light emitting units 112a are connected in a matrix manner, And the phototransistor 112b may be connected in parallel to operate as a kind of optical sensor having a wide surface.

The pressure sensing part 113 may also include a plurality of pressure sensors 113a two-dimensionally arranged on the substrate 113b or two spaced apart conductive films and a spacer ). 4 is merely an example of the operation unit 110, and it is also possible that the operation unit 110 does not include the pressure detection unit 113 as described above.

FIG. 5 is a circuit diagram of an LED matrix constituting an object sensing unit, and FIG. 6 is a circuit diagram of a phototransistor array constituting an object sensing unit.

Referring to FIG. 5, P1-P5 and Q1-Q7 denote the digital output pins of the sensor control unit 121. The desired LEDs can be turned on by adjusting these outputs appropriately. For example, to light the LEDs in the third row and the second column, the sensor control unit 121 sets P1 = P2 = P4 = P5 = 0, P3 = 1, Q1 = Q3 = Q4 = Q5 = Q6 = Q7 = 1, You can adjust the output with Q2 = 0. In this way, one LED can be lit sequentially at a time.

Referring to FIG. 6, all the phototransistors are connected in parallel, and the current through them all flows through the upper resistor. Accordingly, when the output signal OUT outputted through the output pin of the phototransistor array maintains a value close to the power supply voltage VCC in the absence of light, when the light is incident on the phototransistor array, the voltage drops in proportion to the amount thereof .

The output signal of the phototransistor is input to the control signal generation unit 122. The control signal generation unit 122 outputs the control signal to the control unit 110 based on the position of the LED and the output signal of the phototransistor, For example, the position of a user's hand or finger, the distance to the operation unit 110, the area, and the like. A detailed description thereof will be given later.

5 and 6 are merely examples that can be applied to an embodiment of the on-vehicle control device 100, and the embodiment of the onboard control device 100 is not limited to the above example. 5 and 6, it can be applied to the operation unit 110 as long as it can detect the user's hand or finger near the operation unit 110 and calculate the position, distance, area, have.

Hereinafter, the operation of the onboard control device 100 will be described together with an embodiment of the onboard vehicle control device 100 mounted on the vehicle.

FIG. 7 is an external view of a vehicle according to an embodiment, and FIG. 8 is a control block diagram of a vehicle according to an embodiment.

7, a vehicle 10 according to an embodiment includes a main body 1 forming an appearance of a vehicle 10, wheels 51 and 52 for moving the vehicle 100, wheels 51 and 52, A door 71 and 72 for shielding the interior of the vehicle 10 from the outside (see Fig. 9), a front surface for providing the driver inside the vehicle 10 with a view of the front of the vehicle 10 Glass 31, and side mirrors 81 and 82 that provide the driver with a field of view behind the vehicle 10.

The wheels 51 and 52 include a front wheel 51 provided on the front of the vehicle and a rear wheel 52 provided on the rear side of the vehicle and the driving device 60 includes a front wheel 51 and a rear wheel 52, (51) or the rear wheel (52). Such a drive unit 60 may employ an engine for generating a rotational force by burning fossil fuel or a motor for generating a rotational force by receiving power from a capacitor (not shown).

The doors 71 and 72 are provided so as to be rotatable on the left and right sides of the main body 1 so that the driver can ride inside the vehicle 10 at the time of opening. Shield.

The front glass 31 is provided on the front upper side of the main body 1 so that a driver inside the vehicle 10 can obtain time information in front of the vehicle 10. The windshield glass is also called a windshield glass.

The side mirrors 81 and 82 include a left side mirror 81 provided on the left side of the main body 1 and a right side mirror 82 provided on the right side. 10) side information and rear-side time information.

In addition, the vehicle 10 may include a proximity sensor for detecting rear or side obstacles or other vehicles, and a rain sensor for detecting rainfall and precipitation.

Referring to FIG. 8, a vehicle 10 according to an embodiment includes a vehicle control device 100 and an AVN (Audio Video Navigation) The AVN apparatus 200 is an apparatus for integrally performing an audio function, a video function, and a navigation function. In addition to the above functions, it is also possible to perform additional functions such as a telephone call.

The AVN apparatus 200 includes a display 210 for visually outputting information for performing various functions, a speaker 220 for outputting audibly and an AVN apparatus The AVN control unit 230 controls the AVN 200 as a whole.

Hereinafter, the operation of the vehicle control apparatus 100 mounted inside the vehicle 10 and the external appearance of the AVN apparatus 200 will be described together with a specific operation.

Fig. 9 is an external view of the vehicle control device mounted on the vehicle from the rear seat, and Fig. 10 is an external view of the vehicle control device mounted on the vehicle from the passenger seat.

9 and 10, the display 210 may be mounted on the center fascia 33, which is a central area of the dashboard 32, and may include an audio screen, a video screen, a navigation screen, A screen necessary for performing various functions to be performed can be displayed.

The display 210 may be implemented as an LCD (Liquid Crystal Display), a LED (Light Emitting Diode), a PDP (Plasma Display Panel), an OLED (Organic Light Emitting Diode), a CRT (Cathode Ray Tube)

The operation unit 110 may be provided on the center console 40 between the driver's seat 21 and the passenger's seat 22. [ The center console 40 refers to an area in which a gear lever 41 and a console box 42 as a storage space for storing articles are formed between the driver's seat 21 and the passenger's seat 22. [

For example, the operation unit 110 may be extended to a front end of an arm rest 43 provided at an upper portion of the console box 42.

In general, in order to control the AVN apparatus 200, the user operates a hard key 211 provided near the display 210, a jog shuttle provided on the center console 40, or a hard key provided on the center console 40 . This may affect the safety operation of the user during operation and may require a lot of space in order to provide a large number of hard keys, or a hard key or jog shuttle several times in order to input desired control commands.

However, in the vehicle 10 according to the embodiment, the user who rides on the front seats 21 and 22 stably holds the operating portion 110 using the hand H in a state in which the arm is placed on the armrest 43 Can be operated.

Since the pad 111 is located at the top of the operation unit 110, the user can touch the pad 111 and input a control command. As described above, since the pad 111 is made of a flexible material, the user's operation feeling can be improved, and even when the control command is not input, the user can comfortably hold the hand on the pad 111. [

In addition, a hot key function can be performed by displaying a desired menu screen on the display 211 by a simple operation as described later.

On the other hand, the mounting position of the vehicle control apparatus 100 is not limited to the example shown in Figs. 9 and 10, and the vehicle control apparatus 100 is mounted on the armrest of the rear seat so as to receive a control command from the occupant on the rear seat And a plurality of vehicle control apparatuses 100 are provided in the vehicle 10 so that one is mounted on the center console 40 as shown in FIGS. 9 and 10 and the other is mounted on the armrest of the rear seat It is also possible to mount it.

FIG. 11 is a diagram illustrating an example of a user operating the operation unit, and FIG. 12 is a diagram illustrating an example of a user image formed by an output signal of the object detection unit when the user operates the operation unit as shown in FIG. 11 .

The user's hand may be set in such a manner that the operation mode such as covering or pressing the predetermined area of the operation unit 110 or pressing the operation unit 110 by the user's finger inputs the control command. Therefore, the control commands corresponding to the respective operation modes are mapped in advance, and when the user inputs a control command, the control signal generator 122 can generate control signals corresponding thereto.

Alternatively, a control command corresponding to each of the preset areas of the operation unit 110 may be mapped, and a control command mapped to the corresponding area may be executed when the user's hands cover or press a predetermined area Do. Hereinafter, specific embodiments will be described.

For example, as shown in Fig. 11, a control command can be inputted in such a manner that the user's hand H covers the left end of the operation portion 110. [ When the object detection unit 112 includes the photovoltaic proximity sensor as described above, the respective output signals output from the plurality of phototransistors 112b constituting the object detection unit 112 constitute one image Pixel value. Hereinafter, the image formed by the output signal of the object detection unit 112 will be referred to as a user image.

6, the collector voltage of the phototransistor becomes an output, so that the greater the amount of the LED reflected light incident on the phototransistor, the more the phototransistor array < RTI ID = 0.0 > The output of the phototransistor array becomes higher as the amount of LED reflected light incident on the phototransistor becomes smaller.

When the pixel at the maximum output of the phototransistor is white and the pixel at the minimum output of the phototransistor is black, when the user operates the operation portion as shown in Fig. 11 A user image I as shown in Fig. 12 can be obtained.

The control signal generating unit 122 can determine that the user's hand H covers the left end of the operation unit 110 when the user image I as shown in FIG. 11 is acquired, A control signal can be generated. An image recognition algorithm can be applied to determine whether the object covering the left end of the operation unit 110 is the user's hand H. [ To this end, the control signal generator 122 preliminarily stores the morphological characteristics of the hand of the human body, and determines whether or not the object represented by the user image I is a hand. Through this process, it is possible to filter out misidentification that the control command is input until another part of the human body such as the user's arm or wrist is positioned on the operation unit 110. [

FIG. 13 is a diagram showing an example of an audio reproduction screen displayed on the display of the AVN apparatus, FIG. 14 is a diagram showing an example of a screen displayed on the display of the AVN apparatus according to a user's operation, FIG. 8 is a view showing an example of visually displaying the ratio of the operation time to the reference time.

For example, the operation method described with reference to FIG. 11 may be mapped to a hot key function for calling up the main menu. The hot key function is a function that can immediately call a desired function irrespective of the function currently being performed by the AVN apparatus 200. [

13, when the user's hand H covers the left end of the operation unit 110 as shown in FIG. 11 in a state that an audio reproduction screen is displayed on the display 210 as shown in FIG. 13, The main menu list 213a may be displayed in one area of the display 210 as shown in FIG.

12 is obtained by the output signal of the object detection unit 112, and the control signal generation unit (not shown) 122 may determine that the user's hand H covers the left end of the operation unit 110 based on the user image I. [ The operation of the user's hand H covering the left end of the operation unit 110 is mapped to a control command for calling the main menu and the control signal generation unit 122 generates a control signal for calling the main menu, To the AVN control unit 230 of the device 200. Then, the AVN controller 230 controls the display 210 to display the main menu list 213a as shown in FIG.

On the other hand, only when the user's hand touches the left end of the operation unit 110 for more than the reference time for distinguishing the operation other than the operation for the control command, the control signal generation unit 122 generates a control signal Lt; / RTI > To this end, the reference time can be set in advance, and the user can be provided with information about how much time remains before reaching the reference time.

For example, as shown in FIG. 15, a reference bar 213b indicating a ratio of a time to a reference time when the user's hand covers the left end of the operation unit 110 is displayed on the display 210 . The height of the reference bar 213b may vary with time, and may start from the bottom of the display 210 initially and gradually increase in height. When the reference time is reached, the height of the reference bar 213b reaches the upper end of the display 210, and the main menu list 213a can be displayed as shown in FIG.

The user can grasp how much the user should hide his / her hands by looking at the reference bar 213b shown in FIG. 15. If the user does not want to call the main menu, the user can stop the operation of covering the operation unit 110 before reaching the reference time To cancel the control command for the main menu call.

When the user desires to call the main menu immediately without waiting until the reference time, the user can directly call the main menu by pressing the pad 111 while keeping the left end of the operation unit 110 covered with the hand. In this case, the pressure sensing unit 113 senses this, and when the output signal of the pressure sensing unit 113 indicates the pressing of the operation unit 110, the control signal generating unit 122 calls the main menu immediately without waiting until the reference time And transmits the generated control signal to the AVN control unit 230. Alternatively, when the operation unit 110 does not include the pressure sensing unit 113 as described above, it may be determined whether the operation unit 111 is pressed by using the output signal of the object sensing unit 112.

FIG. 16 is a view showing another example in which a user operates the operation unit, and FIG. 17 is a view showing an example of a user image formed by an output signal of the object detection unit when the user operates the operation unit as shown in FIG. 16 .

16, a control command can also be input in such a manner that the user's hand H covers the right end of the operation unit 110. [ When the object detection unit 112 includes the photovoltaic proximity sensor as described above, the respective output signals output from the plurality of phototransistors 112b constituting the object detection unit 112 constitute one image Pixel value.

6, the collector voltage of the phototransistor becomes an output, so that the greater the amount of the LED reflected light incident on the phototransistor, the more the phototransistor array < RTI ID = 0.0 > The output of the phototransistor array becomes higher as the amount of LED reflected light incident on the phototransistor becomes smaller.

When the pixel at the maximum output of the phototransistor is white and the pixel at the minimum output of the phototransistor is black, when the user operates the operation unit 110 as shown in Fig. 16 The user image I as shown in Fig. 17 can be obtained

The control signal generation unit 122 may determine whether an object close to the upper portion of the operation unit 110 is a hand by applying an image recognition algorithm to the user image I. [ If the object shown in the user image I is the user's hand and the user's hand covers the right end of the operation unit 110, a corresponding control signal can be generated.

12 and 16, in order to distinguish the operation for inputting another control command or the operation of the user irrespective of the control command, when the user's hand moves to the reference of the left or right end of the operation unit 110 Only when the area is covered, a control signal corresponding thereto can be generated, so that the reference area can be set in advance to have a certain range.

Further, when the object shown in the image is a hand, it is possible to determine whether the hand is the hand of the driver or the passenger of the passenger boarding the assistant seat 22 by using the arrangement order of the fingers. This determination result can be used to perform a lock function for the operation authority of the on-vehicle control device 100. When the lock function that only gives the operation authority of the on-vehicle control device 100 to the driver is set, The generating unit 122 may generate a control signal and transmit the control signal to the AVN apparatus 200 only when the hand displayed in the user image I is the hands of the driver.

FIG. 18 is a view showing another example of a screen displayed on the display of the AVN apparatus according to a user operation, and FIG. 19 is a diagram showing another example of visually displaying the ratio of the user's operation time to the reference time.

For example, the operation method described with reference to FIG. 16 may be mapped to a hot key function for invoking a context menu as shown in FIG. In the example of FIG. 18, items such as USB and Bluetooth are displayed in the context menu list 213c. However, this is only an example, and various items other than the items shown in FIG. 18 are displayed in the context menu list 213c .

In this case, too, the control signal generator 122 generates the context menu 122 only when the user's hand H is touching the right end of the operation unit 110 for more than the reference time for distinguishing the operation other than the operation for the control command. Lt; RTI ID = 0.0 > a < / RTI > To this end, the reference time can be set in advance, and the user can be provided with information about how much time remains before reaching the reference time. Here, the reference time may be set to be the same as or different from the reference time used for calling the main menu.

For example, as shown in Fig. 19, a reference bar 213d indicating a ratio of a time to a reference time when the user's hand covers the right end of the operation unit 110 is displayed on the display 210 . The height of the reference bar 213d may vary with time and may initially increase in height starting from the bottom of the display 210. [ When the reference time is reached, the height of the reference bar 213d reaches the upper end of the display 210, and the context menu list 213c can be displayed as shown in FIG.

The user can grasp how much the user should hide his / her hands by looking at the reference bar 213d shown in FIG. 19. If the user does not want to call the context menu, the user can stop the operation of covering the operation unit 110 before reaching the reference time To cancel the control command for the context menu call.

In addition, when the user desires to call the context menu immediately without waiting until the reference time, the user can directly call the context menu by pressing the pad 111 while keeping the right end of the operation unit 110 covered with the hand. In this case, the pressure sensing unit 113 senses this, and when the output signal of the pressure sensing unit 113 indicates the pressing of the right end of the operation unit 110, And transmits the generated control signal to the AVN control unit 230. [0050] FIG. When the operation unit 110 does not include the pressure sensing unit 113 as described above, it is possible to determine whether the operation unit 111 is pressed by using the output signal of the object sensing unit 112. [

20 is a view showing another example in which a user operates the operation unit, and FIG. 21 is a view showing an example of an image formed by an output signal of the object detection unit when the user operates the operation unit as shown in FIG. 20 .

As shown in FIG. 20, a control command can also be input in a manner in which the user's hand covers the central portion of the operation unit 110. FIG. When the object detecting unit 112 includes a photo proximity proximity sensor, as described above, the respective output signals output from the plurality of phototransistors 112b constituting the object detecting unit 112 constitute one image Pixel value.

When the photodiode array constituting the object detection unit 112 has a circuit configuration as shown in FIG. 5, since the collector voltage of the photodiode is output, the greater the amount of the LED reflected light incident on the photodiode transistor, As the output becomes lower and the amount of LED reflected light incident on the phototransistor becomes smaller, the output of the phototransistor array becomes larger.

When the pixel at the maximum output of the phototransistor is white and the pixel at the minimum output of the phototransistor is black, when the user manipulates the manipulating portion as shown in Fig. 20 A user image I as shown in Fig. 21 can be obtained.

22 and 23 are diagrams showing still another example of a screen displayed on the display of the AVN apparatus according to a user operation.

For example, the operation method described with reference to FIG. 20 may be mapped to a hot key function for turning off the display 210. The control signal generating unit 122 generates a control signal for turning off the display 210 and outputs the control signal to the AVN apparatus 200. In this case, Lt; / RTI >

On the other hand, even if the display 210 is turned off, the function being executed can be continuously executed. For example, when the audio function is being executed, the music output through the speaker 220 can be continuously output even after the display 210 is turned off. In the case where the navigation function is being executed, The guidance voice can be continuously output even after the display 210 is turned off.

When the user's hand covers the reference area of the central portion of the operation unit 110 in order to distinguish the operation for inputting another control command or the operation of the user irrespective of the control command The display 210 may be turned off, and further, the display 210 may be turned off only when the reference time is exceeded. Here, the reference time may be set equal to or different from the reference time applied to call up the main menu or the reference time applied to call up the context menu.

Alternatively, even if the user does not reach the reference time, the display 210 may be turned off as soon as the user presses the pad 111 while keeping the central portion of the operation unit 110 covered. In this case, the pressure sensing unit 113 senses this, and when the output signal of the pressure sensing unit 113 indicates the pressing of the central portion of the operation unit 110, the control signal generating unit 122 immediately displays the display 210 And transmits the control signal to the AVN control unit 230. [0051] FIG. When the operation unit 110 does not include the pressure sensing unit 113 as described above, it is possible to determine whether the operation unit 111 is pressed by using the output signal of the object sensing unit 112. [

Alternatively, the operation method described with reference to FIG. 20 may be mapped to the hot key function for turning off the AVN apparatus 200. In this case, if the output signal of the object detection unit 112, that is, the user's hand shown in the user image I covers the central part of the operation unit 110, the control signal generation unit 122 generates a control signal And transmits the generated control signal to the AVN apparatus 200. [0050] When the power of the AVN apparatus 200 is turned off, all functions that have been executed are also ended.

Alternatively, when the user's hand H covers the central portion of the operation portion 110, the display 210 is turned off as shown in FIG. 22, and when the user's hand H presses the central portion of the operation portion 110 It is also possible to turn off the power of the AVN apparatus 200 as shown in FIG.

On the other hand, the embodiments of the vehicular controller 100 and the vehicle 10 are not limited to the examples described with reference to Figs. 11 to 23 above. 12, when the user operates the operation unit 110 as in the example of FIG. 11 to acquire the user image I as in the example of FIG. 12, the main menu is not called and the call of the context menu 210 ), And other hot key functions such as power off or power off can be performed. When the user image as shown in the example of FIG. 17 is obtained by operating the operation unit 110 as in the example of FIG. 16, It is possible for other hot key functions to be performed, such as calling the main menu, turning off the display 210, or turning off the power. The display 210 is turned off or the power is not turned off even when the user image I as shown in the example of FIG. 21 is obtained by operating the operation unit 110 as in the example of FIG. 20, and another hot key function is executed It is also possible.

The operation mode for performing the hot key function is not limited to the manner in which the left and right end portions and the center portion of the operation section 110 are covered with the hand, and the operation mode is not limited to the left end, right end, May be set as an operation mode for executing the hot key function. For example, a different hot key function may be mapped to an area corresponding to four corners where the left end and the right end of the operation unit 110 are separated upward and downward, respectively, and one of the four corners is mapped to the user's hand It is possible to execute the mapped hot key function.

As described above, the operation of manually covering the predetermined area of the operation unit 110 is a simple and easy operation that is not burdensome for the driver to perform while driving. Therefore, when such an operation is set as an operation mode for executing the hot key function , The driver can input a desired control command while focusing on driving and maintaining the posture.

The control commands that can be input by operating the operation unit 110 may be for selecting various menus displayed on the display 210 as well as for executing the hot key function. Hereinafter, this will be described in detail.

24 is a diagram illustrating a display that displays a pointing object corresponding to a finger position;

Referring to FIG. 24, the display 210 may display a pointing object 213e at a position corresponding to the position of the finger F close to the operation unit 110. FIG. To this end, the control signal generation unit 122 calculates the position of the finger F close to the operation unit 110. [ Here, the position of the finger F is a position on the two-dimensional plane viewed from above the operation unit 110.

The control signal generation unit 122 can calculate the position of the finger F based on the output signal of the object detection unit 112. [ The user image I can be obtained by the output signal of the object detection unit 112. [ For example, when the image is composed of nxm pixel arrays, an arbitrary pixel value P (i, j) (an integer of 1? I? N and an integer of 1? J? M) i, j) th LED is turned on, the value corresponding to the output signal of the phototransistor array. P (i, j) has a maximum value when there is no object that reflects light irradiated from the (i, j) th LED, and when the object that reflects light is closest to the (i, Respectively. Here, the object positioned on the operation unit 110 and reflecting light may be a user's finger.

P (i, j) does not have the same maximum and minimum values for all (i, j) due to the difference between the individual elements of the LED and the phototransistor and the distribution difference between the LED and the phototransistor in the object detection unit 112 . Therefore, the maximum value P _M (i, j) and the minimum value P _m (i, j) of P (i, j) are determined using experiments or statistics and these values are used to calculate The normalized image g (i, j) can be obtained.

[Equation 1]

Here, g (i, j) has a value between 0 and 1. Then, the control signal generator 122 converts each pixel value of the normalized image into a level necessary for image processing, and calculates the center of gravity and the ellipticity of the converted value. The coordinates of the image can be corrected using the computed center of gravity and the flatness, and the position of the object on the plane can be calculated by filtering the corrected coordinate values through the adaptive low-pass filter (LPF).

Specifically, the normalized image g (i, j) is transformed using the function h (g) between unit intervals. The function h (g) may have a form of h (g) = g ^? (?> 0) as in gamma correction used in image processing, but it is not limited thereto and may have various forms have.

The application of the function h (g) to the normalized image emphasizes the value corresponding to the end of the finger F in the user image I and the position of the finger F to be obtained as a result is the end of the finger F To be close to the part.

The transformed image is obtained by applying the function h (g) to the normalized image g (i, j), the left upper corner point of the operation unit 110 as the origin, the right direction as the x axis, If the direction is the y-axis, the coordinates of an arbitrary point on the operation unit 110 can be represented by (x, y). The center of gravity coordinates (x _c , y _c ) of h (i, j) can be obtained according to the following equations (2) and (3)

&Quot; (2) "

&Quot; (3) "

When the finger F of the user operating the operation unit 110 is a thumb, the finger of the user image I is long in the diagonal direction due to the structural characteristics of the finger. In this case, if the coordinates of the finger F are determined using the center of gravity as described above, the resulting coordinates do not correspond to the end portion of the thumb, but may have a value corresponding to a position shifted considerably toward the palm. Therefore, the center-of-gravity coordinates (x _c , y _c ) can be corrected in order to correct the error represented by the structural characteristics of the thumb.

First, one of several possible values proportional to the length of the thumb, e, can be defined according to Equation (4) below.

&Quot; (4) "

The value of e calculated according to Equation (4) becomes 0 if the object appearing in the image is a circle, 0 if it is lengthened in the descending diagonal direction, and becomes negative if it is lengthened in the diagonal direction. When the user is a driver and manipulates the operation unit 110 with his right thumb, the object appearing in the image appears long in the descending diagonal direction, where e has a large positive value.

On the other hand, when the user is a passenger boarded on the assistant seat 22 and manipulates the operation unit 110 with the left thumb, the object appearing in the image is displayed in a diagonal direction rising up, where e has a large negative value. The center-of-gravity coordinates can be corrected according to the following equations (5) and (6) by reflecting the calculation result.

&Quot; (5) "

&Quot; (6) "

Here,? Is a positive real number indicating the degree of correction and can be determined by experiments. However, when the finger F of the user operating the operation unit 110 is not a thumb, the coordinates of the center of gravity (x _c , y _c ) need not be corrected.

The control signal generating unit 122 generates a control signal for controlling the height of the finger F from the pad 111 plane or the object sensing unit 112 using the image g (i, j) normalized according to Equation (1) Or the distance (z) between the pad 111 plane or the object sensing portion 112 and the finger F can be estimated. In this case, Equation (7) below can be used.

&Quot; (7) "

The previously defined g (i, j) has a value between 0 and 1 and has a maximum value 1 when the finger F touches the pad 111 and the maximum reflection occurs on the (i, j) th LED . Therefore, z has a value between 0 and 1. That is, when the finger F touches the pad 111, z has a value close to 0, and when the finger F is far enough away from the pad 111, z has a value close to 1, ) And the finger F can be approximated to be close to each other. However, these values may not necessarily represent a value proportional to the physical distance.

Then, the parameter of the adaptive low-pass filter (LPF) can be determined by measuring the rate of change of the height z. That is, the height z is filtered through a low-pass filter, and the rate of change is measured by differentiating the filtered value, and the parameters of the adaptive low-pass filter are determined using the measured rate of change.

Applying the adaptive low-pass filter is intended to cope with hand tremors and noise. If the low-pass filtering is merely performed, the hand trembling is alleviated, but at the same time, the delay may occur and the reactivity may be lowered. Therefore, it is necessary to change the strength of the low-pass filter adaptively according to the magnitude of the movement of the finger F.

Specifically, (x _c, y _c) or _{(x 'c, y' c} ) is because the maintenance of the reactivity as more important than the relief of tremor and weaken the low pass filtering, (x _c, y for a large change _When the change of ( _c ') or (x' _c , y ' _c ) is small, the relaxation of the tremor is more important than the reactivity.

It is also necessary to stabilize the pointing by making the position estimate x and y of the finger F constant at the moment when the finger F touches the pad 111. [ To this end, the rate of change of z is measured, and the intensity of the low-pass filtering is increased at the instant when z rapidly decreases, thereby reducing the variation of (x, y). In summary, the parameters of the low-pass filter can be determined by measuring the variance of (x _c , y _c ) or (x ' _c , y' _c ) and measuring the rate of change of z. First, z is filtered using a low-pass filter according to Equation (8) below.

&Quot; (8) "

는 z가 저역 통과 필터에 의해 필터링된 값이고, a_z는 원폴 필터의 폴의 위치를 나타낸다. 연속하는 두

값의 차이로 z의 변화율인 V_z를 연산한다. 그리고, 최근 w샘플 동안의 x_c 또는 x'_c 의 표준 편차인 σ_x와 최근 w샘플 동안의 y_c 또는 y'_c 의 표준 편차인 σ_y를 연산한다. 마지막으로, (x_c, y_c) 또는 (x'_c, y'_c)를 아래 [수학식 9] 및 [수학식 10]에 따른 저역 통과 필터를 이용하여 필터링하여 (

,

)를 구한다.here,

Z is the value filtered by the low pass filter, and a _z is the position of the pole of the one-pole filter. Two consecutive

Vz, which is the rate of change of _z , is calculated by the difference of the values. Then, the value of x _c Or x is calculated for the standard deviation σ _{y c} 'of the y or y _{c c} for the standard deviation of σ _x and w recent sample. Finally, (x _c , y _c ) or (x ' _c , y' _c ) is filtered using a low-pass filter according to Equation (9)

,

).

&Quot; (9) "

&Quot; (10) "

Here, a _x and a _y can be determined according to the following equations (11) and (12).

&Quot; (11) "

a _x = min (1, max (0, a _{0 -} ? _{x -?} V _z )

&Quot; (12) "

a _y = min (1, max (0, a _{0 -} ?? _{y -?} V _z )

Here, a ₀ is a value between 0 and 1 that determines the strength of the overall low-pass filter, and κ is a quantity representing the degree of reflection of (x _c , y _c ) or (x ' _c , y' _c ) And? Is a positive parameter indicating the degree of reflection of the rate of change of z.

,

) 와 손가락(F)이 패드(111)와 근접한 정도를 나타내는 높이 z 또는

를 연산하면, 디스플레이(210)는 조작부(110) 위에서의 손가락(F)의 위치에 대응되는 위치에 포인팅 객체(213e)를 표시한다.Position of the control signal generator 122, the finger (F) as described above, _{(x c, y c),} (x 'c, y' c) or (

,

And a height z indicating the degree of proximity of the finger F to the pad 111 or

The display 210 displays the pointing object 213e at a position corresponding to the position of the finger F on the operation unit 110. [

However, the above-described method is merely an example of a method of calculating the position and height of the finger F, and the embodiment of the disclosed invention is not limited to the above-described example.

The control signal generation unit 122 or the AVN control unit 230 may calculate the position on the display 210 corresponding to the position of the finger F on the operation unit 110 according to the following equation . The coordinate of an arbitrary point on the display 210 is (X, Y) according to a coordinate system in which the upper left vertex of the display 210 is the origin, the right direction is the X axis, and the downward direction is the Y axis .

&Quot; (13) "

Here, (x _M , y _M ) represents the coordinates of the lower right corner of the operation unit 110, and (X _M , Y _M ) represents the coordinates of the lower right corner of the display 210. That is, the four vertexes of the rectangular manipulation unit 110 correspond to the four vertexes of the display 210, and the points inside the manipulation unit 110 correspond to the points inside the display 210 linearly in proportion to each other. The operation unit 110 may have the same aspect ratio as the display 210.

Referring again to FIG. 24, the pointing object 213e may be displayed at a location on the display 210 corresponding to the location on the operation unit 110 where the finger F is located. The user can see the pointing object 213e displayed on the display 210 and can grasp to which position the finger F should be moved for the desired control. In other words, it can receive feedback on the actions it performs.

The shape of the pointing object 213e may be a circular shape as shown in FIG. 24, but the embodiment of the vehicle control device 100 and the vehicle 10 is not limited to this, and a polygon such as a square, Any other shape may be used as long as it can indicate the position of the finger F by being distinguished from the information displayed on the display 210.

On the other hand, the pointing object 213e can be displayed on the display 210 in a state in which the finger F is in contact with the pad 111, a state in which the finger F is not in contact with the pad 111, and a state in which the pad 111 is pressed. However, the pointing object 213e may be displayed differently depending on the status, for example, the visual characteristic such as the color characteristic or the shape characteristic of the pointing object 213e may be displayed differently.

The control signal generator 122 may distinguish all three states using the output signal of the object sensor 112. The object sensor 112 may be configured to detect the three states, And the output signal of the pressure sensing unit 113 may be used to distinguish the three states.

Considering that the thickness of the pad 111 together with z is taken into consideration, the finger F may be in contact with the current pad 111 It is possible to judge whether it is in a close state or not.

As a result of the determination, if the finger F transitions to the contact state while being in proximity to the pad 111, the visual characteristic of the pointing object 213e can be changed. As an example of changing the color characteristic, when the finger F touches the pad 111, the color can be displayed darker than before the touching. That is, transparency can be reduced.

The state in which the finger F is pressed against the pad 111 may be determined using the output signal of the pressure sensing unit 113 or may be determined using the output signal of the object sensing unit 112. [ When the finger F presses the pad 111, the pressed portion of the pad 111 is depressed and the finger F and the object detection unit 112 are pressed together, The distance between them becomes closer. The control signal generating unit 122 can determine whether the finger F has pressed the pad 111 with only the z value indicating the distance between the finger F and the object sensing unit 112. [

Alternatively, it is possible to judge whether or not the finger F has pressed the pad 111 by using the pattern of the z value. It can be expected that z changes abruptly when the finger F presses the pad 111 rather than simply touching or touching the pad 111. [ Therefore, it is also possible to judge that the finger F presses the pad 111 when the z value suddenly changes.

As a result of the determination, when the finger F is moved from the contact state to the press state, the visual characteristic of the pointing object 213e can be changed. As an example of changing the color characteristic, when the finger F presses the pad 111, the color of the pointing object 213e can be displayed more darkly in a state where the finger F touches the pad 111 .

Alternatively, as an example of changing the shape characteristic, the size of the pointing object 213e may be increased or decreased when the finger F touches the pad 111 or presses the pad 111. [

When the finger F is not in contact with the operation unit 110, the visual characteristics of the pointing object 213e may be different depending on the degree of proximity between the finger F and the operation unit 110. [ For example, the closer the finger F is to the operation unit 110, the darker the color of the pointing object 213e can be displayed. That is, the transparency of the pointing object 213e increases as the finger F becomes farther away from the operation unit 110, and may not be displayed when the finger F is above a predetermined limit.

Alternatively, the shadow of the pointing object 213e is displayed under the pointing object 213e with the shadow of the pointing object 213e being transparent, and the distance between the pointing object 213e and the shadow is displayed in proportion to the distance between the finger F and the operation unit 110 It is possible.

The user can move the finger F on the operation unit 110 until the pointing object 213e is positioned on the menu button to be selected by the user and the pointing object 213e can move on the menu button The pad 111 can be pressed. When the pad 111 is pressed, the menu button displayed at the position of the pointing object 213e on the display 210 can be selected.

The menu button is not selected until the user presses the pad 111. [ Therefore, even when the user does not perform the control through the operation unit 110, the user can rest his / her hand on the pad 111 and maintain the running in a stable posture.

FIG. 25 is a view showing a display in which a menu list in which a plurality of menu buttons are continuously arranged is displayed, and FIG. 26 is a diagram illustrating a drag operation for moving a menu list.

As shown in FIG. 25, the display 210 may display a menu list 215 in which selectable menu buttons are successively arranged. In the example of Fig. 25, a plurality of menu buttons 215a-215e for selecting music are listed. The user can select a desired menu button by moving the finger F on the operation unit 110 to position the pointing object 213e on the desired menu button and pressing the pad 111 with the finger F. [

However, menu buttons included in the menu list 215 may not be displayed on one screen at all. In this case, the user can move the menu list 215 in such a manner that the finger F drags the pad 111 as shown in Fig.

The user first presses the pad 111 at the position corresponding to the drag start point with the finger F and presses the finger 111 in the desired direction with the pad 111 pressed or in contact with the pad 111 F). When the menu buttons 215a to 215e are arranged in the vertical direction as shown in FIG. 25, a menu button that is not shown on the screen can be displayed by moving the finger F in the upward or downward direction.

As shown in FIG. 26, when the finger F is moved downward, a menu button that is not visible is displayed. On the contrary, when the finger F is moved upward, a menu button that is not shown below is displayed. The degree to which the menu list moves may be proportional to the degree of movement of the finger F or may be proportional to the moving speed of the finger F. [

When a desired menu button is displayed on the display 210, the user can select a desired menu button by positioning the pointing object 213e on the desired menu button and pressing the pad 111. [

Among the functions that the AVN apparatus 200 can perform are navigation functions. Hereinafter, a specific embodiment in which the user operates the operation unit 110 to control the navigation function will be described.

FIG. 27 is a control block diagram in which a configuration of an AVN apparatus that performs a navigation function is embodied; FIGS. 28 and 29 are views showing examples of a map screen displayed on a display when performing a navigation function;

27, the AVN apparatus 200 performing the navigation function includes a GPS receiver 241 for receiving position information of the vehicle 10 from GPS (Global Positioning System) satellites, and a storage unit 242 for storing map data ).

The AVN control unit 230 generates a travel route from the start position to the destination using the map data stored in the storage unit 242 and stores the generated travel route in the storage unit 242. [ The starting position may be a current position of the vehicle 10 received from the GPS receiving unit 241, or may be a position separately set by the user.

When the vehicle starts traveling, the display 210 displays the traveling route corresponding to the current position of the vehicle 10, and displays the current position of the vehicle 10 on the displayed traveling route.

On the other hand, the map data stored in the storage unit 242 may be map data including three-dimensional information, and the AVN controller 230 may control the display 210 to display map data according to various view angles can do.

The display 210 may display the map data according to a vertical view as seen from above in the vertical direction or may display the map data at a predetermined angle You can also display them according to the same bird view you see in the view. When the map data is displayed according to the vertical view, the two-dimensional information on the traveling route is substantially provided. When the map data is displayed according to the bird view, three-dimensional information on the traveling route is provided.

Depending on the situation, the information provided in the vertical view may be useful, or the information provided in the bird view may be useful. In the embodiment of the vehicle control device 100 and the vehicle 10, in the state where the display 210 displays the driving route, the user can not view the vehicle through the setting menu of the navigation, The viewing angle can be adjusted by operating the operation unit 110. [

Figs. 30 and 31 are views showing an example of an operation for displaying a vertical view, and Fig. 32 is a view showing an example of an operation for displaying a bird view.

30 is a top view of the hand H for operating the operation unit 110 and FIG. 31 is a side view of the hand H for operating the operation unit 110. FIG. 30 and 31, when the finger F is bent at 90 degrees in a state in which the operating unit 110 is touched or pressed with two or more fingers F, May be displayed. Here, the bending of the finger F by 90 degrees means that the portion from the end portion of the finger F to the first or second node J is raised from the surface of the pad 111 by 90 degrees.

  When the map data is displayed according to the vertical view, the user can accurately recognize the left turn, the right turn or the U-turn point, and the intersection check or the distance check can be more accurately performed.

On the other hand, it is more effective to display the map data in accordance with the bird view when it is desired to check the future traveling route and what road or building is ahead. In this case, the user can lay down or unfold the finger F on the pad 111 at an angle of less than 90 degrees as shown in Fig. 32, and the display 210 displays the finger F as shown in Fig. It is possible to display the map data according to the bird view corresponding to the angle of the vehicle.

In summary, when the display 210 displays the map data according to the vertical view as shown in Fig. 28, when the user places the finger F on the pad 111 at an angle lower than 90 degrees The view angle is changed to an angle corresponding to the angle of the finger F, and the map data can be displayed according to the bird view.

29, when the display 210 displays the map data according to the bird view, if the user bends the finger F by 90 degrees on the pad 111 as shown in Figs. 30 and 31 The map data can be displayed according to the vertical view.

However, even if the user wants to view the map data according to the vertical view, it may be difficult to bend the finger F exactly 90 degrees. Therefore, the reference angle corresponding to the vertical view is set in advance, and when the user's finger F is bent at a reference angle or more, the map data can be displayed according to the vertical view. For example, when the reference angle is set to 70 degrees, the map data is displayed according to the vertical view if the angle of the user's finger (F) exceeds 70 degrees. If the angle is not over 70 degrees, Data can be displayed.

As described above, in order to change the view angle of the map data displayed on the display 210 according to the angle of the finger F on the operation unit 110, a process of calculating the angle of the finger F is required. This will be described in detail with reference to FIGS. 33 and 34. FIG.

33 is an example of a user image obtained when an operation for displaying a vertical view is applied, and FIG. 34 is an example of a user image obtained when an operation for displaying a bird view is applied.

If the user can obtain the user image I from the output signal of the object detection unit 112 and the user performs operations as shown in FIGS. 30 and 31 to display the vertical view, The user image I such as shown in FIG. 34 can be acquired when the operation as shown in FIG. 32 is performed to display the bird view.

The control signal generation unit 122 may calculate the distance between the finger edge J and the end of the finger F that is in contact with the pad 111 from the user image I, The distance between the end of the finger F shown in the user image I and the finger joint J depends on the degree to which the finger F is bent.

The control signal generation unit 122 may calculate the distance between the finger joint J and the operation unit 110 from the user image I. [ The brightness of the user image I varies depending on the distance between the operation unit 110 and the object. The examples of FIGS. 33 and 34 show that the closer the distance between the operation unit 110 and the object is, .

Accordingly, when the user bends the finger F vertically as shown in FIGS. 30 and 31, the end portion of the finger F touching the pad 111 appears dark, as shown in FIG. 33, Lt; / RTI >

32, when the user fingers the finger F as shown in FIG. 32, the brightness is uniformly or gradually brighter from the end portion of the finger F touching the pad 111 to the palm direction as in the example of FIG. 34 .

The control signal generating unit 122 can calculate the distance between the finger F and the operation unit 110 from the brightness pattern of the finger F displayed on the user image I, The angle of the finger F can be calculated based on the distance between the finger joints J and the distance between the finger joint J and the operation portion 110. [

30 to 32, the user manipulates the operation unit 110 using four fingers F, but it is not necessary to use all of the four fingers F, and instead of using two or more fingers F A control command relating to the view angle can be input through the operation unit 110. [ It is possible to press the pad 111 with two or more fingers F in advance to prevent confusion with other operations such as zooming operation, but it is also possible to bend the finger F after touching, It can be determined that the operation is for controlling the view angle.

When the angle of the finger F is calculated, the control signal generating unit 122 generates a control signal for changing the view angle according to the calculated angle of the finger F and transmits the control signal to the AVN apparatus 200, (230) controls the display (210) according to the transmitted control signal.

The vehicle control apparatus 100 can control various convenience devices provided in the vehicle 10 in addition to the AVN apparatus 200. [ As another example, the vehicle control apparatus 100 can control the air conditioning apparatus 300, which will be described in detail below.

35 is a control block diagram of a vehicle including a vehicle control device for controlling the air conditioner.

35, the vehicle 10 may include an air conditioner 300 together with the onboard controller 100, and the onboard controller 100 may control the air conditioner 300.

The air conditioner 300 can perform both heating and cooling of the interior of the vehicle 10, and as a concrete example, a condenser for condensing and liquefying the cooling medium, an evaporator for vaporizing the liquefied cooling medium, a compressor An indoor / outdoor door for selectively exhausting or introducing indoor air or outdoor air of the vehicle 10, a blower for sending the air introduced through the indoor / outdoor door to the evaporator, A cooling water line for cooling the heater core, a temperature control door provided between the evaporator and the heater core for controlling the flow of the heater core to the air passing through the evaporator, an air passage through the evaporator or heater core A ventilation hole for introducing air into the interior of the vehicle 10, and the like.

Since the air conditioner provided in the vehicle 10 is a well-known technology, a more detailed description thereof will be omitted.

Generally, a control command for the air conditioner 300 is inputted by operating a hard key provided in the center pace 33 of the dashboard 32. However, the vehicle 10 according to the embodiment may receive a control command for the air conditioning apparatus 300 using the control apparatus 100 for a vehicle.

For example, a menu screen related to the control of the air conditioner 300 is displayed on the display 210, and a user may input a control command by operating the operation unit 110 with the finger F as described above.

However, even when the menu screen related to the control of the air conditioner 300 is not displayed on the display 210, the user can operate the operation unit 110 to input the control command. Specifically, one area of the operation unit 110 is mapped to the control of the air conditioner 300, and when the mapped area is manually covered, the vehicle control apparatus 100 receives a control command for the air conditioner 300 .

The user can control the air conditioner 300 by operating the operation unit 110 when the vehicle control apparatus 100 can receive the control command for the air conditioner 300. [ For example, as shown in Fig. 26, one point of the pad 111 is pressed by the finger F, and the finger F is moved upward while keeping the pressure or touching the pad 111, The temperature can be lowered by moving it up or down.

The vehicle control device 100 mounted on the vehicle 10 may be used to control the position and angle of the seat and the various convenience devices provided in the vehicle 10 may be all controlled by the vehicle control device 100 It can be controlled.

Control of the vehicle using the above-described vehicle control device improves the operation feeling and convenience of the user and improves the accuracy of the operation by providing visual and tactile feedback to the user.

In addition, by performing the hot key function by a simple operation method, it is not necessary to provide a plurality of hard keys, thereby achieving a space saving effect and inputting a control command stably while driving.

10: vehicle 100: vehicle control device
110: Operation part 111: Pad
112: Object sensing unit 113: Pressure sensing unit
120: control unit 121: sensor control unit
122: control signal generator 200: AVN device
210: Display 220: Speaker
230: AVN control unit 241: GPS receiver
242:

Claims (28)

An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein,
And a control unit for acquiring a user image including a user's hand from an output signal of the object detection unit and determining whether a predetermined area of the operation unit is covered by the user's hand based on the user image,
Wherein the display comprises:
And displays a list of menus mapped to the preset area when a preset area of the operation part is covered by the hand of the user for more than a reference time. The method according to claim 1,
Wherein the object detection unit comprises:
A capacitive proximity sensor, an ultrasonic proximity sensor, and a photoelectric proximity sensor. The method according to claim 1,
Wherein,
And calculates the position or height of the object on the operation unit based on the output signal of the object detection unit. The method of claim 3,
Wherein,
And judges whether or not the operating portion is pressed by the object based on the height of the object on the operating portion. The method according to claim 1,
Wherein,
And a pressure sensing unit disposed under the object sensing unit for sensing pressure. The method of claim 3,
Wherein the display comprises:
And displays the pointing object at a position corresponding to the position of the object on the operation unit. The method according to claim 6,
Wherein the display comprises:
And displays the visual characteristic of the pointing object differently according to the height of the object on the operation unit. The method according to claim 6,
Wherein the display comprises:
A plurality of menu buttons are displayed,
Wherein,
And generates a control signal for selecting a menu button where the pointing object is located among the plurality of menu buttons when the operation unit is pressed. The method according to claim 1,
Wherein the display comprises:
(Bar) indicating a ratio of a time when the preset area of the operation unit is covered by the user's hand and the reference time. An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein,
And a control unit for acquiring a user image including a user's hand from an output signal of the object detection unit and determining whether a predetermined area of the operation unit is covered by the user's hand based on the user image,
Wherein the display comprises:
And displays a menu list mapped to the predetermined area when a predetermined area of the operation unit is pressed by the user's hand. An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein,
And a control unit for acquiring a user image including a user's hand from an output signal of the object detection unit and determining whether a predetermined area of the operation unit is covered by the user's hand based on the user image,
Wherein the display comprises:
And when the predetermined area of the operating portion is pressed by the user's hand, the vehicle is turned off. An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein,
And a control unit for acquiring a user image including a user's hand from an output signal of the object detection unit and determining whether a predetermined area of the operation unit is covered by the user's hand based on the user image,
The AVN apparatus includes:
And when the predetermined area of the operating portion is pressed by the user's hand, the vehicle is turned off. An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein,
And a control unit for acquiring a user image including a user's hand from an output signal of the object detection unit and determining whether a predetermined area of the operation unit is covered by the user's hand based on the user image,
Wherein the display comprises:
And is turned off when a predetermined area of the operation portion is covered by the user's hand. An operation unit including an object sensing unit for sensing an object in a non-contact manner including a plurality of sensors arranged in two dimensions, and a pad having elasticity, which is disposed on the object sensing unit and is made of a gel-like elastic body;
An AVN (Audio Video Navigation) device including a display; And
And a control unit for generating a control signal for controlling the AVN apparatus based on an output signal of the operation unit,
Wherein the display comprises:
Display map data for performing the navigation function,
Wherein,
Acquires a user image including a user's hand from an output signal of the object detection unit, and calculates an angle of a finger that contacts the pad based on the user image. 15. The method of claim 14,
Wherein the display comprises:
And displays the view angle of the map data differently according to the calculated angle of the finger. The method of claim 15, wherein
Wherein the display comprises:
And displays the map data according to the vertical view when the calculated angle of the calculated finger is equal to or greater than a reference angle. 16. The method of claim 15,
Wherein the display comprises:
And displays the map data according to a bird view corresponding to an angle of the calculated finger when the calculated angle of the finger is less than a reference angle. 15. The method of claim 14,
Wherein,
And is connected to the end portion of the armrest provided between the driver's seat and the assistant's seat.
delete delete delete delete delete delete delete delete delete delete

Images