KR101558369B1 - In-vehicle infotainment device and method for controlling thereof - Google Patents

Abstract

A vehicle infotainment apparatus according to an embodiment of the present invention detects a gesture on a first image captured by a camera, a display unit, and a camera, determines a position in the vehicle where a gesture is detected, And a control unit for displaying a second image related to the function to the occupant in the position on the display unit.

Description

TECHNICAL FIELD [0001] The present invention relates to a vehicle infotainment device and a vehicle infotainment device control method,

The present invention relates to a user interface technology, and more particularly, to a vehicle infotainment device and a vehicle infotainment device control method that accurately recognize a gesture of a user.

An in-vehicle infotainment device is installed in a vehicle to display information related to the vehicle and can be connected to various driver assistance systems, in particular a navigation system, a vehicle communication system, a driving and parking assistance system and a crash warning system.

As the functions of the vehicle infotainment device become diversified, the infotainment device for a vehicle is implemented in the form of a multimedia device having a complex function of playing music, moving picture files, receiving games, and receiving broadcasts, for example.

To support and enhance the functionality of such a vehicle infotainment device, it may be contemplated to improve the structural and / or software portion of the infotainment device for a vehicle.

There is a demand for a vehicle infotainment device for providing a user interface (UI) that is easy for a passenger of a vehicle to operate.

It is an object of the present invention to provide a vehicle infotainment apparatus and a control method thereof, which are provided to satisfy the above-mentioned necessity, and which individually provide a function of a vehicle to a passenger of the vehicle.

It is another object of the present invention to provide a vehicular infotainment apparatus and a control method thereof for allowing a passenger of the vehicle to conveniently control the vehicle.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the precise forms disclosed. Other objects, which will be apparent to those skilled in the art, There will be.

In order to achieve the above object, an infotainment system for a vehicle according to an embodiment of the present invention detects a gesture in a first image photographed by a camera, a display unit and a camera, determines a position in the vehicle where a gesture is detected, And a control unit for controlling the vehicle to provide a function corresponding to the gesture and displaying a second image related to the function to the occupant in the display unit.

The control unit can detect the passenger's hand in the first image and detect the motion of the hand with the gesture.

When the hand of the passenger is detected, the control unit can control the camera to photograph the hand of the passenger by zooming in.

The controller may determine an area in which the gesture is detected in the image frame divided into the plurality of areas, and determine the position in the vehicle corresponding to the area in which the gesture is detected.

The control unit can control the vehicle such that, when a plurality of gestures are detected, functions corresponding to the plurality of gestures are separately provided to a plurality of positions in the vehicle in which a plurality of gestures are detected.

The control unit may display a plurality of second images related to the functions corresponding to the plurality of gestures to the passengers at the plurality of positions in a multi-view image on the display unit.

A method for controlling a vehicle infotainment apparatus according to an embodiment of the present invention includes a step of photographing a first image with a camera, a step of detecting a gesture in a first image, a step of determining a position in the vehicle where the gesture is detected, Controlling the vehicle so that a corresponding function is provided, and displaying a second image related to the function to the occupant of the position.

The step of detecting the gesture in the first image may include detecting the occupant's hand in the first image and detecting the motion of the hand with the gesture.

The step of detecting the occupant's hand in the first image may include the step of controlling the camera to zoom in and photograph the occupant's hand when the occupant's hand is detected.

The step of determining a position in the vehicle includes a step of determining a region where the gesture is detected in an image frame included in the first image and divided into a plurality of regions, and a step of determining a position in the vehicle corresponding to an area in which the gesture is detected .

The step of controlling the vehicle may include controlling the vehicle such that, when a plurality of gestures are detected, functions corresponding to the plurality of gestures are separately provided to a plurality of positions in the vehicle in which a plurality of gestures are detected.

The step of displaying the second image may include displaying the plurality of second images related to the functions corresponding to the plurality of gestures to the passengers at the plurality of positions in a multi-view image on the display unit.

The effects of the vehicle infotainment apparatus according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, there is an advantage that the function of the vehicle can be individually provided to the occupant of the vehicle.

According to at least one of the embodiments of the present invention, the passenger of the vehicle can control the vehicle conveniently.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of an infotainment apparatus for a vehicle according to an embodiment of the present invention.
2 is a flowchart illustrating a method for controlling a vehicle infotainment apparatus according to an embodiment of the present invention.
3 is an exemplary view of a vehicle infotainment apparatus according to an embodiment of the present invention as viewed from the inside of the vehicle.
4 is an exemplary view showing the interior of a vehicle in which a camera, a display unit, and an acoustic output module of the infotainment device for a vehicle according to an embodiment of the present invention are installed.
5 is an exemplary view showing an image taken by a camera of a vehicle infotainment apparatus according to an embodiment of the present invention.
FIG. 6 is an exemplary view showing a display unit of a vehicle infotainment apparatus and an interior of a vehicle according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An infotainment apparatus for a vehicle according to the present invention will be described in detail below with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer or the like, a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal , A PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and a navigation device, as will be appreciated by those skilled in the art.

1 is a block diagram of an infotainment apparatus 100 for a vehicle according to an embodiment of the present invention.

The vehicle infotainment apparatus 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, so that a vehicle infotainment device having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the vehicle infotainment device 100 and the wireless communication system or between the infotainment device 100 and the network where the infotainment device 100 is located . For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. More than one such broadcast receiving module may be provided to the infotainment device 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server that generates and transmits broadcast signals and / or broadcast-related information, or a server that receives the generated broadcast signals and / or broadcast-related information and transmits the information to the infotainment device 100 for vehicles . The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (DVB-CBMS), OMA-BCAST (Open VEHICLE Alliance-Broadcast), CMMB (China Multimedia VEHICLE Broadcasting), MBHMS (VEHICLE Broadcasting Business Management System), ISDB-T Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for VEHICLE communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and can be built in or externally mounted on the infotainment device 100 for a vehicle. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for acquiring the position of the infotainment device for a vehicle, and a representative example thereof is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment. The camera 121 may be provided on a rearview mirror, an instrument panel of a vehicle driver's seat, a dashboard, a center fascia, a headrest rear surface of each seat, and the like.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the infotainment apparatus 100 for a vehicle. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 located on the front of the infotainment apparatus 100 for a vehicle, and may include a keypad, a dome A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the infotainment apparatus 100 and generates a sensing signal for controlling the operation of the infotainment apparatus 100 for a vehicle. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed in the infotainment apparatus 100 for a vehicle. For example, when a vehicle infotainment device is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

There may be two or more display units 151 according to the embodiment of the infotainment apparatus 100 for a vehicle. For example, in the vehicular infotainment apparatus 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor may be stacked on the display unit 151 to form a layer structure when the touch sensor has a form of a touch film, a touch sheet, a touch pad, or the like. ≪ / RTI >

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed within an interior region of the infotainment device for a vehicle wrapped by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 can output audio data received from the wireless communication unit 110 or stored in the memory 160. [ The sound output module 152 also outputs sound signals related to functions performed in the infotainment device 100 for a vehicle. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like. The sound output module 152 may be provided in the vehicle in plural or may be provided at a position corresponding to the seat of the vehicle.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the infotainment apparatus 100 for a vehicle. Examples of events that occur in the infotainment device 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound output module 152 may be a type of the alarm unit 153. The display unit 151 and the sound output module 152 may be connected to the display unit 151 or the sound output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the infotainment device 100 for a vehicle.

The memory unit 160 may store a program for processing and control of the controller 180 or may perform a function for temporarily storing input / output data. The frequency of use of each of the data may be stored in the memory unit 160.

In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The vehicle infotainment apparatus 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a pathway to all the external devices connected to the infotainment device 100 for a vehicle. The interface unit 170 receives data from an external device or supplies power to each component in the infotainment device 100 for a vehicle or allows data in the infotainment device 100 to be transmitted to an external device. For example, a port for connecting a device with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, O (input / output) port, an earphone port, and the like may be included in the interface unit 170.

When the infotainment apparatus 100 is connected to an external cradle, the interface unit may be a path through which the power from the cradle is supplied to the infotainment apparatus 100 for the vehicle, or various command signals input from the cradle by the user And can be a passage that is transmitted to the infotainment device for a vehicle. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the inflatabging device for the vehicle is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the infotainment device for a vehicle. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Since the vehicle infotainment apparatus 100 can be operated even while the vehicle is running, it is necessary to provide a convenient user interface to the occupant of the vehicle. Accordingly, the present invention can provide an infotainment apparatus 100 for a vehicle and an infotainment apparatus control method for a vehicle that can provide the passengers with the functions required by the passengers individually, thereby improving the safety even when the vehicle is running and enabling the passengers to intuitively operate the vehicle .

Hereinafter, a vehicle infotainment device control method for detecting a gesture of a passenger photographed by a camera 121 and providing a function corresponding to a gesture to a passenger will be described with reference to Fig.

2 is a flowchart showing a method of controlling the infotainment apparatus 100 for a vehicle according to an embodiment of the present invention.

First, the camera 121 captures an image (S10). The camera 121 can take a picture of the inside of the vehicle 10 as a whole. For example, the camera 121 can take a photograph so that the passenger power of the vehicle 10 is divided. In addition, the camera 121 can photograph at least one of the passengers by zooming in.

Next, the control unit 180 detects the gesture in the image photographed by the camera 121 (hereinafter referred to as the first image) (S20). The control unit 180 may detect the hands of the driver or the passenger by using values such as color, saturation, and brightness of pixels in at least one image frame included in the first image.

Then, the control unit 180 can detect the shape of the hand, the movement of the hand or the movement of the hand, and the like with a gesture. At this time, the operation of the passenger detected by the gesture to the control unit 180 is not limited to this.

At this time, when the control unit 180 recognizes the passenger's hand on the first image, the control unit 180 can control the camera 121 to zoom in on the passenger's hand and shoot the image.

Then, the control unit 180 determines the position in the vehicle 10 where the gesture is detected (S30). The control unit 180 may determine an area where the gesture is detected in the image frame divided into the plurality of areas, and determine the position in the vehicle 10 corresponding to the area where the gesture is detected. This will be described later with reference to FIG.

Next, the control unit 180 controls the vehicle 10 so as to provide the function corresponding to the gesture to the determined position (S40).

For example, when the function corresponding to the detected gesture is an operation for increasing the air volume of the air blowing port of the air conditioner installed in the vehicle 10, the control unit 180 controls the air conditioner It is possible to increase the air volume of the blowing port corresponding to the position where the middle gesture is detected.

The function corresponding to the gesture is not limited to the above example, but includes a function provided to an occupant by an electronic device or a mechanical device installed in the vehicle 10. [

Then, the control unit 180 displays a second image related to the function corresponding to the gesture to the occupant of the determined position (S50). The control unit 180 may display a multi-view image corresponding to the view of a plurality of passengers aboard the vehicle 10 on the display unit 151. [

At this time, the multi-view image may be displayed considering the type of the occupant determined in the first image. For example, the control unit 180 measures a seat occupant's sitting height or an eye level of a passenger, generates a multi-view image such that a plurality of images corresponding to the passenger's sight are displayed on one display unit 151, Can be displayed on the display section (151).

Next, the camera 121, the display unit 151, and the sound output module 152 of the infotainment device 100 for a vehicle will be described with reference to Fig.

3 is an exemplary view of the infotainment apparatus 100 for a vehicle according to an embodiment of the present invention viewed from the inside of the vehicle 10. As shown in the figure, the camera 121 may be installed at the lower end of the rearview mirror to take a picture of the inside of the vehicle 10 as a whole. The camera 121 may be connected to an actuator that drives the camera 121 to move.

The display unit 151 may be installed at the center of the center fascia of the vehicle 10. When the vehicle 10 is arranged in two rows, the display unit 151 may display both the first view image of the first-row seat occupant and the second view image of the second-row seat occupant.

The control unit 180 may combine the first view image and the second view image to display the multi-view image on the display unit 151. [ This is a display method in which left and right images are refracted through a lenticular screen in which lenticular lenses are vertically arranged and different images are transmitted through the human eyes.

In addition, various methods such as an active shutter glasses method for displaying multi-view images have been introduced or commercialized. Hereinafter, the present invention should not be construed to be limited by some exemplary methods, although the specific method of providing the multi-view image by the display unit 151 is not mentioned.

Next, a plurality of sound output modules 152 may be installed in the vehicle 10. For example, the first speaker 152a may be installed at the door of the driver's seat side vehicle 10, and the second speaker 152b may be installed at the door of the passenger side vehicle 10. [ The volume of sound output to the first speaker 152a and the second speaker 152b can be controlled individually.

Hereinafter, with reference to FIG. 4, a description will be given of a method for the infotainment device 100 for a vehicle to detect the position of the occupant and determine the position.

4 is an exemplary view showing the interior of a vehicle 10 in which a camera 121, a display unit 151, and an audio output module 152 of the infotainment device 100 according to an embodiment of the present invention are installed. As shown, the plurality of sound output modules 152 can be disposed in the vehicle interior in correspondence with the seats inside the vehicle. Then, the camera 121 can photograph a seat in the vehicle and its periphery.

The first image 300 captured by the camera 121 will be described with reference to FIG.

5 is a diagram illustrating an example of a first image 300 captured by a camera 121 of a vehicle infotainment apparatus 100 according to an embodiment of the present invention. As shown in the figure, the passengers 200a, 200b, 200c, and 200d who are seated in the vehicle seat can be photographed in the first image 300. [ In addition, the image frame included in the first image 300 may be divided into a plurality of regions corresponding to a seat in the vehicle.

If the gesture is detected, the controller 180 can determine the area where the gesture is detected. For example, when the operation of shaking the hand of the second occupant 200b to the left and right is photographed by the camera 121 and the control unit 180 detects an operation of shaking the hand from side to side by gesture, It is possible to determine an area in the detected image frame and determine that the determined area is an area corresponding to the position of the second occupant 200b. That is, the controller 180 can determine that the gesture is detected in the lower left region of the image frame.

Then, the control unit 180 can control the vehicle 10 such that the function corresponding to the action detected by the gesture is provided to the position of the second occupant 200b. For example, when the control unit 180 detects an operation of swinging the hand from side to side with a gesture and the function corresponding to the detected gesture is an operation of increasing the output volume of the speaker 152, The volume of the second speaker 152b corresponding to the position can be increased.

Next, a method of displaying the second image on the display unit 151 will be described with reference to FIG.

6 is an exemplary view showing the interior of the display unit 151 and the vehicle 10 of the infotainment device 100 for a vehicle according to an embodiment of the present invention. As shown in the figure, the display unit 151 may display a first view image displayed to the first occupant 200a and a second view image displayed to the second occupant 200b.

For example, when the control unit 180 increases the volume of the second speaker 152b by the gesture of the second occupant 200b, the control unit 180 displays the volume of the second speaker 152b is increased The second viewpoint image can be generated and displayed on the display unit 151 together with the first viewpoint image. At this time, the first viewpoint image is displayed on the first passenger 200a, and the second viewpoint image can be displayed on the second occupant 200b only.

That is, individual images are displayed on one display unit 151, and a multi-view image can be generated so that an image corresponding to the viewpoint of the passenger provided with the function according to the gesture displays a screen related to the function.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: vehicle infotainment device 110: wireless communication section
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (12)

camera;
A display unit; And
A gesture detection unit for detecting a gesture in a first image captured by the camera, determining a position in the vehicle where the gesture is detected, controlling the vehicle to provide a function corresponding to the gesture to the position, A controller for displaying a second image related to the function to a passenger at a position;
And an inflator for inflating the vehicle. The method according to claim 1,
Wherein the control unit detects a hand of the occupant in the first image and detects an operation of the hand by a gesture. 3. The method of claim 2,
Wherein the controller controls the camera to zoom in on the occupant's hand when the hand of the occupant is detected. The method according to claim 1,
Wherein the controller determines an area where the gesture is detected in an image frame included in the first image and divided into a plurality of areas and determines a position in the vehicle corresponding to an area where the gesture is detected. The method according to claim 1,
Wherein the control unit controls the vehicle such that functions corresponding to the plurality of gestures are separately provided to a plurality of positions in the vehicle where the plurality of gestures are detected, when the plurality of gestures are detected. 6. The method of claim 5,
Wherein the controller displays a plurality of second images related to functions corresponding to the plurality of gestures to the passengers at the plurality of positions in a multi-view image on the display unit. Capturing a first image with a camera;
Detecting a gesture in the first image;
Determining a position in the vehicle where the gesture is detected;
Controlling the vehicle such that a function corresponding to the gesture is provided to the position; And
Displaying a second image associated with the function to a passenger at the location;
And controlling the infotainment device. 8. The method of claim 7,
Wherein the step of detecting a gesture in the first image comprises:
Detecting a hand of the occupant in the first image; And
Detecting an operation of the hand with a gesture;
And controlling the infotainment device. 9. The method of claim 8,
Wherein detecting the hands of the occupant in the first image comprises:
And controlling the camera to zoom in on the occupant's hand so as to photograph the inflator when the hand of the occupant is detected. 8. The method of claim 7,
Wherein the step of determining a position in the vehicle comprises:
Determining a region included in the first image and in which a gesture is detected in an image frame divided into a plurality of regions; And
Determining a position in the vehicle corresponding to an area in which the gesture is detected;
And controlling the infotainment device. 8. The method of claim 7,
The step of controlling the vehicle includes:
And controlling the vehicle so that functions corresponding to the plurality of gestures are separately provided to a plurality of positions in the vehicle where the plurality of gestures are detected, when the plurality of gestures are detected. 12. The method of claim 11,
Wherein the displaying the second image comprises:
And displaying a plurality of second images related to the functions corresponding to the plurality of gestures to the passengers at the plurality of positions in a multi-view image on the display unit.

Images