KR20150072203A - Vehicle Control Apparatus And Vehicle Control Method Using the same - Google Patents

Vehicle Control Apparatus And Vehicle Control Method Using the same Download PDF

Info

Publication number
KR20150072203A
KR20150072203A KR1020130159598A KR20130159598A KR20150072203A KR 20150072203 A KR20150072203 A KR 20150072203A KR 1020130159598 A KR1020130159598 A KR 1020130159598A KR 20130159598 A KR20130159598 A KR 20130159598A KR 20150072203 A KR20150072203 A KR 20150072203A
Authority
KR
South Korea
Prior art keywords
selection module
coordinates
vehicle
hand
user interface
Prior art date
Application number
KR1020130159598A
Other languages
Korean (ko)
Inventor
김성운
석동희
Original Assignee
현대자동차주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 현대자동차주식회사 filed Critical 현대자동차주식회사
Priority to KR1020130159598A priority Critical patent/KR20150072203A/en
Publication of KR20150072203A publication Critical patent/KR20150072203A/en

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R16/00—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for
    • B60R16/02—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements
    • B60R16/023—Electric or fluid circuits specially adapted for vehicles and not otherwise provided for; Arrangement of elements of electric or fluid circuits specially adapted for vehicles and not otherwise provided for electric constitutive elements for transmission of signals between vehicle parts or subsystems
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08—Interaction between the driver and the control system
    • B60W50/10—Interpretation of driver requests or demands

Abstract

A vehicle control device according to an embodiment of the present invention comprises: a camera; an image processing unit to process an image recorded by the camera to recognize the hand and generate coordinates of the end point of the hand; an information control unit to control information on a vehicle through a user interface with a selection module; and a control unit to match coordinates of the end point of the hand to coordinates of the selection module in order to control the movement of the selection module with the movement of the tip of the hand. One objective of the vehicle control device and the vehicle control method using the same is to provide extended hovering and thus minimize a risk resulting from the control while driving a vehicle.

Description

[0001] The present invention relates to a vehicle control apparatus and a vehicle control method using the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a vehicle control apparatus and a vehicle control method using the same, and more particularly, to a technique of recognizing a user's hand and controlling the vehicle using a gesture of a hand.

2. Description of the Related Art Generally, a touch screen, a touch pad, a driver information system (DIS), and the like are used as an information control device of a vehicle.

In the case of the touch screen, the information display unit and the control unit coincide with each other in a space so that the user can control it very intuitively and is used as a convenient user interface (UI) control system for various applications such as pinch and rotation through multi touch. However, in the vehicle, there is a problem that the driver's eyes and hands are fixed to the touch screen during the touch control, which interferes with driving and is dangerous to the driver.

In the case of the touch pad and DIS, the risk of control is reduced because the driver's hand is located near the armrest, but the driver's gaze must be fixed on a separate display, which is a danger to the operation.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned needs, and it is an object of the present invention to provide a vehicle control apparatus and a vehicle control method using the same to provide extended hovering to minimize the risk of control during operation.

Also, by applying a method of expanding the area of the touch pad, it is possible to minimize the dispersion of the line of sight that the driver is looking for the touch pad.

In addition, to reduce costs by using existing cameras in the car.

The technical objects to be achieved by the present invention are not limited to the above-mentioned technical problems, and other technical subjects which are not mentioned can be clearly understood by those skilled in the art from the description of the present invention .

A vehicle control apparatus according to an embodiment of the present invention includes: a camera; An image processor for recognizing a hand by image processing the image photographed by the camera and generating coordinates of an end point of the hand; An information control unit for controlling vehicle information through a user interface including a selection module; And a controller for controlling the movement of the selection module by moving the fingertip in correspondence with the coordinate of the selection module.

The vehicle control apparatus and the vehicle control method using the same according to the present invention provide extended hovering to minimize the risk of control during operation.

Further, by applying a method of expanding the area of the touch pad, it is possible to minimize the dispersion of the line of sight that the driver searches for the touch pad.

In addition, it can reduce the cost by utilizing the camera in the existing vehicle.

1 is a diagram showing a configuration of a vehicle control apparatus according to an embodiment of the present invention.
2 is a flowchart showing a vehicle control method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art to which the present invention pertains. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention, parts not related to the description are omitted, and the same or similar components are denoted by the same reference numerals throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have.

1 is a diagram showing a configuration of a vehicle control apparatus according to an embodiment of the present invention.

Hereinafter, a vehicle control apparatus 1 according to an embodiment of the present invention will be described with reference to Fig.

The vehicle control apparatus 1 performs image processing of the photographed driver image to recognize the driver's hand, and controls the movement of the selection module (e.g., cursor) of the user interface by using the recognized movement of the fingertip. The vehicle control apparatus 1 controls information of the vehicle using a user interface.

The vehicle control apparatus 1 includes a camera 10, an image processing unit 20, an information control unit 30, a control unit 40 and a touch pad 50. [

The camera 10 is installed inside the vehicle and can photograph a driver. The camera 10 can be a stereoscopic (3D) camera and can photograph a stereoscopic image of the driver.

The image processing unit 20 may image the image photographed by the camera 10 and extract only the shape of the driver from the photographed image. The image processing unit 20 can detect the shape of the driver's hand on the touch pad among the extracted driver shapes. The image processing unit 10 can generate hand end point coordinates using the detected image pattern of the hand image. The generated coordinates may be plane coordinates including X-axis and Y-axis coordinates, or spatial coordinates including X-axis, Y-axis, and Z-axis coordinates, but are not limited thereto.

The image processing unit 20 may generate the coordinates of the hand end point within the boundary of the touch pad 50 as the start coordinates and generate the hand end point coordinates even if the hand moves away from the boundary of the touch pad 50. [

The touch pad 50 is a pad for recognizing the touch of the driver's hand. A plurality of metal electrodes are arranged in the X and Y axes to measure a change in impedance caused by the finger, thereby recognizing the touch of the driver and transmitting the recognized touch information to the control unit 30 send. The electrode of the touch pad 50 can recognize the single touch, but recognizes the multi-touch or the touch.

The touch pad 50 may display a specific pattern (e.g., a square, a barcode shape) at the boundary thereof so that the image processing unit 20 detects the driver's hand on the touch pad 50. [ The touch pad 50 may display a specific pattern (e.g., a rectangle, a barcode shape) at its boundary so as to reflect only the motion intended by the driver.

The touch pad 50 may include a metal electrode of a vehicle interior part, a controller for detecting capacitance, and a wire connecting the metal electrode and the controller, but is not limited thereto. The touch pad 50 may be placed in an armrest, a console, a seat, or the like inside the vehicle, but is not limited thereto.

The information control unit 30 controls vehicle information through a user interface (UI) including a selection module. The controlled vehicle information is not limited to the vehicle control information such as audio, navigation, room mirror, start-up, and the like.

The user interface (UI) may be a graphical user interface (GUI) and may include a plurality of applications that control various functions of the vehicle. The function of the controlled vehicle may include various functions of the vehicle such as audio, navigation, room mirror, start-up. Each of the plurality of applications may be displayed as an icon on a graphical user interface (GUI), and the selection module may be located on at least one of the plurality of icons and may be selected by the touch of the driver One application can be run, controlled or terminated.

The control unit 40 controls the movement of the selection module by moving the fingertip in correspondence with the coordinates of the operator's hand end point to the coordinates of the selection module.

2 is a flowchart showing a vehicle control method according to an embodiment of the present invention.

Hereinafter, a vehicle control method according to an embodiment of the present invention will be described with reference to FIG.

In the step S10 of photographing the vehicle driver's image, the camera 10 photographs the driver's shape inside the vehicle.

In step S20 of generating the end point coordinates of the hand, the image processing unit 20 detects the hand by image processing the photographed image, and generates hand end point coordinates using the detected image pattern of the hand image.

In the step S30 of controlling the movement of the selection module, the control unit 30 controls the movement of the selection module by moving the fingertip in correspondence with the coordinate of the selection module (cursor) of the user interface.

At least one application selected by the touch of the driver recognized by the touch pad 50 is executed, controlled or terminated in the vehicle information control step S40, so that the information control unit 30 controls the audio , Navigation, room mirror, start-up, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, , Changes, deletions, additions, and so forth, other embodiments may be easily suggested, but these are also within the scope of the present invention.

1: vehicle control device
10: Camera
20:
30: Information control unit
40:
50: Touchpad

Claims (11)

camera;
An image processor for recognizing a hand by image processing the image photographed by the camera and generating coordinates of an end point of the hand;
An information control unit for controlling vehicle information through a user interface including a selection module; And
And a control unit for controlling the movement of the selection module by moving the fingertip in correspondence with the coordinates of the hand module to the coordinates of the selection module. The method according to claim 1,
A touch pad,
Wherein the information control unit associates a touch recognized by the touch pad with a click of the selection module and controls the vehicle information to be controlled by a click of the selection module. 3. The method of claim 2,
Wherein the image processing unit generates coordinates of a hand end point in the boundary of the touch pad as start coordinates,
Wherein the control unit controls movement of the selection module by associating the start coordinates with start coordinates of the selection module. The method of claim 3,
Wherein the user interface is a graphical user interface and the graphical user interface comprises at least one application for controlling the vehicle,
Wherein the at least one application is selected and located on an icon representing the at least one application, and the at least one application is executed, controlled or terminated with a touch recognized by the touch pad. The method according to claim 1,
Wherein the camera is a 3D camera. 3. The method of claim 2,
Wherein the touch pad is located in any one of an armrest, a console, and a seat inside the vehicle. Photographing a vehicle driver's image;
Recognizing a hand by image processing the photographed image and generating coordinates of an end point of the hand;
Controlling movement of the selection module by moving the fingertip in correspondence with the coordinate of the selection module of the user interface;
And controlling the vehicle information with the selection module. 8. The method of claim 7,
Wherein the step of generating the endpoint coordinates of the hand comprises generating finger coordinates of the endpoint within the boundary of the touchpad as starting coordinates,
Wherein the step of controlling the movement of the selection module controls the movement of the selection module by associating the start coordinates with the start coordinates of the selection module. 9. The method of claim 8,
Wherein the step of controlling the vehicle information comprises:
And a step in which the touch recognized by the touch pad corresponds to a click of the selection module, and the vehicle information is controlled by a click of the selection module. 10. The method of claim 9,
Wherein the user interface is a graphical user interface and the graphical user interface comprises at least one application for controlling the vehicle,
Wherein the step of controlling the vehicle information comprises:
Selecting the at least one application by the selection module; And
Wherein the at least one application is executed, controlled or terminated with a touch recognized by the touch pad. 8. The method of claim 7,
Wherein the step of photographing the vehicle driver image comprises photographing a stereoscopic image using a 3D camera.
KR1020130159598A 2013-12-19 2013-12-19 Vehicle Control Apparatus And Vehicle Control Method Using the same KR20150072203A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130159598A KR20150072203A (en) 2013-12-19 2013-12-19 Vehicle Control Apparatus And Vehicle Control Method Using the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020130159598A KR20150072203A (en) 2013-12-19 2013-12-19 Vehicle Control Apparatus And Vehicle Control Method Using the same

Publications (1)

Publication Number Publication Date
KR20150072203A true KR20150072203A (en) 2015-06-29

Family

ID=53518270

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130159598A KR20150072203A (en) 2013-12-19 2013-12-19 Vehicle Control Apparatus And Vehicle Control Method Using the same

Country Status (1)

Country Link
KR (1) KR20150072203A (en)

Similar Documents

Publication Publication Date Title
US10466794B2 (en) Gesture recognition areas and sub-areas for interaction with real and virtual objects within augmented reality
US10203764B2 (en) Systems and methods for triggering actions based on touch-free gesture detection
US20190302895A1 (en) Hand gesture recognition system for vehicular interactive control
US9389779B2 (en) Depth-based user interface gesture control
US20180101248A1 (en) Head-mounted display system, head-mounted display, and head-mounted display control program
JP5261554B2 (en) Human-machine interface for vehicles based on fingertip pointing and gestures
EP2908215B1 (en) Method and apparatus for gesture detection and display control
US20140361989A1 (en) Method and Device for Operating Functions in a Vehicle Using Gestures Performed in Three-Dimensional Space, and Related Computer Program Product
EP3008551A1 (en) Systems and methods for performing a device action based on a detected gesture
JP6390799B2 (en) Input device, input method, and program
US10156938B2 (en) Information processing apparatus, method for controlling the same, and storage medium
WO2014106219A1 (en) User centric interface for interaction with visual display that recognizes user intentions
US10296101B2 (en) Information processing system, information processing apparatus, control method, and program
KR101708455B1 (en) Hand Float Menu System
JP2016126687A (en) Head-mounted display, operation reception method, and operation reception program
JP6319220B2 (en) Transparent wearable terminal, data processing apparatus, and data processing system
JP2015118507A (en) Method, device, and computer program for selecting object
KR20150072203A (en) Vehicle Control Apparatus And Vehicle Control Method Using the same
US20230386093A1 (en) Changing Locked Modes Associated with Display of Computer-Generated Content
US20160283103A1 (en) Electronic devices provided with touch display panel
US11416140B2 (en) Touchscreen devices to transmit input selectively
JP2017228216A (en) Information processing apparatus, control method therefor, program, and storage medium
JP2016115039A (en) System, program, and method enabling pointer operation on head-mounted display with touch panel type device
JP2018041354A (en) Pointer control system and pointer control program
JP2016045918A (en) Information processing apparatus, information processing method, and information processing program

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E90F Notification of reason for final refusal
AMND Amendment
E601 Decision to refuse application
E801 Decision on dismissal of amendment
AMND Amendment
E801 Decision on dismissal of amendment