KR101657947B1 - Apparatus and method for controlling menu of a vehicle having audio video bridging system - Google Patents
Apparatus and method for controlling menu of a vehicle having audio video bridging system Download PDFInfo
- Publication number
- KR101657947B1 KR101657947B1 KR1020150061382A KR20150061382A KR101657947B1 KR 101657947 B1 KR101657947 B1 KR 101657947B1 KR 1020150061382 A KR1020150061382 A KR 1020150061382A KR 20150061382 A KR20150061382 A KR 20150061382A KR 101657947 B1 KR101657947 B1 KR 101657947B1
- Authority
- KR
- South Korea
- Prior art keywords
- menu
- vehicle
- control
- user
- display unit
- Prior art date
Links
- 238000000034 method Methods 0.000 title abstract description 16
- 238000004891 communication Methods 0.000 claims abstract description 16
- 238000012790 confirmation Methods 0.000 claims description 12
- 239000011521 glass Substances 0.000 claims description 10
- 230000004397 blinking Effects 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 3
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60K—ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60K35/00—Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- B60W2050/08—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/146—Display means
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Human Computer Interaction (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention relates to an apparatus and method for controlling a menu of a vehicle to which an audio-video bridging system is applied. The apparatus includes a vehicle communication unit for communicating with a line-of-sight recognition apparatus and receiving sight line information of a user, A control menu related to the electronic device in the vehicle mapped on the basis of the sight line information of the user, information related to the vehicle equipment, or an image photographed by the camera is displayed on the display unit And a menu image storage unit for previously storing a control menu image related to the electronic apparatus.
Description
The present invention relates to an apparatus and method for controlling a menu of a vehicle to which an audio-video bridging system is applied. More particularly, the present invention relates to a menu control device for a menu of an electronic device mounted on a vehicle And more particularly, to an apparatus and method for controlling a menu of a vehicle to which an audio video bridging system is applied.
Recent vehicles have even more improved electronic devices.
For example, the electronic device is further equipped with a stereo and sound system, a navigation system, a rear auxiliary camera, an ambient view system, and a plurality of diagnostic sensors (e.g., laser, ultrasound, infrared, etc.).
As a result, as the installation and interoperation of various electronic devices becomes increasingly complicated and expensive, the automotive industry is studying audio-video bridging systems as a way to reduce cost and complexity.
It is also necessary to study a technique for controlling electronic devices mounted on a vehicle to which the audio-video bridging system is applied.
BACKGROUND OF THE INVENTION [0002] The background art of the present invention is disclosed in Korean Patent No. 10-1008506 filed on October 10, 2011, entitled Method and System for Centralized Vehicle Electronic System Using Ethernet with Audio-Video Bridging.
The present invention has been made to solve the above-mentioned problems, and an audio-video bridging system that enables a user to operate a menu of an electronic device mounted on a vehicle through a line of sight that a driver views through a line- And an apparatus and method for controlling a menu of an applied vehicle.
An apparatus for controlling a menu of a vehicle to which an audio-video bridging system according to an aspect of the present invention is applied includes a vehicle communication unit for communicating with a line-of-sight recognition apparatus and receiving sight line information of a user; At least one camera mounted on the inside or outside of the vehicle to photograph an image and output the selected image to the display unit under the control of the control unit; A control unit for outputting a control menu related to the electronic device in the vehicle mapped on the basis of the sight line information of the user, information related to the vehicle equipment, or an image photographed by the camera, to the display unit; And a menu image storage unit for previously storing a control menu image related to the electronic apparatus.
In the present invention, the eye recognizing device may include a line of sight recognition unit to be worn on a face of a user, the eye recognizing eyeglass may include at least a line of sight detection unit for detecting a line of sight or a viewing direction of the user; And a spectacle communication unit for transmitting the sight line or the watching direction information of the detected user to the vehicle communication unit.
In the present invention, the menu image storage unit may include a control menu having the same design as the design implemented in the electronic device, or a control menu that is different from the design implemented in the electronic apparatus, And at least one of them is stored.
In the present invention, when the display unit is a display of an AVN (Audio Video Navigation) apparatus, the control unit displays information related to the control menu or the vehicle goods in the entire display area, and when the display unit is a head- And displays information relating to the control menu or the vehicle article only on one side of the display area.
According to another aspect of the present invention, there is provided a method of controlling a menu of a vehicle to which an audio-video bridging system is applied, the method comprising: a control unit recognizing a user's gaze or gaze direction based on information transmitted from the gaze- Outputting, to the display unit, the control menu of the electronic device corresponding to the line of sight of the user or the viewing direction of the user or information related to the vehicle equipment; When the user's gaze or gaze direction is directed to the control menu of the electronic device or the information related to the car article in the predetermined time, the control unit displays the control menu or the vehicle article of the electronic device output to the display unit Maintaining an output of associated information for a further period of time; The control unit sensing input of a menu selection or menu confirmation information from the user while the control menu of the electronic device output to the display unit or the information related to the vehicle equipment is being output; And when the user inputs a menu selection or menu confirmation information while the information related to the control menu or the vehicle article of the electronic device output to the display unit is being output, And executing a corresponding menu selected via the menu.
The present invention allows a user to operate a menu of an electronic device mounted on a vehicle through a line of sight that the driver views through the line-of-sight detecting glasses worn by the driver, thereby fixing the driver's gaze forward and minimizing the driver's gaze dispersion, So that the menu can be operated.
BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a diagram illustrating a schematic configuration of a menu control apparatus for a vehicle to which an audio-video bridging system according to an embodiment of the present invention is applied; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a method for controlling a menu of a vehicle to which an audio video bridging system is applied.
FIG. 3 is an exemplary view for explaining a method of displaying a control menu and selecting a menu on the basis of a user's gaze in FIG. 2; FIG.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the like elements throughout.
In this process, the thicknesses of the lines and the sizes of the components shown in the drawings may be exaggerated for clarity and convenience of explanation. In addition, the terms described below are defined in consideration of the functions of the present invention, which may vary depending on the intention or custom of the user, the operator. Therefore, definitions of these terms should be made based on the contents throughout this specification.
FIG. 1 is a diagram illustrating a schematic configuration of a menu control apparatus for a vehicle to which an audio-video bridging system according to an embodiment of the present invention is applied.
1, the
At this time, the eye-recognizing
Since the
However, the eyeglass-recognizing
1, a
The
The
The
The
The
The
A control menu having the same design as the design implemented in the actual
The
When the
For example, when the size of the
In the present embodiment, when the size of the
The
The image of the
FIG. 2 is a flowchart illustrating a method of controlling a menu of a vehicle to which the audio-video bridging system according to an embodiment of the present invention is applied. FIG. Is displayed and selected. Hereinafter, a method of displaying a control menu of an electronic device on a head-up display and controlling a menu by using a sight line (sight direction) of a vehicle driver with reference to Figs. 2 and 3 will be described.
As shown in FIG. 2, the
The
The
For example, the
For example, when the
After the control menu of the
If the user's gaze (gazing direction) is not directed to the control menu of the
That is, the
However, if the user's gaze (gazing direction) is directed to the control menu of the
While the control menu of the
For example, the menu selection or menu confirmation information may include at least one of a user's gaze (gaze direction) holding time, eye blinking, and voice.
The control unit 13 displays the user's gaze (gaze direction) on the control menu of the
Accordingly, the user can select the menu by inputting the menu selection or menu confirmation information while the icon is displayed at a desired position (i.e., menu).
If input of menu selection or menu confirmation information is detected from the user (YES in S105) while the control menu of the
For example, when the selected menu is a menu related to the air conditioner, on / off of the air conditioner and temperature adjustment are performed, and when the selected menu is a menu related to the radio, on / off or channel of the radio can be adjusted.
However, if the input of the menu selection or the menu confirmation information is not detected by the user while the control menu of the
That is, the
FIG. 3 is an exemplary diagram illustrating a method of displaying a control menu and selecting a menu based on the user's line of sight (viewing direction) in FIG.
3 (a), when the user watches the room mirror for a predetermined time (for example, 0.5 seconds), the
3B, when the user watches the AVN device mounted on the vehicle for a predetermined time (for example, 0.5 second), the
As described above, according to the embodiment, the user can operate the menu of the electronic device mounted on the vehicle through the line of sight that the driver views through the line-of-sight detecting glasses worn by the driver, thereby fixing the driver's gaze to the front, So that the menu can be operated quickly and easily while minimizing the effect.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, I will understand the point. Accordingly, the technical scope of the present invention should be defined by the following claims.
100: Menu control device
110: vehicle communication section
120:
130:
140: menu image storage unit
200: Eyewear recognition glasses
210:
220:
310:
320: electronic device
Claims (5)
At least one camera mounted on the inside or outside of the vehicle to photograph an image and output the selected image to the display unit under the control of the control unit;
A control unit for outputting a control menu related to the electronic device in the vehicle mapped on the basis of the sight line information of the user, information related to the vehicle equipment, or an image photographed by the camera, to the display unit; And
And a menu image storage unit for previously storing a control menu image associated with the electronic apparatus,
Wherein the menu image storage unit stores both a control menu having the same design as the design implemented in the electronic device and a control menu different from the design implemented in the electronic device and designed to allow menu selection through the user's eyes,
The control unit adjusts the position and the size of the control menu or the information related to the vehicle article to match the size of the display unit when outputting information related to the control menu or the vehicle article related to the electronic device in the vehicle to the display unit , And when the display unit is a display unit of an AVN (Audio Video Navigation) apparatus, information related to the control menu or the vehicle article is displayed on the entire display unit, and when the display unit is the display unit of the head- The control menu or the information related to the vehicle article is displayed so that the menu can be easily selected by using the line of sight while being superimposed on the information originally outputted to the display unit,
The visual-recognition device according to claim 1, wherein the visual-recognition device comprises: a visual-line sensing unit for sensing at least a user's gaze or gaze direction; And a spectacle communication unit for transmitting the sight line or the watching direction information of the detected user to the vehicle communication unit,
The camera includes a camera of the surround view system, a rear camera, a front camera, a side camera, and a black box camera, and the camera image is transmitted through an AVB (Audio Video Bridge) And when the camera is a monolithic module including a microphone, the video and audio are transmitted to the controller through the AVB system,
The control unit recognizes the user's gaze or gaze direction on the basis of the information transmitted from the visual-recognition glasses, and displays information on the control menu of the electronic device corresponding to the user's gaze or direction And when the user's gaze or gaze direction is directed to the control menu of the electronic apparatus or the information relating to the car article output on the display unit within a predetermined time, Or the output of information related to the vehicle article for a predetermined period of time,
Wherein the control unit outputs a rear image to the display unit when the user watches the room mirror for a predetermined time and outputs the side mirror image to the display unit when the user watches the side mirror for a predetermined time,
If the user inputs a menu selection or menu confirmation information while the information related to the control menu or the vehicle article of the electronic apparatus is being output, the control unit displays the menu selected through the menu selection or the menu confirmation information And the menu selection and the menu confirmation information are input by one of the user's gaze, the holding time of the gaze direction, the blinking of the eyes, and the voice,
The control unit may further display an icon corresponding to the user's gaze or direction of sight on the information related to the control menu or the vehicle article of the electronic device output to the display unit, So that the user can select and execute the menu by inputting the menu selection or menu confirmation information in a state where the icon is displayed at a desired position or menu. A menu control device of the applied vehicle.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150061382A KR101657947B1 (en) | 2015-04-30 | 2015-04-30 | Apparatus and method for controlling menu of a vehicle having audio video bridging system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150061382A KR101657947B1 (en) | 2015-04-30 | 2015-04-30 | Apparatus and method for controlling menu of a vehicle having audio video bridging system |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101657947B1 true KR101657947B1 (en) | 2016-09-26 |
Family
ID=57068285
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150061382A KR101657947B1 (en) | 2015-04-30 | 2015-04-30 | Apparatus and method for controlling menu of a vehicle having audio video bridging system |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101657947B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018117560A1 (en) * | 2016-12-19 | 2018-06-28 | 삼성전자 주식회사 | Electronic device, mobile electronic device, and display device, which are controlled on basis of user gaze and input |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06323832A (en) * | 1993-05-13 | 1994-11-25 | Nissan Motor Co Ltd | Interface for vehicle |
JP2008230296A (en) * | 2007-03-16 | 2008-10-02 | Mazda Motor Corp | Vehicle drive supporting system |
JP2014174598A (en) * | 2013-03-06 | 2014-09-22 | Denso Corp | Vehicle input device |
-
2015
- 2015-04-30 KR KR1020150061382A patent/KR101657947B1/en active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06323832A (en) * | 1993-05-13 | 1994-11-25 | Nissan Motor Co Ltd | Interface for vehicle |
JP2008230296A (en) * | 2007-03-16 | 2008-10-02 | Mazda Motor Corp | Vehicle drive supporting system |
JP2014174598A (en) * | 2013-03-06 | 2014-09-22 | Denso Corp | Vehicle input device |
Non-Patent Citations (1)
Title |
---|
김동진 외 2인. 스마트차량용 Ethernet AVB 플랫폼 동향분석 . 한국인터넷정보학회, 인터넷정보학회지 16(1), 2015.6, 19-23 (5 pages). * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018117560A1 (en) * | 2016-12-19 | 2018-06-28 | 삼성전자 주식회사 | Electronic device, mobile electronic device, and display device, which are controlled on basis of user gaze and input |
US10962785B2 (en) | 2016-12-19 | 2021-03-30 | Samsung Electronics Co., Ltd. | Electronic device, mobile electronic device, and display device, which are controlled on basis of user gaze and input |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9001153B2 (en) | System and apparatus for augmented reality display and controls | |
KR101867915B1 (en) | Method for executing vehicle function using wearable device and vehicle for carrying out the same | |
KR101596751B1 (en) | Method and apparatus for displaying blind spot customized by driver | |
EP2441635B1 (en) | Vehicle User Interface System | |
KR101071777B1 (en) | Handling device for vehicle | |
US9517776B2 (en) | Systems, methods, and apparatus for controlling devices based on a detected gaze | |
US20150352953A1 (en) | Vehicle control system with mobile device interface | |
WO2015125243A1 (en) | Display control device, display control method for display control device, gaze direction detecting system, and callibration control method for gaze direction detecting system | |
US20190317328A1 (en) | System and method for providing augmented-reality assistance for vehicular navigation | |
JP4481187B2 (en) | Vehicle control device | |
KR20160050852A (en) | Control device for concentrating front view in hud system | |
US20120093358A1 (en) | Control of rear-view and side-view mirrors and camera-coordinated displays via eye gaze | |
KR20160071070A (en) | Wearable glass, control method thereof and vehicle control system | |
US10185392B2 (en) | Method for transmitting information to a driver of a motor vehicle, and adaptive driver assistance system | |
WO2018179786A1 (en) | Information display device | |
JP6804805B2 (en) | Head-up display device | |
US20100156782A1 (en) | Hand Control Image For Replication | |
WO2014049787A1 (en) | Display device, display method, program, and recording medium | |
KR20140079947A (en) | Video recording apparatus for a vehicle and Method of video recording for a vehicle | |
US9751406B2 (en) | Motor vehicle and method for controlling a climate control system in a motor vehicle | |
KR101657947B1 (en) | Apparatus and method for controlling menu of a vehicle having audio video bridging system | |
CN105323539A (en) | Automotive safety system and operating method thereof | |
GB2563647A (en) | Method of displaying an image | |
KR20130036492A (en) | Rear communication system using for vehicle and method thereof | |
JP2017125883A (en) | Eyeglass information display device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AMND | Amendment | ||
E601 | Decision to refuse application | ||
AMND | Amendment | ||
X701 | Decision to grant (after re-examination) | ||
GRNT | Written decision to grant |