KR101638610B1 - Apparatus for communicating with wearable device in car and method for controlling the same - Google Patents

Abstract

The present invention relates to a vehicle device and a wearable device. A method of controlling an on-vehicle apparatus capable of communicating with a wearable device according to an embodiment of the present invention includes the steps of communicating with a wearable device, receiving photographic information of a specific point in the vehicle from the wearable device connected to the communication, And estimating a first position of the wearable device with reference to the memory and controlling to change a second position of at least one component in the vehicle corresponding to the first position .

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a vehicle device capable of communicating with a wearable device,

The present invention relates to a wearable device and a vehicle device. For example, it is applicable to a technical field for controlling the position of at least one component in a vehicle through data communication between the vehicle device and the wearable device.

The frequency of use of the multimedia system in the vehicle is increasing, and the function of the multimedia system of the vehicle is becoming more complicated according to the needs of the user. Further, when a plurality of users (for example, family members) use one vehicle, there is a problem in that the position of the steering wheel, the angle of the side mirror or the room mirror, and the position of the driver seat have to be manually changed every time .

Recently, a method of predetermining the position of the above-mentioned components in the vehicle has been introduced for a plurality of users. However, this is also required at least for the manual setting of the user at least once, and even if the driver is the same driver, There was a problem to be changed.

One embodiment of the present invention provides a solution that automatically optimizes the position of in-vehicle components for each driver and when the driver seats, without having to manually set the components in the vehicle I want to.

Another embodiment of the present invention provides a method for minimizing an error in calculating a position of an in-vehicle component optimized for a driver who is seated by using a wearable device (for example, glass) do.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to another aspect of the present invention, there is provided a method of controlling a vehicle device, the method comprising: communicating with a wearable device; receiving shot information of a specific point in the vehicle from the wearable device connected to the vehicle; Estimating a first position of the wearable device with reference to the memory and controlling to change a second position of at least one component in the vehicle corresponding to the first position do.

The vehicle apparatus according to an embodiment of the present invention includes a communication unit in which a communication connection is established with a wearable device, a memory that stores at least one position related information, and a control unit that controls the communication unit and the memory, The control unit estimates a first position of the wearable device by referring to the memory when photographing information of a specific point in the vehicle is received from the wearable device connected to the communication, And controls to change the second position of at least one component.

According to another aspect of the present invention, there is provided a method of controlling a wearable device, the method comprising: communicating with an in-vehicle device; And transmitting the video data including the photographed point to the in-vehicle apparatus connected to the communication.

A wearable device according to an embodiment of the present invention includes a wireless communication module in which a communication connection is established with an in-vehicle device, a camera that photographs at least one point in the vehicle according to a predetermined guide of audio or video type, And a controller for controlling the wireless communication module to transmit video data including a point photographed by the camera to the in-vehicle apparatus connected to the communication.

According to at least one embodiment of the present invention, there are the following effects.

First, according to an embodiment of the present invention, it is possible to automatically change the position of the in-vehicle component elements for each driver automatically and at the time when the driver is seated, without having to manually set the components in the vehicle Solution.

According to another embodiment of the present invention, there is provided an additional method for minimizing an error in calculating a position of an in-vehicle component optimized for a driver who is seated by using a wearable device (for example, glass) There is a technical effect to be presented.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram showing an example of a configuration of an AVN system according to an embodiment of the present invention.
2 shows an example of a wearable device that can be applied to embodiments of the present invention.
3 is a flowchart illustrating a communication connection between a car and a wearable device according to an embodiment of the present invention.
4 is a view for explaining a process in which a wearable device according to an embodiment of the present invention photographs a specific point in a vehicle.
FIG. 5 illustrates a case where a wearable device according to an embodiment of the present invention photographs a specific marker in a vehicle at a predetermined point.
FIG. 6 illustrates a case where a wearable device according to an embodiment of the present invention photographs a specific marker in a vehicle at an arbitrary point.
FIG. 7 is a diagram for explaining a process of estimating the position of a driver in a vehicle, with reference to FIGS. 5 and 6. FIG.
8 is a view for explaining a process of automatically changing the position of a specific component in a vehicle according to an embodiment of the present invention.
9 illustrates a database stored in a memory of an in-vehicle apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

According to an embodiment of the present invention, a position of a driver is primarily estimated using a camera mounted on a wearable device (e.g., smart glass) worn by a driver. The position of the driver corresponds to, for example, the position of the driver's seat or eyes (eyes). Further, based on the primary estimation result, the position of the in-vehicle components (for example, driver's seat, headrest, steering wheel, side mirror, room mirror, etc.) is automatically changed .

However, according to another embodiment of the present invention, the wearable device installs a marker at any point in the vehicle in order to more accurately calculate the position of the driver. The marker may be, for example, a logo, and any image may suffice. Further, the position at which the marker is installed may be attached, for example, near a windshield, a center facia or an A pillar in a vehicle. On the other hand, the present invention can be applied without using a plurality of markers, but there is an additional advantage that the accuracy of the driver's position calculation can be further improved when a marker is attached to a predetermined position.

Hereinafter, embodiments of the present invention will be described in detail with reference to Figs. 1 to 9.

1 is a block diagram showing an example of a configuration of an AVN (Audio Video Navigation) system according to an embodiment of the present invention. The in-vehicle apparatus described in the present specification should be designed to be capable of communicating with the wearable device, and an AVN system may be used as an example. Of course, it is also within the scope of the present invention to use another apparatus instead of the AVN system.

1, a vehicle AVN system is connected to a wearable device (for example, smart glasses) and includes a wireless communication unit 410 for exchanging safety-related information with various control signals through a wireless communication scheme such as Bluetooth or Wi-Fi A wired communication unit 420 for exchanging signals with another controller (e.g., a smart cruise control controller, a blind zone detection controller, a rear / rear distance sensor controller, an aur View system controller, etc.) A display unit 430 for displaying a list of various functions or an execution screen, a command input unit 440 for receiving commands from a driver, such as a touch pad or a key button, and the like, And a control unit 450 for performing determination and calculation.

For example, when the safety-related information is requested from the smart glasses, the control unit 450 controls the wired communication unit 420 to collect safety-related information from the related controllers and transmits the safety-related information to the smart glasses through the wireless communication unit 410 You can deliver it.

Of course, it will be apparent to those skilled in the art that the configuration of FIG. 1 is illustrative and may include more or fewer components as needed. For example, the wireless communication unit may be provided in a controller existing outside the AVN system, and may further include an audio output unit for outputting multimedia, a navigation announcement voice, and a warning sound.

A wearable device capable of communicating with the above AVN system will be described with reference to Fig.

FIG. 2 illustrates smart glasses as an example of a wearable device that can be applied to embodiments of the present invention, but the present invention is not necessarily limited to smart glasses. That is, a wearable device such as Smart Watch is applicable to the embodiments of the present invention.

The smart glasses 200 are configured to be worn on the head of a human body, and a frame part (case, housing, etc.) for the smart glasses 200 may be provided. The frame portion may be formed of a flexible material to facilitate wearing. In this figure, it is illustrated that the frame portion includes a first frame 201 and a second frame 202 of different materials.

The frame portion is supported on the head portion, and a space for mounting various components is provided. 2, electronic components such as a control module 280, an audio output module 252, and the like may be mounted on the frame portion. In addition, a lens 203 covering at least one of the left and right eyes may be detachably mounted on the frame portion.

The control module 280 is configured to control various electronic components included in the smart glasses 200. For example, the control module 280 allows the AVN system and the wireless data path of the vehicle to be established through a wireless communication unit (not shown) of the smart glasses, so that the safety-related information of the vehicle is requested and received through the established data path . In addition, the control module 280 may display the safety-related information received on the display 251, and may use at least one of the camera disposed to face the user's eyes and the image captured through the front camera 221 The direction of the user's gaze can be determined. In addition, the control module 280 can determine whether or not the forward sight is deviated by using the determined sight direction or the direction detected by the gyro sensor (not shown).

2 illustrates that the control module 280 is installed in the frame portion on one side of the head. However, the position of the control module 280 is not limited thereto.

The display unit 251 may be implemented as a head mounted display (HMD). The HMD type refers to a display method that is mounted on a head and displays an image directly in front of the user's eyes. When the user wears the smart glasses 200, the display unit 251 may be disposed to correspond to at least one of the left eye and the right eye so that the user can directly provide an image in front of the user's eyes. 2 illustrates that the display unit 251 is located at a portion corresponding to the right eye so that an image can be output toward the right eye of the user.

The display unit 251 can project an image with the user's eyes using a prism. Further, the prism may be formed to be transmissive so that the user can view the projected image and the general view of the front (the range that the user views through the eyes) together.

As described above, the image output through the display unit 251 can be overlapped with the general view. The smart glasses 200 can utilize the characteristics of such a display to assist the driver in selecting functions without disturbing the forward gaze during operation.

The camera 221 is disposed adjacent to at least one of the left eye and the right eye, and is configured to photograph a forward image. Since the camera 221 is located adjacent to the eye, the camera 221 can acquire a scene viewed by the user as an image.

2, the camera 221 is provided in the control module 280. However, the present invention is not limited thereto. The camera 221 may be installed in the frame part, or may be provided in a plurality of ways to acquire a stereoscopic image. In addition, a camera (not shown) facing the user's eyes may be additionally arranged in a direction opposite to the camera 221 facing the front. The camera facing the user's eyes acquires an image for determining the gaze direction through pupil tracking of the user.

The smart glasses 200 may include command input units 223a and 223b operated to receive a control command. The command input units 223a and 223b can be operated by a touch, a push, or the like.

Particularly, the wearable device 200 shown in Fig. 2 includes a wireless communication module (not shown) in which a communication connection is established with an in-vehicle device, and a wireless communication module And a controller (280) for controlling the camera (221) to photograph and control the wireless communication module to transmit video data including a point photographed by the camera to the in-vehicle apparatus connected to the communication. The in-vehicle apparatus corresponds to, for example, an AVN (Audio Video Navigation) system.

3 is a flowchart illustrating a communication connection between a car and a wearable device according to an embodiment of the present invention. The automobile shown in Fig. 3 may correspond to the AVN system shown in Fig. 1, for example, and the wearable device shown in Fig. 3 may correspond to the smart glasses shown in Fig. 2, for example. Of course, this is only one example, and it is obvious that the scope of the present invention should be construed in accordance with the matters set forth in the claims from the viewpoint of those skilled in the art.

As shown in FIG. 3, a car (e.g., an AVN system) is communicatively coupled to the wearable device (S310). Further, the automobile receives the photographing information of the specific point in the vehicle from the communication-connected wearable device (320). The vehicle refers to the memory to estimate a first position of the wearable device (S330) and controls to change the second position of at least one component in the vehicle, corresponding to the first position (S340 ).

Further, when the wearable device is first recognized, the automobile is designed to output a message as an audio or video type, which guides the wearable device to change its direction. This direction means, for example, that the in-vehicle marker is directed to the displayed area.

Wherein the memory stores positional information of the wearable device corresponding to a difference between a marker received from the wearable device and a marker stored in the wearable device and further comprising at least one component As shown in FIG. In this regard, it will be described in more detail below with reference to FIG.

At least one component in the vehicle corresponds to at least one of, for example, a side mirror, a room mirror, a seat or a handle, as described above. Of course, this is merely an example, and may be a component in another vehicle.

[0040] The main body of each step shown in FIG. 3 will be described in more detail with reference to FIG.

The wireless communication unit 410 of the AVN system shown in FIG. 1 is designed to establish a communication connection with the wearable device. Of course, the wired communication unit 420 may be replaced with the wired communication unit 410 instead of the wireless communication unit 410.

Although not shown in FIG. 1, the memory in the AVN system stores at least one location-related information, and will be described later with reference to FIG.

The control unit 450 is designed to control the communication unit 410 and the memory (not shown). For example, when photographing information of a specific point in the vehicle is received from the wearable device connected to the communication, Estimates a first position of the wearable device, and controls to change a second position of at least one component in the vehicle, corresponding to the first position.

4 is a view for explaining a process in which a wearable device according to an embodiment of the present invention photographs a specific point in a vehicle. The wearable device 200 shown in FIG. 4 corresponds to, for example, the smart glasses described above with reference to FIG.

As shown in Fig. 4, it is assumed that a wearer wearing the wearable device 200 aboard a driving magnet in the vehicle. First, when a driver wearing the wearable device 200 is seated on the seat, a communication connection is established between the wearable device 200 and the in-vehicle AVN system.

The wearable device 200 or the in-vehicle AVN system outputs an audio or video type message so that the wearable device 200 is directed to a specific direction in the vehicle (e.g., the markers 421, 422, 423, 424) . After the wearable device 200 faces the direction in which the marker is positioned, the wearable device 200 operates the camera to shoot at least one marker 421, 422, 423, and 424.

The sizes and tilt of the markers photographed by the wearable device 200 vary depending on the driver's seat height and the like. Upon receiving the marker information photographed from the wearable device 200, the AVN system compares the size and position information of the known marker with the marker information received, and calculates the driver's sitting key. In this case, there is a possibility that an error will occur when the driver's position is estimated using only one marker. Therefore, it is also a feature of the present invention to design a more accurate position estimation value using a plurality of markers.

And transmits the measured position information of the driver to the seat control unit and the mirror control unit, and the seat control unit and the mirror control unit adjust the positions of the seat and the mirror based on the received data. Of course, it is also within the scope of the present invention to design all functions to be performed by one control unit other than a separate control unit.

FIG. 5 illustrates a case where a wearable device according to an embodiment of the present invention photographs a specific marker in a vehicle at a predetermined point. FIG. 6 illustrates a case where a wearable device according to an embodiment of the present invention photographs a specific marker in a vehicle at an arbitrary point.

The marker 510 shown in FIG. 5 means a case where the marker 510 is photographed without being tilted by the wearable device. For example, when the same marker as the marker 510 shown in FIG. 5 is photographed, it means that the driver's sitting height corresponds to the reference value A cm. On the other hand, when the marker photographed by the wearable device corresponds to the graphic image 610 shown in FIG. 6, it is assumed that the driver's sitting key is different from the reference value A cm. Therefore, the driver position information which varies according to the degree of inclination compared with the reference marker must be stored in the memory, and the optimization position value of the components in the vehicle corresponding to each driver position must also be stored in the memory. Hereinafter, this will be described below with reference to FIG.

FIG. 7 is a diagram for explaining a process of estimating the position of a driver in a vehicle, with reference to FIGS. 5 and 6. FIG.

Through the comparison process described in FIGS. 5 and 6, the in-vehicle apparatus (ex: AVN system) calculates the position of the driver's sitting key or the eye. For example, as shown in FIG. 7, the estimated position of the driver's sitting position is indicated by a dotted line 710. The position of the in-vehicle components optimized for the driver having the sitting key corresponding to the dashed line 710 is stored in the memory.

8 is a view for explaining a process of automatically changing the position of a specific component in a vehicle according to an embodiment of the present invention.

As shown in FIG. 7, when the sitting key of the driver is calculated, the driver's seat is slightly changed from 60 degrees to 55 degrees as shown in FIG. For example, if the same marker image as the image of the marker (not tilted at all) as the reference value is photographed through the wearable device, the driver's seat is not changed. However, when a tilted marker image is photographed through the wearable device as compared with the image of the marker (for example, shown in Fig. 5) serving as the reference value, the driver's seat is changed. The tilting of the marker image is presumably because the driver's sitting height has changed.

9 illustrates a database stored in a memory of an in-vehicle apparatus according to an embodiment of the present invention.

Although not shown in FIG. 9, the position information (e.g., the glass position, the eye position, etc.) of the driver corresponding to the image of the marker serving as the reference value and the modified marker image is stored in the memory. Further, as shown in FIG. 9, the position information of the optimized in-vehicle components corresponding to each driver's position information (which is exemplified as a glass position in FIG. 9) must also be stored in the memory. For example, if the glass position is 50 cm, the side mirror is designed to move 60 degrees and the sheet is moved 20 cm. If the glass position is 80 cm, the side mirrors are designed to move 50 degrees, When the glass position is 90 cm, the side mirrors are designed to move 450 degrees, and the seat 15 cm backwards.

As described above, according to the related art, the driver manually sets the seat height / front / back position, the handle height, the headrest height, the room mirror position (angle), and the side mirror position (angle) Discomfort is expected.

On the other hand, according to any one of the above-described embodiments of the present invention, it is possible to quickly set an appropriate seat and mirror position determined based on the driver's state information. Furthermore, it is advantageous to set the optimal seat position and handle height for the driver and to adjust the mirror so as to fit the driver's eyes (vision) range, to help safe driving, and to increase the convenience through automatic setting.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet).

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

410:
420:
430:
440: command input section
450:

Claims (15)

A control method of an on-vehicle apparatus capable of communicating with a wearable device,
A communication connection is established through a wearable device and a communication unit of the on-vehicle apparatus;
Receiving photographing information of a specific point in the vehicle from the wearable device connected to the communication;
A memory for storing positional information of the wearable device corresponding to a difference value between a marker received from the wearable device and a marker stored in the wearable device and positional information of at least one component in the vehicle corresponding to the positional information of the wearable device, Estimating a first position of the wearable device by referring to positional information of the wearable device corresponding to a difference value of the markers in the wearable device; And
Controlling to change a second position of at least one component in the vehicle using position information corresponding to the first position among position information of at least one component in the vehicle stored in the memory
, ≪ / RTI &
At least one component in the vehicle,
A side mirror, a side mirror, a room mirror, a seat or a handle. The method according to claim 1,
When the wearable device is recognized for the first time, outputting a message guiding to change the direction of the wearable device as an audio or video type
≪ / RTI > 3. The method of claim 2,
Preferably,
Wherein the in-vehicle marker is directed to a displayed area. delete delete delete An apparatus capable of communicating with a wearable device,
A communication unit for communicating with the wearable device;
The location information of the wearable device corresponding to the difference value between the marker received from the wearable device and the marker stored in the wearable device and the positional relationship information of at least one component in the vehicle corresponding to the positional information of the wearable device Memory; And
And a control unit for controlling the communication unit and the memory,
Wherein,
When shooting information of a specific point in the vehicle is received from the wearable device connected to the communication,
Estimating a first position of the wearable device by referring to positional information of the wearable device corresponding to a difference value of the markers stored in the memory,
Control to change a second position of at least one component in the vehicle using position-related information corresponding to the first position among position-related information of at least one component in the vehicle stored in the memory,
At least one component in the vehicle,
A side mirror, a side mirror, a room mirror, a seat or a handle. 8. The method of claim 7,
When the wearable device is first recognized through the communication unit,
An output module for outputting a message as an audio or video type to guide the wearable device to change its direction
Lt; / RTI > 9. The method of claim 8,
Preferably,
Wherein the in-vehicle marker is directed to a marked area. delete delete delete A method of controlling a wearable device capable of communicating with an in-vehicle apparatus,
Communicating with an in-vehicle apparatus through a wireless communication module;
Photographing at least one point in the vehicle through a camera according to a predetermined guide of audio or video type; And
Transmitting video data including the photographed point to the in-vehicle apparatus connected to the communication through the wireless communication module
, ≪ / RTI &
Wherein the in-vehicle apparatus corresponds to an AVN (Audio Video Navigation) system. 14. The method of claim 13,
Wherein the wearable device corresponds to a glass capable of data communication. A wearable device capable of communicating with an in-vehicle device,
A wireless communication module in which a communication connection is established with an in-vehicle device;
A camera for photographing at least one point in the vehicle according to a predetermined guide of audio or video type; And
A controller that controls the wireless communication module to transmit video data including a point photographed by the camera to the in-vehicle apparatus connected to the communication;
, ≪ / RTI &
The in-vehicle apparatus corresponds to an AVN (Audio Video Navigation) system.

Images