KR20150051671A - A display control device using vehicles and user motion recognition and its method of operation - Google Patents

Abstract

The present invention relates to a screen control device based on vehicle and user motion recognition and an operation method thereof. More specifically, according to the present invention, a route guidance using map data in a vehicle having a head-up display (HUD) is outputted via a main HUD output unit, and event information extracted or generated by recognizing one or more among a route guidance event, a vehicle direction event or a driver′s eye movement event are displayed on screens generated via one or more sub HUD output units around a screen outputted via a main HUD output unit, thus improving HUD visibility of a driver. The screen control device based on vehicle and user motion recognition of the present invention comprises: a recognition unit recognizing an event occurring in one or more among driver motion, vehicle movement or route information; an HUD output unit consisting of a main HUD output unit and one or more sub HUD output units to output information on one or more events among image data corresponding to the event or traffic information; a control unit setting one or more among the number, size and location of screens to be outputted via the HUD output unit; and a camera unit supplying images outside of the vehicle to the HUD output unit.

Description

TECHNICAL FIELD [0001] The present invention relates to a display control device and a method of operating the same,

[0001] The present invention relates to a screen control apparatus for a vehicle and a user operation and a method of operating the same. More particularly, the present invention relates to a route guidance using map data in a vehicle using a head-up display through a main HUD output unit, HUD output unit recognizes at least one of a guidance event, a direction event of a vehicle, and a motion event of a driver's eye to generate a screen through one or more sub-HUD output units around the screen output through the main HUD output unit, To a screen control device for recognizing a vehicle and a user's motion for improving the visibility of the HUD of a driver, and a method of operating the same.

In general, a head-up display (hereinafter referred to as a "HUD") is a device that displays various driving information (speed, flow rate, water temperature, distance, etc.) on a windshield .

In the conventional HUD, characters or images of various information appearing on the LCD are reflected by the front glass to allow the driver to recognize the light illuminated from the back of the LCD. Can be confirmed.

However, since the conventional HUD always outputs the screen at the same position of the front glass, it is difficult for various drivers to easily recognize the HUD screen.

To solve such a problem, Korean Patent Registration No. 10-1131983 (Registered Mar. 23, 2012) discloses a head-up display device for a vehicle that changes the projection position of a virtual image information image according to vehicle speed.

In order to solve the problem of changing the viewpoint of the driver according to the speed of the vehicle at a low speed or a high speed, the prior art has proposed a technique of adjusting the angle of illumination of the lens that transmits the HUD video image, It is a technique to adjust the position at various angles.

However, in the related art, one piece of information is outputted from one screen. In order to output other pieces of information, the information of the current HUD screen is terminated and the other information is newly outputted to the user. In this case, when the screen of the other information to be outputted is terminated and the existing information is not newly output, there is a problem that the user can not confirm the existing information.

Another method is to divide a single screen into pieces of existing information and output other information at the same time. In this method, each existing information and other information outputted due to the problem of dividing the screen are outputted small or all the information is outputted .

Therefore, in order to solve the problems of the related art as described above, the present invention, which has been developed, outputs a screen for performing route guidance, etc. in the main HUD, and additional information, such as route guidance output from the main HUD, Output from the sub HUD.

It is another object of the present invention to extract or generate event information corresponding to a positional shift of a pupil of a driver according to an event generated by recognizing the pupil of a driver and output the generated information to the sub HUD.

It is another object of the present invention to extract or generate event information corresponding to a vehicle operation according to an event generated by recognizing a vehicle operation operated by a driver and outputting the event information to the sub HUD.

It is another object of the present invention to extract or generate event information corresponding to route guidance according to an event occurring in route guidance performed in the main HUD and output the generated event information from the sub HUD.

It is another object of the present invention to output the event information related to the main HUD to the screen of the sub HUD around the output screen of the main HUD so that the driver can ensure the visibility of the additional information.

It is another object of the present invention to extract or generate event information according to an event occurring according to driver's eyes, a vehicle operation, or route guidance, and to output the event information temporarily using the sub HUD.

It is another object of the present invention to provide a screen using sub-HUD as event information including additional information without switching the screen output by the main HUD performing route guidance.

It is another object of the present invention to output event information extracted or generated according to a recognized event to one or more screens using one or more sub HUDs.

It is another object of the present invention to output a screen output by using one or more sub HUDs at various positions according to recognized events.

It is another object of the present invention to output a screen output using one or more sub HUDs according to a recognized event at a position selected by a user.

The above object of the present invention can be achieved by a screen control apparatus comprising a recognition unit for recognizing an event occurring in at least one of a driver's motion, a vehicle operation, and route information, A HUD output unit including one main HUD output unit and one or more sub HUD output units for outputting event information, and a controller for setting at least one of a number, a size and a position of the screens output from the HUD output unit; And a camera unit for providing an image outside the vehicle to the HUD output unit.

It is another object of the present invention to provide a method of operating a screen control device, which includes a first step of recognizing an event occurring in at least one of a driver's motion, a vehicle operation, or route information, And a third step of extracting event information corresponding to the event from at least one of the traffic information receiving unit, the map data unit, and the camera unit when the information related to the event exists, And a fifth step of selecting a HUD output unit to output the event information according to a direction in which the event occurs, and a fifth step of outputting the event information to the HUD output unit selected in the fourth step, The event information includes map data output through the main HUD output unit included in the HUD output unit, Wherein the event information is output through at least one sub-HUD output unit included in the HUD output unit, wherein the at least one sub-HUD output unit includes at least one of data, traffic information, And the like.

Therefore, the screen control device and its operating method according to the vehicle and user's operation recognition of the present invention can display the event information including the additional information according to route guidance outputted from the main HUD, Is output from the sub HUD temporarily output from the periphery of the main HUD, so that various information can be simultaneously outputted so as to facilitate driver identification.

In addition, the present invention extracts or generates event information corresponding to the movement of the pupil of the driver according to an event generated by recognizing the pupil of the driver, and outputs the generated information to the sub HUD so that the driver can display event information such as traffic information There are other effects that can be easily identified on a separate screen.

Further, the present invention extracts or generates event information corresponding to the vehicle operation according to an event generated by recognizing the vehicle operation operated by the driver, and outputs the generated event information from the sub HUD, thereby recognizing the traveling direction of the vehicle There is another effect that the driver can easily confirm the real-time image of the traffic information or the traveling direction on a separate screen.

In addition, according to the present invention, event information corresponding to the route guidance is extracted or generated according to an event occurring in the route guidance performed by the main HUD, and outputted from the sub HUD, There is another effect that can be easily confirmed.

Further, according to the present invention, the event information related to the main HUD is displayed on the screen of the sub HUD around the output screen of the main HUD, so that there is another effect that the driver can secure the visibility of the additional information.

In addition, the present invention extracts or generates event information according to an event occurring in accordance with a driver's pupil, a vehicle operation, or route guidance, and temporarily outputs the event information using the sub HUD, thereby preventing traffic of the driver There is another effect of allowing the user to identify the user.

Further, the present invention provides a screen using sub-HUD for event information including additional information without switching the screen output from the main HUD performing route guidance, thereby allowing the driver to continuously check information output from the main HUD There is another effect that makes it possible.

In addition, according to the present invention, the event information extracted or generated according to the recognized event is output to one or more screens using one or more sub HUDs, so that the driver can simultaneously check the event information associated with the information output from the main HUD output unit There is another effect.

Further, according to the present invention, there is another effect that the driver can easily check the information output at the predetermined position by outputting the screen output by using one or more sub HUDs according to the recognized event at various positions.

In addition, according to the present invention, a screen output using one or more sub-HUDs according to recognized events is output to a position selected by the driver, so that the driver can check the selected information at the sight line position, .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is an overall configuration diagram illustrating a HUD screen control apparatus according to the present invention;
2 is a block diagram illustrating a configuration of a part of a HUD screen control apparatus according to the present invention.
3 is a flowchart illustrating an operation method of the HUD screen control apparatus according to the present invention.
4 is an exemplary diagram illustrating an application example of a HUD screen according to an embodiment of the present invention.
FIG. 5 is an exemplary diagram illustrating a location of a HUD screen according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating an example of controlling a HUD screen in response to a motion of a pupil according to an embodiment of the present invention.
FIG. 7 is an exemplary view for controlling a HUD screen in accordance with direction information according to an embodiment of the present invention;
FIG. 8 is an exemplary diagram for controlling the HUD screen in correspondence to the speed information / braking information according to the embodiment of the present invention.

The terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary terms and the inventor may appropriately define the concept of the term in order to best describe its invention It should be construed as meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention and do not represent all the technical ideas of the present invention. Therefore, It is to be understood that equivalents and modifications are possible.

Hereinafter, preferred embodiments of the present invention will be described in detail.

FIG. 1 is a block diagram of a HUD screen control device according to the present invention. FIG. 2 is a block diagram illustrating a configuration of a HUD screen control device according to the present invention. Referring to FIG. 1 and 2, the HUD screen control device 100 includes a control unit 110 for controlling the output of the HUD screen, map data for route guidance, traffic information, camera image data, and the like A HUD output unit 120, a Portable Navigation Device (PND) output unit 130 for receiving information from the HUD screen control device 100 and carrying it by the driver, and a traffic information receiving unit 130 for receiving traffic information, A recognition unit 150 for recognizing an event occurring in the driver's eyes, a motion of a driver's function, a route guidance, etc., a map data unit 160 for storing map data used for route guidance, A communication unit 170 for receiving various traffic information from an information providing apparatus (not shown), a camera unit 180 provided at one or more to capture images of the inside and the outside of the vehicle, To determine comprises a GPS unit 190 for receiving a GPS satellite signal.

The control unit 110 receives an event generated by the recognition unit 150 and extracts or generates event information, which is various additional information according to an event type. The event information may include multimedia contents such as map data, detailed map data, POI information, traffic information, vehicle camera image, route guidance data, route summary information, application program, music or image, a black box image, a closed circuit television Circuit Television, roadside infrastructure unit (RSU) information, driver scheduling information, and information within the mobile terminal associated with the mobile terminal.

Accordingly, the control unit 110 may automatically extract or generate the event information according to the event recognized by the recognition unit 150 and output the generated event information to the screen through the HUD output unit 120. In response to the input of the control command of the driver, The event information may be extracted or generated and output to the screen through the HUD output unit 120.

In addition, the controller 110 controls the position, size, and number of the screen output from the HUD output unit 120 and outputs the control result. At this time, the main HUD output unit 121 included in the HUD output unit 120 is provided as one and outputs a screen, and the first sub HUD output unit 122, the second sub HUD output unit 123, It is preferable to provide at least one screen in accordance with the screen size.

Accordingly, the control unit 110 controls the position and size of the main HUD output unit 121 to output a screen, and includes a first sub HUD output unit 122 and a second sub HUD output unit 123 It controls the position, size and number of the sub HUD output section to output the screen.

When an event occurs, the control unit 110 controlling the sub HUD output units 122 and 123 controls the sub HUD output units 122 and 123 to output a screen. If an event does not occur, HUD 122 and 123 are not operated to output a screen. Only when an event occurs, the sub HUD output units 122 and 123 are controlled to output a screen.

The control unit 110 controls the sub-HUD output units 122 and 123 to output event information extracted or generated according to the occurrence of the event to the screen. The event information is output to the sub HUD output units 122 and 123 The event information output through any one of them can be controlled to be output only by the controller 110 for a predetermined time.

That is, the event information such as the overspeed warning outputted through the sub HUD output units 122 and 123 is controlled to be outputted for about 3 seconds to 10 seconds, and the detailed map data in the vicinity of the destination or the information of the destination POI, To be output continuously.

The control unit 110 controls the traffic information receiving unit 140 to receive traffic information including real-time traffic information provided from an external traffic information providing server (not shown) And may receive traffic information from a providing server (not shown).

The control unit 110 controls the map data unit 160 to store the map data provided by the route guidance server (not shown). The map data is stored in the map data unit 160. When it is necessary to update the map data, the map data can be updated by accessing a route guidance server (not shown) through the communication unit 170, (Communication-type navigation), only the map data according to the route is downloaded and stored in the map data unit 160.

The control unit 110 displays the current position of the vehicle on the map data output using the current position of the vehicle generated using the GPS satellite signal received by the GPS unit 190. [

The control unit 110 transmits the event information to the PND output unit 130, which is a PND (Portable Navigation Device) carried by the driver using the communication unit 170, according to the driver's selection or according to the set control .

In addition, the controller 110 receives the image of the CCTV located outside and the information of the roadside equipment (RSU) through the communication unit 170, and generates the event information.

The HUD output unit 120 includes a main HUD output unit 121 for outputting map data for route guidance and sub HUD output units 122 and 123 for outputting event information corresponding to various additional information . The main HUD output unit 121 is output as a single screen and the outputted position and size can be output to the front glass of the vehicle under the control of the control unit 110. The sub HUD output units 122 and 123, HUD output unit 122 and the second sub-HUD output unit 123 in FIG. 2, it is preferable that the first sub-HUD output unit 122 and the second sub-

The sub HUD output units 122 and 123 output the event information extracted or generated by the control unit 110 according to the recognized event, and the position, size, and number of the output screen are determined according to the contents set in the control unit 110 And is outputted around the screen output from the HUD output unit 121. [ At this time, the sub HUD output units 122 and 123 can be output to various positions such as the front glass, the left and right side glass and the rear glass of the vehicle, the bonnet of the vehicle, HUD output units 122 and 123 for outputting a screen may be provided at various positions of the vehicle, respectively.

The event information output from the sub HUD output units 122 and 123 of the HUD output unit 120 preferably outputs the contents related to the information output from the main HUD output unit 121. For example, It is possible to output the map data on the traveling direction of the vehicle based on the turn-by-turn information of the route guidance in the unit 121 and output the detailed map data of the destination or the main POI.

Further, when the speed of the vehicle is low (slow), it is possible to further output the map data including the detailed POI and the like of the surroundings. When the vehicle runs on the expressway, the main IC, tollgate, Can be output.

In addition, when the vehicle is slowing down and turning left / right, the camera unit 180 provided in the vehicle can be used to output an image in the rotational direction.

If it is determined that the driver's eye pupil is watching the specific position of the screen output through the main HUD output unit 121, It is determined that the driver's pupils are to watch the position of the position outside the screen output through the main HUD output unit 121, The detailed map data of the position can be outputted.

The various event information is outputted around the screen output from the main HUD output unit 121 under the control of the control unit 110. [

The sub HUD output units 122 and 123, which are provided as one or more than one, output event information to the screen as an event occurs, and output the event information until a predetermined time or the end of the event according to the control of the control unit 110 , And does not generate a screen when no event occurs.

Meanwhile, the screen output from the main HUD output unit 121 and one or more sub HUD output units 122 and 123 may output a screen through the HUD output unit provided with various numbers.

In the first case, all the screens are generated and output from the HUD output unit provided as one. In the second case, one HUD output unit generates and outputs one screen corresponding to the main HUD output unit, and one HUD output unit generates and outputs one or more screens corresponding to the sub HUD output unit. In the third case, one HUD output unit generates and outputs one screen corresponding to the main HUD output unit, and two or more HUD output units respectively generate and output screens corresponding to the respective sub HUD output units. That is, the HUD output unit can generate one or more screens, and can configure the main HUD output unit and the sub HUD output unit by selecting the number of HUD output units as needed.

The PND output unit 130 is a PND (Portable Navigation Device) carried by the driver and can receive and output event information through the communication unit 170 according to the setting of the driver's selection or the control unit 110. [ Accordingly, the PND output unit 130 is connected to the communication unit 170 through one or more of wired or wireless, and outputs the transmitted event information.

The traffic information receiving unit 140 receives traffic information including real-time traffic information transmitted from an external traffic information providing apparatus (not shown), provides traffic information necessary for event information under the control of the controller 110, The received traffic information can be selectively stored as needed.

2 (b), the recognition unit 150 includes a vehicle motion recognition unit 151, a driver motion detection unit 151, and a driver motion recognition unit 151. The recognition unit 150 recognizes an event occurring in the driver's eyes, A recognition unit 152 and a path information recognition unit 153. [

The vehicle motion recognizing unit 151 recognizes the vehicle operation operated by the driver and includes a steering sensor 151-1 for recognizing the steering operation of the steering wheel, a direction sensing unit for recognizing the operation of the vehicle steering wheel 151-2, a braking sensing portion 151-3 for recognizing the braking operation of the vehicle, and a speed sensing portion 151-4 for recognizing the speed of the vehicle.

That is, the steering sensing unit 151-1 senses the direction of rotation of the steering wheel of the vehicle to generate an event for the vehicle traveling direction, and the direction sensing unit 151-2 senses the direction indicator of the vehicle, And the braking sensing unit 151-3 recognizes the deceleration and deceleration acceleration of the vehicle to generate an event for braking. The speed sensing unit 151-4 recognizes the speed of the vehicle, And generates an event.

Accordingly, the control unit 110, which receives events generated by the respective vehicle motion recognition units 151, extracts or generates event information corresponding thereto and outputs the generated event information through the sub HUD output units 122 and 123, Additional information can be provided.

On the other hand, at least one of the braking sensing unit 151-3 or the speed sensing unit 151-4 measures the speed at which the vehicle moves, and when it is moved to a predetermined speed or lower, it is determined that the vehicle performs parking Create a parking event. Accordingly, when the control unit 110 receives the parking event, it captures an obstacle located in the vicinity of the vehicle using the camera unit 180, and outputs the peripheral image of the taken vehicle to the screen using the HUD output unit 120 .

For example, when parking is performed on the side of a road on which the vehicle is traveling, the vehicle is moved to a speed lower than a predetermined speed, and the vehicle is moved from any one of the braking sensing portion 151-3 or the speed sensing portion 151-4 When generating the parking event according to the speed, the control unit 110 receives the parking event, and accordingly uses the camera unit 180 to photograph the surroundings of the vehicle. Then, a real-time image to be photographed is output to the screen through the sub HUD output units 122 and 123 of the HUD output unit 120 so that the user can recognize the real-time image.

At this time, the camera unit 180 detects an obstacle (a roadblock, a pedestrian, a vehicle obstacle, a roadside tree, a staircase, a column, a wall, etc.) in the photographed image, and displays an enlarged image of the detected obstacle on the sub HUD output unit 122 , 123) to the screen.

The driver's motion recognition unit 152 recognizes the motion of the driver's eyes and monitors driver's eyes watching the screen output through the main HUD output unit 121 through a driver's motion recognition camera provided in the vehicle The control unit 110 extracts or generates the event information corresponding to the location and outputs the generated event to the sub HUD output units 122 and 123. In this case, To the screen.

The recognition of the driver's pupil is recognized when the driver's pupil watches for a predetermined period of time on the screen output through the main HUD output unit 121. The controller 110 displays detailed map data of the position or direction observed, Extracts or generates event information such as POI information, map data associated with map data output through the main HUD output unit 121, traffic information, camera images, and the like, and outputs it to the screen through the sub HUD output units 122 and 123 do.

On the other hand, the driver's motion recognition unit 152 includes an HUD camera (not shown) for photographing the pupil of the driver and an image detector for extracting the pupil movement from the image photographed through the HUD camera.

Further, the driver's motion recognition unit 152 measures the distance to the eyes of the driver as well as the eyes of the driver by using the driver's motion recognition camera (not shown) so that the driver can see the screen output through the HUD output unit 120 When the user moves his / her face closer to the screen position for closer view, an event is generated to enlarge the screen displayed on the main HUD output unit 121 and enlarge the screen through the sub HUD output units 122 and 123 . That is, the driver's motion recognition camera (not shown) senses that the distance of the driver's pupil is moved close to the screen and generates an event corresponding to the detected distance. The controller 110 generates event information HUD output units 122 and 123, and outputs them to the screen.

The route information recognizing unit 153 recognizes route information generated in the route guidance outputted to the screen from the main HUD output unit 121 as an event. The event recognized by the path information recognizing unit 153 is route guidance data including a forward traffic guide, a rotation section, main POI information, and destination information. At this time, the route guidance data generated according to the route guidance may be displayed on the screen output from the main HUD output unit 121 that outputs the map data like general navigation, and the route guidance data may be displayed on the screen of the sub HUD output units 122 and 123 It can be output separately.

The map data unit 160 stores map data according to route guidance, and receives and stores the map data from a route guidance server (not shown). The map data stored in the map data unit 160 is received by storing all or a part of the map data as needed. In the case of communication type navigation, only a part of map data necessary for route guidance is received from a route guidance server do.

The communication unit 170 communicates with an external traffic information providing apparatus (not shown), a route guidance server (not shown), a CCTV (not shown), a roadside apparatus (not shown), and a PND output unit 130, Wired or wireless.

The camera unit 180 is provided to photograph an image outside the vehicle and includes at least one camera for photographing the front, left / right side of the vehicle, rear of the vehicle, and the like, . The camera unit 180 may include a storage unit (not shown) for storing photographed images or may be stored in a storage unit (not shown) provided in the HUD screen control device 100 and stored.

The GPS unit 190 receives the GPS satellite signal to determine the current position of the vehicle, and displays the current position of the determined vehicle on the map data of the route guidance.

3 is a flowchart illustrating an operation method of the HUD screen control apparatus according to the present invention. As shown in FIG. 3, the HUD screen control device 100 monitors the driver's pupil, vehicle operation, and route information through the recognition unit 150 (S110).

In step S110, the monitoring is performed by the driver's motion recognition unit 152, the vehicle motion recognition unit 151, and the route information recognition unit 153, respectively.

The driver's motion recognition unit 152 checks the movement of the eyes of the driver and, if the pupil of the driver watches the specific position of the map data output through the main HUD output unit 121, generates an event for the corresponding position, The control unit outputs detailed map data of the specific position on the screen by using the sub HUD output units 122 and 123. [

In addition, the vehicle motion recognition unit 151 monitors the steering, the turn signal, the brake, and the speed of the vehicle, and generates an event including related information when the related operation is performed, and transmits the event to the control unit 110. [

The route information recognizing unit 153 recognizes the guidance data generated in the route guidance using the map data output through the main HUD output unit 121 as an event and transmits the guidance data to the control unit 110.

In addition, the event may include information received from an external CCTV or roadside device, and the information may include image data and traffic information.

If the event occurs in step S120, the controller 110 determines whether there is event information, i.e., additional information corresponding to the event in step S130. If the event information exists, The event information is extracted or generated from the data unit 160, the camera unit 180, and an external information providing apparatus (not shown) (S140).

The event information includes traffic information including detailed map data, POI information, destination information, route guidance information, information of the roadside apparatus, image data of the camera unit 180 provided in the vehicle, external CCTV image data, And image data such as image data.

Thereafter, the control unit 110 selects an output screen for outputting the extracted or generated event information (S150). The output screen is preferably output to the screen generated through the sub HUD output units 122 and 123. The output screen is determined by the control unit 110 in accordance with the position, size, and number of the screen, (S160). On the other hand, the controller 110 can output the position, size, and number of the screen according to the setting selected and stored by the driver. At this time, it is preferable that the position of the screen output through the sub HUD output units 122 and 123 is output to any one of the top, bottom, left, and right positions of the screen output by the main HUD output unit 121 It may be output at other positions.

The event information screen output through the sub HUD output units 122 and 123 is output until a predetermined time or a time when event information ends. If no event occurs, the sub HUD output units 122 and 123 output .

If there is no event information as additional information corresponding to the recognized event in step S120, detailed map data according to the event occurrence is output to the screen generated through the sub HUD output units 122 and 123 (S170) .

4 is an exemplary diagram illustrating an application example of a HUD screen according to an embodiment of the present invention. As shown in FIG. 4, the HUD output unit 120 included in the HUD screen control device 100 can output one or more screens as shown in (a). The HUD output unit 120 for outputting one or more scenes includes a main HUD output unit 121 for outputting map data for route guidance and a sub HUD output unit 121 for outputting various event information, (122, 123).

For example, route guidance is performed through the main HUD output unit 121 as shown in (b), and the overspeed / speed information generated according to the route guidance is output to the first sub HUD output unit 122. On the other hand, since no separate event information is generated, the second sub-HUD output unit 123 does not output any information on the screen. Preferably, the second sub-HUD output unit 123 does not generate a screen.

The main HUD output unit 121 or the sub HUD output units 122 and 123 may be configured to have a perspective view of the screen output according to the traveling direction of the vehicle, The size and position of the screen output through the main HUD output unit 121 or the size, position, and number of the screen output through the sub HUD output units 122 and 123 according to the driver setting or the driver setting are determined and output.

In general, a screen output from the main HUD output unit 121 is fixed to a front view of a driver, and a screen output from one or more sub HUD output units 122 and 123 is a screen displayed on the main HUD output unit 121 But it is possible to determine and output various positions, sizes, and numbers according to the convenience of the driver.

That is, the screen output from the sub HUD output units 122 and 123 may be located on the top, bottom, left, and right sides of the screen output from the main HUD output unit 121, And the like.

5 is a diagram illustrating an example of a location of a HUD screen according to an embodiment of the present invention. 5 (a), the HUD screen control device 100 includes a screen output through the main HUD output unit 121 and the sub HUD output units 122 and 123, It is possible to output the event information through the controller 130.

In addition, each HUD output unit 120 in the HUD screen control device 100 can output a screen to a front glass, a bonnet, a left / right side glass, a rear glass, etc. of the vehicle, The position of each HUD output unit 120 is determined according to the setting of the control unit 110 or the driver, and a screen is output at the corresponding position.

FIG. 6 is an exemplary diagram for controlling the HUD screen in response to the movement of the pupil according to an embodiment of the present invention. As shown in (a) of FIG. 6, the driver watches the current position of the vehicle in the map data output through the main HUD output unit 121, and then moves to the A point on the right side of the map data When viewing the A point by using the driver's pupil, detailed map data of the A point viewed by the driver's pupil through the sub HUD output unit can be output to the screen on the right side of the screen output through the main HUD output unit 121 .

At this time, the screen output through the sub HUD output unit may be formed so as to have a larger screen magnification from the main HUD output unit 121 in the outward direction so as to improve the visibility of the driver. That is, the screen is moved from the center screen to the outside so that the driver can feel a three-dimensional effect through one or more screens of the sub HUD output unit that outputs the screen around the main HUD output unit 121 and the main HUD output unit 121 By increasing the size, the outside is made wider.

Such a screen can be applied to the screen of the sub HUD output unit which is output in the up / down / left / right and diagonal directions around the main HUD output unit 121.

Thereafter, when the position of the driver's eye moves further from the A point to the right as shown in (c), and the screen is outputted from the main HUD output unit 121, the screen of the sub HUD output unit outputted in (b) And map data of an area not displayed in the map data output from the main HUD output unit 121 can be outputted through the sub HUD output unit.

That is, in order to check the map data that is not displayed in the screen area but the current navigation is moved to the right side of the map data, the right map data connected to the current map data is displayed on the screen Or the operation of moving the map data by the driver had to be performed.

However, as in the present invention, when the position of the driver's pupil is watching the point A on the current map data and looking at a point outside the right screen, map data linked with the current map data is output to the right through the sub HUD output unit, The current map data and the map data outputted on the right side can be connected and confirmed.

At this time, the determination of the generation of the event according to the position of the eyes of the driver is made through the HUD camera and the image detector provided in the driver's motion recognition unit.

6, the driver's pupil recognition is performed through a driver's motion recognition camera (not shown) in the driver's motion recognition unit 152. Further, the driver's motion recognition unit 152 uses a driver's motion recognition camera (not shown) The distance to the eyes of the driver as well as the pupils of the driver is measured by using the HUD output unit 120. When the driver moves his / her face closer to the position of the screen to closely view the screen output through the HUD output unit 120, And the screen output to the main HUD output unit 121 is expanded to enlarge the screen through the sub HUD output units 122 and 123. That is, the driver's motion recognition camera (not shown) senses that the distance of the driver's pupil is moved close to the screen and generates an event corresponding to the detected distance. The controller 110 generates event information HUD output units 122 and 123, and outputs them to the screen.

FIG. 7 is an exemplary diagram for controlling the HUD screen according to the direction information according to the embodiment of the present invention. As shown in (a) of FIG. 7, when the map data for route guidance is outputted through the main HUD output unit and route guidance is performed on the map data, the driver turns on the right turn indicator light the steering sensor 151-1 or the direction sensing unit 151-2 in the vehicle motion recognition unit 151 performs the operation of each of the motions 151-1 and 151-2 in the case where the steering apparatus is rotated to the right as shown in FIGS. And generates an event.

At this time, the controller 110 extracts or generates event information corresponding to the generated event, and outputs the event information to the screen through the sub HUD output unit. (d), a real-time image for photographing the right side of the vehicle among the camera unit 180 that photographs the outside of the vehicle in accordance with the right turn progress direction information or the right turn progress planned direction information is output from the main HUD output unit It can be output to the right of the output screen.

In addition to the camera image, map data (detailed map data) located on the right side is output to the screen through the sub HUD output unit in accordance with the right turn.

That is, when an event is generated with respect to the steering or turn signal information of the vehicle, event information associated with the direction is extracted or generated, and a screen is output through the sub HUD output unit at a position corresponding to the direction.

When the driver depresses the brake pedal or decelerates the speed of the vehicle by depressing the brakes, the braking sensing unit 151-3 or the speed sensing unit 151-3 in the vehicle motion recognition unit 151, as shown in (e) 151-4 recognize each operation and generate an event.

At this time, the controller 110 extracts or generates event information in response to the generated event, and may output event information through the sub HUD output unit. The event information related to the brake braking or the speed deceleration may include detailed map data in which the peripheral map is enlarged, and the detailed map data may further include destination information, surrounding POI information, intersection name, and the like.

Furthermore, when brake braking or speed reduction of the vehicle and information on the traveling direction of the vehicle or information on the traveling direction of the vehicle occur together, the control unit 110 outputs the detailed map data corresponding to the direction corresponding to the information. That is, the right detailed map data is outputted when the traveling direction of the vehicle or the planned traveling direction is right, and the left detailed map data is outputted when the vehicle is turning left.

FIG. 8 is an exemplary diagram for controlling the HUD screen in correspondence to the speed information / braking information according to the embodiment of the present invention. As shown in FIG. 8A, when an event corresponding to the low-speed movement or stop of the vehicle occurs through the braking sensing unit 151-3 or the speed sensing unit 151-4, the control unit 110 May output one or more camera images of the area around the vehicle through the first sub-HUD output unit 122 through the camera unit 180 of the vehicle according to the event.

Further, it is determined that the driver is searching for a destination or a POI around the vehicle position, and detailed map data of the surrounding area can be output through the second sub HUD output unit 123. The detailed map data includes destination information, , An intersection name, and the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, Various changes and modifications will be possible.

100: HUD screen control device 110:
120: HUD output section 121: Main HUD output section
122: first sub HUD output unit 123: second sub HUD output unit
130: PND output unit 140: Traffic information receiving unit
150: recognition unit 151: vehicle motion recognition unit
151-1: Steering sensing part 151-2: Direction sensing part
151-3: Braking sensing unit 151-4: Speed sensing unit
152: Driver's motion recognition unit 153: Path information recognition unit
160: map data section 170: communication section
180: camera unit 190: GPS unit

Claims (21)

A screen control device comprising:
A recognition unit for recognizing an event occurring in at least one of a driver's motion, a vehicle operation, or route information;
A HUD output unit including one main HUD output unit and one or more sub HUD output units for outputting any one or more event information of the image data or traffic information corresponding to the event;
A controller for setting at least one of a number, a size, and a position of a screen output from the HUD output unit; And
A camera unit for providing an image outside the vehicle to the HUD output unit;
And a control unit for controlling the display unit.
The method according to claim 1,
A traffic information receiving unit for receiving the traffic information from an external traffic information providing apparatus;
A map data unit for storing map data output to the HUD output unit;
A GPS unit for generating position information for recognizing a current position of the vehicle;
A PND (Portable Navigation Device) output unit for outputting the traffic information; And
A communication unit for receiving at least one of image data or traffic information from the external traffic information providing apparatus;
And a screen control device for recognizing the user and the vehicle.
The method according to claim 1,
The recognition unit
A vehicle motion recognition unit for recognizing an operation event of the vehicle;
A driver's motion recognition unit for recognizing a motion event of the driver's eye; or
A path information recognizing unit for recognizing a path information event
Wherein the vehicle motion recognizing unit includes a steering sensor for recognizing steering device operation of the vehicle, a direction sensing unit for recognizing the operation of the turn signal lamp, a braking sensing unit for recognizing the brake operation, And a speed detecting unit for recognizing the user and the user.
The method of claim 3,
The driver's motion recognition unit
A HUD camera for photographing the eyes of the driver;
An image detector for extracting the pupil movement from an image captured by the HUD camera,
Wherein the event is generated by recognizing the pupil movement, wherein the event is generated by recognizing the pupil movement.
The method according to claim 1,
The main HUD output unit outputs map data for performing route guidance, and the sub HUD output unit outputs event information extracted or generated according to the recognition of the event, and the sub HUD output unit outputs, when the event occurs, Wherein the controller generates a screen according to the control of the controller and outputs the event information until a predetermined time or a time when the event ends, and does not generate the screen when the event does not occur. .
6. The method of claim 5,
Wherein the sub HUD output unit is selectively output according to recognition of the event, and at least one of the number, the size, and the position of the screen output from the sub HUD output unit is set by the control unit. .
The method of claim 3,
The steering sensor or the direction sensing unit generates an event for sensing the left or right traveling direction or the traveling direction of the vehicle, and the braking sensing unit or the speed sensing unit generates an event for sensing a speed or a stop of the vehicle And a screen control device according to vehicle and user motion recognition.
3. The method of claim 2,
The communication unit may receive at least one of the image data or the traffic information from at least one of a closed circuit television (CCTV) or a roadside infrastructure unit (RSU) that is the external traffic information providing device, The HUD output unit, or the PND output unit, and outputs the output using the at least one of the HUD output unit and the PND output unit.
The method according to claim 1,
Wherein the screen output from the HUD output unit includes the front glass of the vehicle and is output to at least one of a left / right glass of the vehicle, a rear glass of the vehicle, and a vehicle bonnet. Screen control device.
5. The method of claim 4,
When the pupil movement detected by the image detection unit is located at one of the main HUD output units, outputs any one of the additional information through the sub HUD output unit, and when the pupil moves out of the main HUD output unit, And outputs the map data in the off-location direction through the sub HUD output unit.
8. The method of claim 7,
A real time image of the left or right side of the vehicle is transmitted through the camera unit to the sub HUD output unit included in the HUD output unit in accordance with at least one of a forward direction or a forward direction occurring through the steering sensor or the direction sensing unit And outputs the result to the screen.
8. The method of claim 7,
Traffic information or traffic information in the map data output through the main HUD output unit included in the HUD output unit according to at least one of the speed, deceleration, and stoppage generated through the braking sensing unit or the speed sensing unit, And outputs the real time image of the vehicle to the screen using the sub HUD output unit included in the HUD output unit.
The method according to claim 1,
The screen output from the sub HUD output unit is formed to have a large size in a direction away from the screen output from the main HUD output unit so that each screen output from the sub HUD output unit and the main HUD output unit Wherein the control unit is configured to have a perspective and a stereoscopic effect.
8. The method of claim 7,
Wherein when the vehicle moves below a predetermined speed, any one of the braking sensing unit or the speed sensing unit included in the vehicle motion recognition unit generates a parking event by determining that parking is performed, And outputs the image of the surroundings of the vehicle photographed by using the camera unit to the screen by using the HUD output unit.
A method of operating a screen control device,
A first step of recognizing an event occurring in at least one of a driver's motion, a vehicle operation, or route information;
Determining whether information related to the event exists if the event is generated;
A third step of extracting event information corresponding to the event from at least one of a traffic information receiving unit, a map data unit, and a camera unit when information related to the event exists;
A fourth step of selecting a HUD output unit to output the event information according to a direction in which the event occurs; And
A fifth step of outputting the event information to the HUD output unit selected in the fourth step
Wherein the event information is at least one of map data output from the main HUD output unit included in the HUD output unit, detailed map data, traffic information, or an image of the camera unit, HUD output unit included in the output unit. The method of claim 1, further comprising:
16. The method of claim 15,
Wherein the driver's motion recognition is performed by analyzing an image captured through the HUD camera and recognizes an event according to the motion of the driver's pupil.
16. The method of claim 15,
The recognition of the vehicle operation may include a steering sensor for sensing the steering of the vehicle, a direction sensing unit for sensing a direction indicator (flashing) of the vehicle, a speed sensing unit for sensing the speed of the vehicle or a braking Wherein the control unit recognizes an event occurring in at least one of the braking sensing units for detecting the vehicle and the user.
16. The method of claim 15,
Wherein the sub HUD output unit outputs one or more screens, and outputs the screen to any one of a top, a bottom, a left, and a right of a screen output from the main HUD output unit. Operating method of the apparatus.
16. The method of claim 15,
And the sub HUD output unit is output according to the size, position, and number of the screen set by the control unit.
20. The method of claim 19,
The form of the screen output from the sub HUD output unit is formed to be large in the direction away from the screen output from the main HUD output unit, and the size of the screen output from the sub HUD output unit and the main HUD output unit Wherein the screen has a perspective and a stereoscopic effect.
18. The method of claim 17,
The braking sensing unit or the speed sensing unit for recognizing the vehicle motion generates a parking event when it is judged that the vehicle is parked when the vehicle moves below a predetermined speed and the control unit receives the parking event And the image of the surroundings of the vehicle photographed using the camera unit is output to the screen using the HUD output unit.

Images