KR20170002330A - Driver-customized display variable apparatus and method for controlling the same - Google Patents

Abstract

The present invention relates to a driver-customized display variable apparatus, and a method for controlling the same. To this end, the driver-customized display variable apparatus used for a vehicle where a first camera unit, a second camera unit, and a display unit are mounted to assist driving of the vehicle comprises an area setting unit outputting at least one portion in a camera image captured through the first camera unit to an output area; an image analyzing unit analyzing a drivers image captured by the second camera unit in order to detect information on the action of a driver; a coordinate control unit controlling a viewpoint of the output area inside the camera image in accordance with the information on the action of a driver; and an output control unit displaying the output area of which the viewpoint is controlled through the display unit.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a driver-

The present invention relates to a driver-customized display variable device and a control method therefor, and more particularly, to a driver-customizable display variable device that allows a constant output area of a camera image displayed in a vehicle to be converted to a point of time according to a motion of a driver, And a control method thereof.

The rear, which the driver can not see during driving, is a major threat to the safety of the driver, and it is difficult to pay attention to the rear of the vehicle because the driver who drives the vehicle is usually only observing the front.

In order to eliminate such risk factors, a variety of rear recognition technologies have been developed for vehicles, and a typical technique for displaying the rear image of the vehicle in the vehicle is the most popular.

The above-described technique includes installing a plurality of cameras for photographing a rear image on the outside of the vehicle, forming one panoramic image by matching or combining images captured by the plurality of cameras, And can be output to a display device such as an inside rear view mirror (hereinafter referred to as a room mirror) or navigation installed in the room.

However, such a conventional technique is a one-dimensional technique for fixedly displaying a rear image captured by the camera on a display device, and there is a problem that an output area to be output to a display device is limited as compared with a wide angle that at least one camera can achieve .

Of course, even if it is apparent that the output area is limited by a certain standard of the display device, utilization of such a photographing area as a whole can be more advantageous than the photographing area of the camera which can actually photograph according to the wide angle inherent to the camera It is low.

Furthermore, the driver may want to monitor the other side of the rear portion in addition to the output area output to the display device. Such conventional technology can not satisfy the driver's desire as described above.

Accordingly, there is a need for a display technology capable of effectively utilizing the entire shooting area of a camera by recognizing a time point according to a user's motion and adjusting an output area of the display device according to the recognized point of view.

Korean Patent Publication No. 10-2010-0030991 (Mar. 19, 2010)

In order to solve such problems, it is an object of the present invention to provide a driver-customized display variable device and a control method thereof, in which a constant output area of a camera image displayed in a vehicle is converted to a point corresponding to a driver's motion.

In order to solve the above-mentioned problems, the present invention is applied to a first camera unit, a second camera unit, and a vehicle equipped with a display unit, and the driver-customized display variable unit for assisting the driving of the vehicle is photographed through the first camera unit An area setting unit for extracting at least a part of the camera image as an output area; An image analyzer for analyzing a driver image photographed through the second camera unit to detect operation information of the driver; A coordinate system adjusting unit for adjusting a viewpoint of the output area in the camera image according to the operation information of the driver; And an output control unit for displaying an output area whose viewpoint is adjusted through the display unit.

In addition, the operation information may include information on the inclination value of the variable time axis S 'while at least one of the driver's face and the pupil moves.

Also, the coordinate system adjustment unit can compare the driver's face position with the driver's reference area based on the operation information.

In addition, when the face position of the driver is out of the driver reference area, the coordinate system adjustment unit can adjust the view point of the output area in the camera image according to the operation information of the driver.

In addition, when the face of the driver moves in one of the left and right directions, the coordinate system adjuster can adjust the viewpoint of the output area to the other one of the left and right directions.

In addition, the coordinate system adjustment unit can adjust the rotation of the viewpoint of the output area to the other one of the upward and downward directions when the driver's face moves in one of the upward and downward directions.

The area setting unit may set a reference area having a standard field of view and a viewing angle set according to the driver reference area in the camera image as the output area.

Also, the coordinate system adjustment unit can adjust the output area view by rotating and adjusting the output coordinate system of the output area according to the operation information of the driver.

Further, the image analyzing unit can further detect the distance information on the variable distance between the driver's face and the display unit by analyzing the driver image.

In addition, the driver-customized display variable device according to an embodiment of the present invention enlarges at least a part of the output area according to the distance variation included in the distance information when the distance between the face of the driver and the display decreases, And a perspective control unit for reducing the output area according to the distance variation when the distance between the face of the display unit and the display unit increases.

According to another aspect of the present invention, there is provided a method of controlling a driver-assisted display variable device for assisting a driving of a vehicle, the method including: a first camera unit, a second camera unit, Extracting at least a part of the camera image taken through the camera as an output area; An image step of detecting driver's operation information by analyzing a driver image photographed through a second camera unit; Adjusting a viewpoint of the output area in a camera image according to operation information of a driver; And displaying an output area whose view is adjusted through the display unit.

In addition, the operation information may include information on the inclination value of the variable time axis S 'while at least one of the driver's face and the pupil moves.

Further, the method of controlling a driver-customizable display variable device according to an exemplary embodiment of the present invention may further include comparing a face position of a driver with a driver reference area based on operation information.

Also, the step of adjusting the viewpoint of the output area may be performed when the face position of the driver is out of the driver reference area.

In addition, the step of adjusting the viewpoint of the output area may include a step of determining whether the driver's face moves in one of the left and right directions; And adjusting the viewpoint of the output area to the other one of the left and right directions when the driver's face moves in one of the left and right directions.

In addition, the step of adjusting the viewpoint of the output area may include determining whether the driver's face has moved in one of upward and downward directions; And adjusting the rotation of the viewpoint of the output area to the other one of the upward and downward directions when the driver's face moves in one of the upward and downward directions.

The step of extracting at least a part of the camera image as an output area may be performed by setting a reference area having a standard field of view and a viewing angle set according to a driver reference area in the camera image as an output area.

The step of adjusting the viewpoint of the output area may be performed by adjusting the output coordinate system of the output area in accordance with the operation information of the driver.

Further, the method of controlling a driver-customizable display variable device according to an embodiment of the present invention may further include detecting distance information on a variable distance between a face of a driver and a display unit by analyzing a driver image.

According to another aspect of the present invention, there is provided a method of controlling a driver-customizable display variable device, the method comprising: expanding at least a portion of an output area according to a distance variation included in distance information when a distance between a face of a driver and a display unit decreases; And reducing the output area according to the distance variation when the distance between the driver's face and the display unit increases.

The driver-customized display variable device and control method thereof according to an embodiment of the present invention has an advantage that a certain output area of a camera image displayed in a vehicle is converted to a point of time according to a driver's motion.

According to another aspect of the present invention, there is provided a driver-customizable display variable device and a control method therefor, which detects distance information between a driver and a display unit through analysis of a driver image captured by a camera unit, It can be enlarged or reduced.

1 is a conceptual diagram of a driver-customizable display variable system according to an embodiment of the present invention.
2 is a block diagram of a driver-customizable display variable apparatus according to a first embodiment of the present invention.
FIG. 3 is a conceptual diagram illustrating a photographing wide angle, an output wide angle, and an output area of a display unit of a first camera unit according to an embodiment of the present invention.
4 is a conceptual diagram illustrating an embodiment in which a driver views the front of a display unit according to an embodiment of the present invention.
5 is a view illustrating an embodiment in which a driver views a side of a display unit according to an embodiment of the present invention.
6 is a block diagram of a driver-customizable display variable apparatus according to a second embodiment of the present invention.
7 is a flowchart illustrating a method of controlling a driver-customizable display variable device according to a first embodiment of the present invention.
8 is a flowchart of a step of adjusting a viewpoint of an output region according to the first embodiment of the present invention.
FIG. 9 is a flowchart illustrating a method of controlling a driver-customized display variable device according to a second embodiment of the present invention.

The present invention will now be described in detail with reference to the accompanying drawings. Hereinafter, a repeated description, a known function that may obscure the gist of the present invention, and a detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

Hereinafter, a driver-customizable display variable system according to an embodiment of the present invention will be described.

1 is a conceptual diagram of a driver-customizable display variable system according to an embodiment of the present invention. The driver-customizable display variable system according to an embodiment of the present invention is characterized in that the output area of the camera image displayed through the display unit 13 in the vehicle 10 is controlled so as to be converted to a point of time according to the movement of the driver do.

To this end, the driver-customized display variable device 100 according to an embodiment of the present invention may be installed in a vehicle to which the first camera unit 11, the second camera unit 12, and the display unit 13 are applied, The above-mentioned control process can assist the driving of the vehicle. Here, the first camera unit 11 may be configured to photograph at least one of the front, side, and rear of the vehicle, and the second camera unit 12 may be defined to capture the inside of the vehicle.

Here, the first camera unit 11 is installed on at least one of the front, rear, and side surfaces of the vehicle, and is provided on at least one of the front, side, and rear of the vehicle with reference to an arbitrary photographing coordinate system A Can be output to the camera. For example, the first camera unit 11 may include four cameras (hereinafter referred to as cameras 1, 2, 3 and 4, respectively), and each camera may include a left / right side mirror of the vehicle, , And a camera image can be generated in the center of the upper side.

For example, the camera 1 is installed at a right side mirror of the vehicle with a predetermined angle with the longitudinal axis of the vehicle, and can photograph and output the right side dead zone and rear side of the vehicle according to the wide angle characteristic.

The camera 2 is installed on the left side mirror of the vehicle with a predetermined angle with the longitudinal axis of the vehicle, and can photograph and output the left and right blind zones of the vehicle according to the wide angle characteristics.

The camera 3 is installed at a predetermined angle in the shake antenna position at the center of the upper side of the vehicle body, and can photograph the rear side in accordance with the wide angle (narrow angle) characteristic and output it.

The camera 4 is installed by forming an angle preset in an emblem, a license plate, a window glass, etc. arranged at the rear of the vehicle, and can photograph and output the rear according to the wide angle characteristic.

The configuration of the first camera unit 11 and the operation of the configuration are generally known technologies, and the drawings and reference numerals are not shown in the present invention. The first camera unit 11, the second camera unit 11, , 4 'are also set so as to be easily distinguished from each other, so that the setting can be variously changed by those skilled in the related art.

In the foregoing description, the first camera unit 11 is constituted by four cameras and the installation positions of the respective cameras have been described in detail. However, such installation positions are not limited to the embodiments of the present invention, The installation position of the camera and the installation direction of the camera may be variously changed in addition to the above examples.

However, according to the embodiment of the present invention, each camera included in the first camera unit 11 may have each specific wide angle that can be photographed, and the total sum of each of these wide angles is the same as that shown in FIG. 3 Similarly, a total photographing wide angle R1 can be formed.

Accordingly, the first camera unit 11 has the photographing wide angle R1 in which the wide angles of the cameras 1, 2, 3, and 4 are combined, The camera image can be photographed in an area (not shown). It is needless to say that the photographing wide angle R1 is not limited to the drawing, but can be variously changed depending on the type of the camera.

The camera included in the first camera unit 11 is preferably a CMOS camera or a CCD camera. However, the present invention is not limited thereto, and a speed dome camera, a pinhole camera, a pan / tilt zoom camera, or the like can be used. Of course, the first camera unit 11 may be additionally provided with an infrared camera so that it can be photographed even at night. According to an embodiment of the present invention, a zoom lens having a zoom lens It is also possible to have a camera.

The display unit 13 may display an output area P (see FIG. 3) including at least a part of the camera images output through the first camera unit 11. [ That is, the driver-customized display variable device 100 according to an exemplary embodiment of the present invention sets at least a part of the camera images photographed through the first camera unit 11 as an output area, 13). Of course, it is also possible to display an entire camera image through the single display unit 13 of the present invention. However, when displaying the entire camera image through the display unit 13, it is difficult to grasp the region of interest actually desired by the driver, and it can cause dizziness or the like to the driver. Accordingly, the driver-customized display variable device 100 according to an embodiment of the present invention can set a region of interest, which is a part of camera images photographed through the first camera unit 11, as an output region.

The display unit 13 may be implemented by at least one of a room mirror, a navigation system, a head up display (HUD), and a cluster installed in a vehicle, but is not limited thereto .

Here, the output area P represents a display area determined according to the specification of the display unit 13 or the function of the first camera unit 11, as shown in Fig. That is, the output area P is set to a predetermined output wide angle R 2, which is a photographing wide angle R 1 of the first camera unit 11, in consideration of various image characteristics such as sharpness and image quality of a camera image to be outputted to the display unit 13 And is actually output to the display unit 13 along the output coordinate system B in which the output wide angle R2 is set.

Here, the output coordinate system B provides a detection reference value to be displayed in an image pickup area of the first camera unit 11, and according to the present invention, when the image pickup wide angle R1 of the first camera unit 110 is set Various coordinate transformations can be performed within the photographing coordinate system A.

In addition, the driver-customized display variable device 100 according to an embodiment of the present invention changes the viewpoint of the output area displayed through the display unit 13 according to the operation of the driver. For this, the driver-customized display variable device 100 according to an embodiment of the present invention shoots the driver's image for the driver through the second camera unit 12, and detects the driver's operation information based on the driver's image can do.

To this end, the second camera unit 12 is installed in the vehicle, and can photograph a driver located in the driver's seat in the vehicle. In addition, it is preferable that the second camera unit 12 is installed in a place where various body parts such as an upper body, a face, a head, and a pupil of a driver can be photographed as a whole.

The second camera unit 12 may be a video camera, a digital camera, a camcorder, a web camera, or the like, but the present invention is not limited thereto. Any type of image capturing apparatus including an image sensor such as a CCD or CMOS may be used . Of course, the second camera unit 12 may use a multi-image simultaneous photographing apparatus such as a stereo camera or an ultra low-light camera or an infrared camera capable of photographing day and night without any illumination.

When the driver's image is output through the second camera unit 12, the driver-customized display variable device 100 according to the embodiment of the present invention detects the driver's operation information by analyzing the driver's image. Thereafter, the driver-customized display variable device 100 according to an embodiment of the present invention changes the viewpoint of the output area output through the display unit 13 according to the motion of the driver, Can be displayed. Referring now to FIG. 2, a description of a driver-customizable display control device 100 in accordance with a first embodiment of the present invention is provided.

2 is a block diagram of a driver-customizable display variable apparatus 100 according to a first embodiment of the present invention. As described above, the driver-customized display variable device 100 according to the first embodiment of the present invention sets at least a part of the camera images photographed through the first camera unit 11 as an output area, And changes the viewpoint of the output area according to the operation of the driver. The driver-customized display variable device 100 according to the first embodiment of the present invention includes a storage unit 110, an area setting unit 120, an image analysis unit 130, a coordinate system adjustment unit 140, and an output control unit 150). Here, the area setting unit 120, the image analyzing unit 130, the coordinate system adjusting unit 140, and the output controlling unit 150 divide the respective components into functions in order to facilitate understanding of the present invention. In reality, It is also possible to implement the configuration of one processing device such as GPU and ECU.

The storage unit 110 may store a camera image captured through the first camera unit 11. Of course, it is also possible that the driver image photographed through the second camera unit 12 is stored in the storage unit 110. Also, the storage unit 110 may further include comparison data for determining whether or not the driver operates as described below.

Here, the comparison data includes anatomical data such as the skeleton and muscles of the human body, motion prediction data of the body parts such as the neck, head, and eyes, which are related to the change of the driver's viewing direction, (S, see Fig. 4), such as the body posture and the behavior modeling data of the body according to the body shape, age, and the like.

Also, the storage unit 110 may incorporate design and production data of each part of the vehicle related to the calculation of the slope value of the time axis S, so that the storage unit 110 may be utilized in the calculation of the slope value described later.

The area setting unit 120 extracts at least a part of the camera image as an output area. Specifically, the area setting unit 120 sets at least a part of the camera images photographed through the first camera unit 11 as an output area. Specifically, the area setting unit 120 may set, as an output area, a reference area having a standard field of view and a viewing angle set according to a driver reference area described in the following description in the camera image. Here, the reference area indicates a basic area set when there is no separate view change request.

In the following description, it is assumed that the first camera unit 11 includes only one camera for photographing the rear of the vehicle. However, this is to facilitate understanding of the present invention, and in fact, even if the first camera unit 11 includes a plurality of cameras, it may include the same technical idea.

In this example, the area setting unit 120 can extract only a part of the area of the camera image taken through the first camera unit 11, as an output area. This is because, when the entire camera image is displayed through the display unit 13 as described above, it is not only possible to cause dizziness to the driver, but also it is difficult to grasp the area of interest desired to be grasped by the driver. Accordingly, the area setting unit 120 can set only a part of the camera image as an output area.

The image analysis unit 130 analyzes the driver image photographed through the second camera unit 12. As described above, the driver-customized display variable device 100 according to an embodiment of the present invention changes the viewpoint of the output area output through the display unit 13 in consideration of the operation of the driver. Accordingly, the image analysis unit 130 can detect the operation information of the driver by analyzing the driver image.

In addition, the image analyzer 130 may recognize the motion of the driver through a pre-stored image processing program to perform the function. For example, the image analysis unit 130 compares the driver image output by the second camera unit 12 with the comparison data stored in the storage unit 110 through a previously stored image processing program, Can be detected.

For example, the image processing program may store the comparison data, that is, a sample image (sample driver image made up of the anatomical data and the body posture and the operation modeling data) stored in advance or the second camera unit 12 110 and extracts the stored driver image and compares the extracted driver image with the driver image currently being photographed.

More specifically, the pixels of two images to be compared are analyzed, and the similarity is detected through the movement displacement and the angular displacement of the pixels defined by the vector, so that the position of the object and the body part and the movement thereof can be recognized . Of course, other than the above-mentioned method, a method of finding an edge such as a border or contour of an object or a body part, a line segment approximating the contour, a curve, or the like may be obtained and recognized. In addition, it is also possible to perform recognition using feature points that are unchangeable with respect to edge points, invariant points, rotation changes, or size changes existing in the driver image, and extract feature points of the object and body parts included in the image to recognize .

The image analysis process performed through the image analysis unit 130 is generally known technology and various modifications can be designed by a person having ordinary knowledge in the related field. In addition, various image processing methods such as a driver's body, As well as the change of the object located in its vicinity.

Accordingly, the image analyzer 130 can recognize the time axis S of the driver looking at the display unit 13, and when the time axis S of the driver changes, The distance between the eyes of the driver, the moving distance of the pupil, and the like.

Here, as described above, the operation information may include information on a slope value of a time axis (S ', see FIG. 5) varying with various body parts such as an upper body, a face, and a pupil of a driver.

The coordinate system adjustment unit 140 functions to adjust the output area P displayed on the display unit 13. [ That is, the coordinate system adjustment unit 140 determines whether the driver is operating based on the operation information detected through the image analysis unit 130, adjusts the viewpoint P of the output region in the camera image according to the degree of operation of the driver .

Preferably, the coordinate system adjustment unit 140 may determine whether the driver's face is within the predetermined driver reference area in the driver image in determining whether the driver is operating. Here, the driver reference area can be defined as an area indicating the driver's face position when the driver does not take any action while the driver is sitting on the driver's magnet. Of course, it is also possible that the driver reference area is set not only based on the face position of the driver but also on the basis of other body parts. That is, the driver reference area can be used to determine a change in the position of the driver's body part or the like.

However, in the case of the upper body of the driver, the movable range is small, and in the case of the hand, the frequent movement is generated according to the continuously changing driving situation, so that the viewpoint of the output area is likely to be changed unlike the driver's intention. The size of the body part is smaller than other parts of the body, and it is difficult to detect it when wearing glasses or sunglasses. Thus, although it is possible that the driver reference area may be set to another body part, it is most preferable to be set based on the face position of the driver.

If it is determined that the driver's face is located within the driver reference area, the coordinate system adjustment unit 140 may determine that the driver has not taken any other action for changing the viewpoint of the output area output through the display unit 13 have. Conversely, when the driver's face is outside the driver reference area in the driver image, the coordinate system adjustment unit 14 can determine that the driver has taken an operation for changing the viewpoint of the output area.

First, when the driver does not take a separate operation for changing the viewpoint of the output area, the coordinate system adjuster 140 does not perform a separate viewpoint change process for the output area set through the area setting unit 120. [ That is, if the driver does not perform any other operation for changing the viewpoint of the output area, the output area set through the area setting unit 120 may be output as it is. In other words, when the driver does not take a separate operation for changing the viewpoint of the output region, the output control unit 150 described below can display the output region set as the preset reference region through the display unit 13 .

Conversely, when the coordinate system adjustment unit 140 determines that the driver's face is out of the driver reference area, the explanation is made.

When it is determined that the driver's face is out of the driver reference area, the coordinate system adjustment unit 140 first determines whether the driver's face has moved in one of the left and right directions. As a result of the determination, when it is determined that the driver's face moves in one of the left and right directions, the coordinate system adjustment unit 140 can adjust the viewpoint of the output region to the other one of the left and right directions.

For example, when it is determined through the coordinate system adjustment unit 140 that the driver's face is moved to the left beyond the driver reference area, the viewpoint of the output area can be adjusted to the right. As a result of the determination made by the coordinate system adjustment unit 140, when it is determined that the driver's face is moved to the right beyond the driver reference area, the viewpoint of the output area can be adjusted to the left. An example of this will become more apparent with reference to Figs. 4 and 5.

4 shows an example when the driver's face is within the driver reference area, and Fig. 5 shows an example when the driver's face is located on the right side beyond the driver reference area. In this example, the second camera unit 12 and the display unit 13 are shown as a single configuration, but this is merely an example, and the second camera unit 12 and the display unit 13 may be separated from each other and arranged in the vehicle.

First, referring to FIG. 4, an output area set on the basis of the reference area in the camera image is displayed on the display unit 13, while the driver's face is within the driver reference area. That is, when the driver looks at the front of the display unit 13 at a predetermined time axis S, the image I1 set based on the reference area can be output to the display unit 13. [

On the other hand, as shown in FIG. 5, when the driver looks at the left side of the display unit 13 with the variable time axis S 'by moving the face (head) to the right in the situation of FIG. 4, The image I2 whose rotation angle of the output area is adjusted to the left side can be displayed. That is, the area of the camera image which is not shown in FIG. 4 can be freely monitored within the shooting area of the first camera unit 11 (see FIG. 1) according to the user's intention, that is, the motion.

In addition, the coordinate system adjustment unit 140 can further determine the upward and downward movement of the driver's face as well as the determination of the lateral movement of the face described above. Specifically, when it is determined that the driver's face is out of the driver reference area, the coordinate system adjuster 140 first determines whether the driver's face has moved in one of the upward and downward directions. If it is determined that the driver's face is moving in one of the upward and downward directions, the coordinate system adjustment unit 140 may adjust the viewpoint of the output region to the other one of the upward and downward directions.

For example, if it is determined through the coordinate system adjustment unit 140 that the face of the driver is moving upward beyond the driver reference area, the viewpoint of the output area can be adjusted downward. As a result of the determination by the coordinate system adjustment unit 140, when it is determined that the driver's face moves out of the driver reference area and moves downward, the viewpoint of the output area can be rotated upward.

Here, the viewpoint change of the output area through the coordinate system adjuster 140 may be performed as follows. When the operation information of the driver is detected through the image analysis unit 130, the coordinate system adjustment unit 140 performs rotation adjustment on the output coordinate system B of the output area P that has been displayed according to the detected operation information. The coordinate system adjuster 140 may then transmit the variable output area P '(see FIG. 3) to the output controller 150 according to the adjusted output coordinate system (B', see FIG. 3).

Conventionally known techniques can be applied to control the rotation of the specific coordinate system to control the display area to be transformed or inverted, and various modifications can be designed within the technical scope of the present invention.

According to the driver-customized display variable device 100 according to the first embodiment of the present invention, comparison data stored in advance in the storage unit 110 and the driver image output from the second camera unit 12 are compared And the coordinate system adjuster 140 adjusts the output area P based on the amount of change. However, the driver-customized display variable device 100 according to an exemplary embodiment of the present invention is not limited to this, and may be configured to coordinate the time axis S of the driver, which the image analysis unit 130 can recognize, with the coordinate system adjustment unit 140 , The output coordinate system B may be directly rotated according to the time axis S without utilizing the storage unit 110. [

The output control unit 150 functions to display an output area through the display unit 13. Specifically, the output control unit 150 can display the output region whose viewpoint has been adjusted through the display unit 13, based on the adjustment result of the output region viewpoint through the coordinate system adjustment unit 140.

Of course, in the case of the screen displayed through the output control unit 150, if the driver's face is within the driver reference area, the reference area set through the area setting unit 120 can be displayed. On the contrary, The output area whose viewpoint has been adjusted through the coordinate system adjustment unit 140 can be displayed through the display unit 13.

6 is a block diagram of a driver-customizable display variable device 200 according to a second embodiment of the present invention. Here, the driver-customized display variable device 200 according to the second exemplary embodiment of the present invention includes the functions of the driver-customized display variable device 100 according to the first exemplary embodiment of the present invention described above with reference to FIGS. 2 to 5 Alternatively, the distance between the driver and the display unit 13 may be detected, and the output area may be further enlarged or reduced based on the distance.

2 to 5, the driver-customized display variable device 200 according to the second exemplary embodiment of the present invention may further include an image analysis unit 230, It is possible to further detect distance information between the unit 13 and the driver and determine whether the output area is enlarged through the perspective control unit 250. [

In the following description, the elements that are the same as those described with reference to FIGS. 2 to 5 will be omitted, and the description will be made mainly on the differences. In order to facilitate the understanding of the present invention, the area setting unit 220, the image analyzing unit 230, the coordinate system adjusting unit 240, the perspective control unit 250, and the output control unit 260, And may actually be implemented as a single processing unit such as a CPU, MPU, GPU, and ECU.

The image analysis unit 230 analyzes the driver image photographed through the second camera unit 12. As described above, the driver-customized display variable device 100 according to an embodiment of the present invention changes the viewpoint of the output area output through the display unit 13 in consideration of the operation of the driver. Accordingly, the image analyzing unit 230 can detect the operation information of the driver by analyzing the driver image.

The image analyzer 230 can further detect the distance information on the variable distance between the driver's face and the display unit 13 through the above-described image analysis as well as the operation information described above. Here, the distance information may include a distance variation amount with respect to the distance between the face of the driver and the display unit 13. [

The perspective control unit 250 determines whether the distance between the driver's face and the display unit 13 is increased or decreased based on the distance information detected through the image analysis unit 230. [ Then, the perspective control unit 250 may enlarge at least a part of the output area to be outputted through the display unit 13 or reduce the output area according to the increase or decrease determined previously.

For example, when the distance between the face of the driver and the display unit 13 decreases, that is, when the face of the driver approaches the display unit 130, the perspective control unit 250 determines the distance At least a part of the output area can be enlarged according to the amount of change. Here, it is preferable that the enlarged portion is enlarged around the center portion of the output region.

In contrast, when the distance between the driver's face and the display unit increases, that is, when the driver's face moves away from the display unit, the perspective control unit 250 can reduce the output area according to the distance variation included in the distance information . Here, when the position of the driver's face reaches the driver's reference area described above, it is preferable that the weight occupied by the output area in the entire camera image is returned to the size of the reference area.

As another example, the perspective control unit 250 can obtain a result similar to that described above by controlling the zooming-in or zooming-out of the first camera unit 11 as well as enlarging or reducing the output area described above.

For example, when the operation information of the driver including the distance information is detected through the image analysis unit 230, the perspective control unit 250 calculates the Zoom-In of the first camera unit 11 according to the distance information ) Or zoom-out (Zoom-Out). The function of controlling the zooming-in or zooming-out of the first camera unit 11 is a function of controlling only a predetermined area within the output area P of the first camera unit 11 to fill the screen of the display unit 120 And the digital zoom function can be applied to general known techniques.

In addition, according to the embodiment of the present invention, the Zoom-In or Zoom-Out control is not limited to the digital zoom function, and a zoom lens may be used to change the focal distance. And may be achieved by the first camera unit 11 provided.

Of course, this is only an example, and there may be a situation where the camera of the vehicle to which the driver-customized display variable device 200 according to the second embodiment of the present invention is applied does not include such a zoom-in or zoom-out function, It is more preferable to enlarge or reduce the output screen through the above-described image processing technique because the manufacturing cost of the camera is increased.

7 is a flowchart illustrating a method of controlling a driver-customizable display variable device according to a first embodiment of the present invention. As described above, the driver-customized display variable device according to the first embodiment of the present invention can be applied to a vehicle including a first camera unit, a second camera unit, and a display unit. In addition, the driver-customized display variable device according to the first embodiment of the present invention sets at least a part of camera images as an output area through the first camera unit and displays the output image through the display unit, . A description will now be given of a method of controlling the driver-customized display variable device according to the first embodiment of the present invention described above with reference to FIG.

Step S110 is a step of collecting the camera image and the driver image. Specifically, the step S110 collects the camera images photographed through the first camera unit and the driver image photographed through the second camera unit, and stores the collected images in the storage unit. Here, it is preferable that the camera images are collected in real time and repeatedly, and the driver image can be continuously or intermittently photographed according to a predetermined driving and photographing procedure.

As described above, the first camera unit can be configured to include at least cameras, and each camera can be installed to photograph at least one of the front, side, and rear directions of the vehicle. The second camera unit can be installed inside the vehicle for photographing the driver. Here, the second camera unit and the display unit may be constituted by a single device, but the present invention is not limited thereto.

Step S120 is a step of extracting at least a part of the camera image into an output area. That is, step S120 is a step of extracting at least a part of the camera image output through the first camera unit as an output area. As mentioned earlier, the output area initially set can be set based on a reference area having a standard field of view and a viewing angle set according to the driver reference area in the camera image. As will be described below, this reference area may be a basic area to be set when the driver does not take a separate action for changing the viewpoint.

Step S130 is a step of detecting the driver's operation information by analyzing the driver image. As described above, in step S130, a body part such as an upper body, a face, and a pupil of a driver may be detected in the driver image collected through step S110, and motion of the body part may be detected. In operation S 130, when motion of the body part is detected, motion information is generated by detecting information on the inclination value of the variable time axis as the body part moves. In addition, the image analysis method performed in step S130 has been described in detail with reference to FIG. 2. Since various methods can be adopted and applied, a further explanation will be omitted.

Step S140 is a step of determining the face position of the driver based on the detected operation information through step S130.

Step S150 is a step of determining whether or not the face position of the driver is within a predetermined driver reference area. Here, the driver reference area may be defined as an area indicating a position of a body part such as a driver's face, a pupil, an upper body, and a hand when the driver does not take a separate action while the driver is sitting on the driver's magnet. However, as described above, it is most preferable that the driver reference area is set based on the face position of the driver, and the determination in step S150 is most preferably based on the driver's face position.

As a result of the determination in step S150, if the face position of the driver driving the current vehicle is within the predetermined reference area, the control is transferred to step S170. Otherwise, control passes to step S160.

The step S160 is a step performed when the face position of the driver is out of the preset driver reference area and the step of rotating the view point of the output area based on the operation information of the driver detected through step S130.

That is, in step S160, the face position of the driver is determined based on the motion information detected through step S130, and the rotation of the view point of the output area is adjusted corresponding to the face position of the driver. Here, the determination of the driver's face position can be made for left and right and top and bottom. Of course, the above procedure is merely an example, and it is also possible to perform up-and-down and left-and-right judgment on the driver's face position.

In step S170, based on the determination result in step S150, the output area set in step S130 is displayed on the display unit or the output area on which the viewpoint is rotated and adjusted in step S160 is displayed.

Specifically, if the driver does not perform a separate operation for changing the viewpoint of the output area, the output area set in step S130 (i.e., the output area set based on the reference area) may be output as it is. On the contrary, if the face of the driver is out of the driver reference area as a result of the determination in step S150, step S170 may display the adjusted output area through the display unit through step S160. Control is then passed to the return block.

8 is a flowchart of a step of adjusting a viewpoint of an output region according to the first embodiment of the present invention. Hereinafter, with reference to FIG. 8, a description will be given of a step of adjusting the viewpoint of the output region according to the first embodiment of the present invention.

Step S161 is a step of determining whether the driver's face has been sensed in the lateral direction. If it is determined in step S161 that the face position of the driver is shifted to the left or right with respect to the driver reference area, the control is transferred to step S163. Otherwise, the process proceeds to step S162.

Step S162 is a step of determining whether the up-and-down movement of the driver's face is detected. As a result of the determination in step S162, if the face position of the driver is moved upward or downward with reference to the driver reference area, control is transferred to step S163. Otherwise, control is passed to step SlOl.

In operation S163, when the driver's face moves left or right or up-and-down motion occurs, the step S163 is a step of adjusting the viewpoint of the output area in the direction opposite to the direction of movement of the driver's face.

Specifically, if the driver's face is out of the driver reference area and moved in the direction of either the left or the right with reference to the driver reference area, step S163 adjusts the viewpoint of the output area to the other one of left and right . If the driver's face is out of the driver reference area and moved in one of the upward and downward directions with respect to the driver reference area, step S163 may adjust the starting point of the output area to one of the left and right directions have.

For example, if it is determined in step S161 that the position of the driver's face deviates from the driver reference area and is shifted to the left based on the driver reference area, step S163 may adjust the viewpoint of the output area to the right have. As a result of the determination in step S161, if it is determined that the driver's face is moving rightward beyond the driver reference area, the viewpoint of the output area can be adjusted to the left.

Likewise, if it is determined in step S162 that the driver's face is moving upward beyond the driver reference area, step S163 may adjust the rotation of the point of view of the output area downward. If it is determined in step S162 that the driver's face is moving downward beyond the driver reference area, step S163 may adjust the rotation of the point of view of the output area upward.

In the above description, it is explained that the step S162 is performed when the face of the driver does not have the left / right motion since the judgment through the step S161. However, since this is only an example and there may be a situation in which the driver's face moves diagonally, it is also possible that the determination is performed in parallel in the steps S161 and S162. That is, the determination of the driver's facial motion itself may be made after the determination of the left-right motion, but it should be understood that the determination of the up-down motion is not performed only when there is no left-right motion.

FIG. 9 is a flowchart illustrating a method of controlling a driver-customized display variable device according to a second embodiment of the present invention. Here, the method for controlling the driver-customized display variable device according to the second exemplary embodiment of the present invention is performed through the driver-customized display variable device control method according to the first exemplary embodiment of the present invention described above with reference to FIGS. 7 and 8 Not only the function but also the distance between the driver and the display unit can be detected and the enlargement or reduction of the output area can be further performed based on the distance.

Accordingly, in the following description, elements overlapping with those described with reference to FIGS. 7 and 8 are omitted, and explanations are mainly made on differences.

Step S210 is a step of collecting the camera image and the driver image. Specifically, the step S110 collects the camera images photographed through the first camera unit and the driver image photographed through the second camera unit, and stores the collected images in the storage unit.

Step S220 is a step of extracting at least a part of the camera image into an output area. That is, step S120 is a step of extracting at least a part of the camera image output through the first camera unit as an output area. As mentioned earlier, the output area initially set can be set based on a reference area having a standard field of view and a viewing angle set according to the driver reference area in the camera image.

The step S230 analyzes the driver image collected through the step S210, and detects the driver's operation information and distance information based on the image analysis result. Here, the distance information may indicate information on a variable distance between the driver's face and the display unit. In addition, the distance information may include a distance variation with respect to the distance between the face of the driver and the display unit.

In addition, the technique of adjusting the viewpoint of the output image based on the operation information obtained through steps S240 through S260 has been described in detail in the first embodiment of the present invention, and a further explanation will be omitted.

In step S270, it is determined whether the distance between the face of the driver and the display unit is increased or decreased based on the distance information detected in step S230. Specifically, the step S270 compares the distance change between the face of the driver and the display unit based on the distance information detected in operation S230 and the zoom determination value. If it is determined in step S270 that the distance variation between the driver's face and the display unit is greater than or equal to the zoom determination value, control is passed to step S280. Otherwise, control passes to step S290.

Step S280 can be performed when the distance change amount is equal to or greater than a predetermined zoom determination value, and is a step of enlarging or reducing the output area according to the moving direction of the driver's face.

Specifically, when the distance between the face of the driver and the display unit decreases, that is, when the face of the driver approaches the display unit 130, at least one of the output areas is selected according to the distance variation included in the distance information. The portion can be enlarged. Here, it is preferable that the enlarged portion is enlarged around the center portion of the output region.

Conversely, if the distance between the driver's face and the display unit increases, that is, if the driver's face moves away from the display unit, the output area may be reduced according to the distance variation. Here, when the position of the driver's face reaches the driver's reference area described above, it is preferable that the weight occupied by the output area in the entire camera image is returned to the size of the reference area.

As another example, in step S280, it is possible to obtain a result similar to that described above by controlling the zooming-in or zooming-out of the first camera unit, not by performing image processing to enlarge or reduce the output area described above.

Of course, this is only an example. There may be a situation where the camera of the vehicle to which the driver-customized display variable device according to the second embodiment of the present invention is applied does not include the zoom-in or zoom-out function. Since the manufacturing cost of the camera is increased, it may be preferable to enlarge or reduce the output screen through the above-described image processing technique.

As described above, according to the driver-customized display variable device and the control method thereof according to the first and second embodiments of the present invention, the predetermined output area of the camera image displayed in the vehicle is displayed at a time point There is an advantage that it can be converted appropriately.

Further, the distance information between the driver and the display unit is detected through the analysis of the driver image taken by the camera, and the zoom operation of the camera unit for photographing the rear side according to the distance information is controlled, thereby enabling the driver to monitor the camera image more efficiently .

As described above, an optimal embodiment has been disclosed in the drawings and specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the present invention. something to do. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

100: Operator customizable display variable device
110: storage unit 120: area setting unit
130: Image analysis unit 140: Coordinate system adjustment unit
150:
200: Operator customizable display variable device
230: image analysis unit 250: perspective control unit

Claims (20)

1. A driver-customized display variable device for assisting a driving of a vehicle, the device being applied to a first camera unit, a second camera unit, and a vehicle equipped with a display unit,
An area setting unit for extracting at least a part of a camera image photographed through the first camera unit as an output area;
An image analyzer for analyzing a driver image photographed through the second camera unit to detect operation information of a driver;
A coordinate system adjuster for adjusting a viewpoint of the output area in the camera image according to operation information of the driver; And
And an output control unit for displaying an output area whose view is adjusted through the display unit. The method according to claim 1,
Wherein the operation information includes information on a slope value of a time axis S 'that varies as at least one of a driver's face and a pupil moves. 3. The method of claim 2,
The coordinate system adjustment unit,
And comparing the face position of the driver with the driver reference area based on the operation information. The method of claim 3,
The coordinate system adjustment unit,
And adjusts an output area viewpoint in the camera image according to the operation information of the driver when the face position of the driver is out of the driver reference area. 5. The method of claim 4,
The coordinate system adjustment unit,
Wherein when the face of the driver moves in one of the left and right directions, the viewpoint of the output region is adjusted to rotate in the other one of the left and right directions. 5. The method of claim 4,
The coordinate system adjustment unit,
Wherein when the face of the driver moves in one of an upward direction and a downward direction, the viewpoint of the output region is adjusted to rotate in the other direction of the upward and downward directions. The method of claim 3,
Wherein the area setting unit comprises:
Wherein the reference area having a standard field of view and a viewing angle set according to the driver reference area is set as an output area in the camera image. The method according to claim 1,
The coordinate system adjustment unit,
And adjusts the output area view by rotating and adjusting the output coordinate system of the output area according to the operation information of the driver. The method according to claim 1,
The image analysis unit may include:
And further detects distance information on a variable distance between a face of the driver and the display unit by analyzing the driver image. 10. The method of claim 9,
When the distance between the face of the driver and the display unit decreases, at least a part of the output area is enlarged according to the distance variation included in the distance information, and when the distance between the face of the driver and the display unit increases, Further comprising a perspective control unit for reducing the output area according to a distance change amount. A control method of a driver-customized display variable device for assisting driving of a vehicle, the method being applied to a first camera unit, a second camera unit, and a vehicle equipped with a display unit,
Extracting at least a part of a camera image taken through the first camera unit as an output area;
An image step of analyzing a driver image photographed through the second camera unit to detect operation information of a driver;
Adjusting a viewpoint of the output area in the camera image according to the operation information of the driver; And
And displaying an output area having a viewpoint adjusted through the display unit. 12. The method of claim 11,
Wherein the operation information includes information on a tilt value of a variable time axis S 'while at least one of a driver's face and a pupil is moving. 13. The method of claim 12,
Further comprising the step of comparing the face position of the driver with the driver reference area based on the operation information. 14. The method of claim 13,
The step of adjusting the viewpoint of the output region includes:
And when the face of the driver is out of the driver reference area. 15. The method of claim 14,
The step of adjusting the viewpoint of the output region includes:
Whether the driver's face has moved in one of the left and right directions; And
And rotating the viewpoint of the output area in one of a left direction and a right direction when the face of the driver moves in one of a left direction and a right direction. Control method. 15. The method of claim 14,
The step of adjusting the viewpoint of the output region includes:
Determining whether the driver's face has moved in one of an upward direction and a downward direction; And
Further comprising the step of adjusting the rotation of the viewpoint of the output area to the other one of the upward and downward directions when the driver's face moves in one of the upward and downward directions. Control method. 14. The method of claim 13,
Wherein extracting at least a portion of the camera image into an output region comprises:
And setting a reference area having a standard field of view and a viewing angle set according to the driver reference area as an output area in the camera image. 12. The method of claim 11,
The step of adjusting the viewpoint of the output region includes:
And adjusting an output coordinate system of the output area in accordance with operation information of the driver. 12. The method of claim 11,
Further comprising the step of detecting distance information on a variable distance between a face of the driver and the display unit by analyzing the driver image. 20. The method of claim 19,
When the distance between the face of the driver and the display unit decreases, at least a part of the output area is enlarged according to the distance variation included in the distance information, and when the distance between the face of the driver and the display unit increases, Further comprising the step of reducing the output area in accordance with a distance change amount.

Images