KR100854922B1 - Apparatus for displaying circumference of a vehicle - Google Patents

Abstract

An apparatus for displaying an image of surroundings of a vehicle is provided to allow a driver to safely drive the vehicle by enabling the driver to recognize the situation around the vehicle in third person observer point of view. An apparatus for displaying an image of surroundings of a vehicle comprises a camera, a rotating unit(110), a partial image generating unit(120), and a coupling unit(130). The camera is movable up and down along a pillar installed in the vehicle. The rotating unit generates a rotary image based on the image photographed by the camera and rotation information including a rotation angle that is preset by a user. The partial image generating unit generates partial images based on the rotary image and crop information. The coupling unit combines the partial images based on position information of the partial images.

Description

Apparatus for displaying circumference of a vehicle}

1 is a view illustrating an operation concept of the vehicle main display surface 200 according to the present invention.

FIG. 2 is a diagram illustrating a vehicle circumference change surface display apparatus 200 and a vehicle circumference change surface generating apparatus 100 according to the present invention.

3 is a view showing the operation of the rotating unit 110, respectively.

4 is a diagram illustrating the operation of the present invention step by step.

5 is a diagram illustrating an operation of the partial image generating unit 120, respectively.

6 is a view showing the operation of the coupling unit 130, respectively.

The present invention relates to a display device for changing the vehicle circumference, and more particularly, by providing a screen that matches the orientation of the user at the sky view point (viewed from the sky), allowing the user to more intuitively understand the surrounding situation of the vehicle. The present invention relates to a vehicle main display surface display device that enables recognition.

Vehicle driving is directly related to the safety of the vehicle driver, and a lot of economic losses occur when contacting with other vehicles. In driving a vehicle, visibility is essential for safe driving. In particular, parking is more sensitive to the sense of distance, but the elderly, beginners or women drivers do not have such a sensitive sense of distance, the need for a device to assist the vehicle is increasing.

At present, as an auxiliary device, a device that transmits a distance or a warning sound to a user using a front and rear distance sensor, or installs a camera in a front bumper or a rear bumper of a vehicle and presents the image captured by the camera to a driver through a monitor in the vehicle. Is being used.

However, a simple numerical value or warning sound is not a substitute for sensitive parking sensation, and a monitoring system that shows the captured image to the user does not provide immediate spatial sensation to the user by presenting the captured image to the user as it is. . In particular, in the case of providing the captured image, there is a problem in that the user cannot provide a sense of distance between the vehicle and its surroundings because the image transmitted from one camera is provided to the user as it is.

That is, even if a camera for monitoring the front, rear, left, and right sides is installed around the vehicle, individual images transmitted from each monitor, that is, only the image on the left side, only the image on the right side, or the image on the rear side, are displayed one by one or multiple monitors are installed. It is difficult for a silver driver or a novice driver with poor synesthesia to comprehensively judge the space around the vehicle. In other words, the images of each of the front, rear, left, and right provide information about the surrounding objects and the person, but become a separate problem from the parking itself, which requires synesthesia.

Accordingly, the present invention has been made to solve the above problems, the object of the present invention is to present the spatial situation around the vehicle at the sky view point (view from the sky) to provide a more immediate sense of space to the driver. It is to provide a vehicle visibility device that can be.

In order to solve the above problems, the present invention is a device for displaying the vehicle change image to the user at the sky view point, the camera (2) mounted in a state of being movable in the pillar of the vehicle; A rotating unit 110 generating a rotating image based on the rotating image including the image captured by the camera and a rotation angle predetermined by the user; A partial image generation unit (120) for generating a partial image based on cropping information which is information on which of the rotating image and the portion of the rotating image to be cropped; And a coupling unit 130 which mutually couples the partial images based on the combination information, which is information indicating the position of the partial image and the partial image in the entire image.

In one embodiment, the crop information is characterized in that it includes information about the crop shape, crop size and crop position.

In one embodiment, the combining information is characterized in that it includes information about the area size and area location.

In an exemplary embodiment, the partial image generating unit 120 may replace a portion not represented by the rotatable image with a predetermined image of the vehicle.

In addition, the present invention is a device for generating a vehicle principal change surface that is the sky view point from an image captured from one or more cameras installed in the upper portion of the vehicle, the rotation including an image captured by the camera and a predetermined rotation angle by the user A rotating unit 110 generating a rotating image based on the information; A partial image generation unit (120) for generating a partial image based on cropping information which is information on which of the rotating image and the portion of the rotating image to be cropped; And a coupling unit 130 which mutually couples the partial images based on the combination information, which is information indicating the position of the partial image and the partial image in the entire image.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

1 is a view illustrating an operation concept of the vehicle main display surface 200 according to the present invention.

The pillar 2 of the vehicle 1 is provided with a camera 2. The camera 2 is movable by the lift device 4, and when the imaging is not necessary, the camera 2 is recessed inside the filler 3 so as not to harm the aesthetics of the automobile. The vehicle 2 and the lift device 4 may be installed in an appropriate pillar of the vehicle because the position of the pillar varies from vehicle to vehicle, and the aesthetics of the vehicle must be taken into consideration.

Each camera 2 located in each pillar captures a screen from the viewpoint of the camera itself, and transmits it to the vehicle monitor screen generating device inside the vehicle. However, the vehicle circumference change surface display apparatus of the present invention generates the vehicle circumference change surface at the sky view point (viewed from the sky) from the user's point of view based on the captured screen.

In the present invention, since the first camera captures the image from the elevated position by the lift apparatus, the unit screen for constituting the screen of the sky view point is possible, and the second lift apparatus is installed in the pillar and normally recessed in the pillar. It may not hurt the beauty of

In addition, the present invention does not simply present the screen shot at the sky view point to the user, but converts the screen into a screen that can provide the user with a more suitable sense of distance at the sky view point. This will be described in more detail with reference to FIG. 2.

FIG. 2 is a diagram illustrating a vehicle circumference change surface display apparatus 200 and a vehicle circumference change surface generating apparatus 100 according to the present invention.

The vehicle main surface changing device 200 includes cameras 11, 12, 13, and 14 and a vehicle main surface changing apparatus 100.

The cameras 11, 12, 13, and 14 are mounted in the vehicle pillar in a state capable of moving. Shanghai East means can be implemented by a lift means, such lift means are well known in the art.

The vehicle circumference changing surface generating device 100 is a device for generating the vehicle surroundings screen 30 based on the imaging images 21, 22, 23, and 24 input from the cameras 11, 12, 13, and 14.

The vehicle main change surface generating apparatus 100 includes a rotating unit 110, a partial screen generating unit 120, and a coupling unit 130.

The rotating unit 110 generates the rotating image 121, 122, 123, 124 based on the captured images 21, 22, 23, 24 and the rotation information 115 captured by the cameras 11, 12, 13, and 14. The rotation information 115 is information about how much the screen shot from each camera should be rotated so as to be expressed in a right direction intuitively to the user. That is, the rotating unit 110 generates the rotated image 121 by rotating each captured image 21 by a predetermined angle in the rotation information 115. Detailed operation thereof will be described with reference to FIG. 3.

The partial image generation unit 120 generates partial images 131 to 134 based on the rotation image 121 to 124 and the crop information 125. Crop information 125 is positional information relating to which part of each of the rotational images 121 to 124 is to be cut out. The partial image generating unit 120 generates the partial images 131 to 134 by cropping the rotated images 121 to 124 by a predetermined portion from the crop information 125 corresponding to each of the rotated images. do.

The combiner 130 generates the vehicle surrounding image 30 based on the partial images 131 to 134 and the combined information 139. The combined information 139 is information indicating which partial image is located at which position in the entire image, that is, the vehicle head change image 30. That is, the coupling unit 130 generates the vehicle change image 30 by placing each partial image 131 to 134 at a corresponding position based on the coupling information 139 which is information on which each partial image should be located.

3, 5, and 6 are views showing the operation of the rotating unit 110, the partial image generating unit 120 and the coupling unit 130, respectively, Figure 4 is a view for explaining the operation of the present invention step by step.

In FIG. 4, the operation of the rotating unit 110 corresponds to steps s410 and s 420, the operation of the partial image generating unit 120 corresponds to the steps s430 and s440, and the operation of the coupling unit 130 is the operation of step s450. Corresponds to.

In FIG. 3, the camera 11 is a camera located in the upper right pillar of the vehicle. As shown in FIG. 3, the captured image 41 captured by the camera 11 is an image around the right headlight of the vehicle, and as shown in the orientation display, faces an empty space, not the vehicle, above the center of the screen. have. This is because the camera is installed obliquely by the direction and the angle a of the vehicle so as to efficiently photograph the surroundings of the vehicle, and the direction in which the vehicle is photographed differs from the direction of the vehicle by the angle a.

If the captured image 41 is displayed to the user as it is, the user or driver cannot intuitively recognize the upper right side of the vehicle. This is because the vehicle is recognized as being distorted because the direction of the vehicle is different from the azimuth in the captured image, and as a result, the user must recognize the sense of distance in consideration of this point (the image of step s410 of FIG. 4).

Therefore, an appropriate measure for correcting this is necessary and in the present invention, the imaging image 41 is rotated by a predetermined angle for this purpose. For example, in Fig. 3, the picked-up image 41 on the upper right side needs to be rotated by 90-a angle clockwise.

In FIG. 4, in step S410, the captured image 41 is input to the rotating unit 110. The captured image 41 is an image in which the vehicle portion s1 and the peripheral portion s2 are combined, and since the camera 11 faces toward the upper right side of the vehicle, that is, in the 1-2 o'clock direction, the captured image 41 is viewed from the user's point of view. It is an inclined shape.

Next, in step 420, the rotating unit 110 rotates the captured image 41 by a predetermined rotation angle. For example, in the case of the image picked up by the camera 11 in FIG. 3, the rotating unit 110 rotates the picked-up image 41 clockwise by an angle of 90-a. By doing so, the direction of the vehicle coincides with the azimuth direction when the user sees the display device of the present invention.

The rotation angle is information predetermined by the user as the rotation information. The rotation information includes the camera identifier and the rotation angle (including direction) of the screen captured by the camera. This is because the rotation angle is different for each camera.

In one embodiment, the present invention further includes a storage medium for storing rotation information, and a user may store rotation information suitable for each vehicle in the storage medium. If the user selects and inputs the most suitable rotation angle in advance, the vehicle and its camera can be used as long as they do not change the position of the camera, so that the inconvenience of having to input the rotation angle every time does not occur.

5 is a diagram illustrating the operation of the partial image generation unit.

In FIG. 5, the partial image generation unit 120 generates the partial image 43 based on the rotation image 42 and the crop information 125 (FIG. 2).

Crop information 125 is information regarding which part of the rotational image 42 is cut into what shape. In one embodiment, as shown in Table 1, the crop information 125 includes information regarding crop form, crop size, and crop position. More specifically, the crop information 125 includes a reference point coordinate O, a horizontal length X, and a vertical length Y.

TABLE 1

Camera number Crop Form Crop size Crop position (reference point) Undisplayed Area Display Type 11 Rectangle 6 * 8 O (-12, -13) Black color 12 Rectangle 6 * 8 O (12, -13) Black color 13 Rectangle 6 * 8 O (-12, -13) Black color 14 Rectangle 6 * 8 O (12,13) Black color

In FIG. 5, the generating of the partial image 43 is as follows, and the generating of the partial image in FIG. 4 corresponds to steps s430 and s440.

First, the rotating image 42 is placed on the xy plane.

Next, locate the crop rectangle as indicated by the crop information. That is, the reference point coordinates are determined as relative coordinates from the rotation image 42. For example, in the crop information, if the reference point coordinates O = (-12, -13), X = 6, and Y = 8, the O (-12, -13) points from the reference point (determined by the user) of the rotating image. From this place a crop rectangle of length 6 and length 8 is placed (step s 430 of FIG. 4).

Next, the image inside the boundary line of the crop rectangle is cut out to select the partial image. In one embodiment, a portion (s3 in FIG. 4) not represented by the rotatable image 42 in the region inside the boundary line may give an indication (eg, black) that no image exists (FIG. 4). 4, s440). In another embodiment, the portion s3 other than the rotatable image may produce a more natural whole image by positioning a predetermined image by the user, for example, a planar photograph of the vehicle.

6 is a view showing the operation of the coupling unit 130.

In FIG. 6, the coupling unit 130 generates the vehicle main transformation image 30 based on the partial image 43 and the coupling information 139. The partial image 43 generated by the partial image generating unit 120 is input to the combining unit 130, and the combining unit 130 is based on the combining information 139 corresponding to the partial image 43. The position of 43 is determined, and the partial image 43 is positioned at that position. The combined information 139 is information indicating where the partial image picked up from each camera is located on the full screen.

In one embodiment, the present invention further includes a storage medium for storing the binding information, and the user may store the coupling information suitable for each vehicle in the storage medium. If the user selects and inputs the most suitable combination information in advance, the vehicle and the camera can be used as long as the position of the camera is not changed. Therefore, the inconvenience of having to input the combination information every time does not occur.

In one embodiment, the vehicle area 501, which is the part of the vehicle change image 40, in which the vehicle is expected to be intuitively located, can be presented as a predetermined image by the user. In this case, by providing the form of the vehicle to the user in advance, the user can more easily determine the combined information indicating the position of the partial image. In this case, it is preferable that the brightness of the image provided in advance is displayed on the display device with a lighter brightness than the partial image. This is to make the image provided in advance so as to be clearly distinguished from the partial image to be displayed.

In Fig. 6, the area 502 of the part not represented by the partial image 43 is a non-displayed part, which is colored by a user's predetermined color, or by a user's predetermined image, for example, a plane photograph of a vehicle. It may also be displayed by the. This is to present a more intuitive image to the user.

In Fig. 4, the coupling unit 130 positions the partial image 43, which is an image picked up from the camera 11, in the area A in the partial area of the main vehicle image 40 (step s450). In this manner, the partial images 131, 132, 133 and 134 captured from all the cameras are located in the respective areas A, B, C and D indicated by the combined information 135, 136, 137 and 138.

The combined information 135 to 138 is positional information indicating where each of the partial images 131 to 134 is located in the vehicle circumference image (40 in FIG. 4). For example, the combined information may be represented as shown in Table 2.

 TABLE 2

Camera number Realm name Area size Area location (reference point) Area type 11 A 6 * 8 (0.0.) Rectangle 12 B 6 * 8 (0, -3) Rectangle 13 C 6 * 8 (-3, -3) Rectangle 14 D 6 * 8 (-3,0) Rectangle

On the other hand, the vehicle head changing surface display method according to the vehicle head changing surface display apparatus according to the present invention can be created by a computer program. Codes and code segments constituting the program can be easily inferred by a computer programmer in the art. In addition, the program is stored in a computer readable media, which is read and executed by a computer to implement a vehicle main display surface display method. The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

As described above, according to the present invention, since the combined screen is provided to the user based on the screen captured from the camera installed on the vehicle, the user can view the entire vehicle around 360 degrees at the sky view point and the third person observer point in the sky. Can recognize the vehicle, leading to safer driving.

In addition, since the screen image captured by the camera is rotated by a predetermined angle so as to match the orientation of the user's vision and then coupled to each other and provided to the user, the user can recognize the surroundings of the vehicle more intuitively.

In addition, since the rotation angle is a predetermined value according to the shape of the vehicle, an embodiment in which the user may store the predetermined value without setting every time, does not cause any inconvenience in setting the rotation angle.

Claims (5)

A device for displaying the vehicle change image to the user at the sky view point, A camera 2 mounted in a pillar of the vehicle in a movable state; A rotating unit 110 generating a rotating image based on the rotating image including the image captured by the camera and a rotation angle predetermined by the user; A partial image generation unit (120) for generating a partial image based on cropping information which is information on which of the rotating image and the portion of the rotating image to be cropped; And Coupling unit 130 for mutually combining the partial images based on the combined information which is information indicating the position of the partial image and the partial image in the entire image Vehicle change phase display device comprising a. The apparatus of claim 1, wherein the crop information includes information on a crop shape, a crop size, and a crop position. The apparatus of claim 1, wherein the combining information includes information about an area size and an area position. The apparatus of claim 1, wherein the partial image generating unit (120) replaces a portion not represented by the rotatable image with a predetermined image of the vehicle. An apparatus for generating a vehicle main change surface which is a sky view point from an image captured by at least one camera installed on an upper portion of a vehicle, A rotating unit 110 generating a rotating image based on the rotating image including the image captured by the camera and a rotation angle predetermined by the user; A partial image generation unit (120) for generating a partial image based on cropping information which is information on which of the rotating image and the portion of the rotating image to be cropped; And Coupling unit 130 for mutually combining the partial images based on the combined information which is information indicating the position of the partial image and the partial image in the entire image Vehicle change phase display device comprising a.

Images