KR102270316B1 - Avm system having multivision comprise of smart devices - Google Patents

Abstract

The present invention relates to a multi-channel AVM system having a multi-vision consisting of a smart terminal for constructing a monitoring system by utilizing unopened surplus smart phones, and the present invention includes: a plurality of cameras for acquiring images outside the vehicle; a control unit mounted on a vehicle to obtain image information from the plurality of cameras and process the obtained image information; and a multi-vision comprising portable terminals receiving image information from the control unit. According to the present invention as described above, in the present invention, since the image obtained from the around-view monitoring system can be provided to the user through the unopened portable terminal, there is an effect that can significantly reduce the cost of configuring the AVM system.

Description

Multi-channel AVM system with multi-vision composed of smart terminals {AVM SYSTEM HAVING MULTIVISION COMPRISE OF SMART DEVICES}

The present invention relates to an Around View Monitoring (AVM) system, and to a multi-channel AVM system equipped with a multi-vision consisting of a smart terminal that constructs a monitoring system by utilizing unopened surplus smart phones.

Recently, various convenience facilities and devices and systems for operating and controlling them have been developed as a method for improving driver convenience and safety. In particular, an image camera system is used in a wide range of automobiles.

For example, there are various systems such as installing a camera on the outside of the car and using it to check the external image around the vehicle through the display on the driver's seat instrument panel, or recognize objects and lanes around the vehicle and warn the driver. developed and applied.

Among them, the around-view monitoring system performs a function of supporting a driver to drive and park smoothly by installing a plurality of cameras on the outside of the vehicle and photographing the surroundings of the vehicle. The output image of the around-view monitoring system is finally displayed by synthesizing images captured by a plurality of cameras into a single bird view image as viewed from above of a vehicle through an image processing process.

On the other hand, the bird view image to be displayed is provided by a separate display device provided in the vehicle, and in the configuration of the AVM system, there is a problem in that the cost of the AVM system is increased because the cost ratio of the display device is high.

Korean Patent Registration No. 10-1519288

The present invention has been devised to solve the conventional problems as described above, and the present invention implements a material vision according to the needs of the user by linking the around-view image acquired by the cameras mounted on the vehicle with an unopened portable terminal. This is to provide a multi-channel AVM system for output.

According to a feature of the present invention for achieving the above object, the present invention includes a plurality of cameras for acquiring an image outside the vehicle; a control unit mounted on a vehicle to obtain image information from the plurality of cameras and process the obtained image information; and a multi-vision comprising portable terminals receiving image information from the control unit.

In this case, the multi-vision may be configured by combining unopened portable terminals.

And the plurality of cameras, a first camera, a second camera, a third camera, a fourth camera, a fifth camera and a sixth camera respectively mounted on the front, rear, left front, left rear, right front and right rear of the vehicle A camera may be included, and the control unit may synthesize or divide the images obtained from the first to sixth cameras, and selectively distribute and output the images in the area set on the multi-vision.

In addition, the setting area of the multi-vision may be designated by the driving mode of the vehicle.

In addition, the setting area of the multi-vision may be designated by a user's input.

On the other hand, the plurality of cameras, a first camera, a second camera, a third camera, a fourth camera, a fifth camera and a second camera respectively mounted on the front, rear, left front, left rear, right front and right rear of the vehicle. 6 cameras, and the control unit may output each image obtained from the first camera to the sixth camera through a smart terminal matched to the first camera to the sixth camera, respectively.

And the matching of the plurality of cameras and the portable terminal, corresponding to the installation position of the plurality of cameras, according to the arrangement position of the portable terminal is matched; Setting the arrangement positions of the portable terminals includes the steps of: (A) dividing one image according to the number of the portable terminals to generate divided images; (B) randomly matching the divided images to the portable terminals and outputting them; (C) changing the matching portable terminal of the divided image according to the user's touch input input to the portable terminals; (D) changing the matching portable terminal of the divided image according to the user's touch input input to the portable terminals; and (E) determining the arrangement positions of the changed and matched portable terminals according to the division position information of the divided images on the original image.

In the matching of the plurality of cameras and the portable terminals, when the number of portable terminals is less than the number of cameras, different weights are given to each camera, and the portable terminals are allocated and matched according to the weights; The weight may be differently assigned to each camera according to the driving mode of the vehicle.

In addition, the portable terminals may be configured to include an acceleration sensor and a gyro sensor, respectively.

In addition, the control unit may determine whether there is an accident in the vehicle according to the measured values of the acceleration sensors of each portable terminal, and when the accelerations of the respective acceleration sensors are all less than or equal to a preset reference value, the vehicle may be determined as a collision accident.

In addition, the control unit determines whether or not the vehicle is overturned according to the rotation amount measurement value of the gyro sensors of each portable terminal, and when the average rotation amount measurement value of the gyro sensors is equal to or greater than a preset value, the vehicle rollover may be determined. have.

Meanwhile, the portable terminals are configured to include four or more portable terminals; In calculating the average rotation amount of the gyro sensors of the portable terminals, the control unit may calculate the average rotation amount by correcting the average rotation amount by excluding the portable terminal having a rotation amount greater than or equal to the preset comparison value. .

In this case, the control unit, in calculating the average rotation amount of the gyro sensors of the portable terminals, the rotation amount of the gyro sensor provided in the portable terminal and the rotation amount and the difference value of the image received from the matched camera are preset The average rotation amount may be calculated by excluding the portable terminal having the error value or more.

The following effects can be expected in the multi-channel AVM system having a multi-vision composed of a smart terminal according to the present invention as described above.

That is, in the present invention, since the image obtained from the around-view monitoring system can be provided to the user through the unopened portable terminal, there is an effect of significantly reducing the cost of configuring the AVM system.

In addition, in the present invention, it is possible to extend the multi-vision through an unopened portable terminal, thereby improving the user's convenience.

1 is an exemplary diagram schematically illustrating the configuration of a vehicle around-view monitoring system according to the present invention.
2 is a block diagram illustrating an around-view monitoring system according to a specific embodiment of the present invention.
3 is a flowchart illustrating an around-view monitoring method according to a specific embodiment of the present invention.
4 is an exemplary diagram illustrating an example of around-view monitoring according to a specific embodiment of the present invention.

Hereinafter, a multi-channel AVM system having a multi-vision composed of a smart terminal according to a specific embodiment of the present invention will be described with reference to the accompanying drawings.

Before the description, effects, features, and a method of achieving the same of the present invention will become clear in the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the art to which the present invention pertains. It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims.

In the description of the embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description will be omitted, and the terms to be described later are used in the embodiment of the present invention. As terms defined in consideration of the function of Therefore, the definition should be made based on the content throughout this specification.

Each block in the accompanying block diagram and combinations of steps in the flowchart may be executed by computer program instructions (execution engine), which computer program instructions may be executed by a processor of a general-purpose computer, special-purpose computer, or other programmable data processing equipment. It may be mounted so that the instructions, which are executed by the processor of a computer or other programmable data processing equipment, create means for performing the functions described in each block of the block diagram or in each step of the flowchart.

These computer program instructions may also be stored in a computer-usable or computer-readable memory that may direct a computer or other programmable data processing equipment to implement a function in a particular manner, and thus the computer-usable or computer-readable memory. It is also possible for the instructions stored in the block diagram to produce an article of manufacture containing instruction means for performing the functions described in each block of the block diagram or each step of the flowchart.

And since the computer program instructions may be mounted on a computer or other programmable data processing equipment, a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executable process to create a computer or other programmable data processing equipment. It is also possible that the instructions for performing the data processing equipment provide steps for performing the functions described in each block of the block diagram and each step of the flowchart.

In addition, each block or step may represent a module, segment, or portion of code comprising one or more executable instructions for executing specified logical functions, and in some alternative embodiments the blocks or steps referred to in the block or steps. It is also possible for functions to occur out of sequence.

That is, the two illustrated blocks or steps may be performed substantially simultaneously, and also the blocks or steps may be performed in the reverse order of the corresponding functions, if necessary.

As shown in FIG. 2, the AVM system according to the present invention is provided with a plurality of cameras 100 in the vehicle 10, and as shown in FIG. 1, a front camera 110 mounted on the front of the vehicle. , the left front camera 120 mounted on the left front side of the vehicle, the right front camera 130 mounted on the right front side of the vehicle, the rear camera 140 mounted on the rear side of the vehicle, the left rear side mounted on the left rear side of the vehicle It is configured to include a camera 220 and a right rear camera 230 mounted on the right rear side of the vehicle.

That is, the AVM system according to the present invention includes a 6-channel camera.

Meanwhile, the control unit 200 may obtain an around-view image by processing the captured images.

In addition, in the around-view monitoring system according to an embodiment of the present invention, as shown in FIG. 2 , the control unit 200 is interlocked with portable terminals, and specifically, the communication module 300 is mounted on the control unit 200 . and transmits the image obtained from the camera 100 or the result of processing the image obtained from the camera 100 to the portable terminals 400 , 500 , 600 , and 700 .

In this case, the front, left, right, and rear images captured by the camera 100 and the around-view image are output using the display of the portable terminal 300 without the need for a separate display device in the vehicle 10 , respectively. it is possible

At this time, the mobile terminals constitute a multi-vision, and the mobile terminals are constituted of an unopened smart phone and constitute the multi-vision, and accordingly, the mobile terminal is interlocked with the control unit by communication methods such as Bluetooth and Wi-Fi. do.

Meanwhile, the control unit synthesizes or divides the images obtained from the first to sixth cameras, and selectively distributes and outputs the images in the area set on the multi-vision.

Specifically, the control unit matches the images captured by each camera to the respective portable terminals and outputs them.

In this case, the portable terminal may be provided with the same number of cameras, but may be provided with a smaller number than the number of cameras.

That is, since the present invention configures the multi-vision of the AVM system using the remaining unopened smart phone, it is possible to use the portable terminal without the number of cameras depending on the user's condition.

Hereinafter, the matching process between the portable terminals and the camera will be described separately according to the number of portable terminals.

First, a case in which the portable terminal is provided with the same number of cameras will be described.

In this case, the matching between them basically matches the vehicle installation position of each camera and the arrangement position of the portable terminal to ensure intuitive visibility of the user.

As a specific example, a first camera, a second camera, a third camera, a fourth camera, a fifth camera, and a second camera respectively mounted on the front, rear, left front, left rear, right front and right rear of the vehicle Assuming that it consists of six cameras and that six portable terminals are provided, the control unit may match the respective images acquired from the first to sixth cameras to the first to sixth cameras, respectively. output through

At this time, the control unit cannot know the arrangement position of the portable terminal. In order to understand this, the present invention divides one image corresponding to the number of portable terminals, and then randomly matches each divided image to the portable terminal. print it out

Then, the user inputs a touch command (drag, etc.) so that each divided image is arranged in the original arrangement form to change the arrangement form of each segmented image, and the control unit identifies the arrangement position of each portable terminal according to the changed information do.

This will be described in detail with reference to FIG. 5. First, the control unit (A) divides one image according to the number of the portable terminals to generate divided images.

Thereafter, (B) the divided images are randomly matched and outputted to the portable terminals. An example in which a divided image is output through random matching is shown on the left side of FIG. 5 .

Next, (C) the user changes the matching portable terminal of the divided image by touching the screen so that the entire image matches the original image, and (D) the control unit responds to the user's touch input input to the portable terminals. Accordingly, the matching portable terminal of the divided image changes.

In the illustrated example, an embodiment in which a drag touch input for changing the front left and right sides and rear left and right sides of the vehicle is input is illustrated.

Accordingly, when the divided image output to each portable terminal is corrected to be identical to the arrangement of the original image, (E) the control unit according to the division position information of the divided images on the original image and the changed matching blueprint Determine the actual placement location.

In this case, the image does not necessarily have to be a vehicle image as in the illustrated example, and it is sufficient as long as it is easy to intuitively grasp the batty shape rather than an image such as overlapping patterns, and may be an image such as a figure.

According to such a matching method, the user can intuitively and easily set the arrangement position of the portable terminal.

On the other hand, if the number of the portable terminals is smaller than the number of cameras, since the entire camera-acquired image cannot be matched to each portable terminal, a weight is given to each camera to preferentially match the portable terminals according to the weight. can

In this case, the weight may be differently assigned to each camera according to the driving mode of the vehicle.

That is, as shown in FIG. 6 , there are three installed portable terminals, and as described above, when the first to sixth cameras are installed, the vehicle moves forward (D) when the driving mode is the driving (D) mode. The first camera), the left front (third camera), and the right front (fifth camera) are given high weights so that images obtained from the first camera, the third camera, and the fifth camera are output to each portable terminal.

On the other hand, when the driving mode of the vehicle is the reverse (R) mode, the rear (second camera), left rear (fourth camera), and right rear (sixth camera) are given high weights, so that each portable terminal has a second camera. , so that images obtained from the fourth and sixth cameras are output.

Accordingly, there is an advantage that AVM can be implemented by combining optimal camera images according to the driving mode of the vehicle and the number of installed portable terminals.

Meanwhile, in the driving mode of the vehicle, the weight may be set differently according to the parking mode (P) or the left and right lane change mode in addition to the reverse mode (R) and the driving mode (D).

Hereinafter, a method of providing a multi-channel AVM having a multi-vision configured by a smart terminal according to the present invention as described above will be described in detail with reference to the accompanying drawings.

As shown in FIG. 4 , the method for providing a multi-channel AVM having a multi-vision configured by a smart terminal according to the present invention starts with the camera 100 of the vehicle acquiring an image (S100).

Thereafter, the control unit 200 determines the output conditions (region division) of each terminal constituting the multi-vision (S200).

In this case, as described above, the division of the area may be divided by the driving mode or may be divided by the user's setting.

And the control unit 200 generates and provides the obtained image to each terminal according to the output conditions of each terminal (S300, S400).

Accordingly, each terminal constituting the multi-vision outputs a divided image.

On the other hand, the multi-channel AVM system according to the present invention can determine the presence or absence of an accident and the type of accident by using the provided portable terminals.

At this time, it is also possible for the control module to transmit a rescue/rescue message according to the determined existence and type of accident.

To this end, each of the portable terminals includes an acceleration sensor and a gyro sensor.

First, looking at the accident determination method of the control unit, the control unit determines whether the vehicle has an accident according to the measurement values of the acceleration sensors of each portable terminal.

In this case, when the accelerations of the respective acceleration sensors are all less than a preset reference value, the control unit determines that the vehicle collision accident occurs.

Here, the reference value is set to a negative value indicating rapid deceleration and is set to be smaller than a deceleration value generated during sudden braking of the vehicle to identify a case in which a physical collision occurs.

Next, looking at the accident rest determination method of the control unit, in the present invention, it is determined whether the vehicle is overturned by the type of the accident.

To this end, the control unit determines whether or not the vehicle is overturned according to the rotation amount measurement value of the gyro sensors of each portable terminal, and when the average rotation amount measurement value of the gyro sensors is greater than or equal to a preset value, it is determined that the vehicle rollover has occurred. judge

Meanwhile, in order to improve the accuracy of determining whether or not the vehicle is overturned, the present invention provides for calculating the average rotation amount of the gyro sensors of the portable terminals, except for the portable terminal having an overall average rotation amount and a rotation amount greater than or equal to a preset comparison value. Thus, the average rotation amount can be corrected and calculated.

In this case, the comparison value is a value indicating a rotation amount deviation of each portable terminal that may occur even within the same vehicle rotation depending on the installation location of the portable terminals. In such a case, when a specific portable terminal falls from the cradle or rolls separately, This is to prevent mistaking it for vehicle overturning and judging it.

Of course, in order to apply this embodiment, at least three portable terminals should be provided, and it is preferable to provide four or more for effective verification.

Meanwhile, in order to more accurately determine whether the vehicle has overturned, the following embodiment may be applied.

That is, in the present invention, in calculating the average rotation amount of the gyro sensors of the portable terminals, even if the average rotation amount is calculated by excluding a specific portable terminal, the change in the image acquired from the camera of the excluded portable terminal and the portable terminal It can be determined by comparing the amount of rotation measured from the gyro sensor provided in the .

Specifically, when the control unit calculates the average rotation amount of the gyro sensors of the portable terminals, the rotation amount of the gyro sensor provided in the portable terminal and the rotation amount of the image received from the matched camera and the difference value The average rotation amount may be calculated by excluding portable terminals that are equal to or greater than the preset error value.

At this time, the error value is a value representing the rotation amount of the cradle (portable terminal) that can be generated by vibration (speed bump, etc.) or shaking of a general vehicle, and the rotation amount of the image acquired from a camera attached to the outside of the vehicle and If there is a large difference in the amount of rotation of the portable terminal, it means that the portable terminal is not integrally attached to the vehicle. Accordingly, the rotation amount of the portable terminal is excluded from the determination of whether or not the vehicle is overturned, thereby improving the accuracy of the determination. .

The right of the present invention is not limited to the embodiments described above, but is defined by what is described in the claims, and a person of ordinary skill in the art can make various modifications and adaptations within the scope of the claims. it is self-evident

The present invention relates to a multi-channel AVM system having a multi-vision composed of a smart terminal for constructing a monitoring system by utilizing unopened surplus smart phones. Since it can be provided to users through , there is an effect of significantly reducing the cost of configuring the AVM system.

10: vehicle 100: camera
110: front camera 120: left front camera
130: right front camera 140: rear camera
220: left rear camera 230: right rear camera
200: control unit 300: communication unit
400: first terminal 500: second terminal
600: third terminal 700: fourth terminal

Claims (5)

a plurality of cameras for acquiring an image outside the vehicle;
a control unit mounted on a vehicle to obtain image information from the plurality of cameras and process the obtained image information; And
and a multi-vision comprising portable terminals receiving image information from the control unit;
The control unit is
Matching and outputting image information from the plurality of cameras to the portable terminal:
The multi-vision is
Unopened mobile terminals are combined and configured:
The plurality of cameras,
A first camera, a second camera, a third camera, a fourth camera, a fifth camera and a sixth camera respectively mounted on the front, rear, left front, left rear, right front and right rear of the vehicle,
The control unit is
and outputting each image obtained from the first camera to the sixth camera through a smart terminal matched to the first camera to the sixth camera, respectively:
Matching the plurality of cameras and the portable terminal,
Corresponding to the installation positions of the plurality of cameras, matched according to the arrangement positions of the portable terminals;
The arrangement positions of the portable terminals are,
(A) generating divided images by dividing one image according to the number of the portable terminals;
(B) randomly matching the divided images to the portable terminals and outputting them;
(C) changing the matching portable terminal of the divided image according to the user's touch input input to the portable terminals;
(D) changing the matching portable terminal of the divided image according to the user's touch input input to the portable terminals;
(E) A multi-channel AVM system with a multi-vision composed of a smart terminal, characterized in that the arrangement positions of the changed and matched portable terminals are determined according to the divided position information of the divided images on the image.
delete delete delete The method of claim 1,
Matching the plurality of cameras and the portable terminal,
when the number of portable terminals is less than the number of cameras, assigning different weights to each camera, assigning and matching portable terminals according to the weights;
The weight is
A multi-channel AVM system with a multi-vision composed of a smart terminal, characterized in that different cameras are assigned according to the driving mode of the vehicle.

Images