KR101406222B1 - System and method for transmitting Around View Monitor video including automotive status information - Google Patents

Abstract

The present invention provides an around view monitor (AVM) image transmitting system reflecting vehicle state information to identify a state around a vehicle and a vehicle′s parking state at the same time. The AVM video transmitting system includes an around camera capturing an image around a vehicle and including a front camera, a rear camera, a pair of left and right side cameras; a body control module (BCM); an AVM module generating a top view image by synthesizing a front image, left and right side images, and a rear image provided from the around camera as being connected to the around camera and generating an overlay top view image by analyzing vehicle state information received from the BCM and overlaying at least one warning icon on the top view image; and a wireless communications interface transmitting the overlap top view image generated by the AVM module to a predetermined mobile terminal.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an AVM image transmission system and method,

The present invention relates to an AVM video transmission system and method reflecting vehicle status information. More particularly, the present invention relates to a system and a method for transmitting an AVM image overlaid with a warning icon reflecting vehicle status information to a mobile terminal of a driver.

Generally, a system for displaying a peripheral image of a vehicle is not universally installed in a vehicle, so that a driver can check the surroundings of the vehicle only through his or her eyes, or through an inside mirror or an outside mirror We checked the surroundings of the vehicle.

However, depending on the type of vehicle, there is a direction in which it is easy to identify the front and rear surroundings when sitting in the driver's seat, and there is a blind spot that can not be visually recognized or visually recognized through a mirror.

Particularly, in the case of a large-sized vehicle, since there are a relatively large number of areas that can not be confirmed only by an inside mirror or an outside mirror, it is necessary to check whether the obstacle exists visually while looking around the vehicle before driving. It is possible to prevent accidents and accidents.

Accordingly, in recent years, devices have been developed for photographing the surrounding environment through cameras installed in the front, rear, left, and right directions of the vehicle, and displaying images of the surroundings of the vehicle through a display device provided in the vehicle by combining the captured images.

On the other hand, Japanese Patent No. 7880602 and European Patent Publication No. 2481637 disclose a technique in which auxiliary information such as the position of a peripheral obstacle of a vehicle is overlaid on a peripheral image of the vehicle. However, the above patent documents do not disclose a configuration in which the operating state of the vehicle, not the external environment of the vehicle, is overlaid on the peripheral image of the vehicle and transmitted to the mobile terminal of the driver.

An object of the present invention is to provide an AVM image transmission system that reflects vehicle status information for transmitting a top view image overlaid with an icon for informing a vehicle status to the mobile terminal by analyzing status information of the vehicle.

Another object of the present invention is to provide an AVM image transmission method that reflects vehicle status information for transmitting a top view image overlaid with an icon for informing a vehicle status to the mobile terminal by analyzing status information of the vehicle.

Another object of the present invention is to provide an AVM image transmission system that reflects vehicle status information, which simultaneously transmits status information of a vehicle and a top view image of a vehicle to a mobile terminal.

Another object of the present invention is to provide an AVM image transmission method that reflects vehicle status information, which simultaneously transmits status information of a vehicle and a top view image of a vehicle to a mobile terminal.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other matters not mentioned can be clearly understood by those skilled in the art from the following description.

In order to solve the above problems, an AVM image transmission system reflecting vehicle status information according to one aspect of the present invention (ASPECT) includes a vehicle surrounding camera configured by a front camera, a rear camera, a pair of right and left side cameras, (BCM), and a vehicle surroundings camera, and generates a top view image by synthesizing a front image, a left and right side image, and a rear image received from the vehicle surroundings camera to generate a top view image, And a wireless communication interface for transmitting an overlay top view image generated by the AVM module to a pre-designated mobile terminal. The overlay top view image is generated by overlaying the at least one warning icon on the top view image.

The AVM video transmission system further includes a battery device for supplying power to the vehicle surroundings camera, the body control module, the AVM module, and the wireless communication interface in a state in which the ignition is off so as to operate even when the vehicle is not started can do. In this case, the wireless communication interface receives the image providing request signal from the mobile terminal and provides the received image providing request signal to the AVM module. In response to receiving the image providing request signal, The vehicle monitoring system according to claim 1, further comprising: an overlaying unit for overlaying at least one warning icon on the top view image by analyzing the vehicle status information received from the body control module to generate a top view image by synthesizing a front image, a left and right side image, A top view image can be generated.

The AVM module may overlay the one or more warning icons over a location corresponding to each alert icon in the vehicle symbol by overlaying the display location based on the vehicle symbol display area of the top view image.

Wherein the warning icon warns an abnormal state of a specific part in the vehicle, and the AVM module determines the display position based on the vehicle symbol display area of the top view image and overlays the one or more warning icons on the vehicle symbol The display position may be determined and overlaid based on the position of the part according to each warning icon.

The warning icon may be at least one of a door open warning icon, a headlight on warning icon, a sunroof open warning icon, a trunk open warning icon, a warning light on warning icon, and a window open warning icon.

An AVM image transmission system reflecting vehicle state information according to another aspect of the present invention for resolving the above problems (ASPECT) includes a vehicle surround photography camera including a front camera, a rear camera, and a pair of right and left side cameras, An AVM module connected to the vehicle surrounding camera and generating a top view image by synthesizing a front image, a left and right side image, and a rear image received from the vehicle surrounding camera, And transmits the identification information of the displayed target alert icon to the mobile terminal by analyzing the top view image generated by the AVM module and the vehicle status information received from the body control module And a wireless communication interface.

According to another aspect of the present invention, there is provided an AVM image transmission method reflecting vehicle state information according to ASPECT, comprising the steps of: a vehicle receiving an information provision request from a mobile terminal; A step of generating a top view image by synthesizing a front image, a left and right side image, and a rear image provided from a surrounding camera, and generating a top view image, wherein the vehicle includes vehicle state information received from a body control module (BCM) Analyzing and overlaying at least one warning icon on the top view image to generate an overlay top view image; and transmitting, by the vehicle, the overlay top view image to the mobile terminal.

According to another aspect of the present invention for resolving the above problems, an AVM video transmission method reflecting vehicle status information includes: receiving a request for providing information from a mobile terminal; A step of generating a top view image by synthesizing a front image, a left and right side image, and a rear image received from a surrounding camera; analyzing vehicle state information received from a body control module (BCM) provided in the vehicle; Generating an overlay top view image by overlaying at least one warning icon on the top view image; and analyzing the vehicle condition information received from the body control module (BCM) provided in the vehicle to determine a display target warning icon And displaying the overlay top view image and the identification information of the warning icon to the mobile terminal The steps involved are included.

Other specific details of the invention are included in the detailed description and drawings.

According to the present invention, a driver or an official of the vehicle can confirm his / her mobile terminal from outside the vehicle through the top view image of the vehicle's surroundings, and can check the state information of the vehicle, for example, whether or not the headlight is lit Can be easily grasped.

1 is a first block diagram for explaining an AVM video transmission system reflecting vehicle status information according to an embodiment of the present invention.
2 is a diagram showing an example of a display of a top view image generated by the AVM module.
3 is a second block diagram for explaining an AVM image transmission system reflecting vehicle status information according to an embodiment of the present invention.
4 is a block diagram of an AVM video transmission system that reflects vehicle status information according to another embodiment of the present invention.
5 is an example of an image displayed on a mobile terminal receiving data from an AVM image transmission system reflecting vehicle status information according to an embodiment of the present invention.
6 is a first flowchart illustrating an AVM image transmission method reflecting vehicle state information according to an embodiment of the present invention.
FIG. 7 is a second flowchart illustrating an AVM image transmission method reflecting vehicle state information according to an embodiment of the present invention. Referring to FIG.

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Is provided to fully convey the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

The terms spatially relative, "below", "beneath", "lower", "above", "upper" May be used to readily describe a device or a relationship of components to other devices or components. Spatially relative terms should be understood to include, in addition to the orientation shown in the drawings, terms that include different orientations of the device during use or operation. For example, when inverting an element shown in the figures, an element described as "below" or "beneath" of another element may be placed "above" another element. Thus, the exemplary term "below" can include both downward and upward directions. The elements can also be oriented in different directions, so that spatially relative terms can be interpreted according to orientation.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise.

1 is a schematic block diagram illustrating a configuration of an AVM video transmission system that reflects vehicle status information according to an exemplary embodiment of the present invention.

Referring to FIG. 1, an AVM image transmission system 1 reflecting vehicle state information according to the present embodiment includes a vehicle surround camera 40 including a front camera, a rear camera, a left camera, a right camera, (BCM) 30, an AVM module 10, and a wireless communication interface 20. Of course, the wireless communication interface 20 is further provided with an antenna 21.

There are numerous electronic control units (ECUs) in vehicles. ECUs connected to each device, such as wipers, power windows, seat heating lines, remote control keys, lamps, etc., act as a `brain` to control these devices. ECU is an essential technology for automobile intelligence and recently it has been applied to various intelligent safety vehicles such as inter-vehicle distance system and advanced control system. The body control module 30 is a module for integrating various ECUs applied to a vehicle and integrally controlling the integrated ECUs with one central control device. Therefore, the body control module 30 stores and manages information about how parts in the vehicle are operating at a high level. For example, the body control module 30 can store and manage information on a door open state, a headlight on state, a sunroof open state, a trunk open state, an emergency light on state, a window open state, and the like.

The AVM module 10 is supplied with image data from the camera 40 around the vehicle. The AVM module 10 can receive images in a CAN (Controller Area Network) communication method, but according to another embodiment, the AVM module 10 can receive images in an Ethernet manner. The AVM module 10 synthesizes the received image data to generate a top-view image. A display example of the top view image is shown in Fig. As shown in FIG. 2, the top view image is composed of a vehicle model arranged at the center and partial images 1 to 4 indicating front, rear, left, and right images of the vehicle. As shown in Fig. 2, the top view image brings intuitive recognition such as looking down at the vehicle from the sky.

The AVM module 10 according to the present embodiment can receive the vehicle status information from the body control module 30. [ The vehicle state information is information about which part in the vehicle is operating. That is, it may be the operation status display data for each part in the vehicle.

The AVM module 10 analyzes the received vehicle state information to determine the part in the abnormal operation state of each part in the vehicle. The part may refer to each operation unit managed by the body control module 30. The part may be, for example, a car door, a headlight, a sunroof, a trunk, an emergency light, a window, a wiper, and the like. The abnormal operation state means that it is not the previously designated state. For example, it can be determined that the vehicle is in an abnormal operation state, such as a door open, a headlight is lit, a sunroof is open, a trunk is open, an emergency light is turned on.

That is, it can be understood that the abnormal operation state means a state in which the abnormal operation state is placed in the parking operation state.

Next, the AVM module 10 overlays the warning icon corresponding to the part in the abnormal operation state on the top view image. At this time, the warning icon can be overlaid on the basis of the vehicle symbol position of the top view image. In particular, the warning icon may be overlaid on the part position on the vehicle symbol, reflecting the actual vehicle position of each icon corresponding part.

5, the door open warning icon 501 is displayed in correspondence with the door position of the vehicle symbol, the trunk open warning icon 502 is displayed in correspondence with the trunk position of the vehicle symbol, The sunroof open warning icon 503 determines the display position corresponding to the sunroof position of the vehicle symbol, the interior light on warning icon 504 determines the display position corresponding to the interior light position of the vehicle symbol, The display position is determined in correspondence with the headlight position of the vehicle symbol, and the display position is determined in correspondence with the emergency light position of the vehicle symbol by the emergency lightening warning icon 506. [

Referring again to FIG. 1, an overlay top view image in which one or more warning icons 501 to 506 are overlaid by the AVM module 10 is transmitted to the mobile terminal 50 via the wireless communication interface 20. Transmission to the mobile terminal 50 may be performed only when a request signal of the mobile terminal 50 is received.

It is preferable that the AVM video transmission system reflecting the vehicle status information according to the present embodiment operates in a wake-up operation as the request signal of the mobile terminal 50 is received even when the vehicle is in the off-state.

To this end, the system according to the embodiment of the present invention includes a vehicle surrounding camera 40, a body control module 30, an AVM module 10, and a wireless communication interface 20 in a state where startup is off as shown in FIG. And a battery device 60 for supplying power. At this time, the wireless communication interface 20 receives the image providing request signal from the mobile terminal 50 and provides the received image providing request signal to the AVM module 10, and the AVM module 10 provides the image providing request signal And a controller for generating a top view image by synthesizing a front image, a left and right lateral image, and a rear image provided from the vehicle surroundings camera in response to receiving the request signal, analyzing the vehicle status information received from the body control module, Icon is overlaid on the top view image to generate an overlay top view image.

4 is a block diagram of an AVM image generation system for an AVM image transmission vehicle that reflects vehicle status information according to another embodiment of the present invention.

4, the front IP gateway 100, the central IP gateway 200, and the rear IP gateway 300 are connected to each other via ethernet, and the AVM video transmission system 1, which reflects the vehicle status information, Are connected to each other via a network.

The front camera 110, the rear camera 310, the left camera 240, and the right camera 210 are configured to acquire a front image, a rear image, a left image, and a right image, respectively, about the vehicle periphery.

And a body control module 260 is connected to the central IP gateway 200. In addition, although the body control module 260 is described as being connected to the central IP gateway in FIG. 4, the body control module 260 may be connected to the front IP gateway 100 and the rear IP gateway 300 according to another embodiment.

The touch display 222 displays the top view image generated by the AVM module 220.

The AVM module 220 receives the vehicle status information from the body control device 260 through the central IP gateway 200 and receives the vehicle status information from the cameras 110, 210, 230, Data can be provided. The AVM module 220 may analyze the vehicle status information received from the body control module and overlay one or more warning icons on the top view image to generate an overlay top view image.

The overlay top view image may be transmitted to the wireless interface 20 through the central IP gateway 200 and transmitted to the mobile terminal 50.

According to another embodiment of the present invention, the top view image and information on the warning icon may be separately transmitted. That is, the AVM module 220 generates only the top view image, transmits it to the mobile terminal 50 via the wireless communication interface 20, analyzes the vehicle status information received from the body control module, The identification information may be transmitted to the mobile terminal 50 separately from the top view image. That is, in this case, the mobile terminal 50, not the AVM module 220, performs an operation of overlaying the warning icon on the top view image.

Hereinafter, an AVM image generation method for an AVM image transmission vehicle that reflects vehicle status information according to another embodiment of the present invention will be described with reference to FIGS.

First, referring to FIG.

First, the vehicle information providing application of the mobile terminal 50 is executed (S100), and an information providing request signal is transmitted to the vehicle 1 (S102). When the information providing request signal is received through the wireless communication interface provided in the vehicle 1, the AVM image generating system for the AVM image transmitting vehicle reflecting the vehicle status information of the vehicle 1 is waked up (S104).

Next, the AVM module of the vehicle 1 receives the front, rear, and side images through the cameras provided in the vehicle, and generates an AVM top view image (S106). The AVM module also receives the vehicle status information from the body control module (BCM) (S108).

The AVM module transmits the AVM top view image to the mobile terminal 50, and transmits information about the vehicle status in addition to the AVM top view image (S112). For example, the AVM module may analyze the received vehicle status information to determine a part in an abnormal operating state, and then transmit the identification information of the warning icon corresponding to the determined part.

The mobile terminal 50 overlays the received vehicle status information on the received top view image (S114) and displays the overlapped (S116).

7, the AVM module of the vehicle 1, unlike the one shown in FIG. 6, displays the top view image in which the warning icon is overlaid at the position corresponding to the warning icon (S111), and the mobile terminal 50 can receive and display the overlaid top view image (S116).

The steps of a method or algorithm described in connection with the embodiments of the invention may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. The software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of recording medium known in the art. An exemplary recording medium is coupled to a processor, which is capable of reading information from, and writing information to, the recording medium. Alternatively, the recording medium may be integral with the processor. The processor and the recording medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in the AVM module 10, AVM module 220. Alternatively, the processor and the recording medium may reside as discrete components in the AVM module 10, the AVM module 220, and the like.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, You will understand. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

10: AVM module
20: Wireless communication interface
30, 260: Body control module
40: Camera around camera
Battery unit: 60
100: forward IP gateway
110: front camera
200: Central IP gateway
210: Right camera
220: AVM module
222: Touch display
230: Left camera
300: Rear IP gateway
310: rear camera

Claims (8)

A camera around the vehicle comprising a front camera, a rear camera, and a pair of left and right side cameras;
Body Control Module (BCM);
A body view photographing module for analyzing the vehicle state information received from the body control module and generating a top view image by synthesizing a front image, a left and right side image, and a rear image received from the vehicle surroundings photographing camera, An AVM module for overlaying a warning icon on the top view image to generate an overlay top view image; And
And a wireless communication interface for transmitting an overlay top view image generated by the AVM module to a previously designated mobile terminal,
The AVM module includes:
Overlaying the at least one warning icon on a position corresponding to each warning icon in the vehicle symbol by overlaying and determining a display position with reference to the vehicle symbol display area of the top view image,
AVM video transmission system reflecting vehicle status information. The method according to claim 1,
Further comprising a battery device for supplying power to the peripheral camera, the body control module, the AVM module and the wireless communication interface in a state in which the ignition is off,
Wherein the wireless communication interface receives an image provision request signal from the mobile terminal and provides the received image provision request signal to the AVM module,
Wherein the AVM module generates a top view image by synthesizing a front image, a left and right side image, and a rear image received from the vehicle surrounding camera in response to receiving the image providing request signal, Analyzing information and overlaying at least one warning icon on the top view image to generate an overlay top view image;
AVM video transmission system reflecting vehicle status information. delete The method according to claim 1,
The warning icon warns an abnormal state of a specific part in the vehicle,
The AVM module includes:
Determining at least one warning icon based on a vehicle symbol display area of the top view image and overlaying the overlay by determining a display position based on a part position according to each warning icon on the vehicle symbol,
AVM video transmission system reflecting vehicle status information. 5. The method of claim 4,
The warning icon,
A door open warning icon, a headlight on warning icon, a sunroof open warning icon, a trunk open warning icon, an emergency light on warning icon, a window open warning icon,
AVM video transmission system reflecting vehicle status information. A camera around the vehicle comprising a front camera, a rear camera, and a pair of left and right side cameras;
Body Control Module (BCM);
An AVM module connected to the vehicle surrounding camera to generate a top view image by synthesizing a forward image, a left and right lateral image, and a rear image received from the vehicle surrounding camera; And
Receiving the image supply request signal from the pre-designated mobile terminal and delivering it to the AVM module, analyzing the top view image generated by the AVM module and the vehicle status information received from the body control module, And a wireless communication interface for transmitting information to the mobile terminal,
The AVM module includes:
Overlaying at least one warning icon on a location corresponding to each warning icon in the vehicle symbol by overlaying and determining a display position with reference to the vehicle symbol display area of the top view image,
AVM video transmission system reflecting vehicle status information. The vehicle receiving an information provision request from the mobile terminal;
Generating a top view image by synthesizing a front image, a left and right side image, and a rear image provided from a peripheral photographing camera provided in the vehicle;
Analyzing vehicle status information received from a body control module (BCM) provided in the vehicle and overlaying at least one warning icon on the top view image to generate an overlay top view image; And
The vehicle transmitting the overlay top view image to the mobile terminal,
Wherein the generating the overlay top view image comprises:
Overlaying the at least one warning icon on a position corresponding to each warning icon in the vehicle symbol by overlaying and determining a display position with reference to the vehicle symbol display area of the top view image,
AVM image transmission method reflecting vehicle status information. The vehicle receiving an information provision request from the mobile terminal;
Generating a top view image by synthesizing a front image, a left and right side image, and a rear image provided from a peripheral photographing camera provided in the vehicle;
Analyzing vehicle status information received from a body control module (BCM) provided in the vehicle and overlaying at least one warning icon on the top view image to generate an overlay top view image;
Analyzing vehicle status information received from a body control module (BCM) provided in the vehicle to determine a display target warning icon;
The vehicle transmitting the identification information of the warning icon and the overlay top view image to the mobile terminal,
Wherein the generating the overlay top view image comprises:
Overlaying the at least one warning icon on a position corresponding to each warning icon in the vehicle symbol by overlaying and determining a display position with reference to the vehicle symbol display area of the top view image,
AVM image transmission method reflecting vehicle status information.

Images