KR102110607B1 - The vehicle to everything communication method and apparatus based on visual-mimo - Google Patents

Abstract

As an embodiment of the present invention, provided are a visual MIMO-based vehicle-to-everything (V2X) communication apparatus and a method thereof. According to an embodiment of the present invention, a visual MIMO-based V2X communication apparatus comprises: a light emitting unit for outputting color information; a light receiving unit for receiving color information from the outside; a color information processing unit for generating the color information to be output or analyzing the received color information; a driving information collection unit for collecting driving information of a vehicle; a driving control unit for controlling a driving state of the vehicle based on the information provided from the color information processing unit and the driving information collection unit; and a communication unit for performing communication inside or outside the vehicle. Such an apparatus can be mounted on the vehicle and can perform visual-MIMO communication with facilities.

Description

TECHNICAL FIELD The vehicle communication (V2X) device based on visual-mimo and its method {THE VEHICLE TO EVERYTHING COMMUNICATION METHOD AND APPARATUS BASED ON VISUAL-MIMO}

The present invention relates to a vehicle communication (V2X) device and method based on Visual-MIMO, and more specifically, a light emitting unit and a light receiving unit are mounted at least one position toward a front area or a rear area of the vehicle. The present invention relates to an apparatus and method for allowing a plurality of vehicles, facilities having at least one of a light emitting unit and a light receiving unit at a predetermined location, to communicate with each other based on visual-appearance.

A visual MIMO communication system is a communication system that enables a user to provide data transmission and reception using visible light so as not to feel discomfort, multiple inputs and multiples considering data quality and data transmission capacity Refers to a visible light communication system using MIMO (Multi-Input Multi-Output) technology that enables output. That is, MIMO technology mainly uses an LED array (LEA, LED Array) in a transmitting device to support multiple inputs of a transmitting device and multiple outputs of a receiving device, and a data transmission using an image sensor capable of multiple inputs in a receiving device By increasing the capacity or obtaining a spatial diversity effect, the efficiency of the visual-looking communication system can be increased.

Smart Highway is an intelligent highway business that combines information and communication technology (ICT) and road and automobile technologies to reduce accident rates and improve mobility, convenience, and safety of highways, and was initiated by the Korean government since 2007, 2014 It was planned to be completed by the year, but it has not been fully built yet, and it is scheduled to be completed by 2020. Examples of smart highways include LED street lights, LED tunnels, solar panel roads, wireless charging of vehicles, and vehicle infrastructure integration (VII). In the smart highway, information and communication technology (ICT) is important in the smart highway (vehicle infrastructure integration, VII), and these communication links are defined and carried out in the 802.11p group called WAVE. Since WAVE, which is the basic communication means of next-generation ITS, also uses RF at 5.9Ghz, the need for V2X communication with Visual-MIMO applied as an alternative and alternative means is strongly emerging because it has the advantages and disadvantages of RF.

1. Republic of Korea Registered Patent No. 10-1587485

GPS communication is impossible in the tunnel, which is one of the vulnerable areas for wireless communication, and RF communication is limited. To overcome this, various amplification devices are installed in the tunnel to amplify the signals received from the ground to perform communication through a leaky coaxial cable, antenna, aerial, etc. However, there are still concerns that the system also has large environmental and situational constraints, and that communication becomes impossible in a similar situation. In particular, in some local tunnels where the installation of RF radio equipment is old, communication is often impossible due to compatibility problems with digital receivers currently used. In addition, due to the nature of the tunnel where there is a possibility of serious damage to humans in the event of a disaster, it is very difficult to ensure sufficient safety in case of a similar communication with only the currently installed RF communication facility. Moreover, the electromagnetic interference environment in which the RF signal may be restricted, or the smart highway system under construction, if the vehicle is operated in such a situation, has a problem in that damages due to communication errors and disconnections can be serious and serious.

The present invention has been devised as a countermeasure to the above existing problems, and is intended to provide a vehicle communication (V2X) device based on Visual-MIMO and a method thereof as an example.

As an embodiment of the present invention, a vehicle communication (V2X) device based on Visual-MIMO and a method thereof may be provided.

A vehicle communication (V2X) device based on visual-appearance according to an embodiment of the present invention includes a light emitting unit for outputting color information, a light receiving unit for receiving color information from the outside, and generating or receiving color information to be output. A color information processing unit for analyzing information, a driving information collecting unit for collecting driving information of a vehicle, a driving control unit for controlling the driving state of the vehicle based on information provided from the color information processing unit and the driving information collecting unit, and It includes a communication unit for communication inside or outside, and such a device may be mounted on a vehicle, and visual-to-memory communication may be possible with a facility through the device.

In the color information processing unit according to an embodiment of the present invention, as the separation distance to the first other vehicle in the same direction increases, at least one of the color, light emitting structure, and light emission pattern included in the color information to be output to the first other vehicle increases. And identify the second vehicle or facility in the vicinity based on the operation information collected through the operation information collection unit, and obtain color information with the first vehicle through at least one of the identified second vehicle or facility. You can make it communicate.

In addition, the facility includes a tunnel or underpass, and when each of a plurality of vehicles equipped with a device enters the tunnel or underpass, each of the plurality of vehicles directly from the light emitting part of the facility or via another vehicle in the tunnel or underpass At least one color information may be received.

A vehicle communication method based on visual-appearance according to an embodiment of the present invention includes a plurality of vehicles equipped with a light-emitting unit and a light-receiving unit at at least one position toward a front area or a rear area of a vehicle, and a light-emitting unit at a predetermined position. A facility in which at least one of the light-receiving units isequipped, and each of a plurality of vehicles receives color information for color-independent visual-aesthetic communication in real time as at least one of a front region and a rear region of the vehicle. Outputting data to each vehicle when a predetermined event occurs, receiving color information from at least one of a front area and a rear area of each of the plurality of vehicles, and coloring a plurality of vehicles in real time in a facility or whenever a certain event occurs Outputting information or receiving at least one color information from a plurality of vehicles and a plurality of vehicles Each step includes controlling the driving status based on the color information received from other vehicles and the color information received from the facility, and the facility transmits the received color information to the relevant agency or based on the information received from the relevant agency. Can be output as another color information.

In addition, according to an embodiment of the present invention, the first vehicle among the plurality of vehicles preferentially receives color information from the second vehicle in the same direction, and then colors from the third vehicle in progress from the opposite direction. It receives color information from information and facilities, and can synthesize all the received color information to control the driving status.

The predetermined event includes at least one of a vehicle accident, a change in the state of the road surface, a facility inspection, a natural disaster, road construction, and road closure, and color information of a different type may be preset for each predetermined event.

In the first vehicle among the plurality of vehicles, the color information to be output to the second vehicle can be variably adjusted as the separation distance to the second vehicle in the same direction is increased, and through at least one of the third vehicle or facility The second vehicle can transmit and receive color information.

The facility according to an embodiment of the present invention includes a tunnel or an underpass, and when each of a plurality of vehicles enters a tunnel or underpass, a plurality of vehicles may be directly from the light emitting part of the facility or via another vehicle in the tunnel or underpass. At least one color information may be received from each of them.

Meanwhile, as an embodiment of the present invention, a recording medium readable by a computer recording a program for executing the above-described method on a computer may be provided.

Using the device and method according to an embodiment of the present invention, stable communication is possible even in a place where RF communication is restricted in an existing smart highway infrastructure using existing RF communication, or in such a situation (ex. Electromagnetic interference, solar wind, etc.) Since it is possible, there is an advantage that it can be sufficiently utilized as a communication for backup of RF communication.

Visual-MIMO of a device and a method according to an embodiment of the present invention is a visible light communication method utilizing RGB mixed colors, and a light emitting module (ex. LED, etc.) between an already built LED infrastructure of a smart highway and vehicle (s) ) And light receiving module (ex. Camera, etc.) can be used for communication, especially in the environment of tunnels where GPS and RF communication are severely restricted. Since it can be used for communication, it can greatly improve the utilization of existing facilities and has a great advantage in that it does not cost additional infrastructure. In other words, when the vehicle enters the tunnel through the road and the GPS function is blocked. Vehicle to Everything (V2X) visible light communication using the LED infrastructure in the tunnel can be performed to achieve stable vehicle operation.

In addition, the apparatus and method according to an embodiment of the present invention have a higher transmission speed and reliability by using Visual-MIMO, which is a communication utilizing RGB mixed colors in visible light communication (IEEE 802.11.7). Visual-MIMO is a communication that captures RGB LEDs with a camera and analyzes the color of the LEDs. In particular, the camera installed in the vehicle is not limited in module size and performance, so it is possible to perform high-speed shooting or precise shooting depending on the situation. Its utilization value is high.

1 is a schematic diagram of a smart highway system under construction.
2 is a flowchart illustrating a vehicle communication (V2X) method based on visual-looking according to an embodiment of the present invention.
3 shows an example of a vehicle-to-vehicle communication (V2V) based on visual-appearance according to an embodiment of the present invention.
4 shows an example of applying Multiplexing and Diversity according to an embodiment of the present invention.
5 shows an example of a Visual-MIMO communication process in a special facility (ex. Tunnel) according to an embodiment of the present invention.
6 is a block diagram illustrating a vehicle communication (V2X) device based on visual-appearance according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains may easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

Terms used in the specification will be briefly described, and the present invention will be described in detail.

The terminology used in the present invention has been selected, while considering the functions in the present invention, general terms that are currently widely used are selected, but this may vary according to the intention or precedent of a person skilled in the art or the appearance of a new technology. In addition, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, their meanings will be described in detail in the description of the applicable invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents of the present invention, not simply the names of the terms.

When a part of the specification "includes" a certain component, this means that other components may be further included instead of excluding other components, unless specifically stated to the contrary. In addition, terms such as “... unit” and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented in hardware or software, or a combination of hardware and software. . In addition, when a part is "connected" to another part in the specification, this includes not only "directly connected" but also "connected with other elements in between".

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a schematic diagram of a smart highway system under construction.

As mentioned above, the smart highway is an intelligent highway business that combines information and communication technology (ICT) with road and automobile technologies to reduce accident rates and improve mobility, convenience, and safety of highways. It is an upcoming project, and it was planned to be completed by 2014, but it has not been fully built yet, and it has been changed to be completed by 2020. As shown in FIG. 1, as examples of smart highways, LED street lights, LED tunnels, solar panel roads, wireless charging of vehicles, and vehicle infrastructure integration (VII) have been proposed. In the smart highway, information and communication technology (ICT) is important in the smart highway (vehicle infrastructure integration, VII), and these communication links are defined and carried out in the 802.11p group called WAVE. Since WAVE, which is the basic communication means of next-generation ITS, also uses RF at 5.9Ghz, the need for V2X communication with Visual-MIMO applied as an alternative and alternative means is strongly emerging because it has the advantages and disadvantages of RF.

FIG. 2 is a flowchart illustrating a visual-appearance based vehicle communication (V2X) method according to an embodiment of the present invention, and FIG. 3 is a visual-appearance based inter-vehicle communication (V2V) method according to an embodiment of the present invention. An example is shown, and FIG. 4 shows an example of applying Multiplexing and Diversity according to an embodiment of the present invention. In addition, Figure 5 shows an example of a Visual-MIMO communication process in a special facility (ex. Tunnel) according to an embodiment of the present invention.

A vehicle communication (V2X) method based on Visual-MIMO according to an embodiment of the present invention includes a plurality of vehicles equipped with a light emitting unit and a light receiving unit at at least one position toward a front region or a rear region of the vehicle (10, 20, 30), a facility in which at least one of the light emitting unit and the light receiving unit is installed at a predetermined position (facility) (1), a plurality of vehicles (10, 20, 30) each of the vehicle Outputting color information for color-independent visual-appearance communication in real time or whenever a predetermined event occurs (S100), a plurality of vehicles (10, 20, 30) as at least one of the front area and the rear area Each step of receiving color information from at least one of the front area and the rear area (S200), the facility 1 outputs color information for a plurality of vehicles in real time or whenever a predetermined event occurs, or a plurality of vehicles (10, 20, 30) The step of receiving at least one color information (S300), and a plurality of vehicles (10, 20, 30) each of the driving information based on the color information received from the other vehicle, the color information received from the facility (1) It may include the step of controlling (S400), the facility (1) may transmit the received color information to the relevant institution, or may be output as another color information based on the information received from the related institution.

The front area of the vehicle may refer to an area of about 90 degrees left and right, respectively, based on the front view from the driver's seat and the passenger seat. Similarly, the rear area of the vehicle may refer to an area of about 90 degrees left and right respectively, based on the backrest of the driver's seat and the passenger seat. The vehicle may be equipped with at least one light emitting part and a light receiving part toward the front area or the rear area. The light emitting unit refers to a device capable of generating and outputting light such as an LED, and the light receiving unit may refer to a device capable of obtaining information by acquiring light, such as a camera (eg, an image sensor inside). For example, the light emitting unit may be an LED array of a predetermined shape (eg, M x N shape, M and N being natural numbers). Such a light emitting unit may be mounted as a headlight of a vehicle, or may be embedded in a front black box inside the vehicle. In addition, the light receiving unit may be a camera mounted separately on the vehicle, or may be a camera included in a black box mounted toward the inside and outside of the vehicle.

In addition, the facility 1 may refer to a roadside object, such as a street light or a sign. Furthermore, the facility 1 may refer to a building along the road. For example, a light emitting unit for emitting light may be provided at an uppermost portion of a street light on the side of a road, and a light receiving unit for collecting color information provided from a vehicle or the like may be provided at a middle or lower portion of the street light.

Referring to FIG. 3, each of the plurality of vehicles 10, 20, and 30 communicates color-independent visual-to-measure communication with at least one of a front region and a rear region of a corresponding vehicle (eg, each vehicle itself). Color information can be output in real time or whenever a predetermined event occurs. The color information includes at least one of a color, a light emitting structure (ex. Color expression form in an LED array) and a light emitting pattern (ex. A light emitting method such as a flashing cycle in an LED array) matched to predetermined data. Can be.

In a predetermined event according to an embodiment of the present invention, a vehicle accident (ex. Vehicle-to-vehicle accident, vehicle-to-life accident, etc.), changes in road surface conditions (ex. Freezing, sinkhole occurrence, crack occurrence, etc.), facility inspection , Natural disasters (ex. Heavy fog, flooding of rivers, landslides, etc.), at least one of road construction and road closure, and different types of color information (ex. Color, light emitting structure, light emitting pattern, etc.) for each given event May be preset.

Each of the plurality of vehicles may control a driving state based on color information received from another vehicle or color information received from a facility. For example, if a collision accident occurs between vehicles at a distance of 3 km in front of the highway, the accident occurrence information may be expressed and transmitted as color information from vehicles adjacent to the accident point to vehicles at the rear. The rear vehicle receiving color information from the front vehicle may recognize that an accident has occurred in the front and may slow or stop the vehicle. In addition, the color information output from the vehicle adjacent to the accident point can be transmitted to at least one facility, and at least one facility outputs and provides color information for surrounding vehicles to efficiently report the accident. It can also be delivered.

In the facility, the color information received from the vehicle or the like can be transmitted to the related institution, or another color information can be generated based on the information received from the related institution and output to another facility or vehicle. Related organizations may refer to the Ministry of Land, Infrastructure and Transport, the Fire and Disaster Prevention Agency, the National Police Agency, the Meteorological Agency, local government agencies, road management companies, and medical institutions.

Referring to FIG. 3, according to an embodiment of the present invention, the first vehicle 10 among a plurality of vehicles preferentially (ie, primarily) color information from the second vehicle 20 in the same direction. ), And then (secondarily) receives color information from the third vehicle 30 and color information from the facility 1 in progress from the opposite direction. Can be controlled.

In addition, the first vehicle 10 among the plurality of vehicles preferentially receives color information from the facility 1, and then the second vehicle 20 in the same direction and the third vehicle in progress from the opposite direction The color information from (30) can be subsequently received, and all the received color information can be synthesized to control the driving status. Priority of receiving color information may be variously set according to a situation according to a distance from a vehicle, an angle of receiving color information, and the like. For example, color information transmitted from the closest distance from the vehicle may be preferentially received, or may be preferentially received as the angle at which the color information is received is closer to 90 degrees.

In addition, the received color information may be weighted according to a source to be reflected in vehicle driving state control. For example, the highest weight W1 is assigned to the first received color information, and an intermediate weight W2 may be assigned to the second received color information from the opposite vehicle. . In addition, the lowest weight W3 may be assigned to the color information received from the facility 1 (that is, W1> W2> W3). The weight may be automatically assigned by the color information processing unit 1300 of the device 1000 according to an embodiment of the present invention, or may be set in advance by a driver.

Referring to FIG. 4, in a first vehicle 10 among a plurality of vehicles 10, 20, and 30, a color to be output to the second vehicle 20 increases as the separation distance to the second vehicle in the same direction increases. The information may be variably adjusted, and color information may be transmitted and received from the second vehicle 20 by relaying at least one of the third vehicle 30 or the facility 1.

As shown in FIG. 4, the Visual-MIMO can perform communication with multiplexing and diversity with consideration of environmental factors such as road environment and distance between vehicles. Relay communication can also be performed using vehicle and road infrastructure (ex. Facilities, etc.). In FIG. 4, since the distance between the first vehicle 10 and the second vehicle 20 is already farther away from each other, the first vehicle 10 may perform diversity communication by adjusting color information. Since the distance between the third vehicle 30 and the second vehicle 20 is relatively close, multiplexing communication may be performed as shown in FIG. 4. In addition, since communication between the first vehicle 10 and the third vehicle 30 and the second vehicle 20 and the third vehicle 30 is possible, relay communication may be performed with each other. The above description can be applied equally not only between vehicles, but also between vehicles and road infrastructure.

The facility 1 according to an embodiment of the present invention includes a tunnel or an underpass, and when each of a plurality of vehicles 10, 20 and 30 enters a tunnel or underpass, the light emitting part 3 of the facility 1 ), Or at least one color information may be received from each of the plurality of vehicles directly through tunnels or other vehicles in the underpass.

Referring to FIG. 5, V2X communication may be performed using an illumination light source, drowsiness prevention LED, or the like of an existing tunnel that is already installed in a tunnel. In a situation in which RF signals and satellite signals such as tunnels and underground are restricted, the Visual-MIMO V2X communication method and apparatus according to an embodiment of the present invention may be a good alternative. If only Line Of Sight (LOS) is secured, Visual-MIMO communication can be performed, so stable communication using light is possible even in an environment where RF signals cannot be received. In other words, by using the communication method according to an embodiment of the present invention, it is possible to stably operate in a specific driving environment such as a tunnel, and can be used as an effective alternative to the existing smart highway RF communication, other roads, In an environmental situation (ex. Solar wind generation, electromagnetic interference, extreme weather, etc.), an existing RF signal may be subject to many limitations in operation, whereas the method according to an embodiment of the present invention is a kind of preparation for such a special situation. A role as a backup communication can also be sufficiently performed.

6 is a block diagram illustrating a vehicle communication (V2X) device based on visual-appearance according to an embodiment of the present invention.

In accordance with an embodiment of the present invention, a vehicle communication (V2X) device 1000 based on visual-appearance includes a light emitting unit 1100 for outputting color information, a light receiving unit 1200 for receiving color information from the outside, and output Color information processing unit (1300) for generating color information to be generated or for analyzing received color information, driving information collection unit (1400), color information processing unit (1300), and driving information collection unit (1400) for collecting vehicle driving information ) Based on the information provided from the operation control unit 1500 for controlling the driving state of the vehicle and a communication unit 1600 for communication inside or outside the vehicle, such a device 1000 is to be mounted on the vehicle In addition, visual-appearance communication may be possible with the facility 1 through the corresponding device 1000.

In the color information processing unit 1300 according to an embodiment of the present invention, as the separation distance to the first other vehicle 20 in the same direction increases, the color included in the color information to be output to the first other vehicle 20 , Change at least one of the light emission structure and the light emission pattern, identify the second vehicle 30 or facility 1 in the vicinity based on the driving information collected through the driving information collecting unit 1400, and identify the identified agent. 2 It is possible to communicate color information with the first other vehicle 20 via at least one of the other vehicle 30 or the facility 1.

In addition, the facility 1 includes a tunnel or an underpass, and when each of a plurality of vehicles 10, 20, 30 equipped with a device 1000 enters a tunnel or underpass, the light emitting part of the facility 1 ( At least one color information may be received from each of a plurality of vehicles directly from 3) or via other vehicles in a tunnel or underpass.

In order to secure the robustness of the ICT technology, which is the core of the current smart highway, by using the method and apparatus according to an embodiment of the present invention, constraints under an environment using only existing RF communication and satellite communication It has the advantage of being able to overcome effectively. In other words, if the proper use of Visual-MIMO V2X communication as a supplementary communication or alternative communication means in the special circumstances (ex. Natural disasters, interruption of radio communication by electromagnetic waves, etc.) as described above is more robust and reliable even in more road environment situations The stable communication can be performed. In addition, cameras and LED lights attached to vehicles (ex. Black boxes for vehicles, etc.) and LEDs (ex. Lights, signs, etc.) and cameras attached to existing smart highway road infrastructure (ex. Surveillance cameras, etc.) can be used. It has high technical compatibility in that it does not require additional infrastructure construction costs.

With respect to the method according to an embodiment of the present invention, the contents of the above-described system may be applied. Therefore, with respect to the method, descriptions of contents identical to those of the above-described system are omitted.

Meanwhile, the above-described method may be written in a program executable on a computer, and may be implemented in a general-purpose digital computer that operates the program using a computer-readable medium. Further, the structure of the data used in the above-described method can be recorded on a computer-readable medium through various means. It should not be understood that a recording medium that records an executable computer program or code for performing various methods of the present invention includes temporary objects such as carrier waves or signals. The computer-readable medium may include a storage medium such as a magnetic storage medium (eg, ROM, floppy disk, hard disk, etc.) or an optical read medium (eg, CD-ROM, DVD, etc.).

The above description of the present invention is for illustration only, and those skilled in the art to which the present invention pertains can understand that the present invention can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modified forms derived from the meaning and scope of the claims and equivalent concepts thereof are included in the scope of the present invention. do.

1: Facility
3: Light emitting part inside the facility
10: first vehicle
20: second vehicle
30: third vehicle
1000: Vehicle communication (V2X) device based on visual-appearance
1100: light emitting unit
1200: light receiver
1300: color information processing unit
1400: operation information collection unit
1500: Operation control unit
1600: Communication Department

Claims (3)

A vehicle communication (V2X) device based on visual-appearance,
A light emitting unit for outputting color information;
A light receiving unit for receiving color information from the outside;
A color information processing unit for generating the color information to be output or for analyzing the received color information;
A driving information collecting unit for collecting driving information of a vehicle;
A driving control unit for controlling a driving state of the vehicle based on information provided from the color information processing unit and a driving information collection unit; And
And a communication unit for communication inside or outside the vehicle,
The device may be mounted in a vehicle, and visual-to-face communication with a facility is possible through the device,
The color information processing unit changes at least one of the color, light emitting structure, and light emission pattern included in the color information to be output to the first other vehicle as the separation distance to the first other vehicle in the same direction increases. Based on the driving information collected through the information collection unit to identify the second vehicle or facility in the vicinity, and communicates the color information with the first other vehicle via at least one of the identified second vehicle or the facility Vehicle communication device based on visual-appearance, characterized in that.
delete According to claim 1,
The facilities include tunnels or underpasses,
When each of the plurality of vehicles equipped with the device enters the tunnel or underpass, at least one color information from each of the plurality of vehicles directly from the light emitting part of the facility or via another vehicle in the tunnel or underpass. Vehicle communication device based on visual-appearance, characterized in that is received.

Images