KR20160090523A - Vehicle - Google Patents

Abstract

The present invention relates to a vehicle. The vehicle comprises: a light receiving unit receiving traffic information through a light signal emitted from a light source included in a traffic sign; a light transmission unit having at least one light emission element and transmitting information to the outside through light emitted from the light emission element; and a control unit controlling the light transmission unit to transmit the traffic information received through the light receiving unit to the outside.

Description

Vehicle {Vehicle}

The present invention relates to a vehicle for receiving and sending information via optical communication.

A vehicle is a device that moves a user in a desired direction by a boarding user. Typically, automobiles are examples.

On the other hand, for the convenience of users who use the vehicle, various sensors and electronic devices are provided. In particular, various devices for the user's driving convenience have been developed.

Recently, as interest in autonomous vehicles has increased, research on V2V vehicles and infrastructure (V2I) has been actively conducted. If an RF (radio frequency) communication technology or an infrared communication technology is applied to such communication, it is difficult because the frequency used for communication must be separately granted or harmful to the human body may occur. If communication is performed via light, efficient communication can be achieved.

For optical communication devices for automobiles, see US Pat. No. 4,996,719.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a vehicle having a light receiving unit and an optical transmitter.

The problems of the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description.

According to an embodiment of the present invention, a vehicle includes a light receiving unit that receives traffic information through an optical signal emitted from a light source included in a traffic sign, and at least one light emitting device, And a control unit for controlling the light emitting unit to transmit the traffic information received through the light receiving unit to the outside through a light emitting unit for emitting information to the outside through the emitted light.

According to another embodiment of the present invention, there is provided a vehicle including: a light receiving section for receiving information of a preceding vehicle through an optical signal emitted from a light source included in a front vehicle; at least one light emitting element; A light emitting portion for emitting information to the outside, and a control portion for controlling the light emitting portion to transmit the information of the front vehicle to the outside.

According to yet another embodiment, a vehicle includes at least one light emitting device, a camera module for acquiring a forward image through at least one camera, and performing object detection for at least one based on the forward image, A light emitting part for emitting information to the outside via light emitted from the light emitting device, and a control part for controlling the light emitting part to transmit information about the object to the outside.

The details of other embodiments are included in the detailed description and drawings.

According to an embodiment of the present invention, there is one or more of the following effects.

First, the information displayed on the traffic sign can be received through the optical communication, and the received information can be transmitted to the neighboring vehicle again, so that the traffic information can be efficiently provided.

Secondly, since the information acquired by the vehicle itself can be transmitted to the surrounding vehicles, accurate information can be delivered in real time.

Thirdly, the information obtained from the forward vehicle can be transmitted to the rearward vehicle, and more accurate traffic information can be delivered.

Fourthly, information on the traveling route can be obtained, thereby providing convenience to the passenger.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description of the claims.

1 is a view showing an appearance of a vehicle according to an embodiment of the present invention.
2 is a block diagram of a vehicle according to an embodiment of the present invention.
3 is a block diagram of a light receiver according to an embodiment of the present invention.
4 is a block diagram of an optical transmitter according to an embodiment of the present invention.
5 is a view showing the appearance of a camera module according to an embodiment of the present invention.
6 is a block diagram of a camera module according to an embodiment of the present invention.
7 is a diagram referred to in describing an operation of receiving information from a traffic sign through optical communication, according to an embodiment of the present invention.
8 is a diagram referred to explain an operation of transmitting information to an adjacent vehicle through optical communication, according to an embodiment of the present invention.
Figs. 9 to 10 are diagrams referred to in describing an operation of receiving and using driving direction information through optical communication, according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The vehicle described herein may be a concept including a car, a motorcycle. Hereinafter, the vehicle will be described mainly with respect to the vehicle.

The vehicle described in the present specification may be a concept including both an internal combustion engine vehicle having an engine as a power source, a hybrid vehicle having an engine and an electric motor as a power source, and an electric vehicle having an electric motor as a power source.

1 is a view showing an appearance of a vehicle according to an embodiment of the present invention.

Referring to the drawings, a vehicle 100 includes wheels 103FR, 103FL, 103RL, etc. rotated by a power source, a steering wheel for adjusting the traveling direction of the vehicle 100, a light receiving portion 110, And a camera module 200 provided in the vehicle 100. [

The camera module 200 may include a plurality of cameras, and the stereo images obtained by the plurality of cameras may be signal processed in the camera module 200.

In the figure, the camera module 200 includes two cameras.

Meanwhile, the light emitting portion 170 may be a lighting device provided in the vehicle. Here, the lighting apparatus includes a headlight, a tail lamp, a brake light, a turn signal lamp, a car width light, and the like.

The headlamp is attached to the front of the vehicle and illuminates the front during nighttime driving to secure a field of view. The taillight is a lighting device that is attached to the rear of the vehicle and automatically turns on when the headlights are turned on. Direction indicators are attached to the front, back, or side mirrors of a vehicle, and are intermittent lightings to indicate that the vehicle is changing direction or that it is a temporary hazard to another vehicle. The vehicle height is located at the front or rear of the vehicle so that the presence and the width of the vehicle can be recognized in the other vehicle.

2 is a block diagram of a vehicle according to an embodiment of the present invention.

2, a vehicle 200 according to an embodiment of the present invention includes a light receiving unit 110, a camera module 200, a communication unit 130, a sensor unit 140, a navigation unit 150, 155, a first output unit 160, a light emitting unit 170, a power supply unit 180, and a control unit 190.

The light receiving section 110 can convert the light signal into an electric signal and receive the information. The light receiving unit 110 may include a photodiode (PD) for receiving light. Photodiodes can convert light into electrical signals. For example, the light reception unit 110 can receive traffic information through light emitted from a light source included in a traffic sign. As another example, the light receiving section 110 can receive the information of the preceding vehicle through the light emitted from the light source included in the preceding vehicle.

On the other hand, in order to receive information from the traffic sign board through optical communication, the light reception unit 110 is preferably disposed in front of the vehicle.

The camera module 200 may include at least one camera to acquire a peripheral image of the vehicle. The camera module 200 can image-process the acquired image based on the acquired image to generate vehicle-related information. For example, the camera module 200 can acquire a forward image of the vehicle 100. [

Meanwhile, the camera module 200 may be a stereo camera module having the first and second cameras 210a and 210b. The stereo camera module can process the stereo image received from the first and second cameras 210a and 210b based on computer vision to generate vehicle-related information. Here, the vehicle-related information may include vehicle control information for direct control of the vehicle, or vehicle driving assistance information for a driving guide to the vehicle driver.

In particular, the camera module 200 performs signal processing based on computer vision. Accordingly, the camera module 200 acquires a stereo image of the front of the vehicle from the first and second cameras 210a and 210b, performs a disparity calculation on the front of the vehicle based on the stereo image, Based on the detected disparity information, object detection for at least one of the stereo images, and continuously tracking the movement of the object after object detection.

Particularly, the camera module 200 can detect lane detection (LD), vehicle detection (VD), pedestrian detection (PD), brilliant spot detection (BD) Traffic sign recognition (TSR), road surface detection, and the like. The camera module 200 can extract lane information that the vehicle 100 is currently traveling on.

On the other hand, the camera module 200 can generate road surface information of the road under driving based on the obtained image. For example, the camera module 200 can be classified into a dry state, a wet state, a snow state, and an ice state based on a difference in luminance data in an image. Specifically, the luminance of the eye state is the highest, and the luminance can be lowered in the order of the dry state, the ice state, and the wet state. The luminance can be divided into the dry state, the wet state, a snow state, and an ice state. As another example, the camera module 200 can be divided into a dry state, a wet state, a snow state, and an ice state based on intensity and exposure in the image. .

The communication unit 130 can exchange data with the mobile terminal 600 or the external server 500 in a wireless manner. In particular, the communication unit 130 can exchange data with the mobile terminal of the vehicle driver wirelessly. As a wireless data communication method, various data communication methods such as Bluetooth, WiFi Direct, WiFi, and APiX are possible.

The communication unit 130 may receive weather information and traffic situation information of the road, for example, TPEG (Transport Protocol Expert Group) information from the mobile terminal 600 or the external server 500.

On the other hand, when the user is boarding the vehicle, the user's mobile terminal 600 and the vehicle 100 can perform pairing with each other automatically or by execution of the user's application.

The communication unit 130 may be operable to establish communication with the external server 500 under the control of the control unit 190 when the vehicle 100 is started.

The sensor unit 140 senses a signal relating to the running or the like of the vehicle 100. [ To this end, the sensor unit 140 may include a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, A vehicle speed sensor, a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle interior temperature sensor, and a vehicle interior humidity sensor.

Thereby, the sensor unit 140 can acquire the vehicle direction information, the vehicle position information (GPS information), the vehicle angle information, the vehicle speed information, the vehicle acceleration information, the vehicle tilt information, the vehicle forward / backward information, Tire information, vehicle lamp information, vehicle internal temperature information, vehicle interior humidity information, and the like.

In addition, the sensor unit 140 may include an accelerator pedal sensor, a pressure sensor, an engine speed sensor, an air flow sensor AFS, an intake air temperature sensor ATS, a water temperature sensor WTS, A position sensor (TPS), a TDC sensor, a crank angle sensor (CAS), and the like.

Meanwhile, the sensor unit 140 may include a velocity sensing unit 141. The speed sensing unit 141 can sense the speed of the vehicle through the speed sensing means. Here, the speed sensing means may be a concept including a vehicle speed sensor, a wheel sensor, or the like.

The navigation device 150 can provide GPS information of the vehicle, running information of the vehicle, and map information. Navigation 150 may include a user input, a screen display, a memory, and an audio output. Meanwhile, the navigation unit 150 may be integrated with the first output unit 160. A device in which the navigation unit 150 and the first output unit 160 are integrated can be referred to as AVN (Audio, Video, Navigation).

The first memory 155 may store various data for the operation of the entire vehicle 100, such as a program for processing or controlling the control unit 190. [

The first memory 155 is electrically connected to the controller 190, and can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The first memory 190 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like.

The first memory 155 stores information on various traffic signs arranged on the road. For example, the first memory 155 stores traffic information included in a traffic sign and location information of the traffic sign.

The first output unit 160 includes an output unit 160 and a first display unit 161. The first output unit 160 includes a first display unit 161, a first sound output unit 162, a haptic output unit 163, and a cluster 164. The first display unit 161 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. Such a touch screen may function as a user input (not shown) that provides an input interface between the vehicle 100 and the user, and may provide an output interface between the vehicle 100 and the user.

The first display unit 161 displays (outputs) the information processed in the vehicle 100. For example, the first display unit 161 may display execution screen information of an application program driven by the vehicle 100, UI (User Interface) and GUI (Graphic User Interface) information corresponding to the execution screen information have.

The first sound output unit 162 may output audio data received from the communication unit 130 or stored in the first memory 155. [ The first sound output section 162 also outputs an acoustic signal related to a function performed in the vehicle 100. [ The first sound output unit 162 may include a receiver, a speaker, a buzzer, and the like.

The haptic output unit 163 generates various tactile effects that the user can feel. For example, the haptic output section 163 imparts a vibration effect to the steering wheel, the seat belt, or the seat so that the user can recognize the predetermined output.

The cluster 164 displays the vehicle-related information. Here, the vehicle-related information may include driving speed, RPM, mileage, remaining fuel amount, door opening, lighting device operation, vehicle malfunction, and the like.

The light emitting portion 170 converts an electric signal into an optical signal and transmits it to the outside. For example, the light emitting portion 170 can emit an optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency.

The light emitting portion 170 may include at least one light emitting element for converting an electric signal into an optical signal. Here, the light emitting element is preferably an LED (Light Emitting Diode). According to an embodiment, the light emitting portion 170 may include a plurality of light emitting device arrays. According to the embodiment, the light emitting portion 170 may be integrated with the illumination device provided in the vehicle 100. [ For example, the light emitting portion 170 may be at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light.

On the other hand, in order to transmit information to the rear vehicle through optical communication, the light emitting portion 170 is preferably disposed behind the vehicle 100. [

The power supply unit 180 can supply power necessary for operation of each component under the control of the control unit 190. [ Particularly, the power supply unit 180 can receive power from a battery (not shown) in the vehicle.

The control unit 190 can control the overall operation of each unit in the vehicle 100. [ Here, the control unit 190 may be an ECU.

Specifically, the control unit 190 may control the light emitting unit 170 to transmit the traffic information or the information of the forward vehicle received through the light receiving unit 110 to the outside.

For example, the light receiving unit 110 receives traffic information through light emitted from a light source (for example, an LED) included in a traffic sign. At this time, the control unit 190 may control the light emitting unit 170 to transmit the received traffic information to the trailing vehicle. Here, the traffic information includes road information, weather information, and construction information. The road information may include information on the congestion section or the nonconformity section.

As another example, the light receiving section 110 may transmit information of the preceding vehicle through light emitted from a light source (for example, a taillight, a brake light, a turn signal lamp, or a car width equipped with LEDs) . At this time, the control unit 190 may control the light emitting unit 170 to transmit the information of the received forward vehicle to the following vehicle. Here, the information of the preceding vehicle may be information obtained through the front vehicle light receiving section that receives information through the light provided in the preceding vehicle.

If the traffic information received from the optical receiver 110 does not match the traffic information pre-stored in the first memory 155, the controller 190 transmits the traffic information stored in the first memory 155 to the light receiver 110 based on traffic information received at the base station. Thereafter, the control unit 190 transmits the updated traffic information to the external server 500 via the communication unit 130.

The control unit 190 may control the communication unit 130 to communicate with the external server 500 when the vehicle 100 is started.

Meanwhile, the control unit 190 may control the light emitting unit 170 to transmit the information received from the camera module 200 to the outside. Here, the information received from the camera module 200 may include traffic information displayed on the traffic sign, road surface information of the road, or object information of the surroundings of the vehicle. For example, the light receiving unit 110 receives traffic information through light emitted from a light source (for example, an LED) included in a traffic information sign. Also, the camera module 200 acquires an image of a traffic information sign, processes the image, and detects traffic information. The traffic information obtained from the optical receiver 110 and the traffic information detected by the camera module 200 may be the same information. The control unit 190 may control the light emitting unit 170 to transmit the traffic information received through the light receiving unit 110 and the traffic information detected through the camera module 200 to the outside.

The control unit 190 may calculate a time to collision with the object based on the object information received from the camera module 200 and the traveling speed received from the speed sensing unit 141. Here, the object information may include distance information from the vehicle 100 to the object by a disparity calculation. The control unit 190 may control the light emitting unit 170 to transmit the calculated time (TTC) information to the outside.

Meanwhile, the control unit 190 may control the navigation 150 to update the driving information and the map information by receiving the traffic information received through the light receiving unit 110.

Meanwhile, the control unit 190 can receive information on the lane on which the vehicle 100 is currently traveling from the camera module 200. [ The control unit 190 may transmit the received driving lane information to the navigation device 150 and control the display unit included in the navigation device to display the driving lane information.

If the traffic information received through the optical receiver 110 is orientation information in a state in which the navigation direction is preset in the navigation and the direction information matches the direction information, It is possible to control the navigation to display lane change information for driving.

If traffic information is received through the light receiving unit 110 while the navigation direction is preset to the navigation, the controller 190 extracts the traffic information related to the predetermined traveling route, The first output unit 160 can be controlled.

3 is a block diagram of a light receiver according to an embodiment of the present invention.

The light receiving unit 110 may include a lens unit 112, a photodiode 114, an amplification unit 116, and a demodulation unit 118.

The lens unit 112 collects light from the outside. For example, the lens unit 112 may collect the light emitted from the light source of the traffic sign or the light emitted from the light source included in the front vehicle.

The photodiode 114 can convert light condensed by the lens unit 112 into an electric signal. For example, the photodiode 114 may use at least one of a pn junction photodiode, a p-i-n photodiode, and an Avalanch photodiode.

The amplification unit 116 amplifies the electric signal converted by the photodiode 114. [ The amplification section 116 may include at least one amplification circuit for amplifying the signal.

The demodulator 118 demodulates the converted electrical signal so that necessary information can be extracted according to various demodulation schemes. The demodulation scheme may be the same as the modulation scheme described below. The demodulated signal is transmitted to the control unit 190. The demodulation unit 118 may include at least one demodulation circuit for signal demodulation.

4 is a block diagram of an optical transmitter according to an embodiment of the present invention.

The light emitting portion 170 may include a modulating portion 172, a driving portion 174, and a light emitting portion 176.

The modulator 172 modulates information to be transmitted as an optical signal and transmits the modulated signal to the driver 174. Information is modulated by loading it on a carrier frequency which is a specific frequency band according to various modulation schemes. For example, modulation schemes include On Off Keying (OOK), Pulse Width Modulation (PWM), Pulse Position Modulation (PPM), Pulse Amplitude Modulation (PAM), Amplitude Shift Keying (ASK), and M- Shift Keying), and M-ary Quadrature Amplitude Modulation (M-QAM). On the other hand, it is specified that a method for modulating data in addition to the modulation schemes listed above can be included in the scope of the present invention. On the other hand, the modulation section 172 includes at least one modulation circuit for modulating the signal.

The driving unit 174 receives a control signal from the control unit 190. The driving unit 260 applies a driving current to the light emitting unit 176 according to the control signal. Dimming of light emitted from the light emitting portion 176, dimming of light, color temperature of light, color of light, and blinking of light are controlled according to the driving current applied by the driving portion 174. For example, the driving unit 174 can control the light emitting element included in the light emitting unit 176 to blink according to the predetermined frequency under the control of the control unit 190. [ By doing so, the optical signal can be emitted to the outside. At this time, the flashing of the light emitting element can be performed at a high speed such that it can not be felt by the human eye. The driving unit 174 includes at least one driving circuit for applying a driving current to the light emitting unit 176.

The light emitting portion 176 includes a substrate and at least one light emitting element mounted on the substrate. Here, the light emitting element is preferably an LED. The light emitting device emits light when power is applied, and the brightness may be changed according to the amount of the applied power. Also, the color temperature of the light emitting device can be changed according to the power source, and the color of light emitted by a combination of red (R), green (G), and blue (B) can be changed. In the light emitting portion 176, a plurality of LED light emitting elements may be arranged in an array form. Specifically, the light emitting portion 176 may include at least one light emitting device of a white LED, a red LED, a green LED, and a blue LED according to a reaction with the phosphor. The light emitting portion 176 is driven by receiving a driving current from the driving portion 260. For example, the light emitting portion 176 can emit the optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency. At this time, the flashing of the light emitting element can be performed at a high speed such that it can not be felt by the human eye.

5 is a view showing the appearance of a camera module according to an embodiment of the present invention.

5, the camera module 200 may include a first camera 210a having a first lens 223a, and a second camera 210b having a second lens 223b.

The camera module 200 includes a first light shield 222a and a second light shield 222b for shielding light incident on the first lens 223a and the second lens 223b, And a portion 222b.

The camera module 200 in the drawing may be a structure that can be detachably attached to the ceiling or windshield of the vehicle 100.

The camera module 200 obtains a stereo image of the front of the vehicle from the first and second cameras 210 and 220, performs disparity detection based on the stereo image, , It is possible to perform object detection on at least one stereo image and continuously track the movement of the object after object detection.

6 is a block diagram of a camera module according to an embodiment of the present invention.

6, a camera module 200 according to an exemplary embodiment of the present invention includes at least one camera, an input unit 220, an interface unit 230, a second memory 240, a second output unit 250, A second power supply 260, and a processor 270.

The camera module 200 may include a plurality of cameras. Hereinafter, the camera module 200 will be described as having first and second cameras 210a and 210b.

The first and second cameras 210a and 210b can acquire an image in front of the vehicle 100. [ The first and second cameras 210a and 210b may be removably attachable to a ceiling or a wind shield of the vehicle 100. [

An input unit 220, a plurality of buttons attached to the camera module 200, or a touch screen. It is possible to turn on and operate the camera module 200 via a plurality of buttons or a touch screen. In addition, it is also possible to perform various input operations.

The interface unit 230 may receive the vehicle-related data or may transmit the processed or generated signal to the outside by the processor 270. To this end, the interface unit 230 can perform data communication with the control unit 190, the AVN (Audio Video Navigation) apparatus, the sensor unit 140, and the like in the vehicle by a wired communication or a wireless communication method.

The interface unit 230 can receive map information related to vehicle driving by data communication with the AVN apparatus. For example, the AVN device may include navigation, and the interface 230 may receive information about the location of the vehicle on the map and map from the navigation and deliver it to the processor 270.

On the other hand, the interface unit 230 can receive the sensor information from the control unit 190 or the sensor unit 140.

Here, the sensor information includes at least one of a slip degree of the vehicle, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / backward information, , Tire information, vehicle lamp information, vehicle interior temperature information, and vehicle interior humidity information.

Such sensor information may include at least one of a wheel speed sensor, a heading sensor, a yaw sensor, a gyro sensor, a position module, a vehicle forward / backward sensor, a wheel sensor, A vehicle speed sensor, a vehicle body inclination sensor, a battery sensor, a fuel sensor, a tire sensor, a steering sensor by steering wheel rotation, a vehicle internal temperature sensor, and a vehicle internal humidity sensor. On the other hand, the position module may include a GPS module for receiving GPS information.

On the other hand, among the sensor information, the vehicle direction information, the vehicle position information, the vehicle angle information, the vehicle speed information, the vehicle tilt information, and the like relating to the vehicle running can be referred to as vehicle running information.

The second memory 240 may store various data for operation of the entire camera module 200, such as a program for processing or controlling the processor 270.

The second memory 240 is electrically connected to the processor 270, and can store basic data for the unit, control data for controlling the operation of the unit, and input / output data. The second memory 240 may be various storage devices such as ROM, RAM, EPROM, flash drive, hard drive, and the like.

The second output unit 250 may include a second display unit 251 and a second sound output unit 252.

The second display unit 251 may display an image related to the operation of the camera module 200. For this image display, the second display unit 251 may include a cluster or an HUD (Head Up Display) on the inside of the vehicle interior. On the other hand, when the second display unit 251 is the HUD, it may include a projection module that projects an image to the windshield of the vehicle 100. [

The second sound output unit 252 outputs sound to the outside based on the audio signal processed by the processor 170. [ To this end, the second sound output unit 252 may include at least one speaker.

The second power supply unit 260 can supply power necessary for operation of each component under the control of the processor 270. [ Particularly, the second power supply unit 360 can receive power from a battery or the like inside the vehicle.

The processor 270 controls the overall operation of each unit within the camera module 200.

In particular, the processor 270 performs signal processing based on computer vision. Accordingly, the processor 270 acquires a stereo image for the vehicle front from the first and second cameras 210a and 210b, performs a disparity calculation for the vehicle front based on the stereo image, Perform object detection for at least one of the stereo images based on the disparity information, and continue to track the motion of the object after object detection.

Particularly, when the object is detected, the processor 270 may detect a lane detection (LD), a vehicle detection (VD), a pedestrian detection (PD), a light detection (Brightspot Detection, BD) Traffic sign recognition (TSR), road surface detection, and the like.

Then, the processor 270 can perform a distance calculation to the detected nearby vehicle, a speed calculation of the detected nearby vehicle, a speed difference calculation with respect to the detected nearby vehicle, and the like.

On the other hand, the processor 270 can generate road surface information of a road that is running on the basis of a stereo image. For example, the processor 270 can distinguish between a dry state, a wet state, a snow state, and an ice state based on differences in luminance data in a stereo image. Specifically, the luminance of the eye state is the highest, and the luminance can be lowered in the order of the dry state, the ice state, and the wet state. The luminance can be divided into the dry state, the wet state, a snow state, and an ice state. As another example, the processor 270 can be divided into a dry state, a wet state, a snow state, and an ice state based on intensity and exposure in the image. have. The processor 270 may output a control signal to the controller 190 to control the brake driver based on the uphill or downhill road surface information and road surface information before the road.

Meanwhile, the processor 270 may grasp, in real time, the traffic situation information on the surroundings of the vehicle, which is based on the stereo image, in the camera module 200.

On the other hand, the processor 270 can receive map information and the like from the navigation unit 150 via the interface unit 230.

The processor 270 may receive the sensor information from the controller 190 or the sensor unit 140 through the interface unit 230. [ Here, the sensor information includes at least one of vehicle sleep information, vehicle direction information, vehicle position information (GPS information), vehicle angle information, vehicle speed information, vehicle acceleration information, vehicle tilt information, vehicle forward / backward information, Tire information, vehicle lamp information, vehicle interior temperature information, and vehicle interior humidity information. The processor 270 may receive control information of each unit provided in the vehicle from the control unit 190 through the interface unit 230. [

Meanwhile, the processor 270 may be formed of a digital signal processor (DSP), an application specific integrated circuit (ASIC), or a microcontroller, and may be mounted on one surface of a predetermined circuit board.

7 is a diagram referred to in describing an operation of receiving information from a traffic sign through optical communication, according to an embodiment of the present invention.

Referring to FIG. 7, the traffic sign 710 includes at least one light source. Here, the light source may be an LED. The traffic sign 710 displays traffic information through a light source. In this case, the vehicle occupant can visually recognize the traffic information. On the other hand, the traffic sign board 710 digitizes and modulates the traffic information. The traffic sign 710 blinks the modulated signal to cause the traffic information to be transmitted to the optical signal.

Meanwhile, the vehicle 100 travels on the road where the traffic sign 710 is located. When the vehicle 100 reaches the distance to receive the optical signal emitted from the traffic sign 710, the optical receiver 110 disposed in front of the vehicle 100 receives the optical signal carrying the traffic information . Here, the light receiving unit 110 may include a photodiode (PD) for receiving light.

Here, the traffic information includes road information, weather information, and construction information. The road information may include information on the congestion section or the nonconformity section.

8 is a diagram referred to explain an operation of transmitting information to an adjacent vehicle through optical communication, according to an embodiment of the present invention.

Referring to FIG. 8, a light receiving unit 110 included in the vehicle 100 receives traffic information through an optical signal emitted from a light source included in the traffic sign 810. At this time, the control unit 190 may control the light emitting unit 170 disposed behind the vehicle 100 to transmit the received traffic information to the trailing vehicle 820. The light emitting portion 170 may include at least one light emitting element for converting an electric signal into an optical signal. According to the embodiment, the light emitting portion 170 may be integrated with the illumination device provided in the vehicle 100. [ For example, the light emitting portion 170 may be at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light.

The light emitting portion 170 can emit the optical signal to the outside through the blinking of the light emitting element corresponding to the predetermined frequency.

On the other hand, the light receiving portion 110 included in the vehicle 100 is emitted from a light source 817 included in the front vehicle 815 (for example, a taillight, a brake light, a turn signal lamp, And receives information of the preceding vehicle through the optical signal. The control unit 190 may control the light emitting unit 170 disposed at the rear of the vehicle 100 to transmit the information of the received forward vehicle 815 to the following vehicle 820. [ Here, the information of the front vehicle 815 may be information obtained through the front vehicle light receiving section 816 that receives information through the light provided to the front vehicle 815. [

Meanwhile, the camera module 200 included in the vehicle 100 can acquire a peripheral image of the vehicle. The camera module 200 can image-process the acquired image based on the acquired image to generate vehicle-related information. Here, the vehicle-related information may be at least one of lane detection information, surrounding vehicle detection information, pedestrian detection information, light detection information, traffic information displayed on a traffic sign, and road surface detection information. The control unit 190 controls the light receiving unit (not shown) disposed at the rear of the vehicle 100 to transmit the traffic information received through the light receiving unit 110 and the traffic information detected through the camera module 200 to the trailing vehicle 820, 170 can be controlled.

The control unit 190 may calculate a time to collision of the object based on the object information received from the camera module 200 and the traveling speed received from the speed sensing unit 141. Here, the object information may include distance information from the vehicle 100 to the object by a disparity calculation. The control unit 190 can control the light emitting unit 170 disposed behind the vehicle 100 so as to transmit the calculated time (TTC) information to the following vehicle 820. [

Figs. 9 to 10 are diagrams referred to in describing an operation of receiving and using driving direction information through optical communication, according to an embodiment of the present invention.

Referring to Fig. 9, the vehicle 100 may include navigation 150. Fig. The navigation device 150 may provide the driving information and the map information. When the traffic information is received through the optical receiver 170, the controller 190 may input the traffic information received through the optical receiver to the navigation device 150 to update the driving information or the map information. For example, when the traffic information stored in the memory provided in the navigation unit 150 does not match with the traffic information received through the light receiving unit, the control unit 190 transmits the traffic information received through the light receiving unit to the navigation unit 150, So as to update the running information or the map information.

Meanwhile, as described above, the camera module 200 can acquire the forward image and extract the driving lane information from the acquired image. In this case, the control unit 190 can control the navigation unit 150 to display the extracted driving lane information. At this time, the driving lane information displayed on the navigation 150 may be graphically processed and displayed as an image 930. [ The image may also include a vehicle image 931.

On the other hand, when the traffic information received through the light receiving unit 110 is the direction information 911, and the direction set in the navigation 150 matches the direction information 911 received through the light receiving unit 110, The control unit 190 can display the lane change information 940 and 945 for traveling in the direction in which they coincide. For example, it is assumed that the driving direction preset in the navigation system 150 by the passenger is the Seoul direction. In a state in which the vehicle 100 is traveling in the first lane 905, the vehicle 100 receives traffic information from the traffic sign 910 indicating the Seoul direction. At this time, the traffic information includes information to advance to the outskirts of the road. In this case, the control unit 190 may display an arrow image 940 to change the lane in the image 930 displayed in the navigation 150. [ Alternatively, the control unit 180 can display the text "Change lane on the right lane" on the navigation unit 150. [ Alternatively, the control unit 180 may output a voice message "Change the lane to the right lane ".

Referring to FIG. 10, during driving, the vehicle 100 receives traffic information from the traffic sign 1010 through the light receiving unit 110. FIG. Here, the traffic sign 1010 may be arranged in the form of an electric sign board on the upper side of the road so that the passenger can easily recognize the traffic sign 1010. Alternatively, the traffic sign 1010 may be placed on the top of the highway toll gate in the form of an electric sign board.

The control unit 190 can extract traffic information related to the predetermined driving route in the navigation 150 from the traffic information received through the light receiving unit 110. The control unit 190 may control the first output unit 160 to output the extracted traffic information. According to the embodiment, the control unit 190 may output via the navigation unit 150. [ FIG. 10 illustrates a first display unit 161 composed of AVNs.

For example, the vehicle 100 receives the traffic information 1010 called "Hannam Bridge" through the light receiving unit 110. [ When the navigation path 150 is set to pass through the Hannam Bridge, the control unit 190 outputs the traffic information 1010 called " Hannam Bridge "through the first output unit 160. The control unit 190 can output the text format 1020 through the first display unit 161. Alternatively, the control unit 190 may output a voice message through the first sound output unit 162.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a processor 170 or a controller 770. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: vehicle
110:
141: Speed sensing unit
150: Navigation
155: first memory
160: first output section
170:
190:

Claims (18)

A light receiving unit receiving traffic information through an optical signal emitted from a light source included in a traffic sign;
A light emitting device comprising at least one light emitting element and emitting information to the outside through light emitted from the light emitting element; And
And a control unit for controlling the light emitting unit to transmit traffic information received through the light receiving unit to the outside. The method according to claim 1,
Wherein the traffic information includes road information, weather information, or construction information. The method according to claim 1,
And a memory for storing traffic information included in the various traffic signs and location information of the traffic signs,
Wherein the control unit updates traffic information stored in the memory based on traffic information received from the light receiving unit when traffic information received from the light receiving unit and traffic information previously stored in the memory do not match. The method of claim 3,
And a communication unit capable of data communication with an external server,
And the control unit transmits the updated traffic information to the external server via the communication unit. 5. The method of claim 4,
And the control unit controls the communication unit to be communicatively connected to the external server when startup is required. The method according to claim 1,
And a camera module for acquiring a forward image,
Wherein the control unit controls the light emitting unit to transmit the traffic information received through the light receiving unit and the information detected from the image obtained through the camera to the outside. The method according to claim 6,
Wherein the camera module extracts traffic information displayed on the traffic sign on the obtained image,
Wherein the control unit controls the light emitting unit to transmit the traffic information received by the light receiving unit and the extracted traffic information to the outside. The method according to claim 6,
The camera module extracts road surface information of the road from the obtained image,
Wherein the control unit controls the light emitting unit to transmit the traffic information and the road surface information to the outside, respectively. The method according to claim 6,
The camera module detects an object in the acquired image,
Wherein the control unit controls the light emitting unit to transmit the traffic information and the information about the object to the outside. 10. The method of claim 9,
And a speed sensing unit for sensing a traveling speed,
Wherein the controller calculates a time to collision with the object based on the object information and the sensed traveling speed,
And controls the light emitting section to transmit the calculated time information to the outside. The method according to claim 1,
Further comprising a navigation unit for providing driving information and map information,
Wherein the control unit inputs traffic information received through the light receiving unit to the navigation unit to update the driving information or the map information. 12. The method of claim 11,
And a camera module for acquiring a forward image and extracting driving lane information from the obtained image,
And the control section controls to display the driving lane information on the navigation device. 13. The method of claim 12,
Wherein the traffic information received through the light receiving unit is direction information, and when the traveling direction set in the navigation matches the direction information received through the light receiving unit,
And the control unit controls the navigation to display lane change information for driving in a direction in which the lane changes. 12. The method of claim 11,
Further comprising: an output unit having an output means that can be recognized by a user through any one of visual, auditory, and tactile,
Wherein,
Wherein the control unit extracts traffic information related to a driving route set in the navigation from traffic information received through the light receiving unit and controls the output unit to output the extracted traffic information. A light receiver for receiving information of a front vehicle through an optical signal emitted from a light source included in a front vehicle;
A light emitting device comprising at least one light emitting element and emitting information to the outside through light emitted from the light emitting element; And
And a control unit for controlling the light emitting unit to transmit information of the front vehicle to the outside. 16. The method of claim 15,
Wherein the information of the preceding vehicle is obtained through a front vehicle light receiving section provided in the front vehicle and receiving information via light. A camera module for acquiring a forward image through at least one camera and performing object detection for at least one based on the forward image;
A light emitting device comprising at least one light emitting element and emitting information to the outside through light emitted from the light emitting element; And
And a control unit for controlling the light emitting unit to send information on the object to the outside. 18. The method of claim 1, 15 or 17,
Wherein the light emitting unit is at least one of a headlight, a tail light, a brake light, a turn signal lamp, and a car light.

Images