KR20160050277A - Driving information processing method and apparatus - Google Patents

Abstract

A driving information processing device is disclosed. According to an embodiment of the present invention, the driving information processing device comprises: a receiving unit configured to receive at least one of image information and sound information during driving or not driving and have a plurality of microphones, infrared ray sensors, and CCD image sensors; a pre-processing unit in which pre-processing for dividing, combining, and processing the received image information or sound information to be a variety of information is performed; and an information processing unit configured to perform at least one operation among display, transmission, storage, or preset processing with respect to the pre-processed image information or sound information in accordance with a selection input.

Description

[0001] The present invention relates to a driving information processing method and apparatus,

One embodiment of the present invention relates to traveling information processing, and more particularly, to a traveling information processing apparatus and method for performing preprocessing for receiving image information and sound information while traveling and improving the quality of the information.

As the automobile safety market has grown in recent years, automobile driving information systems and related technologies are being developed and related markets are also growing. Up to now, driving information system technology has been developed around public transportation, including location-based services of public transportation. Recently, with the growth of the smart car market, markets using personal travel information such as a van are also growing.

In recent years, demand for portable personal information communication devices such as smart phones has been increasing, and as a technology for processing various multimedia information has grown, various driving information processing technologies for vehicles have been introduced.

An object of an embodiment of the present invention is to separate, combine, and process information included in image information and sound information received through a set-top box or the like to provide useful and efficient information to a driver of a vehicle.

According to an aspect of the present invention, there is provided a traveling information processing apparatus for receiving at least one of image information and sound information when the vehicle is not traveling or traveling, and includes a plurality of microphones, an infrared sensor, and a CCD image sensor A receiving unit configured; A preprocessor for preprocessing for separating, combining, and processing the received image information or sound information into various information; And an information processing unit for performing at least one of display, transmission, storage, and predetermined processing on at least one of the preprocessed image information and sound information.

Preferably, the pre-processing unit comprises: an image dividing unit dividing an image into at least one region; An area selector for receiving a selection of the divided video area; An illuminance analyzer for analyzing an average illuminance of the received image information using the CCD image sensor in the selected area; The apparatus may further include an illuminance correcting unit for selectively generating an illuminance-improved image by fusing an image using the infrared sensor and an image using the CCD image sensor based on the average illuminance and a preset threshold value.

Preferably, the pre-processor may include a resolution converter for subdividing the pixels of the selected area to a threshold value; And a color correction unit for correcting the color of the subdivided pixel based on the color of the existing pixel and the color of the neighboring pixel.

Preferably, the pre-processing unit includes a visibility determination unit for determining a degree of visibility of an image; A contrast ratio determination unit for determining a contrast ratio of the image; A pixel determination unit for determining a pixel value of an image information reception channel; A fog determining unit determining the presence of fog based on the determination result; And a fog removing unit for removing fog in the image based on the determination.

Preferably, the plurality of microphones simultaneously receive a plurality of pieces of sound information, and at least two of the plurality of microphones are not oriented in the same direction.

The pre-processor may further include a sound information selector for selectively receiving sound information received in a specific direction.

According to an aspect of the present invention, there is provided a traveling information processing method including receiving at least one of image information and sound information when the vehicle is not traveling or traveling; A preprocessing step of separating, combining, and processing at least one of the received image information and sound information into various information; And performing at least one of display, transmission, storage, and predetermined processing on at least one of the preprocessed image information and sound information.

According to an embodiment of the present invention, video information on a driving situation is collected and adjusted according to weather, driving environment, etc. to provide the most reasonable information to a user.

Also, by selectively receiving sound information related to the driving situation, not only the sound information necessary for the user can be provided, but also robust voice recognition function can be provided in various vehicle noise environments.

In addition, it is possible to notify the driver of an abnormal / normal situation of the vehicle, inform the relief agency immediately by using various communication networks such as 3G and Wi-Fi, or transmit it to the server so as to take appropriate measures.

1 is a view for explaining a traveling information processing apparatus according to an embodiment of the present invention.
FIG. 2A is a front view of an external structure of a travel information processing apparatus according to an embodiment of the present invention.
2B is a rear view of an external structure of a traveling information processing apparatus according to an embodiment of the present invention.
3A is a diagram illustrating a preprocessing unit according to an embodiment of the present invention.
3B is a view illustrating a preprocessing unit according to another embodiment of the present invention.
3C is a diagram illustrating a preprocessing unit according to another embodiment of the present invention.
4 is a view for explaining a traveling information processing method according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It is to be understood, however, that the invention is not to be limited to the specific embodiments, but includes all changes, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a traveling information processing apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a traveling information processing apparatus according to an embodiment of the present invention includes a receiving unit 110, a preprocessing unit 120, and an information processing unit 130.

The traveling information processing apparatus may be a vehicle set-top box installed in a vehicle and capable of receiving multimedia information around the vehicle while the vehicle is traveling or not traveling.

As an example of the set-top box, a smart phone having a function of receiving image and sound information can be used, and a black box, navigation or similar multimedia device can be used.

The receiving unit 110 constituting the traveling information processing apparatus receives at least one of image information and sound information when the vehicle is not traveling or traveling, and is composed of a plurality of microphones, an infrared sensor, and a CCD image sensor.

Here, the image information received when the vehicle is traveling or not traveling may correspond to the image information of the front or the rear of the vehicle received using the travel information processor. If the vehicle is not traveling or traveling, the received sound information may include vehicle noise generated in the vehicle or sound information generated outside the vehicle.

When receiving the image information at the receiving unit 110, a general image uses a CCD image sensor, and when the illuminance is low such as nighttime, the image information can be received using an infrared sensor such as an IR sensor.

In addition, when the receiving unit 110 receives the voice information, a microphone may be used. A microphone of a short channel may be used when a surrounding situation is recognized, that is, a microphone, but a plurality of microphones are used when a driver needs voice recognition.

When a plurality of microphones are used, a plurality of pieces of sound information are simultaneously received, and at least two of the plurality of microphones are not oriented in the same direction.

The receiving unit 110 may further include a sound information selector (not shown) for selectively receiving sound information received in a specific direction.

That is, when the direction of the microphone is not the same, the size of the sound received in each direction is analyzed to determine from which direction the sound is received, and the user can selectively receive the sound information transmitted from the desired direction.

For example, if a particular sound information is received at the largest magnitude in a microphone facing a particular direction and the remaining microphone is received at a smaller magnitude, the direction in which the received microphone is oriented in the largest magnitude It can be judged.

In the preprocessing unit 120, preprocessing for separating, combining, and processing the received image information or sound information into various information is performed.

Here, the pre-processing means to separate, combine, and process the received image information or sound information into various information.

For example, adjusting the luminance or illumination of an image according to the weather to facilitate identification of objects in the image, or increasing the resolution of an object at a distance from the image to improve discrimination of objects is an example of a preprocessing process .

The detailed structure of the preprocessing unit 120 will be described later with reference to FIGS. 3A to 3C.

The information processing unit 130 performs at least one of display, transmission, storage, and predetermined processing on at least one of the preprocessed image information and sound information.

The display indicates that the user can visually confirm the image information.

Transmission refers to sending information to the server or to anyone other than the user.

The transmission of information to a person other than the user may be, for example, notifying the relief agency in the event of an accident, or transmitting the information to a black box or a smart phone.

The storage means storing the contents in the server or the traveling information processing device so that it can be used later.

The predetermined processing is processing of information other than the above-described display, transmission, and storage, for example, modification of information and the like.

FIG. 2A is a front view of an external structure of a travel information processing apparatus according to an embodiment of the present invention.

Referring to FIG. 2A, the driving information processing apparatus has a display area 230 in an upper area thereof.

The display area 230 of the traveling information processing apparatus according to an exemplary embodiment of the present invention may use a smart phone. The smartphone can not only display the preprocessed image, but also can be conveniently input by the user by touching the display screen using the UI.

2A shows the main body 210 of the traveling information processing apparatus including the preprocessing unit 120. [

In addition, a variety of selection buttons 220 can be mounted on the main body 210. The selection buttons 220 can be selected by selecting a CCD image sensor and an infrared sensor, and selecting a resolution of a specific portion of the displayed image A selection button for selecting to improve the fog image, a selection button for selecting only the specific sound to receive the received sound information, and the like.

However, when a smart phone is used as an embodiment of the present invention, the selection button may be displayed using the GUI in the display area 230 rather than the main body 210.

2B is a rear view of an external structure of a traveling information processing apparatus according to an embodiment of the present invention.

In the lower area 240 of FIG. 2B, an image information receiving apparatus including a microphone corresponding to a voice information receiving apparatus, a CCD image sensor, and an infrared sensor is shown.

3A is a diagram illustrating a preprocessing unit according to an embodiment of the present invention.

3A, the preprocessing unit 120 may include an image segmentation unit 310, an area selection unit 312, an illuminance analysis unit 314, an image fusion unit 316, and an illuminance correction unit 318 have.

The image divider 310 divides the image into at least one region.

The division of an image divides an image into a plurality of regions having the same area and shape, or a plurality of regions having an unequal area and shape.

The area selection unit 312 receives the selection of the divided video area.

In the embodiment using the smart phone, the selection of the image area according to an embodiment of the present invention can be performed by touching a desired area in the divided area.

In addition, the selection of the video area can select at least one or more areas that are adjacent or not adjacent to each other.

The illuminance analyzer 314 analyzes the average illuminance of the received image information using the CCD image sensor in the selected area.

It is difficult to identify an object because the part with low illumination in the image appears dark. Therefore, if the illuminance is low, preprocessing is required to adjust the illuminance to increase the discrimination power of objects.

If the user selects a part whose illuminance is low in the image and can not identify the object, the illuminance analyzer 314 analyzes the average illuminance in the selected area.

If the average roughness is high, the area is bright enough to identify the object, but if the average roughness is low, the area is dark.

In this case, if the width of the area is wider than the width of the area, and the deviation of the illuminance within the area is large, the average value will not sufficiently represent the darkness of the area. Therefore, in order to accurately express the degree of brightness of the area, it is desirable to set the width of the image area as narrow as possible.

The roughness correction unit 316 selectively generates an image with improved illumination by fusing an image using an infrared sensor and an image using a CCD image sensor based on the average roughness and a predetermined threshold value.

For example, the roughness correction unit 316 generates a fusion image when the average roughness is less than the threshold value, and does not generate a fusion image when the average roughness is equal to or larger than the threshold value.

3B is a view illustrating a preprocessing unit according to another embodiment of the present invention.

3B, the preprocessing unit 120 may include an image segmentation unit 310, an area selection unit 312, a resolution conversion unit 320, and a color correction unit 322.

The image divider 310 divides the image into at least one region.

The area selection unit 312 receives the selection of the divided video area.

The resolution converting unit 320 subdivides the pixels of the selected area to a threshold value.

The reason for correcting the resolution is that the resolution of the object at a distance is lower than that of the image, which makes it difficult to identify the object. In this case, preprocessing is required to increase the resolution of the area having the far object.

When the user selects the far object from the image to increase the discrimination power with respect to the far object, that is, when the far object is selected from the image, the resolution converter 320 subdivides the pixels of the selected area to a predetermined threshold do.

The color correction unit 322 corrects the hue of the subdivided pixel based on the hue of the existing pixel and the hue of the neighboring pixel.

If the resolution of the pixel is increased by increasing the resolution of the pixel, the color of the subdivided pixel is determined based on the color of each pixel and the color of the neighboring pixels in the image before the pixel is subdivided in order to restore it to the image closest to the original object.

3C is a diagram illustrating a preprocessing unit according to another embodiment of the present invention.

Referring to FIG. 3C, the preprocessing unit 120 may include a visibility determination unit 330, a contrast ratio determination unit 332, a pixel determination unit 334, a fog determination unit 336, and a fog removal unit 338 .

The visibility determination unit 330 determines the visibility of the image, that is, the degree of identification of the object in the image.

The degree of visibility should be quantifiable according to pre-set criteria.

The contrast ratio determiner 332 represents the contrast ratio, that is, the difference between the darkest portion and the brightest portion of the image.

The pixel determination unit 334 determines a pixel value of a channel that receives image information.

The fog determination unit 336 determines whether there is fog in the image based on the degree of visibility, the contrast ratio, and the pixel value that have already been determined.

The mist removing unit 338 improves the image when the mist judgment unit judges that the image is foggy, thereby reducing the effect of the fog, thereby enhancing the discrimination power of the objects in the image.

4 is a flowchart illustrating a method of processing travel information according to an embodiment of the present invention.

In step 410, the travel information processing apparatus receives at least one of image information and sound information when the vehicle is not traveling or traveling.

And receives multimedia information around the vehicle when the vehicle is not traveling or running using a set-top box or the like installed in the vehicle.

In step 420, the travel information processing device performs preprocessing for separating, combining, and processing at least one of the received image information and sound information into various information.

The traveling information processing device preprocesses the received information into a state in which the user can best utilize the information.

In step 430, the travel information processing apparatus performs at least one of display, transmission, storage, and predetermined processing for at least one of the preprocessed image information and sound information.

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (7)

A receiving unit for receiving at least one of image information and sound information when the vehicle is not running or traveling, the receiving unit comprising a plurality of microphones, an infrared sensor, and a CCD image sensor;
A preprocessor for preprocessing for separating, combining, and processing the received image information or sound information into various information; And
And an information processing unit for performing at least one of display, transmission, storage, and predetermined processing for at least one of the preprocessed image information and sound information. The method according to claim 1,
The pre-
An image dividing unit dividing an image into at least one region;
An area selector for receiving a selection of the divided video area;
An illuminance analyzer for analyzing an average illuminance of the received image information using the CCD image sensor in the selected area;
Further comprising an illuminance correcting unit for selectively generating an illuminance-improved image by fusing an image using an infrared sensor and an image using a CCD image sensor based on the average illuminance and a preset threshold value. The method according to claim 1,
The pre-
An image dividing unit dividing an image into at least one region;
An area selector for receiving a selection of the divided video area;
A resolution converter for subdividing the pixels of the selected area to a threshold value; And
And a color correcting unit for correcting the color of the subdivided pixel based on the color of the existing pixel and the color of the neighboring pixel. The method according to claim 1,
The pre-
A visibility judgment unit for judging the degree of visibility of the image;
A contrast ratio determination unit for determining a contrast ratio of the image;
A pixel determination unit for determining a pixel value of an image information reception channel;
A fog determining unit determining the presence of fog based on the determination result; And
And a fog removing unit removing fog from the image based on the determination. The method according to claim 1,
The plurality of microphones
A plurality of pieces of sound information are simultaneously received,
At least two of the plurality of microphones
And is not oriented in the same direction. The method according to claim 1,
The pre-
Further comprising: a sound information selector for selectively receiving only sound information received in a specific direction. Receiving at least one of image information and sound information when the vehicle is not traveling or traveling;
A preprocessing step of separating, combining, and processing at least one of the received image information and sound information into various information; And
And performing at least one of display, transmission, storage, and predetermined processing for at least one of the preprocessed image information and sound information according to the selection input.

Images