KR20150092452A - Black box for car using the idle time of the black box and its control method - Google Patents

Abstract

The present invention relates to a video recorder for a vehicle utilizing an idle time thereof capable of increasing a video recording time by enlarging a storing space of a storing unit of the video recorder by analyzing video data and to a controlling method of the video recorder. A video recorder for a vehicle utilizing an idle time thereof according to an embodiment of the present invention includes a camera unit acquiring video data by recording ambient environments of the vehicle; a storing unit storing the video data acquired by the camera unit; and a controller unit selecting either a parking mode or a driving mode of the vehicle, reprocessing the video data stored in the storing unit when the parking mode is selected and thereafter storing the video data in the storing unit. Accordingly, the present invention is capable of improving a speed and accuracy of performing additional functions by performing the additional functions such as extracting of video data related to event, coding, mosaic-processing, changing resolution, a quality control in the parking mode in which the controller unit is operated in the least and preventing an excessive load to the video recorder. In addition, the present invention is capable of minimizing a capacity of the video recorder using a low-capacity main controller unit by not performing the additional tasks such as video processing in the driving mode that the video recorder records video always. In addition, the present invention is capable of increasing a recorded video storing space by extracting and analyzing the video data stored in the driving mode of the vehicle while being in the idle time of the video recorder such as the parking mode of the vehicle and performing a data reprocessing task to reduce the capacity of the video data.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a black box for a vehicle,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a black box for a vehicle and a control method thereof, which utilize the idle time of a black box which can increase a video recording time by re-

In general, a video recording device for a vehicle (video event data recorder for automobiles, VEDR) records an accident before and after a collision to provide information necessary for the identification of an accident situation.

The vehicle black box is mainly used for recording and storing image data of the surroundings of the vehicle using a camera.

Recently, a black box for a vehicle having a 4-channel (front, rear, and side) camera mounted thereon or a camera for outputting high-definition or high-definition , All the screens around the vehicle provide high-quality images, so that it is possible to provide image data that can more accurately determine the circumstances in the event of an accident.

In addition, the vehicle black box is used to detect events through motion analysis of an acceleration sensor and image data while continuously recording the surroundings of the vehicle. Additional functions such as image data extraction related to event detection, encryption, resolution conversion and compression, However, a main controller having a large capacity is required and the additional function can not be used.

When the camera of the vehicle black box stores 4 channels or intelligent high quality image, the image data occupies a large amount of storage space in the storage unit, resulting in a shortage of video recording time due to a lack of storage space.

Korean Patent Publication No. 10-2013-0017497 (Published date 2013.02.20.)

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide an image processing apparatus and method, which can perform only an event detection and a continuous recording function in a traveling mode, Encryption, resolution conversion, image quality correction, compression storage, and the like, can be carried out smoothly in the parking mode, which is the idle time of the black box.

Also, when performing additional functions in parking mode, meaningless information is recompressed to a lower resolution through image analysis, more storage space can be secured.

According to another aspect of the present invention, there is provided a black box for a vehicle that utilizes idle time of a black box, comprising: a camera unit for capturing an image of a surrounding environment of the vehicle to acquire image data; A storage unit for storing image data acquired by the camera unit; And a controller unit for selecting either the parking mode or the driving mode of the vehicle and re-processing the image data stored in the storage unit when the parking mode is selected and storing the same again in the storage unit.

The image data stored in the storage unit after the image data is re-processed may have a smaller storage capacity than that before re-processing.

The re-processing of the image data may tag the time when the occurrence of an event is detected from the image data stored in the parking mode.

The re-processing of the image data may selectively extract image data related to an event occurrence from the image data stored in the parking mode to convert the resolution.

The re-processing of the image data may include encrypting the privacy information with the image data stored in the storage unit.

The re-processing of the image data may encrypt the personal information with the image data stored in the parking mode.

The controller unit may extract information related to an event occurrence from the image data only for a predetermined time before and after a time when an event is detected in the image data.

The controller unit may convert the remaining image data to a resolution lower than an initially acquired resolution based on a time point when an event is detected in the image data.

The controller unit may correct image quality to provide a sharp image quality for a predetermined time based on a point of time when an event is detected in the image data.

In the re-processing of the image data, the image data related to the occurrence of the event is selectively extracted from the image data stored in the parking mode, and the resolution is converted. The ROI that is a part of the image frame is converted into a high resolution, can do.

The ISP unit includes an ISP unit, a buffer memory for temporarily storing digital image data input in real time, a buffer memory for storing the digital image data stored in the buffer memory in a temporal post- A comparator for determining whether an event has occurred, and an ISP for processing an image signal of the digital image data.

The controller, when it is determined that an event is generated, generates a shutoff signal and transfers the cutoff signal to the main controller unit. The controller unit, which has received the shutoff signal from the comparator, interrupts reprocessing of the digital image data, It is possible to acquire an image related to the occurrence of an event.

The digital image data input in real time during the non-occurrence period of the blocking signal determining that the comparator does not generate an event may be stored in the buffer memory or the temporary storage unit.

The controller unit may be switched to the sleep mode so that the power consumption of the controller unit is reduced when the re-processing of the image data is completed.

A control method of a black box for a vehicle utilizing an idle time of a black box according to an embodiment of the present invention includes: an acquisition step of capturing an image data of an environment of a vehicle; A sensing step of sensing a state of the vehicle; A selecting step of selecting either the parking mode or the driving mode according to the information detected in the sensing step; Processing the image data in a controller unit when an event of the vehicle is detected; Storing the image data in a storage unit; And a re-processing step of, when the parking mode is selected, re-processing the image data stored in the storage unit and storing the image data in the storage unit again.

The reprocessing may include tagging a point of time when an event is detected from the image data stored in the storage unit.

The re-processing step may include selectively extracting image data related to an event occurrence from the image data stored in the storage unit, and then converting the resolution.

The re-processing may include encrypting the personal information in the image data stored in the storage unit.

The re-processing step may include extracting information related to an event occurrence from the image data only for a predetermined time before and after a time when an event is detected in the image data.

The re-processing may include converting the remaining image data to a resolution lower than an initially obtained resolution based on a time point at which an event is detected in the image data.

The controller may include a step of correcting the image quality so as to provide a sharp image quality of the image data for a predetermined time based on a point of time when the event is sensed.

The reconstructing step may include a step of selectively extracting image data related to an event occurrence from the image data stored in the storage unit and then converting the resolution into a high resolution image of a region of interest that is a part of the image frame of the photographed image, And the non-interest region may be transformed to a lower resolution.

The re-processing may further include detecting whether the comparator has generated an event.

In the re-processing step, when the blocking signal is transmitted from the comparator to the controller unit, the re-processing of the digital image data is stopped, and the image can be acquired by controlling the camera unit.

The privacy information may be a face of a person or a license plate of a vehicle.

According to the present invention, in the parking mode in which the controller unit operates at a minimum, additional functions such as extraction of additional image data related to the event, encryption, mosaic processing, resolution conversion, and image quality correction are performed, And the overload of the black box can be prevented.

In addition, since the additional operation such as the image processing is not performed in the traveling mode in which the normal recording is performed, the capacity of the black box such as the main controller unit of small capacity can be minimized.

Also, it is possible to increase the video recording storage space by extracting and analyzing the image data stored in the driving mode of the vehicle at the idle time of the black box such as the parking mode of the vehicle, and performing data re-processing to reduce the image data capacity.

1 (a) is a block diagram showing a schematic configuration of a vehicle black box utilizing the idle time of the black box according to the embodiment of the present invention.
FIG. 1 (b) is a block diagram schematically showing that the configuration of a black box for a vehicle utilizing idle time of a black box according to the present invention is driven in a parking mode.
2 is a block diagram showing a schematic configuration of a camera unit which is a component of a black box for a vehicle that utilizes idle time of a black box according to an embodiment of the present invention.
3 is a flowchart schematically illustrating a black box control method for a vehicle utilizing idle time of a black box according to an embodiment of the present invention.
FIG. 4 is a schematic diagram illustrating a background coding operation of a black box control method for a vehicle using an idle time of a black box according to an exemplary embodiment of the present invention. Referring to FIG.
5 is a flowchart schematically illustrating an image data analysis step of a black box control method for a vehicle utilizing idle time of a black box according to an embodiment of the present invention.
6 is a diagram illustrating an example of a reprocessing step in the black box control method for a vehicle utilizing the idle time of the black box according to the embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[ Example 1 ]

First, the idle time of the black box according to the first embodiment of the present invention means a time when the sensor unit 200 is changed to the parking mode to maintain the parking mode.

As shown in FIG. 1, a black box for a vehicle utilizing the idle time of a black box according to the first embodiment of the present invention may include a camera unit 100.

The camera unit 100 can capture image data of a surrounding environment of the vehicle, and can include a CIS (CMOS Image Sensor) 110 and an ISP (Image Signal Processor) 120.

The CIS 110 senses the image light coming through the lens of the camera unit 100 and converts the intensity of the image light into an analog electric signal and digital image data.

Meanwhile, the CIS 110 may be replaced with a CCD (Charge-coupled Device Image Sensor), which is an image sensor that converts light into electric signals.

The ISP unit 120 may process the converted digital image data in the CIS 110 and then provide the controller unit 300 with image data.

Meanwhile, the ISP unit 120 may be implemented as a single semiconductor chip together with the CIS 110.

The vehicle black box utilizing the idle time of the black box according to the first embodiment of the present invention may include the sensor unit 200. [

At least one sensor mounted on the vehicle may generate a sensor signal so that the sensor unit 200 can detect the state of the vehicle and provide the sensor signal to the controller unit 300 to be described later.

The sensor unit 200 may include any one or more of a human body detection sensor, a distance sensor, a speed sensor, an acceleration sensor, and a collision detection sensor. The sensor unit 200 may include human body detection, distance detection, speed detection, acceleration detection, A laser, an ultrasonic wave, a GPS satellite signal, or the like may be used.

The human body detection sensor can generate a sensor signal when it detects the motion of objects such as human body and animals in the vicinity of the vehicle with infrared rays.

The distance sensor can generate a sensor signal by measuring the distance between the vehicle and the object to be measured using infrared rays, ultrasonic waves, and the like.

A GPS satellite signal can be used for the speed sense.

The acceleration sensor can generate the sensor signal by measuring the acceleration of the moving vehicle or the intensity of the impact.

Also, since the acceleration sensor can obtain the speed by integrating the acceleration, it is also possible to measure the speed using the acceleration sensor.

The shock sensor can detect a physical destruction or impact from the outside of the vehicle and generate a sensor signal. Of course, acceleration sensors can also be used.

Meanwhile, the sensor unit 200 may be implemented by the camera unit 100.

For example, the camera unit 100 performs a function of the sensor unit 200 in the form of generating a sensor signal based on information obtained by determining a change in a pixel value due to motion of an object in an image captured by the camera unit 100 It is possible.

The black box for a vehicle utilizing the idle time of the black box according to the first embodiment of the present invention may include a controller unit 300.

The controller unit 300 may include a processor 320 and a memory 330 and may process image data by a program for processing images stored in the memory 330.

For example, the controller unit 300 may process the image through a known algorithm for coding or decoding the image data into a computer-readable image or correcting the image quality of the image data.

The controller unit 300 can select the driving mode and the parking mode according to the information sensed by the sensor unit 200.

For example, the controller unit 300 selects the parking mode when the vehicle speed is zero or more than a preset time, and selects the driving mode when the vehicle speed exceeds zero.

In addition, the controller unit 300 may detect the case where the vehicle is not started, and the sensor unit 200 may detect the parking mode.

When the controller unit 300 selects the driving mode, the CODEC 310 converts the video signal into a digital signal so that the processor 320 can process the received video signal, and the image processing unit 340 converts the video signal into a digital signal, The image data may be stored in the storage unit 400, which will be described later, according to the sensor information sensed by the sensor unit 200, including the metadata at the time of detecting the occurrence of the event in the image data.

The controller unit 300 may determine whether an event has occurred.

That is, when the sensor unit 200 detects motion around the vehicle or a shock is detected and a sensor signal is generated, the controller unit 300 can determine whether an event has occurred according to the degree of motion or the degree of impact .

Meanwhile, if it is determined that an event has occurred in the controller unit 300, the image data may be processed so that the image data for a predetermined time before and after the occurrence of the event is not deleted from the storage unit.

Therefore, information related to the occurrence of the event can be extracted from the image data only for a preset time before and after the occurrence of the event so that more accurate information can be obtained when an accident occurs in the vehicle.

For example, if the predetermined time is set to 30 seconds, the controller unit 300 transmits information related to the occurrence of the event to the metadata 30 seconds before and 30 seconds after the event, It can be extracted easily by searching.

At this time, what can be retrieved by the metadata can be a license plate of a vehicle, a face of a person, a milestone, a telephone number of an adjacent signboard, a mutual name, etc., acquired in the image data.

The vehicle black box utilizing the idle time of the black box according to the embodiment of the present invention may include a storage unit 400. [

The storage unit 400 may temporarily or permanently store the image data processed by the controller unit 300. [

In this case, the storage unit 400 may be a separately provided memory for storing image data in the controller unit 300, a network storage medium (NAS) for storing network communication, or a memory card removable in a slot, A storage medium, or a media storage medium such as a DVD, a BLUE-RAY, or the like.

Hereinafter, a control method of a vehicle black box according to the first embodiment of the present invention will be described.

As shown in FIGS. 2 and 3, generally, a vehicle black box performs basic functions such as motion detection and event detection such as motion detection and continuous recording in a driving mode. In the parking mode, only the event detection function such as the motion detection and the shock detection is performed, and the recording is not performed at all times. Therefore, the controller unit 300 is in an idle state unless an event occurs.

In the case of a normal black box for a vehicle, the vehicle is in the driving mode for about two hours a day, and the parking mode is operated for the remaining 22 hours.

However, conventionally, only the event detection function such as the motion detection and the shock detection is performed in the parking mode, and the camera unit 100 and the main controller 300 are in the ON state, And has a considerable power consumption.

Accordingly, when additional work such as image processing is performed at the time of parking without substantial difference in power consumption, there is an advantage that main additional functions can be performed even with the same black box capacity.

In addition, in the parking mode, the controller unit 300, which is available in the parking mode, is used to analyze the image stored in the traveling mode to extract the time of occurrence of an event, and thereafter tagging or detecting the moving object detection and detection time, It analyzes and automatically extracts images for trajectory, object color, object shape, object change, etc., and describes using various known technologies such as MPEG-7 metadata or general XML metadata.

The image sensing and recognition algorithm stored in the memory 330 of the main controller 300 can be used to detect the type of object such as a vehicle, a person, a road, a lane, and a crossing through analysis of an image taken by the camera unit 100, Recognition, and distance between vehicles, distances between people and vehicles, detection and recognition of lane departure, irregular recognition of motion trajectories of objects such as entry, advance, backward, lane change of a person's vehicle lane, object detection , A license plate recognition, and a signal-violation vehicle detection and recognition. It also includes analyzing the time of occurrence of an event sensed by the sensor unit 200, as well as the image capturing time and photographing position information of the camera unit 100.

Therefore, it is possible to easily and quickly retrieve information related to event occurrence in the entire image using a tag or a metadata search word.

A specific event occurrence time such as a collision of a tracked vehicle is extracted and tagged in the form of metadata, and a vehicle collision process of an image recorded at an event occurrence time, It is possible to extract meaningful information as a whole through license plates, milestones, and location recognition.

Next, the processing of the image is performed by correcting a meaningful image such as an impulse event, a license plate, a milestone, etc. to a resolution higher than the initial resolution, recompressing and storing the unnecessary image, and compressing and storing the unnecessary image by reducing the resolution. Rework.

In this manner, the data stored in the parking mode with a small data processing load is retrieved to extract specific information such as the video information detection and recognition and the time when the event occurs, thereby tagging the event such as tagging, extracting information related to the event occurrence, And performs background coding to perform compression and the like.

That is, in the driving mode, A background coding operation for analyzing image data when the parking mode is in a state in which a large amount of static image data is acquired and a relatively small amount of image data is analyzed is generated because an overload occurs in the controller unit 300 The black box can be efficiently operated.

The background coding operation may be performed in such a manner that the controller unit 300 loads the image data stored in the storage unit 400 and analyzes the image data and stores the image data in the storage unit 400 again.

As shown in FIG. 4, the background coding operation may include a tagging operation of an event.

The tagging of the event can be performed in the form of extracting a point of time when an event occurrence is detected in the image data stored in the storage unit 400. [

For example, the time when the event occurred by the sensor unit 200 included in the image data is extracted or the stored image data is analyzed to extract an occurrence time point of an event other than the occurrence time of the event generated by the sensor unit 200 can do.

Here, the event other than the event generated by the sensor unit 200 may be an event generated by analyzing the object information, rather than an event based on the sensor signal, for example, an arbitrary object in the image data may move around the vehicle for a predetermined period of time Or may be an event that is determined by analyzing the object information recorded in the image data, such as a sudden movement of the object.

At this time, the controller unit 300 recognizes collisions, license plates, people, and the like through image analysis, tags the time when an event occurs based on the tag, and displays event occurrence information as meta data so as to easily access information related to the event occurrence .

Here, tagging is a known technique for classifying or integrally managing data using tags for information on time, space, people, and objects. The tag as described above may be metadata (meatdata) attached to digital data for quick access or retrieval of data. The tag information, such as metadata, is mainly classified into a space tag, a person tag, an object tag, and a time tag. In the present invention, tags are used to classify when an event such as a collision point, a license plate recognition point, or the like occurs.

The background coding operation may include an event occurrence related information extraction operation.

The event-related information extraction operation can extract meaningful information associated with the event. On the other hand, the event occurrence related information extraction can provide information for clues or traces of an event based on the tagged metadata after the event tagging.

On the other hand, the extraction of information related to the occurrence of an event recognizes license plates, milestone recognition, peripheral phone numbers, images, sounds, and the like, and provides the information to a server having a database or a search engine in a memory, And provides the event occurrence related information in the form of providing information retrieved from the event occurrence information.

Background coding operations may include encryption or mosaic processing operations.

This encryption operation can encrypt the portion where the privacy information is displayed in the image data stored in the storage unit in the image data.

Here, the privacy information is information that can infringe an individual's privacy such as a face of a person, a license plate of a vehicle, etc., and can protect personal information of a person by encrypting a portion where the privacy information is displayed in the image data.

Mosaic processing is a method of processing mosaic to prevent personal privacy infringement such as a face of a person. It is a method of reducing the resolution of the image by mixing pixels adjacent to the extracted face area, or by controlling the number of pixels of the extracted face area, A method of designating a block for a face area, and a method of changing the position of a pixel in a block according to a predetermined criterion can be used.

A method of encrypting image data may be a method of mixing the order of bits using a predetermined algorithm, a method of blocking data units, or the like, and a known data encryption method may be used.

In addition to the mosaic processing described above, various image processing logic may be applied to mosaic processing of a face.

In order to protect the personal information of the individual, various methods such as blurring, inverting, distortion, blinding or darkening are applied to the portion where the privacy information is displayed in the image data It is possible.

At this time, the information related to the event occurrence may be excluded from the mosaic processing or encryption.

Background coding operations may include compression storage operations.

The compressed storage operation is performed such that the controller unit 300 reserves a storage space of the storage unit 400 to increase the video recording time, The resolution of the video data before and after the time can be converted.

For example , if the preset time is set to 30 seconds, the controller unit 300 determines that the image data for a total of 60 seconds 30 seconds before and 30 seconds after the event extraction is extracted is the FULL HD 1920 * 1080), the image data can be converted into a higher resolution, and the image data except for the above-mentioned 60 seconds can be converted into VGA, QVGA or the like which is lower than the initially acquired resolution.

As an example of transcoding, an OPLT (Open Loop Transcoder) is known, and the structure of the OPLT is the simplest structure among the transcoders so far proposed.

After converting the resolution, the image data may be compressed and stored in the storage unit 400 so as to provide a natural image to a human eye.

Compression of image data involves using standardized techniques such as H.264, MPEG, and JPEG.

As described above, the image data for a certain period of time before and after the point of time when the controller 300 senses the occurrence of the event is stored as important data at a high resolution, so that more accurate information can be provided when an accident occurs in the vehicle, The previous and subsequent image data are stored as low importance data at a low resolution, and the storage space of the storage unit 400 is secured in advance, thereby increasing the recording time of the image acquired by the camera unit 100. [

Here, the controller unit 300 may correct the image quality so as to provide a clear image quality for a predetermined time before and after the point of time when the event is detected so as to provide more accurate information according to the occurrence of the event . After converting the resolution, the image data may be compressed and stored in the storage unit 400 to provide a natural image to a human eye.

In the method for controlling a black box for a vehicle utilizing the idle time of the black box according to the first embodiment of the present invention having such a structure, first, the camera unit 100 photographs the surrounding environment of the vehicle and acquires image data, To the controller unit 300 (S100).

Various sensors of the sensor unit 200 sense the state of the vehicle and transmit the sensed sensor signals to the controller unit 300.

Then, the controller unit 300 senses the state of the vehicle according to the information of the sensor signal sensed by the sensor unit 200 (S200).

In addition, the controller unit 300 selects either the parking mode or the driving mode according to the sensor signal sensed by the sensor unit 200 (S300).

On the other hand, if the controller unit 300 selects the driving mode, the controller unit 300 processes the image data when an event occurs while the vehicle is traveling (S400).

At this time, if the controller unit 300 determines that an event has occurred according to the information sensed by the sensor unit 200, the controller unit 300 processes the image data by including the information at the time of detecting the occurrence of the event in the image data.

For example, when the subject is sensed by the sensor unit 200, the sensor unit 200 transmits the sensed sensor signal to the controller unit 300, The controller unit 300 can process the image data in a form including the data at the time when the controller 300 senses the occurrence of the event in the image data.

The image data acquired by the camera unit 100 may be image-processed by the controller unit 300 and stored in the storage unit 400 (S500).

When the controller unit 300 selects the parking mode, the controller unit 300 retrieves the image data stored in the storage unit 400 and analyzes the image data as a rework, that is, a background coding operation. And stores it in the unit 400 (S600).

Here, a control method due to the background coding operation in the controller unit 300 will be described (see FIG. 3).

The controller unit 300 extracts a time point at which an event is detected in the image data stored in the initial storage unit 400 (S610).

At this time, tagging is performed with respect to the occurrence of an event such as collision, license plate recognition, etc. through image analysis. It is also possible to generate metadata for searching for an occurrence of an event on the basis of a motion change of an object or the like. And can be compressed and stored.

Information relating to the occurrence of the event is extracted from the image data only for a preset time before and after the time when the event is detected (S620).

That is, in order to obtain more accurate information in the event of an accident of the vehicle, the controller unit 300 may be configured to detect the occurrence of an event for 30 seconds, 30 seconds, 30 seconds, The license plate of the vehicle, the face of the person, the milestone, and the object colliding with the vehicle can be extracted from the image data.

This is to extract meaningful information from the entire image data by searching metadata such as a tagging.

In particular, information on the milestones can be used to determine the location of the point where the event occurred.

On the other hand, when the event information is acquired from the image data, the controller unit 300 encrypts or mosaicizes the portion where the privacy information is displayed in the image data (S630).

That is, it is possible to protect the personal image of the person who is not involved in the event by analyzing the information of the person, such as the face of the person and the license plate of the vehicle, irrespective of the occurrence of the event in the image data and performing encryption or mosaic processing.

The image data for a preset time before and after the time when the occurrence of the event is detected is maintained at an initially acquired resolution or converted to a higher resolution, To a resolution lower than the resolution of the data (S640).

For example, if the predetermined time is set to 30 seconds, the controller unit 300 determines 30 seconds before and 30 seconds after the occurrence of the event. If the resolution is FULL HD (1920 * 1080), it is maintained or converted to a higher resolution, and the video data before and after the preset time corresponds to meaningless image data, so that VGA or QVGA And can be stored after being compressed.

As described above, the image data for a certain period of time before and after the time when the controller 300 senses the occurrence of an event can be stored at a high resolution, so that more accurate information can be provided when an accident occurs in the vehicle, The data is compressed at a low resolution and stored, thereby securing a storage space of the storage unit 400, thereby increasing the video recording time of the camera 100 during driving or during parking of the vehicle.

The controller unit 300 corrects the image quality so as to provide a clear image quality for a predetermined time before and after the point of time when the event is detected so as to provide more accurate information according to the occurrence of the event, (S650). Of course, storage can utilize standardized compression techniques such as H.264, MPEG, and JPEG.

Until now, although the resolution has been differentially re-compressed for the segment image of a specific time at the time of occurrence of the event, the ROI and the non-ROI of the displayed image frame (hereinafter referred to as ROI) The region of interest, then the region of interest is stored at a high resolution, and the region of interest is stored at a low resolution.

When an event occurs during the event or during the event, the recording is performed. When the event occurs, the storage space can be ensured by compressing and storing the captured image according to interest areas such as the ROI and the ROI. That is, important items such as a license plate are identified as a region of interest, converted into a high resolution, compressed, and stored as meta data for the search. As shown in FIG. 5, when an event occurs, the vehicle part performs an extraction operation of a region of interest such as a license plate at idle time, and then converts and corrects the high-resolution image. In the case of a building, low-resolution compression can be performed.

Accordingly, the image data stored in the driving mode of the vehicle at the idle time of the black box, such as the parking mode of the vehicle, is analyzed and reprocessed to secure the storage space of the storage unit 400, Time can be increased.

In addition, it is possible to improve the speed and accuracy of the additional function work processing by performing additional functions such as event detection at the idle time of the black box, image data extraction related to event detection, encryption, mosaic processing, resolution conversion, , It is possible to prevent the black box from being overloaded.

[ Example  2]

In the second embodiment, detailed description of the same components as those in the first embodiment will be omitted.

The ISP unit 120 may further include a buffer memory 130 and a comparator 140 in addition to the ISP 129 so as to detect the occurrence of an event in the parking mode.

Here, the ISP unit 120 may be implemented as a single semiconductor chip, and only the ISP 129 and the comparator 140 may be implemented as semiconductor chips and the buffer memory 130 may be provided outside.

The ISP 129 converts the digital image data transmitted from the comparator 140 into image data by interpolation, color correction, gamma correction, noise suppression, demosaic, And at least one image processing module may be included as an element for performing image signal processing (ISP).

In the parking mode, the buffer memory 130 temporarily stores digital image data in a temporally previous / following relation acquired in the CIS 110 in a low capacity (for example, one frame). Then, the digital image data of the temporal pre- and post-temporal relations are compared with each other by the comparator 140 to determine whether an event has occurred.

Since it is possible to determine whether an event is generated through the comparator 140 in units of one frame, it is preferable that the buffer memory 130 uses a high-speed and low-capacity memory, such as an SRAM, at a high price. Of course, a DRAM may be used.

Comparing multiple frames rather than comparing two frames is more accurate in event detection. Therefore, the capacity of the buffer memory 130 may be selected as a capacity capable of storing a plurality of frames if there is no problem in manufacturing cost or the like.

The comparator 140 compares the digital image data T-1 already stored in the buffer memory 130 and the next transmitted current image T-1 when the digital image data T of one frame is transferred from the CIS 110. [ It is determined whether a change between both digital image data, that is, a change seen as an occurrence of an event, has occurred compared with the digital image data T.

At this time, if it is determined that an event has occurred, an interrupt signal is generated and transmitted to the controller unit 300 and the ISP 129. The next digital image data T is transmitted to another incoming digital image data T +1) and stored in the buffer memory 130 for comparison with the stored digital image data T-1.

Although the comparator 140 and the buffer memory 130 are shown connected to the front end of the ISP 129 connected in series, the comparator 140 and the buffer memory 130 are connected to the downstream side of the ISP 129 in consideration of the application of the system, allowable energy consumption, Or between the first ISP 121 and the third ISP 125.

When the buffer memory 130 and the comparator 140 are connected to the terminal of the ISP 129, that is, the third ISP 125, the comparator 140 performs the event detection using the digital image data processed through the image signal processing do.

Meanwhile, when the ISP unit 120 including the comparator 140 detects an event such as a vehicle accident in the parking mode, a shutoff signal is generated. The shutoff signal is transmitted to the main controller unit 300.

For example, as shown in FIG. 2, a shutoff signal from the ISP unit 120 may be input to the OR gate 150, and an output of the OR gate 150 may be transmitted to the controller unit 300 as a shutdown signal.

The ISP unit 120 compares the digital image data in the parking mode and outputs the digital image data to the buffer memory 130 or other temporary storage unit 127 when it is determined that the event is not generated, And stores it.

Of course, the temporary storage unit 127 may store an image for a preset time before and after detecting the occurrence of an event. Of course, an image for a preset time period before and after the detection of the occurrence of an event may be stored in the buffer memory 130

If the comparator 140 and the buffer memory 130 are arranged in front of the ISP 129, the ISP 129 does not transmit the digital image data. As a result, the ISP 129 does not perform data processing, have. Of course, when the comparator 140 and the buffer memory 130 are arranged at the rear end of the ISP 129, the ISP 129 performs data processing.

The controller unit 300 stops the background coding operation when the shutdown signal is received from the ISP unit 120 and controls the camera unit 100 so that the camera unit 100 generates an event And can be switched to an active mode for recording an image.

When the controller unit 300 completes the rework operation, that is, the background coding operation, the controller unit 300 controls the controller unit 300 to reduce the amount of power consumed by the controller unit 300 And can be switched to a sleep mode in which background coding is not performed.

Of course, when the ISP unit 120 detects the occurrence of an event in the sleep mode, the controller unit 300 generates a shutdown signal and switches to the active mode.

Hereinafter, a control method of a vehicle black box according to a second embodiment of the present invention will be described.

As shown in FIGS. 1 and 2, in the parking mode, the ISP unit 120 performs event detection, and the main controller 300 performs a background coding operation. When the ISP unit 120 detects an event, the shutdown signal is generated and the shutdown signal is transmitted to the main controller 300.

When the blocking signal is transmitted to the controller unit 300, the controller unit 300 stops the background coding operation and controls the camera unit 100 so that the camera unit 100 displays the event occurrence image Is switched to the active mode in which the recording is performed.

In the active mode, the controller unit 300 may store an image related to an event in the storage unit 400.

When the active mode ends, the controller unit 300 starts background coding again.

On the other hand, when the controller unit 300 completes the background coding operation in the parking mode, the controller unit 300 switches to the sleep mode and can reduce the power consumption as much as the background coding operation is not performed.

Hereinafter, a control process of a vehicle black box utilizing the idle time of the black box according to the second embodiment of the present invention will be described.

The image acquisition step S100, the vehicle state sensing step S200, the mode selection step S300, the image data processing step S400, and the storage step S500 are the same as those in the first embodiment.

The difference from the first embodiment is that in the reprocessing step S600 The controller unit 300 controls the ISP unit 120 so that when the ISP unit 120 detects the occurrence of an event during the background coding operation, the controller unit 300 stops the background coding operation, And controls the camera unit 100 so as to acquire an image of the camera.

Then, the controller unit 300 acquires an image related to the occurrence of an event for a preset time, and then starts a background coding operation again after a preset time elapses (S700).

When the background coding operation is completed, the controller unit 300 may switch to the sleep mode to reduce power consumption while there is no background coding operation.

The above process may be performed in the above-described order, or may be performed separately, if necessary.

While the present invention has been particularly shown and described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, And all changes and modifications to the scope of the invention.

100: camera unit 110: CIS
120 ISP part 200: Sensor part
300: controller 310: CODEC
320: Processor 330: Memory
340: image processing unit 400:

Claims (25)

A camera unit for photographing a surrounding environment of the vehicle and acquiring image data;
A storage unit for storing image data acquired by the camera unit; And
And a controller unit for selecting either the parking mode or the driving mode of the vehicle and re-processing the image data stored in the storage unit when the parking mode is selected, One car black box. The method according to claim 1,
Wherein the image data stored in the storage unit after re-processing the image data is a storage capacity smaller than that before the re-processing, utilizing the idle time of the black box. The method according to claim 1,
Wherein the re-processing of the image data is performed by tagging a point of time when an event occurrence is detected from the image data stored in the storage unit. The method according to claim 1,
Wherein the re-processing of the image data is performed by selectively extracting image data related to an event occurrence from the image data stored in the storage unit to convert the resolution. The method according to claim 1,
Wherein the re-processing of the image data includes encrypting the privacy information with the image data stored in the storage unit. The method of claim 5,
The privacy information
A face of a person, and a license plate of a vehicle. The method according to claim 1,
Wherein the controller unit extracts information related to an event occurrence from the image data only for a predetermined time before and after a time when an event is detected in the image data stored in the storage unit, Car black box. The method according to claim 1,
Wherein the controller converts the image data except for a preset time into a resolution lower than an initially acquired resolution based on a time point at which an event is detected in the image data stored in the storage unit, Car black box using. The method according to claim 1,
Wherein the controller unit corrects the image quality to provide a clear image quality for a predetermined time based on a point of time when an event is detected in the image data. The method of claim 4,
The re-processing of the image data is performed by selectively extracting image data related to an event occurrence from the image data stored in the storage unit to convert the resolution of the image data into a high resolution image and a low resolution image, Wherein the black box is used for the idle time of the black box. The method according to claim 1,
Wherein the camera unit includes an ISP unit,
The ISP department
A buffer memory for temporarily storing digital image data input in real time,
A comparator for determining whether an event has occurred or not based on a comparison between the digital image data stored in the buffer memory before and after the temporal pre-post-
Further comprising an ISP for processing the image data of the digital image data by using the idle time of the black box. The method of claim 11,
When the comparator determines that an event is generated, the comparator generates a blocking signal and transmits the blocking signal to the main controller,
Wherein the controller unit stops the reprocessing of the digital image data and acquires an image related to the occurrence of an event by controlling the camera unit, wherein the controller unit receives the blocking signal from the comparator, box. The method of claim 11,
Wherein the digital image data input in real time during a non-occurrence period of the blocking signal determining that the comparator does not generate an event is stored in a buffer memory or a temporary storage unit. The method according to claim 1,
The controller unit
And the sleep mode is switched to the sleep mode so that the power consumption of the controller unit is reduced when the re-processing of the image data is completed. An acquiring step of acquiring image data by photographing a surrounding environment of the vehicle;
A sensing step of sensing a state of the vehicle;
A selecting step of selecting either the parking mode or the driving mode according to the information detected in the sensing step;
Processing the image data in a controller unit when an event of the vehicle is detected;
Storing the image data in a storage unit; And
And if the parking mode is selected, re-processing the image data stored in the storage unit and storing the image data in the storage unit again. 16. The method of claim 15,
Wherein the step of reprocessing includes tagging a point of time when an event occurrence is detected from the image data stored in the storage unit, using the idle time of the black box. 16. The method of claim 15,
Wherein the step of re-processing includes a step of selectively extracting image data related to an event occurrence from the image data stored in the storage unit, and then converting the resolution of the image data. The control method of a black box for a vehicle using the idle time of a black box . 16. The method of claim 15,
And the step of re-processing includes the step of encrypting the privacy information from the image data stored in the storage unit, using the idle time of the black box. 16. The method of claim 15,
Wherein the step of reconstructing includes extracting, from the image data, information related to an event occurrence only for a preset time before and after a time when an event is detected in the image data stored in the storage unit Control method of vehicle black box using idle time. 16. The method of claim 15,
Wherein the step of reconstructing includes transforming the image data except for a predetermined time based on a point of time when an event occurrence is detected in the image data stored in the storage unit, to a resolution lower than an initially acquired resolution Control method of vehicle black box using idle time of black box. 16. The method of claim 15,
Wherein the controller unit includes a step of correcting the image quality so as to provide a clear image quality of the image data for a predetermined time based on a point of time when the event is detected, Way. 16. The method of claim 15,
The reconstructing step may include a step of selectively extracting image data related to an event occurrence from the image data stored in the storage unit and then converting the resolution into a high resolution image of a region of interest that is a part of the image frame of the photographed image, And converting the non-interest area to a low resolution. The method of controlling a black box for a vehicle using idle time. 16. The method of claim 15,
Wherein the re-processing further includes detecting whether the comparator has generated an event. A method of controlling a black box for a vehicle using idle time. 16. The method of claim 15,
Wherein the re-processing step stops the reprocessing of the digital image data when the blocking signal is transmitted from the comparator to the controller unit, and acquires the image by controlling the camera unit. . 19. The method of claim 18,
The privacy information
A face of a person, and a license plate of a vehicle.

Images