KR20150011654A - Apparatus and method for judgeing low light area, and server for noticing low light area - Google Patents

Abstract

The purpose of the present invention is to collect information on a dark area by measuring the illumination of a street by a user using a black box installed in a vehicle, and to share the collected information with other users. A device installed in a moving object comprises: an image data generation unit for generating image data on an image produced by photographing a certain area by a camera sensor; a brightness information generation unit for generating brightness information on the image by analyzing the image; a location information generation unit for generating location information corresponding to the image; a determination unit for determining whether the area is a dark area based on the brightness information; and a communication unit for transmitting dark area notification data including the location information according to the determination result.

Description

[0001] APPARATUS AND METHOD FOR JUDGEING LOW LIGHT AREA, AND SERVER FOR NOTICING LOW LIGHT AREA [0002]

A device and method for determining that the area is a low light area, and a server for notifying other users of the low light area.

Recently, crime targeting people in dark areas has been increasing. Guidelines such as walking while talking on the dark roads for people to go home safely have appeared. People are also increasingly learning to self-defense to protect themselves. However, until now, pedestrians are not directly informing the pedestrians of the lighting conditions of the roads passing by at night, so it is difficult to judge whether or not the roads that pass by at night are dark. Therefore, a method of informing the pedestrian of the lighting condition of the road passing by at night is required.

On the other hand, in general, a surveillance camera or the like is installed at a specific place such as a parking lot, an entrance or a road, and captures an image of a subject. A vehicle such as a black box is installed inside the vehicle or the vehicle to photograph the front and rear of the vehicle. In the case of a car, the image captured through the black box is analyzed to automatically eliminate the darkness around the vehicle by operating the headlights and tail lights automatically when the surroundings of the vehicle are dark, analyze the camera images installed in the parking lot, It automatically lights up to clear the darkness of the area. Korean Patent Laid-Open Publication No. 2009-0072690 discloses a method for remotely controlling a streetlight using a USN (Ubiquitous Sensor Network).

We want to collect information about the dark area by measuring the user 's participant' s distance illuminance using the black box mounted on the vehicle. We want to share the collected information with others. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may be present.

According to an embodiment of the present invention, there is provided an image processing apparatus including an image data generation unit for generating image data of an image photographed in a predetermined area through a camera sensor, A position information generating unit for generating position information corresponding to the image, a determining unit for determining whether the area is a dark region based on the brightness information, a dark region notification data including position information in accordance with the determination result, And a communication unit for transmitting the data to the server.

According to another embodiment of the present invention, there is provided a method of generating image data, the method comprising: generating image data of an image photographed in a predetermined region through a camera sensor; generating brightness information of the image by analyzing the image; Determining whether the area is dark based on the brightness information, and transmitting the dark area notification data including the position information to the server according to the determination result.

According to another embodiment of the present invention, there is provided an image processing apparatus including an image data generation unit for generating image data of an image photographed in a predetermined region through a camera sensor, a brightness information generation unit for generating brightness information of the image by analyzing the image, A determination unit for determining whether the area is a dark area based on the determination result, and a transmission unit for transmitting notification data to the mobile device according to a determination result.

According to another embodiment of the present invention, there is provided a display device including a receiving unit that receives brightness information of an image photographed in a predetermined area from a video image pickup device installed in a moving object, a position generating unit that generates position information corresponding to the image, A determination unit for determining whether the area is a dark area, and a communication unit for transmitting the dark area notification data including the location information to the server according to the determination result.

According to another embodiment of the present invention, there is provided a mobile device, comprising: a receiving unit for receiving shadow area notification data indicating whether a region photographed by a first device from a first device installed in a moving object is a shadow area; And transmitting the response message including the shadow area notification data to the second device when the response message includes the shadow area notification data.

According to any one of the above-described tasks, the location of the low-illuminated area can be collected using the black box and the smart device mounted on the vehicle through the user participatory manner. The collected information can be provided and shared so that the user of the smart device connected to the server can confirm the low illumination area.

1 is a block diagram of an overall system according to an embodiment of the present invention.
2 is a configuration diagram of a device installed in a moving object according to an embodiment of the present invention.
3 is a configuration diagram of a device installed in a moving object according to another embodiment of the present invention.
4 is a configuration diagram of a server for managing data according to an embodiment of the present invention.
5 is a configuration diagram of a mobile device located in a moving object according to an embodiment of the present invention.
6 is a flowchart illustrating a process of providing a service according to an embodiment of the present invention.
7 is a flowchart illustrating a method of determining a dark region according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

1 is a block diagram of an overall system according to an embodiment of the present invention. Referring to FIG. 1, a system for determining whether a user is in a dark area and providing a user's mobile device with information on a dark area includes a device 10 installed in a moving object, a server 20 managing information on a dark area, Includes a mobile device (30) and a mobile device (40) located on a mobile body. However, since the system of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to FIG.

Each component of the overall system shown in Fig. 1 may be generally connected via a network. The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. One example of such a network is a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) , A WAN (Wide Area Network), a PAN (Personal Area Network), a Bluetooth (Bluetooth), a wireless LAN (Local Area Network) Networks, satellite broadcast networks, analog broadcast networks, Digital Multimedia Broadcasting (DMB) networks, and the like.

The mobile device 40 and the mobile device 30 located in the mobile device can be implemented as portable terminals capable of connecting to a remote server through a network. Here, the portable terminal is a mobile communication device that is guaranteed to be portable and mobility. For example, a portable communication terminal such as a PCS (Personal Communication System), a GSM (Global System for Mobile communication), a PDC (Personal Digital Cellular), a PHS (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-CDMA (W-CDMA), Wibro (Wireless Broadband Internet) , A smart pad, a tablet PC, and the like.

The device 10 installed in the moving object may include devices capable of photographing the outside of the vehicle through a black box, a navigation device, or a camera device installed in the vehicle, and may be implemented as a portable terminal capable of connecting to a remote server through a network It is possible.

However, the device 10 and the mobile devices 30 to 40 are not limited to those illustrated above, and may further include various types of devices. For example, the device 10, the mobile devices 30 to 40 may further include devices that are operated through a predetermined application or program.

The device 10 may generate image data of an image photographed in a predetermined area through a camera sensor and generate brightness information of the image by analyzing the generated image. For example, It is possible to photograph an image outside the vehicle through a camera sensor, analyze the photographed image, and perform image filtering on the illuminance.

The device 10 generates location information corresponding to the image, determines whether the area is a dark area based on the generated brightness information, and transmits the dark area notification data including the location information to the server 20, Lt; / RTI > For example, if the image filtering result for the photographed image is darker than the preset reference, the device 10 may determine that the corresponding region or area is dark, and may transmit the current location information to the server 20 .

Such an operation of the device 10 will be described again in Fig.

The server 20 receives the dark area notification data from the first device 10 installed in the mobile device and informs whether the area photographed by the first device 10 is dark or not, The second device 40 can transmit a notification message including the shadow area notification data to the second device 40. [ For example, the server 20 may transmit notification data for a dark area to a corresponding smart phone based on a request from a smart phone of a user who is moving on foot.

The operation of the server 20 will be described once again in Fig.

The mobile device 30 installed in the moving object can receive the brightness information of the image photographed in a predetermined area from the image capturing device installed in the moving object and generate the position information corresponding to the image. Also, the mobile device 30 installed in the moving object can determine whether the corresponding area is a dark area based on the received brightness information, and transmit the dark area notification data to the server 20 according to the determination result.

The operation of the mobile device 30 will be described once again in Fig.

2 is a configuration diagram of a device 10 installed in a moving body according to an embodiment of the present invention. Referring to FIG. 2, the device 10 includes an image data generation unit 101, a brightness information generation unit 102, a position information generation unit 103, a determination unit 104, and a transmission unit 105. However, the configuration of the device 10 is not limited to those shown in Fig.

The image data generation unit 101 generates image data of an image photographed in a predetermined area through a camera sensor. The image data generation unit 101 can generate a plurality of image data of the area. For example, the image data generation unit 101 may generate image data of a first image photographed at a first position and image data of a second image photographed at a second position through a camera sensor. For example, the image data generation unit 101 may generate image data by shooting a forward image or a backward image outside the vehicle through a camera device installed in the vehicle.

The brightness information generating unit 102 generates brightness information of the image by analyzing the generated image. The brightness information generating unit 102 may generate brightness information of an image through a brightness measurement algorithm. In generating the brightness information by the brightness information generation unit 102, a brightness measurement algorithm can be used. For example, the brightness information generating unit 102 may generate brightness information of an image using low-illuminance image filtering on the photographed image data.

The position information generation unit 103 generates position information corresponding to the image. The position information generating unit 103 may generate position information corresponding to the image using the position measuring sensor. The position information may be position information of the device 10 at the time when the image is captured, (Global Positioning System), and may generate location information corresponding to an image through message transmission / reception with a communication base station.

The determination unit 104 determines whether or not the area is a dark area based on the brightness information. The determination unit 104 may determine whether the area is a dark area by comparing the brightness information with preset reference information. In this case, the determined dark region may be any one of a low-illuminated region, a low-illuminated region, and a low-luminous intensity region.

On the other hand, the determination unit 104 compares brightness information of each of a plurality of video data with predetermined reference information, and determines whether the area is dark based on the number of video data having brightness information smaller than predetermined reference information among a plurality of video data The determination unit 104 may determine whether the brightness information of the first image data photographed at the first position is smaller than the predetermined reference information and the brightness information of the second image data photographed at the second position If the time interval between the first image-taking time point and the second image-taking time point is shorter than a preset time interval, the region may be judged to be a dark region.

For example, the determination unit 104 can determine that a dark region is present when a predetermined region or more of the photographed image is darker than a predetermined reference, and when the region is determined to be dark by more than a predetermined distance, It can be judged as an area. On the other hand, the determination unit 104 can determine the area as a dark area even when the low-illuminated area continuously runs for a specific time or longer.

And transmits the dark area notification data including the location information to the server 20 according to the determination result of the communication unit 105. The dark area notification data may be shared with the external device 40 through the server 20 and may include at least one of an identifier for the area, brightness information, and image data as a result of the determination of the dark area. For example, the communication unit 105 may transmit the dark area notification data to the server 20, which further includes location information at a low illumination point, that is, a point of time when a dark area ends and a dark area ends.

3 is a configuration diagram of a device 10 installed in a moving body according to another embodiment of the present invention. The device 10 shown in FIG. 3 performs an operation of determining a dark area through data transmission / reception with the mobile device 30 located inside the vehicle. Therefore, details not described for the device 10 of FIG. 3 can be included in or can be deduced from the contents of the device 10 described with reference to FIGS. 1 and 2, and therefore detailed description is omitted.

Referring to FIG. 3, the device 10 includes an image data generation unit 106, a brightness information generation unit 107, a determination unit 108, and a transmission unit 109.

The image data generation unit 106 can generate image data of an image photographed in a predetermined area through a camera sensor. For example, the image data generation unit 106 may collect image information about a road in a moving vehicle at night.

The brightness information generating unit 107 can generate brightness information of the image by analyzing the generated image. For example, the brightness information generation unit 107 may perform filtering on the low illumination image among the collected images.

The determination unit 108 can determine whether the area is a dark area based on the brightness information. For example, when the determination unit 108 passes a dark region continuously over a specific time, the determination unit 108 can determine the region as a dark region.

The transmitting unit 109 may transmit the notification data to the mobile device 30 located in the vehicle according to the determination result. For example, the transmitting unit 109 may transmit notification data to the smartphone of the user in the vehicle to indicate that it is a dark area.

4 is a configuration diagram of a server 20 for managing data according to an embodiment of the present invention. The server 20 or the management server 20 shown in Fig. 4 receives the data informing the dark area from the device 10 mounted on the moving body and transmits the dark area notification data to the external mobile device 40 Role. Therefore, the operation of the server 20 of FIG. 4 is omitted from the description of the device 10, which is described in FIG. 1 and FIG.

4, the server 20 includes a receiving unit 201, a transmitting unit 202, and a notification data selecting unit 203, which can be used in combination with a management server, a shadow area notification data management server, .

The receiving unit 201 may receive the dark area notification data indicating whether the area photographed by the first device 10 is dark or not from the first device 10 installed in the moving object. For example, the receiving unit 201 may receive data for a low-illuminated area or data for a dark area collected through a black box from a black box installed in the vehicle.

When the request message is received from the second device 40, the transmitting unit 202 may transmit a response message including the dark area notification data to the second device 40. [ When a message requesting notification of a dark area is received from a smartphone of another user who is moving on a foot, which is being moved on foot, the transmitter 202 transmits information on a dark area checked by the GPS to another user's smart Phone.

The notification data selection unit 203 can select the shadow area notification data among the plurality of shadow area notification data based on the location information. For example, the notification data selection unit 203 determines whether or not the notification data corresponding to the location information is stored in the second device 40 among the plurality of pieces of the dark area notification data based on the location information of the second device 40, Can be selected.

5 is a block diagram of a mobile device 30 located in a mobile terminal according to an embodiment of the present invention. The mobile device 30 shown in FIG. 5 can perform operations of the device 10 shown in FIG. 2 through data transmission / reception with the device 10 shown in FIG. In other words, in another embodiment of the present invention, the device 10 and the mobile device 30 shown in Figures 3 and 5 can be used to implement the operation of the device 10 shown in Figures 1 and 2 . Thus, the description of the device 10 through Figs. 1-2 applies to Fig.

5, the mobile device 30 includes a receiving unit 301, a position generating unit 302, a determining unit 303, and a communication unit 304. However, the configuration of the mobile device 30 shown in Fig. 5 is not limited to that shown in Fig.

The receiving unit 301 can receive the brightness information of the image photographed in a predetermined area from the image capturing device installed in the moving body, and the position generating unit 302 can generate the position information corresponding to the image.

The determining unit 303 may determine whether the area is a dark area based on the brightness information, and the communication unit 304 may transmit the dark area notification data including the position information to the server 20 Lt; / RTI >

6 is a flowchart illustrating a process of providing a service according to an embodiment of the present invention. Referring to FIG. 6, the device 10 collects image information about a road in a moving vehicle at night, and applies low-light image filtering to the collected image to extract brightness information. Thereafter, when the user goes through a dark area for a specific time or a predetermined distance or more, the user generates shadow area notification data including positional information on the area (S601), and transmits the generated shadow area notification data to the server (S602) do. The server 20 may correspond to the location of the mobile device 40 based on a request from the external mobile device 40 or may provide information about the shadow area around the location (S603).

However, FIG. 6 is only an embodiment of the present invention, so that the present invention is not limited thereto, and various embodiments may exist.

7 is a flowchart illustrating a method of determining a dark region according to an exemplary embodiment of the present invention. The method of determining the dark region of FIG. 7 includes steps that are processed in a time-series manner in the device 10 described in FIGS. Therefore, even if omitted from the following description, the description of the device 10 through Figs. 1 and 2 also applies to Fig.

Referring to FIG. 7, the device 10 located inside the moving object generates image data of an image photographed in a predetermined area through a camera sensor (S701), and generates image brightness information by analyzing the image (S702) .

Then, the device 10 generates position information corresponding to the image (S703), determines whether the corresponding region is a dark region based on the generated brightness information (S704), and determines whether the region includes the position information It is possible to transmit the dark area notification data to the server 20 (S705).

The method for generating the shadow area data described with reference to FIG. 7 may also be implemented in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

10: Device inside the moving object
20: Management server
30: Mobile device inside the moving object
40: External mobile device

Claims (17)

In a device installed in a moving body,
An image data generation unit for generating image data of an image photographed in a predetermined area through a camera sensor;
A brightness information generating unit for generating brightness information of the image by analyzing the image;
A position information generating unit for generating position information corresponding to the image;
A determination unit for determining whether the area is a dark area based on the brightness information; And
And transmitting the dark area notification data including the location information to the server according to the determination result.
The method according to claim 1,
Wherein the determination unit determines whether the area is a dark area by comparing the brightness information with preset reference information.
3. The method of claim 2,
Wherein the image data generation unit generates a plurality of image data of a plurality of images of the area,
Wherein the determination unit compares the brightness information of each of the plurality of image data with the preset reference information and determines whether the area is dark based on the number of image data having brightness information smaller than the preset reference information among the plurality of image data Area, < / RTI >
3. The method of claim 2,
Wherein the image data generation unit generates first image data of a first image photographed at a first position and second image data of a second image photographed at a second position,
Wherein the determination unit determines that the brightness information of the first image data is smaller than the preset reference information and the brightness information of the second image data is smaller than the preset reference information, And judges that the region is a dark region when the time interval between shooting points is smaller than a predetermined time interval.
The method according to claim 1,
And the shadow area notification data is shared with the external device through the server.
The method according to claim 1,
And the shadow area notification data includes at least one of the identifier of the area, the brightness information, and the image data as a result of the determination.
The method according to claim 1,
Wherein the brightness information generator generates brightness information of the image through a brightness measurement algorithm.
The method according to claim 1,
Wherein the position information generating unit generates position information corresponding to the image using a position measuring sensor,
Wherein the position measurement sensor is a Global Positioning System (GPS) sensor.
The method according to claim 1,
Wherein the location information generation unit generates location information corresponding to the image through message transmission / reception with the communication base station.
The method according to claim 1,
Wherein the dark region is one of a low illumination region, a low illumination region, and a low luminous intensity region.
The method according to claim 1,
Wherein the location information is location information of the device at the time the image was taken.
A method for generating shadow area notification data,
Generating image data of an image photographed in a predetermined area through a camera sensor;
Generating brightness information of the image by analyzing the image;
Generating position information corresponding to the image;
Determining whether the area is a dark area based on the brightness information; And
And transmitting the shadow area notification data including the location information to the server according to the determination result.
In a device installed in a moving body,
An image data generation unit for generating image data of an image photographed in a predetermined area through a camera sensor;
A brightness information generating unit for generating brightness information of the image by analyzing the image;
A determination unit for determining whether the area is a dark area based on the brightness information; And
And a transmitter for transmitting notification data to the mobile device according to the determination result.
14. The method of claim 13,
Wherein the mobile device generates location information corresponding to the image based on the notification data, and transmits the shadow area notification data including the location information to the server.
In a mobile device,
A receiving unit for receiving brightness information of an image photographed in a predetermined area from a video image pickup device installed in a mobile body;
A position generator for generating position information corresponding to the image;
A determination unit for determining whether the area is a dark area based on the brightness information; And
And a communication unit for transmitting the dark area notification data including the location information to the server according to the determination result.
A server for managing shadow area notification data,
A receiving unit for receiving dark area notification data indicating whether an area photographed by the first device is a dark area from a first device installed in a moving object; And
And a transmission unit for transmitting a response message including the shadow area notification data to the second device when a request message is received from the second device.
17. The method of claim 16,
Wherein the request message includes location information of the second device,
And a notification data selection unit for selecting the shadow area notification data among the plurality of shadow area notification data based on the location information.

Images