KR102405235B1 - Camera detection system based on image comparison - Google Patents

Abstract

The present invention relates to a system for detecting a camera in a search space, and after securing the image data transmitted by the camera by an image packet extraction method, it is compared with a set search image to determine whether it is the same space, but the set search image is stored in advance It can also be transmitted in real time through the searcher terminal, so it can be detected in various spaces that are not saved in advance. it's about
The present invention provides a search server 300 comprising an image packet extraction unit 320 and an image comparison request unit 330; Image comparison unit 410 that compares the image data of the image packet and the set search image to determine whether it is the same space, when determining that the space is the same, a camera location search algorithm is applied to search for location information that generates camera location information based on the video data It is characterized in that it includes an AI server 400 consisting of a unit (420).

Description

Camera detection system based on image comparison

The present invention relates to a system for detecting a camera in a search space, and after securing the image data transmitted by the camera by an image packet extraction method, it is compared with a set search image to determine whether it is the same space, but the set search image is stored in advance It can also be transmitted in real time through the searcher terminal, so it can be detected in various spaces that are not saved in advance. it's about

As camera miniaturization technology develops, cases of using micro-cameras and data transmission devices for voyeurism are rapidly increasing. In particular, so-called "hidden camera incidents" in which cameras are secretly installed in lodging establishments, bathrooms, toilets, and offices to leak internal situations continue to occur. Most of the hidden camera incidents cause great damage to the person concerned by distributing the video of the person's private life regardless of the intention of the person concerned.

As the hidden camera has emerged as a serious social problem, various solutions have been proposed to detect installed cameras. Deformed camera recognition system and method using analysis" and (Patent Document 2) Korean Patent Publication No. 10-2115701 "Secret camera detection system and detection method".

As an alternative for preventing damage to a hidden camera, Patent Document 1 proposes a system for detecting a pattern matching a pattern standard set in a packet of image data of a modified camera, and blocking image data transmission in case of an unauthorized image. Patent Document 2 is to capture the light reflected from the camera lens.

However, in the prior art, it was difficult to detect various spaces except for general public places because the pattern standard had to be set in advance as in Patent Document 1, and since the set pattern was used as the standard, it was possible to block other image data other than the hidden camera or to manipulate the pattern in the future. also cannot be excluded.

In addition, in order to fundamentally block the problem of the hidden camera, it is necessary to remove the camera. However, the method of capturing reflected light from a lens such as Patent Document 2 has a problem that the accuracy is low and the verification operation takes a lot of time because a detailed search is required.

Republic of Korea Patent Publication No. 10-2067046 "A modified camera recognition system and method using machine learning-based network image data transmission pattern analysis" Republic of Korea Patent Publication No. 10-2115701 "Secret camera detection system and detection method"

The present invention first checks whether a camera installed in another space is installed in the search space by first checking whether it exists in the same space through an image comparison method that compares the image data extracted from the image packet transmitted from the camera and the set search image. A problem to be solved is to provide a camera detection system that minimizes the possibility.

In addition, another solution to the present invention is to provide a camera detection system that can accurately present position information of a camera in a search space in an image comparison method, and induces complete removal of the camera.

In addition, the present invention can compare the set search image transmitted in real time through the searcher terminal with the video data of the camera, so that it is possible to detect various spaces that are not stored in advance, so that the detectable space can be infinitely expanded. provision is another challenge.

According to a feature of the present invention for achieving the above object, the present invention is installed in a search space, the access point (AP) access to the camera 100 for transmitting image data; a packet extraction device 200 for extracting an image packet including image data of the camera 100; An image packet extraction unit 320 for receiving the image packet extracted from the packet extraction device 200, and an image comparison request unit 330 for outputting a comparison request signal for the image data of the extracted image packet and a set search image ) a search server 300 consisting of; When the comparison request signal is input, an image comparison algorithm is applied to compare the image data of the extracted image packet with a set search image to determine whether the image is in the same space, the same space by the image comparison unit 410 AI server 400 comprising a location information search unit 420 that generates camera location information based on the image data by applying a camera location search algorithm when determined as; It provides an image comparison-based camera detection system including; a searcher terminal 500 for receiving and outputting the camera location information from the AI server 400 .

As described above, the searcher terminal 500 according to the present invention transmits the image or image for the search space, and the search server 300 receives the image or image for the search space from the searcher terminal 500 . and a search image setting unit 340 for setting the set search image after the integration.

The search image setting unit 340 according to the present invention includes: a 360-degree image integration unit 341 for integrating the image or image for the search space received from the searcher terminal 500 into a 360-degree image; a missing location information generating unit 342 for generating missing location information by searching for missing images or images among the generated 360-degree images; and a missing location photographing request signal transmitting unit 343 for transmitting the missing location photographing request signal including the missing location information to the searcher terminal 500 .

The video packet extraction unit 320 according to the present invention includes: a packet extraction request unit 321 for outputting a packet extraction request signal to the packet extraction apparatus 200; a video packet receiving unit 322 for receiving a video packet from the packet extracting device 200; and an image data generating unit 323 that generates image data from the received image packet, wherein the packet extraction apparatus 200 receives a packet extraction request signal from the packet extraction request unit 321, the a route change request unit 211 for sniffing by outputting a route change request signal to the camera 100; and an image packet receiving unit 212 that receives the image packet from the camera 100 and transmits it to the image packet receiving unit 322 .

The camera location search algorithm according to the present invention as described above, a corresponding location matching module for searching a matching location matching the image data in the set search image; a camera location information generating module for generating location information of the camera 100 by reflecting an angle of view (FOV), focal length, or perspective of the camera 100 at the matching location; It may include; a camera location information output module that outputs a set search image corresponding to the camera location information to induce a searcher to recognize the location information of the camera 100 .

According to the image comparison-based camera detection system according to the present invention, by first determining whether the image data of the camera image packet and the set search image are in the same space through the AI server, it is possible to clearly determine whether the camera is installed in the search space being photographed by the camera. This has the effect of reducing the possibility of errors in searching for other spatial cameras.

In addition, the present invention can induce the permanent removal of the camera by accurately grasping the location information of the camera in the search space through the image comparison method, thereby fundamentally blocking the hidden camera.

In addition, the present invention is configured so that the set search image can be transmitted in real time through the searcher terminal, there is an effect that the camera can be detected even in various spaces that are not stored in advance.

1 is a schematic diagram of an image comparison based camera detection system according to an embodiment of the present invention;
2 is a block diagram of a search server according to an embodiment of the present invention;
3 is an image packet extraction schematic diagram of an image comparison-based camera detection system according to an embodiment of the present invention;
4 is an operation schematic diagram of a searcher terminal and a search image setting unit according to an embodiment of the present invention;
5 is a diagram illustrating an application example of a camera location search algorithm according to an embodiment of the present invention;

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings 1 to 5 .

On the other hand, in the drawings and detailed description, drawings and descriptions of configurations and actions that can be easily recognized by those skilled in this field from general technical configurations are simplified or omitted. In particular, in the drawings and detailed descriptions, detailed descriptions and illustrations of specific technical configurations and actions of elements not directly related to the technical features of the present invention are omitted, and only the technical configurations related to the present invention are briefly illustrated or described. did

The image comparison-based camera detection system according to the present invention includes a camera 100 , a packet extraction device 200 , a search server 300 , an AI server 400 , and a searcher terminal 500 as shown in FIG. 1 .

The camera 100 is a device for capturing an image, and may correspond to an IP camera or a network camera.

The camera 100 is installed in a search space and used as a main means of a hidden camera, and the search space may correspond to various spaces such as accommodations, restrooms, changing rooms, and offices.

Meanwhile, the camera 100 transmits image data by accessing an access point (AP), which is a device that relays data transmission/reception between hardware. Since more detailed information about the access point (AP) can be easily known by those skilled in the art, the configuration and operation thereof will be omitted.

The packet extraction device 200 is a device for extracting an image packet of the camera 100, and refers to hardware including a network adapter such as a smartphone, a PC, and an AP. ARP (Address Resolution Protocol, ARP; Address Resolution Protocol) spoofing is preferable as an operation method of the packet extraction device 200 . That is, if the video packet delivery path of the camera 100 was previously an access point (AP), thereafter, the video packet is changed to be delivered through the packet extraction device 200 through ARP spoofing. Through this image packet extraction method, the packet extraction apparatus 200 extracts an image packet including image data of the camera 100 having the changed IP table.

Specifically, the packet extraction apparatus 200 may include a path change request unit 211 and an image packet reception unit 212 as shown in FIG. 3 . Upon receiving the packet extraction request signal from the packet extraction request unit 321 of the search server 300, the route change request unit 211 outputs a route change request signal to the camera 100 to request sniffing. . The image packet receiving unit 212 receives the image packet from the camera 100 whose path for transmitting the image packet is changed according to the path change request signal of the path change request unit 211, the image packet of the search server 300 The video packet is transmitted to the receiving unit 322 . The image packet receiving unit 322 transmits the received image packet to the image data generating unit 323 to generate image data.

The search server 300 is a server that instructs the packet extraction apparatus 200 to extract a packet, and checks image data through the image packet of the camera 100 extracted through this. That is, the search server 300 receives the video packet extraction unit 320 for receiving the video packet extracted from the packet extraction device 200, and a comparison request signal for the video data of the extracted video packet and the set search image. and an image comparison request unit 330 to output.

In this case, the search server 300 may first perform searcher authentication prior to extracting the above-described image packet. That is, the search server 300 may be configured to command packet extraction only to an authenticated searcher after performing searcher authentication. In this case, the searcher authentication may be induced through an application installed in the searcher terminal 500 .

Specifically, the image packet extraction unit 320 of the search server 300 is interlocked with the packet extraction device 200 to extract the image packet of the camera 100. As shown in FIG. 3, the packet extraction request unit 321 , an image packet receiving unit 322 , and an image data generating unit 323 . The packet extraction request unit 321 outputs a packet extraction request signal to the packet extraction apparatus 200 to instruct the packet extraction apparatus 200 to extract the packet. The video packet receiving unit 322 receives the video packet from the video packet receiving unit 212 of the packet extracting apparatus 200 . The image data generating unit 323 generates image data from the received image packet. The generated image data is transmitted to the AI server 400 together with the set search image, and the AI server 400 performs an image comparison operation on the image data and the set search image to determine whether the two spaces are the same space.

Meanwhile, the search server 300 may further include a search image setting unit 340 . The search image setting unit 340 serves to set a set search image. That is, the set search image to be compared with the image data of the camera 100 may be a new image previously stored in the database DB or received in real time, and the search image setting unit 340 sets the new image as a set search image. will be set

Specifically, the search image setting unit 340 receives and integrates the image or image for the search space from the searcher terminal 500, and then sets it as the set search image. Accordingly, the searcher may reset the set search image by photographing an image or image of the search space currently located through the searcher terminal 500 and transmitting it to the search server 300 .

In addition, the search image setting unit 340 may receive and integrate an image or image of a user's face located in the search space from the searcher terminal 500 from the searcher terminal 500, and then set it as a set search image. In this case, it is convenient for the searcher to recycle the image or image of his or her face previously stored in the searcher terminal 500 . That is, the image or image of the above-described search space must be re-collected whenever the search space is changed, whereas the image or image of the user's face is stored once in the searcher terminal 500 or the search server 400. It can be recycled without the need to re-shoot.

The search image setting unit 340 may include a 360 degree image integration unit 341 , a missing location information generating unit 342 , and a photographing request signal transmitting unit 343 as shown in FIG. 4 . The 360-degree image integration unit 341 integrates the image or image of the search space or the user's face received from the searcher terminal 500 into a 360-degree image. The missing location information generating unit 342 generates missing location information by searching for missing images or images among the generated 360-degree images. The photographing request signal transmitting unit 343 transmits the missing location photographing request signal including the missing location information to the searcher terminal 500 . Through this configuration, the present invention is configured to transmit the set search image in real time through the searcher's terminal, so that the camera can be detected even in various spaces that are not stored in advance.

Meanwhile, the search image setting unit 340 may set the QR code output from the QR code output unit 540 of the searcher terminal 500 as a set search image. The QR code output from the searcher terminal 500 may be configured to be generated by the search server 300 and transmitted to the searcher terminal 500 . In this way, the set search image composed of the QR code is compared with the image data of the image packet by the QR code search unit 411 included in the image comparison unit 410 of the AI server 400 later. In this case, the search server 300 may induce the user to rotate 360 degrees while the QR code output unit 540 is operated and the QR code is being output from the searcher terminal 500 as described above.

The AI server 400 determines whether the image data and the set search image are in the same space based on the image comparison technique, and analyzes the current position of the camera 100 . To this end, the AI server 400 includes an image comparison unit 410 and a location information search unit 420 .

When a comparison request signal is input from the search server 300, the image comparison unit 410 compares the image data of the image packet extracted through the search server 300 with the image data of the image packet extracted through the search server 300 to determine whether the space is the same when a comparison request signal is input. do. The image comparison algorithm utilizes an AI-based image comparison technique.

The image comparison unit 410 may be set to operate the QR code search unit 411 when the set search image includes a QR code. When the QR code output unit 540 of the searcher terminal 500 operates and the QR code is included in the set search image, the QR code search unit 411 includes the QR code of the set search image among the image data of the video packet. explore whether

When the location information search unit 420 is determined to be the same space by the image comparison unit 410, a camera location search algorithm is applied to generate camera location information based on image data.

The camera location search algorithm may be configured to sequentially operate according to a corresponding location matching module, a camera location information generating module, and a camera location information output module. The corresponding position matching module searches for a matching position matching the image data from the camera 100 among the set search images. The camera position information generating module generates position information of the camera 100 by reflecting the field of view (FOV), focal length, or perspective of the camera 100 at the matching position. The camera location information output module outputs a set search image corresponding to the camera location information to induce the searcher to recognize the location information of the camera 100 .

5 is an application example of the camera location search algorithm. When the image data received from the search server 300 is photographing the front of the door, the corresponding location matching module searches the front part of the door in the set search image to find the matching location. set In addition, position information of the camera 100 capturing the image data is generated by guessing and applying the field of view (FOV), focal length, or perspective of the camera 100 through the image data. The generated camera location information is received and output by the searcher terminal 500 to induce the searcher to directly remove the camera 100 .

At this time, when the camera location information is output by the camera location information output module, the camera location information is displayed in a special area for the video or image of the search space transmitted by the searcher and output, so that the searcher can easily grasp the location information of the camera. It can be configured to

Through this configuration, the present invention can induce the permanent removal of the camera by accurately grasping the location information of the camera, thereby fundamentally blocking the hidden camera.

The searcher terminal 500 is a terminal owned by the searcher, and may correspond to a network-based hardware device such as a smart phone or a PC. The searcher terminal 500 receives and outputs the camera location information from the AI server 400 to induce the searcher to recognize the camera location information. If the AI server 400 determines that the image data of the camera 100 and the set search image are not in the same space, it can transmit the determination result to the searcher terminal 500 to clearly check whether the searcher is in the same space It can be configured to

Specifically, the searcher terminal 500 may include a photographing unit 510 , an image transmission unit 520 , and a missing location information output unit 530 as shown in FIG. 4 . The photographing unit 510 is activated by the search space photographing induction application, and captures an image or image for the search space. The image transmitting unit 520 transmits the image or image for the search space photographed by the photographing unit 510 to the 360-degree image integration unit 341 of the search server 300 . Thereafter, as described above, the search image setting unit 340 generates missing location information when there is a missing part while integrating the received image or image for the search space into a 360-degree image. The missing location information output unit 530 outputs the image or image for the search space corresponding to the missing location information when the generated missing location information is included in the missing location photographing request signal and also captures the location where the searcher is missing. induce to do

In addition, when the searcher terminal 500 confirms that it is the same place from the AI server 400, the report button is configured to be activated so that the searcher can easily report to the police.

As described above, although the image comparison-based camera detection system according to the embodiment of the present invention has been illustrated according to the above description and drawings, this is merely an example and various changes within the scope not departing from the technical spirit of the present invention and changes are possible.

100 : camera
200: packet extraction device
211: path change request unit
212: video packet receiving unit
300: search server
310: explorer authentication unit
320: video packet extraction unit
321: packet extraction request unit
322: video packet receiving unit
323: image data generating unit
330: image comparison request unit
340: search image setting unit
341: 360 degree image integration unit
342: missing location information generating unit
343: shooting request signal transmitting unit
400: AI server
410: image comparison unit
411: QR code search unit
420: location information search unit
500: explorer terminal
510: recording unit
520: image transmitting unit
530: missing location information output unit
540: QR code output unit

Claims (5)

a camera 100 installed in the search space and accessing an access point (AP) to transmit image data;
a packet extraction device 200 for extracting an image packet including image data of the camera 100;
An image packet extraction unit 320 for receiving the image packet extracted from the packet extraction device 200, and an image comparison request unit 330 for outputting a comparison request signal for the image data of the extracted image packet and a set search image ) a search server 300 consisting of;
When the comparison request signal is input, an image comparison algorithm is applied to compare the image data of the extracted image packet with a set search image to determine whether the image is in the same space, the same space by the image comparison unit 410 AI server 400 comprising a location information search unit 420 for generating camera location information based on the image data by applying a camera location search algorithm when determined as;
It includes; a searcher terminal 500 for receiving and outputting the camera location information from the AI server 400;
The searcher terminal 500 includes a QR code output unit 540 that displays a QR code from the search server 300;
The search server 300 includes a search image setting unit 340 for setting the QR code as a set search image;
The camera location search algorithm,
a corresponding location matching module for searching a matching location matching the image data among the set search images;
a camera location information generating module for generating location information of the camera 100 by reflecting an angle of view (FOV), focal length, or perspective of the camera 100 at the matching location;
The image comparison-based camera detection system comprising a; a camera location information output module for outputting a set search image corresponding to the camera location information to induce a searcher to recognize the location information of the camera (100). According to claim 1,
The searcher terminal 500,
Transmitting an image or image for the search space,
The search server 300,
An image comparison-based camera detection system comprising a; a search image setting unit (340) configured to receive and integrate the image or image for the search space from the searcher terminal (500) and set the search image as the set search image. According to claim 1,
The searcher terminal 500,
Transmitting an image or image of a user's face located in the search space,
The search server 300,
An image comparison-based camera detection system comprising: a search image setting unit (340) configured to receive and integrate an image or image of a user's face located in the search space from the searcher terminal (500), and set it as the set search image. delete delete

Images