JP4757230B2 - Security system and program for security system - Google Patents

Description

  The present invention relates to a security system that controls a display form of a display screen for inconvenient display information included in a display screen displayed on a monitor, and a program for such a security system.

  In recent years, information processing apparatuses such as personal computers and workstations have been used in a wide variety of fields, such as being used in companies and used as public information terminals installed on streets. In particular, there are not a few cases where it is used in an environment where there are many people around a computer such as an information processing device or an information terminal. For this reason, there has been a problem that the display screen of the computer is seen by surrounding people against the will of the user using the computer.

  In order to solve such a problem, a technique for automatically darkening the display screen using a screen saver with respect to the display screen of the computer or locking it without displaying is known (for example, patents). Reference 1). The information processing apparatus according to Patent Document 1 includes a confidential information determination unit that automatically determines whether or not confidential information is included in display information displayed on a display of the information processing apparatus, and confidential information included in the display information. A display time control unit that controls the time until the screen saver is activated is included only when the screen saver is included, and confidentiality is ensured. Whether or not confidential information is included in the display information is determined by entering a keyword such as “secret” or “confidential” in the attribute area (property) of the data file in advance and registering this keyword separately. This is done by comparing the keyword with In addition to detection by this keyword, when information such as data and document contents is personal information such as name, address, telephone number, and mail address, it can also be determined as confidential information. Furthermore, control is performed by classifying the confidential level by appropriately weighting each registered keyword. Further, as another embodiment, a keyword that can be regarded as substantially the same and a corresponding foreign language are also determined and controlled.

  However, in the technique according to Patent Document 1, since it is necessary to input keywords such as “secret” and “confidential” in advance in the attribute area (property) of the data file, the input is troublesome, If you forget to enter the attribute area, the screen saver does not start, and there is a problem that the confidential information is seen by the people around you. Conversely, if the data file contains confidential information but the confidential information is not displayed on a display device such as a monitor, the attribute area is not likely to be seen by the surrounding people. Since the screen saver is activated in accordance with the keyword entered in, there is annoying to cancel the screen saver.

JP 2006-133595 A (paragraph numbers 0050, 0080, etc.)

  In view of the above problems, an object of the present invention is to recognize inconvenient display information from a display screen displayed on a monitor, thereby controlling the display form of the display screen and reliably preventing information leakage. It is to provide a security system and a program for the security system.

Feature of the security system according to the present invention for achieving the above object, controls a display form of a display screen displayed on the monitor, from the captured image obtained by capturing the display screen, the display about confidential information and A display information extracting unit for extracting inconvenient display information, which is display information showing at least one of displays contrary to public order and morals, by image recognition; and display information for determining an evaluation value of the display screen according to the inconvenient display information There is an evaluation unit, a display control determination unit that determines display control to be performed on the display screen based on the evaluation value, and a display time control unit that controls time until the display control is performed.

With such a configuration, inconvenient display information can be extracted from the captured image by image recognition, so that it is not necessary to set attributes individually for the open file. In addition, since the display screen includes a display control determination unit that determines display control and a display time control unit that controls the time until display control is performed, display control can be performed according to the situation. Become. In addition, since the inconvenient display information in the present invention is display information indicating at least one of display related to confidential information and display contrary to public order and morals, the user leaves the file containing the display related to confidential information open. Even when seated, information leakage can be prevented because display control is performed according to the situation. In addition, when a display contrary to public order and morals is displayed, it is possible to prevent discomfort from being seen by preventing the surrounding people from seeing.

Further, in the present invention, program for a security system for controlling the display form of a display screen displayed on the monitor also has a scope, the computer program, the captured image obtained by capturing the display screen, A display information extraction function for extracting inconvenient display information, which is display information indicating display related to confidential information and display contrary to public order and morals, by image recognition, and an evaluation value of the display screen according to the inconvenient display information A display information evaluation function for determining the display information, a display control determination function for determining display control to be performed on the display screen based on the evaluation value, and a display time control function for controlling the time until the display control is performed. Can be realized.

  Compared with the security system as the subject of the present invention described above, the program for the security system configured as described above is not substantially different in characteristic configuration, and the above-described operational effects can be obtained.

[First embodiment of the present invention]
Hereinafter, as an example in the case of using the security system 100 according to the present invention, a computer network system configured as shown in FIG. 1 will be described. FIG. 1 is a block diagram schematically showing this computer network system. A terminal 1 on which various files are created, viewed, copied, modified, deleted, printed, etc. by a user, and the operation of this terminal 1 are shown. It consists of a management server 2 that monitors the situation. Captured images based on an operation screen displayed on the monitor 1A of the terminal 1 when the user is using the terminal 1 and operation log information in which an operation status is recorded based on the user's operation are received from each terminal 1. It is transmitted to the management server 2. The capture image and the operation log information are transmitted in real time every predetermined time such as an interval of several seconds or an interval of several minutes. Therefore, it may be considered that the operation screen displayed on the monitor 1 </ b> A of each terminal 1 is being monitored by the management server 2. On the other hand, a display screen control signal for controlling the display screen displayed on the monitor 1 </ b> A of the terminal 1 is transmitted from the management server 2 to the terminal 1. Note that the capture image is generated by a capture image generation unit (not shown) provided in the terminal 1. In the present embodiment, the captured image and the operation log information are transmitted separately, but the present invention is not limited to this. Naturally, it is also possible to adopt a configuration in which operation information including these captured images and operation log information is transmitted to the management server 2 at once.

  FIG. 2 is a block diagram schematically showing the configuration of the security system 100. The security system 100 includes a terminal 1 and a management server 2. The management server 2 includes a capture image storage unit 10 that stores a capture image generated based on an operation screen by a capture image generation unit (not shown) of the terminal 1 connected to the network, and is transmitted from the terminal 1. The operation log information storage unit 11 stores operation log information. The operation log information includes an operation log recorded based on an operation of a user who uses the terminal 1. Therefore, the user's operation status can be recognized from the operation log information.

  The application evaluation unit 12 evaluates operation log information stored in the operation log information storage unit 11. Based on the evaluation result, the management server 2 can identify the application running on the terminal 1. As this identification, an application may be specified, or only a classification of an application such as a word processor, a spreadsheet, or a browser may be specified.

  Here, in the security system 100, if the display screen displayed on the monitor 1A of the terminal 1 includes at least one of a display related to confidential information and a display contrary to public order and morals, for example, a user can sit on the terminal 1 The display 1A is provided with a function of controlling the display of the monitor 1A so as not to leak the confidential information or to give an uncomfortable feeling to the surroundings.

  In order to determine whether the display is related to confidential information or contrary to public order and morals, first, the display information extraction unit 13 extracts display information from the captured image stored in the capture image storage unit 10. Here, the captured image includes characters and images, and these characters and images are handled as display information. Therefore, the display information extraction unit 13 includes a character information extraction unit 14 that recognizes characters by character recognition and an image information extraction unit 15 that recognizes image feature points from patterns. The feature points extracted by the image information extraction unit 15 include the ratio of the area indicated by a specific color in the entire image, the shape of the area occupied by the specific color, and display in areas other than the area It is preferable to use a mask process such as mosaic display in an image or an image. When such feature points are extracted, for example, if the ratio of the skin color of the person to the entire image is large, it can be predicted that a person with a lot of exposed skin is displayed. Then, the posture of the person can be recognized by recognizing the shape of the area. Further, when an image (background image) of an area occupied by an area other than the person is analyzed, the shooting location and shooting situation of the image can be recognized from the image shown in the background. Furthermore, if the captured image is subjected to mask processing such as mosaic display, it can be expected that the region that was intentionally excluded from the display is included, so the image may be contrary to public order and morals. High nature. In addition, an image relating to confidential information or an image contrary to public order and morals is stored in a database (not shown) in advance, and the image is extracted from the captured image and recognized as confidential information or information contrary to public order and morals. Of course it is also possible to do. The extraction of characters and images in this case need not take into account, for example, the display where the application windows overlap and cannot be seen, and only from the portion displayed in the captured image.

  Next, the display information evaluation unit 16 evaluates the evaluation value of the display information displayed on the captured image. Specifically, the display information evaluation unit 16 determines whether the display information extracted from the captured image by the character information extraction unit 14 and the image information extraction unit 15 is a display related to confidential information or a display contrary to public order and morals. The display information determination unit 17 is provided. This determination is performed by comparing the display keyword with a reference keyword stored in the reference keyword storage unit 19 or an image feature point stored in the image feature point storage unit 20. In particular, when the display information is characters, the number of keywords determined by the display information counting unit 18 included in the display information evaluation unit 16 at the time of this comparison is a display related to confidential information included in the captured image. Count. The management server 2 can recognize the confidential level of the display information displayed on the monitor 1A based on the quantity of the keywords. Specifically, when the number of keywords is large, it is considered that the confidential level is high, so that the time until the display screen control is activated can be shortened. It is also possible to set a secret level for each keyword and image feature point. These settings need only be set at least once in the management server 2. Once set, a plurality of terminals connected to the network constituting the security system 100 can be monitored. The results obtained by the character information determination unit 17 and the display information counting unit 18 are treated as display information evaluation values determined by the display information evaluation unit 16.

  The display control determination unit 21 determines display control to be performed on the display screen of the monitor 1 </ b> A according to the evaluation value obtained by the display information evaluation unit 16. For example, display control should not be performed unless there is a display related to confidential information or a display that violates public order and morals, and display control may be performed if there is a display related to confidential information or a display that violates public order or morals. It is preferable that the time until display control determined by the display control determination unit 21 is changed according to display information displayed on the monitor 1A. For example, if the display information is particularly important information among confidential information, it is recommended to perform display control as soon as possible, and display control is immediately performed even when images that are contrary to public order and morals are displayed during work. You may make it do. On the other hand, for other confidential information, display control can be performed in a predetermined time. The display time control unit 22 controls the time until such display control is performed. Then, according to the display control determined by the display control determination unit 21 and the time until display control controlled by the display time control unit is performed, the display screen control unit 23 controls the display screen for the terminal 1. Display screen control is performed by outputting a signal.

  A display screen control signal output from the display screen control unit 23 is transmitted to the terminal 1. A control unit (not shown) of the terminal 1 controls the monitor 1A and VRAM (Video Random Access Memory) 1B in accordance with the display screen control signal. In this way, the security system 100 according to the present invention can control the display screen. Here, the terminal 1 and the management server 2 according to the security system 100 are constructed with hardware and / or software, or a function unit for performing various operations relating to security, with the CPU as a core member.

  Next, reference keywords that are referred to when the display information determination unit 17 performs determination will be described with reference to the drawings. The reference keywords are stored in the reference keyword storage unit 19 and are classified for each keyword and stored as a table (see FIG. 3). Therefore, it is possible to easily extract a keyword (used frequently) corresponding to the application specified by the application evaluation unit 12. For example, in FIG. 3A, a company name of a business partner and keywords such as “transaction amount” and “sales” are stored as a “customer information table”. In FIG. 3B, keywords related to product development are stored as “development information table”, and in FIG. 3C, keywords related to contract are stored as “contract information table”. In FIG. 3D, keywords related to in-house information are stored as “in-house information table”. Further, in FIG. 3E, keywords in violation of public order and morals are stored as “public order and morals violation table”. Therefore, the display information determination unit 17 compares these keywords with the character information extracted by the character information extraction unit 14, so that it is possible to determine whether there is confidential information or information contrary to public order and morals in the captured image. It becomes. In the security system 100, it is possible to change the keyword to be referred to according to the application being used. For example, customer information is often used in spreadsheet software, so "customer information table" should be referenced when using spreadsheet software, and contract information should be used in word processing software. For this reason, it is preferable to refer to the “customer information table” when using word processing software. In addition, the more applications that are used, the wider the range of keywords to be referenced.

  The image feature point stored in the image feature point storage unit 20 is a criterion for determining the ratio of the area indicated by the specific color extracted by the image information extraction unit 15 in the entire image, or the specific color. It is preferable to store the shape of the area occupied by the object, an example of an object displayed in an area other than the area, and a determination criterion for the presence or absence of mask processing such as mosaic display in the image. With such a configuration, by comparing the image feature point stored in the image feature point storage unit 20 with the image extracted from the captured image, whether the image included in the captured image is an image contrary to public order and morals. It becomes possible to evaluate whether or not. It is also possible to evaluate by adding weights (points) to these determination criteria and adding the points obtained from the respective determination criteria. This result may be handled as the evaluation value of the display information.

  Next, display screen control will be described with reference to the drawings. FIG. 4 is a diagram showing a display screen on which display screen control is performed on the monitor 1A. As described above, the display screen control is performed according to the display screen control signal output from the display screen control unit 23. As the control, for example, there is a screen saver as shown in FIG. Further, particularly when a word processor is used, only keywords that are not desired to be displayed are blacked out as shown in FIG. 4B, or the entire display screen is displayed in a mosaic as shown in FIG. 4C. It is also possible to do so. Further, although not shown, the monitor 1A can be set to the standby mode. When such a standby mode is set, the monitor 1A is automatically turned off when no operation is continued, so that information leakage can be prevented. Further, when display screen control is performed using the standby mode or screen saver, the display control can be performed using the standby mode or screen saver provided in the computer, so that it is not necessary to provide a new display control means. Furthermore, when information that is not particularly important is displayed, it is possible to perform a comfortable operation by delaying the standby mode activation time. In addition, these display screen controls can be performed according to the number of keywords related to confidential information included in the captured image counted by the display information counting unit 18. Furthermore, it is possible to set a point corresponding to the weight for each keyword in advance and change the time until display control is performed based on the total value of the points. The determination as to whether or not the above-described operation is not performed can be made based on, for example, the time when the operation log information is not transmitted to the management server 2, or the character information extraction unit 14 or the image information. It is also possible to compare the captured images by the extraction unit 15 and determine whether the display in the captured images has changed.

  As another display screen control, there is a method of changing the viewing angle of the monitor 1A. FIG. 5 is a top view showing the relationship between the monitor 1A and the viewing angle. FIG. 5A shows a viewing angle in a normal use state before performing display screen control, and the viewing angle is α. On the other hand, when performing display screen control, the viewing angle is narrowed from α to β in the normal use state as shown in FIG. By narrowing the viewing angle in this way, it becomes possible to make it difficult for people around the terminal 1 who performs display screen control to see the monitor 1A, and in the case of a display contrary to public order and morals, Since it can be made invisible, an uncomfortable feeling can be prevented.

  If the security system 100 is used in this way, information leakage can be prevented even when the user leaves the seat while being displayed on the monitor, such as a rest time. Furthermore, even if an image or the like that is against public order and morals is displayed, it does not cause discomfort to surrounding people.

  Next, the present embodiment will be described using a flowchart. FIG. 6 is a flowchart when the management server 2 performs display screen control of the terminal 1. First, it is confirmed whether or not the terminal 1 has been operated for a certain period of time. This confirmation can be determined based on whether or not the operation log information transmitted from the terminal 1 has been interrupted. When the terminal 1 has not been operated for a certain period of time (step # 01: Yes), the application evaluation unit 12 identifies the application that is activated on the terminal 1 based on the operation log recorded in the operation log information (Step # 02).

  On the other hand, the display information extraction unit 13 extracts display information included in the captured image from the captured image transmitted from the terminal 1 (step # 03). This extraction can be performed by the character information extraction unit 14 by character recognition if the display information is characters, and the image information extraction unit 15 can recognize the pattern if the display information is an image.

  If the extracted display information is a character (step # 04: Yes), this character and the reference keyword stored in the reference keyword storage unit 19 corresponding to the application specified by the application evaluation unit 12 are determined as display information. The part 17 compares (step # 05). Here, in the display information evaluation unit 16, the display information determination unit 17 compares the reference keyword with the extracted character, and counts the quantity of the keyword when the extracted character matches the reference keyword. ing. When the character extracted from the captured image is display information that needs to be prevented from being leaked by the display information determination unit 17 (step # 06: Yes), the display control determination unit 21 displays the character according to the number of keywords. Control is determined, and the time until display control is performed by the display time control unit 22 is determined (step # 07).

  When the time has elapsed, the display screen control unit 23 transmits a display screen control signal corresponding to the display control determined by the display control determination unit 21 to the terminal 1. A control unit (not shown) of the terminal 1 controls the monitor 1A and VRAM (Video Random Access Memory) 1B according to the display screen control signal, thereby controlling the display screen (step # 08). This display screen control is performed until the user cancels it at the terminal 1 or until it is canceled by the management server 2 (step # 09).

  Returning to step # 04, if the extracted display information is not a character (step # 04: No) and the display information is an image (step # 10: Yes), this image and the image feature point storage unit 20 are stored. The display information determination unit 17 compares the image feature points that are present (step # 11). Then, the process is continued from step # 06.

  When an operation is performed on the terminal 1 in step # 01 (step # 01: No), or when there is no display information that needs to be prevented from leaking in the captured image in step # 06 (step # 06: No), When the display information is neither a character nor an image at step # 10 (step # 10: No), or when the display screen control is released at step # 09 (step # 09: Yes), the management server 2 Confirm whether or not to end monitoring. If the monitoring is to be terminated (step # 12: Yes), the process is terminated. On the other hand, when the process is continued (step # 12: No), the process returns to step # 01 to continue the process. According to such a flow, the security system 100 can prevent information leakage.

[Other Embodiments]
In the above embodiment, the capture image and the operation log information have been described as being transmitted to the management server 2 every predetermined time such as an interval of several seconds or an interval of several minutes, but the present invention is not limited thereto. It is possible to change the setting in the management server 2 and, of course, it is also possible to adopt a configuration in which the terminal 1 voluntarily transmits when a situation in which no operation is performed on the terminal 1 continues for a predetermined time. is there.

  In the embodiment described above, the application used in the terminal 1 has been described as being specified by the application evaluation unit 12 based on the operation log recorded in the operation log information. However, the present invention is not limited to this. By analyzing the captured image transmitted from the terminal 1, it is also possible to specify an application activated on the terminal 1. With such a configuration, transmission of operation log information from the terminal 1 can be made unnecessary.

  In the above-described embodiment, the reference keyword storage unit 19 has been described as being classified for each keyword and stored as a table. However, the present invention is not limited to this. For example, when considering using a computer in a company, for example, a keyword that is frequently used for accounting purposes or a keyword that is frequently used for design purposes is different for each department. It is also possible to provide a reference keyword.

  In the above embodiment, the display contrary to public order and morals has been described as an image, but the present invention is not limited to this. A display contrary to public order and morals can naturally be displayed even if it is a character, and for example, it can also be determined by a character such as “18 years old or older” or “under 18 years old” on the homepage.

  In the above embodiment, the file used in the terminal 1 is not particularly described. However, the file may be a file recorded in the terminal, or may be stored in a file server and accessed from the terminal 1 for use. It may be a file. In any case, it is naturally possible to realize the functions of the security system 100.

  In the above-described embodiment, when information leakage can be prevented by minimizing only a window of a specific application, it is possible to adopt a configuration in which only the window is minimized. Furthermore, it is also possible to adopt a configuration that maximizes the window of an application that does not include keywords related to confidential information. Even with such a configuration, it is naturally possible to prevent information leakage.

  In the above-described embodiment, the display information evaluation unit 16 in the flowchart describes the flow of evaluating either a character or an image from a captured image, but the present invention is not limited to this. If the captured image includes both characters and images, it is naturally possible to evaluate both of them.

  In the above embodiment, the reference keyword stored in the reference keyword storage unit 19 or the image feature point stored in the image feature point storage unit 20 has been described as being performed by comparing the display information. Not limited to this. For example, it is naturally possible to configure the information so as to be recognized as information contrary to public order and morals from the text and context displayed on the display screen.

  In the above embodiment, the display screen control has been described as changing the viewing angle of the monitor 1A, but the present invention is not limited to this. For example, the display screen can be controlled by changing the luminance of the monitor 1A.

  In the above-described embodiment, the keyword referred to is changed according to the application, but the present invention is not limited to this. For example, the configuration may be such that the keyword to be referred to is different for each file being used. Further, the keyword need not be in the form of a keyword table, and the keyword can be classified and stored for each folder. With such a configuration, it is possible to determine a folder to be referred to according to the file being used. Also, for example, it is naturally possible to categorize folders for each department such as “sales department folder” and “design department folder” and refer to keywords.

  In each of the above embodiments, the capture image and the operation log information have been described as being transmitted from each terminal 1 to the management server 2 via the network, but the present invention is not limited to this. For example, the function of determining display information from the captured image by the management server 2, that is, the display information extraction unit 13, the character information extraction unit 14, the image information extraction unit 15, the display information evaluation unit 16, the display information determination unit 17, and the display information Functions such as the counting unit 18, the display control determining unit 21, the display time control unit 22, and the display screen control unit 23 are modularized into applications that can be executed on the terminals 1. Of course, it is possible to make it a terminal with a security function.

  In each of the above embodiments, the management server 2 has been described as being constructed by a single computer, but the present invention is not limited to this. The functions of the management server 2 may be divided and distributed to a plurality of computers. For example, the captured image storage unit 10 in the management server 2 is distributed to a dedicated data storage machine such as a file server, and the dedicated data storage machine It is also possible to read out the captured image and operation log information and perform various processes.

  In the above embodiment, the capture image has been described as a still image file obtained by capturing an operation screen or a collection of still image files, but is not limited thereto. Of course, the captured image transmitted from the terminal 1 may be a still image or a moving image. Even when the captured image is a moving image, it is naturally possible to extract display information and perform display screen control according to the evaluation value. In addition, when transmitting from the terminal 1 to the management server 2 in the moving image format, the function of converting the still image into a moving image is provided in the format unit of the terminal 1. Various types of capture images can be selected when recorded in the capture image storage unit 10. For example, JPEG or GIF is used for still images, and MPEG or AVI is used for moving images.

Diagram showing a computer network system Block diagram schematically showing the configuration of the security system The figure which shows an example of the reference keyword stored in a reference keyword storage part The figure which shows an example of display screen control Diagram showing viewing angle change as an example of display screen control Flow chart when performing display screen control

Explanation of symbols

1: Terminal 1A: Monitor 1B: VRAM
2: Management server 10: Captured image storage unit 11: Operation log information storage unit 12: Application evaluation unit 13: Display information extraction unit 14: Character information extraction unit 15: Image information extraction unit 16: Display information evaluation unit 17: Display information Determination unit 18: Display information counting unit 19: Display keyword storage unit 20: Image feature point storage unit 21: Display control determination unit 22: Display time control unit 23: Display screen control unit 100: Security system

Claims (2)

The security system for controlling the display form of a display screen displayed on the monitor,
A display information extraction unit that extracts, by image recognition, inconvenient display information that is display information indicating at least one of display related to confidential information and display contrary to public order and morals from a captured image obtained by capturing the display screen;
A display information evaluation unit that determines an evaluation value of the display screen according to the inconvenient display information;
A display control determining unit that determines display control to be performed on the display screen based on the evaluation value;
And a display time control unit that controls a time until the display control is performed. The program for the security system to control the display form of a display screen displayed on the monitor,
A display information extraction function for extracting, by image recognition, inconvenient display information, which is display information indicating at least one of display related to confidential information and display contrary to public order and morals, from a captured image obtained by capturing the display screen;
A display information evaluation function for determining an evaluation value of the display screen according to the inconvenient display information;
A display control determination function for determining display control to be performed on the display screen based on the evaluation value;
A program for a security system that causes a computer to realize a display time control function for controlling a time until display control is performed.

Images