JP2015184921A - Information display device, information display system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce leakage caused by a peep of information displayed on an information terminal device, and allow a user to browse the information without deterioration of visibility of the user himself/herself.SOLUTION: An information display device comprises: an image division part 12 for dividing a display image including information which a user wants to hide, into an image to be displayed on an operation panel 6 and an image to be displayed on an HMD 9 so that the information which the user wants to hide cannot be read based on only the display content of the operation panel 6; and a display control part 14 for displaying a corresponding division image to the operation panel 6 and HMD 9, respectively.

Description

  The present invention relates to an information display device, an information display system, and a program.

  In recent years, mobile terminals such as smart phones and tablet terminals have been used for business. For example, when business documents including confidential information are viewed using a mobile terminal while traveling using public transportation means such as a train. There is. In this case, as a technique for preventing leakage of confidential information due to so-called peeping, the display content being viewed by a third party behind, a technique for reducing the brightness of the display area of the confidential information in the mobile terminal (for example, Patent Document 1). ) And a technique for displaying confidential information on a portable terminal in a concealed state (for example, Patent Document 2).

JP 2011-133661 A JP 2011-118842 A

  It is an object of the present invention to allow a user to browse information without reducing leakage due to peeping of information displayed on an information terminal device and without reducing the visibility of the user himself / herself.

  An information display device according to the present invention includes a display unit and a wearable display device having the transmissive display screen formed so that the transmissive display screen is positioned in front of the user's eyes when worn by the user. Connecting means for connecting, a dividing means for dividing the display image into a first image and a second image comprising a portion other than the first image of the display image, and displaying the first image on the display means And display control means for controlling to display the second image on the transmissive display screen.

  In addition, the dividing unit may be configured such that when the display image includes confidential information, the first image and the confidential information are not readable only by the first image, or the confidential information is included only in the second image. The image is divided into the second images.

  The dividing unit may divide a graphical user interface component operated by a user so as to be included in the first image.

  The dividing unit divides the first image so that the first image is smaller than the second image.

  An information display system according to the present invention includes a wearable display device formed so that a mounted transmissive display screen is positioned in front of a user's eyes when the user is worn, and an information terminal device. The information terminal device divides a display unit into a display unit, a connection unit that connects the wearable display device, and a display image into a first image and a second image that includes a portion other than the first image of the display image. Splitting means for displaying, and display control means for controlling to display the first image on the display means and to display the second image on the transmissive display screen.

  The program according to the present invention is a wearable display device equipped with the transmissive display screen, wherein the transmissive display screen is positioned in front of the user's eyes when the computer is mounted on the display means and the user. Connecting means for connecting, a display means for dividing the display image into a first image and a second image comprising a portion other than the first image of the display image, and displaying the first image on the display means It is for functioning as display control means for controlling to display the second image on the transmissive display screen.

  According to the first aspect of the present invention, the information can be browsed by the user without reducing the leakage of the information due to the peeping of the information displayed on the information terminal device and without reducing the visibility of the user himself / herself. be able to.

  According to the second aspect of the present invention, leakage of confidential information can be prevented.

  According to the invention described in claim 3, it is possible to prevent the operability from being lowered.

  According to the fourth aspect of the present invention, the visibility of only the image displayed on the display means can be further reduced.

  According to the invention described in claim 5, the information can be browsed by the user without reducing the leakage of the information due to the peep of the information displayed on the information terminal device and without reducing the visibility of the user himself / herself. be able to.

  According to the invention described in claim 6, the information can be browsed by the user without reducing the leakage of the information due to the peep of the information displayed on the information terminal device and without reducing the visibility of the user himself / herself. be able to.

It is the block block diagram which showed one Embodiment of the information display apparatus which concerns on this invention. It is a hardware block diagram of the computer which forms the information display apparatus in this Embodiment. It is the figure which showed an example of the business document in this Embodiment. It is the figure which showed the example of the division | segmentation image of the business document displayed on the operation panel in this Embodiment. It is the figure which showed the example of the division | segmentation image of the business document displayed on HMD in this Embodiment. It is the figure which showed the example of the division image of the business document in which the other business document in this Embodiment and the business document are each displayed on an operation panel and HMD. It is the figure which showed the example of the division | segmentation image of the business document which the other business document in this Embodiment and the business document were each displayed on the operation panel and HMD, and was divided | segmented with the other division | segmentation method. It is the flowchart which showed the display process in this Embodiment. It is the flowchart which showed the image division process in FIG. It is the conceptual diagram which showed an example of the display of the memo document editing application displayed on the operation panel of a general information display apparatus. It is the conceptual diagram which showed an example of the divided image displayed on HMD as information to be kept secret among the images shown in the example of a display of FIG. It is the conceptual diagram which showed an example of the divided image displayed on an operation panel as information which does not need to be concealed among the images shown in the example of a display of FIG. It is the conceptual diagram which showed an example of the display in the mail application displayed on the operation panel of a general information display apparatus. It is the conceptual diagram which showed an example of the divided image displayed on HMD as information to be kept secret among the images shown in the example of a display of FIG. It is the conceptual diagram which showed an example of the divided image displayed on an operation panel as information which does not need to be concealed among the images shown in the example of a display of FIG.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block configuration diagram showing an embodiment of an information display system according to the present invention. The information display system according to the present embodiment includes a head mounted display (hereinafter referred to as “HMD”) 9 and an information display device 10. The information display device 10 is assumed to be a portable computer suitable for use in a public place such as a smart phone or a tablet terminal.

  The HMD 9 is a wearable display device that is worn on the user's head, and has a glasses-like shape formed so that a transmissive display screen is positioned in front of the user's eyes when the user wears the device. It is assumed that the equipment used will be used. Strictly speaking, the image is displayed on a display screen (liquid crystal panel) mounted on the HMD 9, but in the following description, it is also described as “display on the HMD 9” for convenience.

  FIG. 2 is a hardware configuration diagram of a computer forming the information display device 10 according to the present embodiment. The computer forming the information display apparatus 10 in the present embodiment can be realized by a general-purpose hardware configuration that has existed in the past. That is, as shown in FIG. 2, the computer includes the CPU 1, ROM 2, RAM 3, hard disk drive (HDD) 4, network controller 5 provided as communication means, and operation panel 6 provided as user interface means on the internal bus 7. Connected and configured.

  Returning to FIG. 1, the information display device 10 according to the present exemplary embodiment includes an image acquisition unit 11, an image division unit 12, an HMD connection unit 13, a display control unit 14, and a processing control unit 15. Note that components not used in the description of the present embodiment are omitted from FIG.

  The image acquisition unit 11 acquires an image to be displayed on the information display system. The image dividing unit 12 is provided as a dividing unit, and the image acquired by the image acquiring unit 11 is a first image and a second image made up of parts other than the first image so that the images cannot be easily read only by the respective images. Divide into In addition, when the image acquired by the image acquisition unit 11 is an image including confidential information (confidential information), the confidential information cannot be read only by the first image, or the confidential information is second. You may divide | segment into a 1st image and a 2nd image so that it may be included only in an image. The HMD connection unit 13 is provided as a connection unit, and connects the HMD 9 to the information display device 10 so as to be communicable. The connection form may be wired or wireless. The display control unit 14 is provided as a display control unit, and controls to display the first image on the operation panel 6 that is a display unit and to display the second image on the HMD 9. The process control unit 15 performs operation control of each component 11 to 14. Also, processing necessary for performing operation control, specifically, document type discrimination, current position detection, and the like are performed.

  Each component 11-15 in the information display apparatus 10 is implement | achieved by cooperation operation | movement with the program which operate | moves with the computer which forms the information display apparatus 10, and CPU1 mounted in the computer.

  Further, the program used in this embodiment can be provided not only by communication means but also by storing it in a computer-readable recording medium such as a CD-ROM or DVD-ROM. The program provided from the communication means or the recording medium is installed in the computer, and various processes are realized by the CPU of the computer sequentially executing the program.

  Next, before describing the display processing of the document image in the present embodiment, how the document image is displayed as a result of performing the display processing in the present embodiment will be described first.

  FIG. 3 is a diagram illustrating an example of a business document including information to be kept secret that is selected by the user as a display target on the information display device 10. In the present embodiment, for the sake of convenience, the “business document” means a document including information that is desired to be kept secret in order to prevent information leakage to a third party. This is not limited to the so-called “business” document, and may be a document including contents that the user does not want to be seen, such as a personal mail document or memo created by the user. The information display device 10 according to the present embodiment generates the divided images shown in FIGS. 4 and 5 in response to the display request for the business document illustrated in FIG. 3 by the user. The divided image as the first image shown in FIG. 4 is a divided image to be displayed on the operation panel 6, and the divided image as the second image shown in FIG. 5 is a divided image to be displayed on the HMD 9. is there. Even if each of the divided images is browsed independently, the contents described in the business document cannot be easily confirmed. By the way, in the transmissive HMD 9, the black portion of the divided image is transmitted, so that the portion ahead of the black portion is visible. Therefore, if the user views the operation panel 6 so that the black portion shown in FIG. 5 is aligned with the displayed character portion shown in FIG. 4, the divided image displayed on the HMD 9 is displayed. When the divided images displayed on the operation panel 6 appear to be combined, the business document shown in FIG. 3 is formed as an image visible to the user. As described above, the divided image displayed on the operation panel 6 via the HMD 9 on which the divided image shown in FIG. 5 is displayed is in a display state that cannot be easily read only by the divided image displayed on the operation panel 6. By seeing, only the user can read the business document.

  3 to 5 show business documents made up of character strings, while FIGS. 6 and 7 show cases of business documents made up of figures. FIG. 6 shows an example in which the business document 21 is divided into a grid and each divided image is displayed on the operation panel 6 and the HMD 9. FIG. 7 shows an example in which the business document 21 is divided into a central part and its peripheral part, and a split image including the central part is displayed on the HMD 9 and a split image including the peripheral part is displayed on the operation panel 6. Has been. In the image division method illustrated in FIG. 7, there is a high possibility that confidential information is included only in the HMD 9 and the confidential information can be visually recognized only by the display content of the HMD 9, but the display content on the HMD 9 is peeped by a third party. The secret information will not be leaked.

  As described above, the present embodiment is characterized in that the confidential information cannot be read only by the divided image displayed by dividing the business document including the confidential information and displayed on the operation panel 6. For this purpose, it is necessary to divide the confidential information and display it on the operation panel 6 and the HMD 9 or to divide the business document so that the confidential information is included only in the divided images displayed on the HMD 9.

  First, in the former case, when the confidential information is a character string as illustrated in FIG. 3, the character string is arranged by performing image analysis, for example, a straight line passing through the lower end of each character included in the character string is defined as a reference line. To do. And it divides in two up and down. That is, it is divided into upper and lower parts based on the center of the character string. Of course, this is an example of a division method, and the character may be further divided into three or more divisions so that the characters cannot be read more reliably. Or you may divide | segment into a grid | lattice form as illustrated in FIG. 4 and 5, the boundary of the divided image is a straight line, but may be a wavy line or a curve. For example, in the case of horizontal writing, it may be divided in the vertical direction. In the case where the confidential information is a graphic as illustrated in FIGS. 6 and 7, the area may be divided into a lattice shape as illustrated in FIGS. In any case, in this embodiment, even if one divided image is referred to, the character string is divided so that the visibility is lowered and the character string is difficult to read.

  In the latter case, when it can be grasped that the display area of the confidential information is predetermined in the business document image, the second image is formed so as to include at least an image corresponding to the display area of the confidential information, and the HMD 9 May be displayed.

  Further, when character strings and figures are mixed in the confidential information, a predetermined division method, for example, a method of always dividing into a lattice shape may be adopted, or image analysis is performed to Each display area of the graphic may be specified, and the above-described division process may be performed for each specified area.

  3 to 6 show examples in which the image to be displayed is divided almost evenly, but the divided image displayed on the operation panel 6 is divided so as to be smaller than the divided image displayed on the HMD 9. Then, the visibility with only the operation panel 6 may be further reduced.

  Next, display processing for displaying an image on the information display system in this embodiment will be described with reference to the flowchart shown in FIG.

  First, a user of an information display system that displays an image designates a document to be displayed by operating the operation panel 4 of the information display device 10 with the HMD 9 mounted on the head in advance. The document to be displayed may be a document stored in the HDD 4 of the information display device 10 or a document obtainable via a network. The image acquisition unit 11 acquires a document designated by the user. When the document acquired by the image acquisition unit 11 is not a business document (N in Step 110), the display control unit 14 displays the document as it is on the operation panel 6 (Step 150). That is, if the document is not a business document, the entire document may be displayed on the operation panel 6 as usual without performing the processing described later on the acquired document. Whether a business document is a business document may be determined based on the rule when the business document is managed according to a predetermined rule such as a storage location or a document name. In addition, it may be determined whether the document is a business document based on the type of application program that performs document browsing or document editing, such as a document creation application program, mail browsing, or creation application program. Further, it may be configured that the user instructs the document to be a business document by operating the operation panel 6.

  When the document acquired by the image acquisition unit 11 is a business document (Y in step 110), the processing control unit 15 subsequently determines whether the current position where the user is trying to display the business document is a public place. Judge whether. This may be determined by comparing the current position and the position information of the office when the information display device 10 is connected to an in-house network or has a GPS function. When it is determined that the user is not in a public place (N in Step 120), the display control unit 14 displays the document on the operation panel 6 (Step 150).

  On the other hand, when it is determined that the user is in a public place (Y in step 120), the image dividing unit 12 divides the document image as follows (step 130). The flow of the image division process will be briefly described with reference to the flowchart shown in FIG. A public place refers to a place where confidential information may be leaked due to the possibility that a business document displayed on the operation panel 6 can be viewed by a third party. Further, the user may operate the operation panel 6 to instruct whether or not the user is in a public place.

  By the way, the HMD 9 includes a binocular type in which the display screen is located in front of both eyes and a monocular type in which the display screen is located only in one eye. It can be known in advance which type of HMD 9 connected to the information display device 10 is. When the HMD 9 is a binocular type (Y in step 131), the image dividing unit 12 divides the document image into three (step 132), and when the HMD 9 is a monocular type (N in step 131), the image dividing unit 12 divides the document image into two. (Step 133).

  By the way, the present embodiment is characterized in that the document image to be displayed is divided as described above, and the divided images are displayed on the operation panel 6 and the HMD 9 respectively. When the HMD 9 is a binocular type, there are three screens including a display screen corresponding to each of the left and right eyes and the operation panel 6, so the document image is divided into three. That is, this is because different divided images are displayed on both screens of the HMD 9. However, for the sake of brevity, the description will be made assuming that the image of the same content is displayed on both display screens even if the HMD 9 is a binocular type unless otherwise specified. That is, the description will be made assuming that the HMD 9 is divided into two even if it is a binocular type.

  Subsequently, when the business document to be image-divided is a document composed of a character string (Y in step 134), the image dividing unit 12 performs character division such as bi-division or tri-division using the lower end of the character as a reference line as described above. On the other hand, if the document to be image-divided is a document including a figure (N in step 134), the figure is divided such as dividing into a grid as described above (step 135). Step 136). At this time, an area for seeing through the display content of the operation panel 6 included in the divided image displayed on the HMD 9 is processed into black. This is because the black display on the transmissive HMD becomes transparent. On the other hand, the area corresponding to the display position of the HMD 9 included in the divided image displayed on the operation panel 6 is processed into white.

  Here, for convenience, the business document is branched depending on the document composed of character strings or figures. However, when the character strings and the figures are mixed, the business document image is displayed according to a predetermined rule as described above. What is necessary is just to divide | segment an image by dividing | segmenting or analyzing a business document image and specifying each area | region of a character string and a figure.

  When the entire confidential information is displayed on the operation panel 6, there is a possibility that the confidential information may be leaked by being peeped at by a third party in the same public place. Therefore, when dividing the image, the image dividing unit 12 divides the confidential information so that it is displayed only on the display screen of the HMD 9 as described above. Alternatively, the entire confidential information is divided so as not to be displayed on the operation panel 6 so that the confidential information cannot be read from the display content of the operation panel 6.

  When the image dividing unit 12 divides the business document image as described above to form the operation panel and HMD divided images, the display control unit 14 displays the operation panel divided images on the operation panel 6. The HMD divided images are respectively displayed on the HMD 9 (step 140).

  The user interprets the business document by aligning the divided images displayed on the operation panel 6 and the HMD 9 as described above. On the other hand, even if a third party behind the user looks into the operation panel 6, the contents of the document cannot be read only with the divided image of the business document.

  If the image to be divided is a color image, it may be divided by color (RGB) instead of area division as described above, and only a single color may be displayed on the operation panel 6.

  In addition, when the business document to be displayed includes GUI (graphical user interface) parts that can be operated by the user and used for turning pages or inputting characters, the GUI parts are displayed by the user when displayed on the HMD 9. Operation becomes difficult. Therefore, an image including a GUI component may be displayed on the operation panel 6 of the information display device 10 that allows easy operation of the GUI component.

  The image division process in this example will be described. FIGS. 10 to 15 are conceptual diagrams used to explain screen display when editing a document using an application program for editing a memo document in the information display device 10. FIG. 10 is a display example in the memo document editing application displayed on the operation panel 6 of the general information display device 10. The GUI component constituting the displayed information is a display screen including “memo” as the application program name display field 101, a character information input field 102, and a virtual keyboard 103 for inputting characters. The user operates the virtual keyboard 103 displayed on the operation panel 6 to display the characters input in the character information input field 102. In the present embodiment, the image dividing unit 12 generates a divided image composed of information to be concealed and displays it on the HMD 9, generates a divided image composed of information that does not need to be concealed and displays it on the operation panel 6.

  FIG. 11 is an example of a divided image displayed on the HMD 9 as information to be kept secret. The display mode by this divided image is as follows. Since the character input field 112 displays the result of character input, it is displayed on the HMD 9 because it is information that is not desired to be viewed by a third party. Of the character input keys constituting the virtual keyboard 113, the character input keys that are actually input by the user using the operation panel 6 are displayed on the HMD 9. This is to prevent a third party from seeing characters that are actually input. Character input keys that are not operated by the user may be hidden on the HMD 9 or may be configured to display only the border of the virtual keyboard 113 as shown. In FIG. 12, the area not displayed is indicated by a broken line. The same applies to the drawings used in the following description.

  FIG. 12 is an example of a divided image displayed on the operation panel 6 as information that does not need to be concealed. The display mode by this divided image is as follows. The application program name display field 121 displays “new memo” because it is not information that should be kept secret. Since the information to be concealed is displayed in the character input field 122, the input image is not included in the divided image displayed on the operation panel 6, and only the frame line is displayed. In FIG. 12, the frame line is indicated by a broken line because it is a non-display portion. Since the virtual keyboard 123 is information for the user to operate the operation panel 6, a divided image is configured to be displayed on the operation panel 6. Here, not all the character input keys of the virtual keyboard 123 are displayed on the operation panel 6, but a portion overlapping with the character input keys displayed on the HMD 9 may be hidden. Further, when a character input key that is a selection candidate is displayed in a field that is not displayed on the operation panel 6 when one of the character input keys of the virtual keyboard 123 is selected by the user, for example, “A” When “” is selected, “U” is displayed in the input field 122 that is not displayed on the operation panel 6. In this case, the character input key “U” applied to the input field 122 is displayed on the HMD 9 and the virtual keyboard. The character input keys “A”, “I”, “E”, and “O” displayed in the display area 123 may be displayed on the operation panel 6, respectively. Similarly, a divided image may be formed in the mail application.

  FIG. 13 is a display example in the mail application displayed on the operation panel 6 of the general information display device 10. As GUI parts constituting the displayed information, an application program name display field 131, an input field 132 for information such as a destination, a subject, and a body, an operation button 133 for inputting instructions such as sending, storing, and discarding mail are input. It is a display screen comprising a conversion candidate display field 134 for displaying a character conversion candidate and a virtual keyboard 135 for inputting a character. The user can input characters by operating the virtual keyboard 135 displayed on the operation panel 6, or can instruct mail processing by operating the operation buttons 133. In the present embodiment, the image dividing unit 12 generates a divided image composed of information to be concealed and displays it on the HMD 9, generates a divided image composed of information that does not need to be concealed and displays it on the operation panel 6.

  FIG. 14 is an example of a divided image displayed on the HMD 9 as information to be kept secret. The display mode by this divided image is as follows. In the character input field 142, since the result of the character input by the user using the virtual keyboard 145 is displayed, it is displayed on the HMD 9 because the information is not desired to be viewed by a third party. The conversion candidate display field 144 indicating the conversion candidates for the character string input from the virtual keyboard 145 is a display for the user to select and input from the displayed candidate character strings, and information to be concealed. Therefore, it is displayed on the HMD 9. The application program name display field 141, the operation buttons 143, and the virtual keyboard 145 other than these may be hidden, or the divided image may be configured so that only the frame line is displayed on the HMD 9.

  FIG. 15 is an example of a divided image displayed on the operation panel 6 as information that does not need to be concealed. The display mode by this divided image is as follows. The application program name display field 151 displays “Create Mail” because it is not information that should be kept secret. In the character input field 152, information to be concealed is displayed for the input destination and the mail text information, so the divided image displayed on the operation panel 6 does not include the input content and only the frame line is displayed. I am doing so. Further, since the selected conversion candidate character string is displayed in the conversion candidate display field 154, it is information to be kept secret and is not displayed. The operation buttons 153 and the virtual keyboard 155 for inputting instructions such as sending, storing, and discarding mail are information for the user to operate the operation panel 6, and configure a divided image to be displayed on the operation panel 6. .

  In the present embodiment, the information display device according to the present invention is described as an example applied to a mobile terminal such as a smart phone or a tablet terminal. However, the present invention is not necessarily limited by the presence or absence of portability. Any computer that can display information may be realized by a desktop personal computer (PC) or the like.

  Alternatively, a plurality of HMDs 9 may be connected to the information display device 10 and the same divided image may be displayed on the plurality of HMDs 9 so that a plurality of users can view the same business document at the same time.

  1 CPU, 2 ROM, 3 RAM, 4 hard disk drive (HDD), 5 network controller, 6 operation panel, 7 internal bus, 9 head mounted display (HMD), 10 information display device, 11 image acquisition unit, 12 image division unit , 13 HMD connection unit, 14 display control unit, 15 processing control unit.

Claims (6)

Display means;
A connection means for connecting a wearable display device equipped with the transmissive display screen, which is formed so that the transmissive display screen is positioned in front of the user when worn by the user;
A dividing unit that divides the display image into a first image and a second image including a portion other than the first image of the display image;
Display control means for controlling to display the first image on the display means and to display the second image on the transmissive display screen;
An information display device comprising:   When the display image includes confidential information, the dividing means prevents the confidential information from being read only by the first image, or the confidential information is included only in the second image. The information display device according to claim 1, wherein the information display device is divided into two images.   The information display apparatus according to claim 1, wherein the dividing unit divides a graphical user interface component operated by a user so as to be included in the first image.   The information display apparatus according to claim 1, wherein the dividing unit divides the first image so that the first image is smaller than the second image. A wearable display device formed so that the mounted transmissive display screen is positioned in front of the user's eyes when worn by the user;
An information terminal device;
Have
The information terminal device
Display means;
Connection means for connecting the wearable display device;
A dividing unit that divides the display image into a first image and a second image including a portion other than the first image of the display image;
Display control means for controlling to display the first image on the display means and to display the second image on the transmissive display screen;
An information display system comprising: Computer
Display means,
A connection means for connecting a wearable display device equipped with the transmissive display screen, wherein the transmissive display screen is positioned in front of the user's eyes when worn by the user;
A dividing unit that divides the display image into a first image and a second image including a portion other than the first image of the display image;
Display control means for controlling to display the first image on the display means and to display the second image on the transmissive display screen;
Program to function as.

Images