JP2017117167A - Electronic device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic device that enhances safety against peeping of personal information using pseudo multi-screen display.SOLUTION: An electronic device includes: a display unit which, when viewed from a plurality of directions, displays different images in each direction; a mirror disposed at a position corresponding to at least one of the plurality of directions; an angle detection unit configured to detect an angle between a display surface of the display unit and a reflection surface of the mirror; a display controller configured to modify an image displayed in a direction corresponding to the mirror into an image with manipulation target objects to be manipulated by a user and to perform display control; a coordinate identification unit configured to recognize a manipulation on the display unit performed by the user, estimate coordinates specified by the user on the display surface, and identify coordinates on a display surface of a virtual image of the display unit corresponding to the estimated coordinates; and a manipulation recognition unit configured to recognize the manipulation by assuming that the user performed the manipulation on a manipulation target object corresponding to the identified coordinates within the image with the manipulation target objects.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an electronic device and a program that display different images for each direction when observed from a plurality of directions.

  2. Description of the Related Art Conventionally, there is known an information display device capable of simultaneously displaying two different images when the display screen is viewed from the right side and when viewed from the left side (for example, Patent Document 1).

  Hereinafter, the principle of the information display device of Patent Document 1 will be described with reference to FIG. FIG. 1 is a schematic cross-sectional view showing a configuration example of a liquid crystal panel of an information display device of Patent Document 1. As shown in FIG. 1, the liquid crystal panel of the information display device of the same document includes right-side viewing pixels (R-1, R-2,...) And left-viewing pixels (L-1, L-2,...). A color filter including a liquid crystal layer, a substrate, and the like (not shown). A parallax barrier layer including a light shielding portion (S-1, S-2,...) And other light transmitting portions is provided on the upper layer of the color filter. When the display unit configured by the liquid crystal panel as shown in FIG. 1 is viewed from the right side, only the light that has passed through the right-side viewing pixels (R-1, R-2,...) Passes through the parallax barrier layer, Light that has passed through the pixels (L-1, L-2,...) Is blocked by the light shielding portions (S-1, S-2,...). Therefore, in this case, the right visual field image is visually recognized. On the other hand, when the display unit is viewed from the left side, only the light transmitted through the left visual field pixels (L-1, L-2,...) Passes through the parallax barrier layer, and the right visual field pixels (R-1, R-2). ,...) Is blocked by the light shielding portions (S-1, S-2,...). Therefore, in this case, the left visual field image is visually recognized. If the parallax barrier layer is formed of a liquid crystal sheet, the light shielding portions (S-1, S-2,...) Can be electrically controlled ON / OFF. When the function of the light-shielding unit is turned on and the multi-view state is set, the left-side view image and the right-side view image are displayed at a resolution half the original resolution of the liquid crystal panel. If the function of the light-shielding part (S-1, S-2,...) Is controlled to be OFF and the multi-view function is controlled to be OFF, the original resolution of the liquid crystal panel is not impaired.

  In this document, a mirror surface is arranged adjacent to the display screen described above, and the image information of either the right-side view image or the left-side view image being displayed is reflected on the mirror surface so that the user can visually recognize the two images. Information is simultaneously viewed to realize a pseudo dual view display.

  In this document, as an example of an information display device, a conventional portable terminal in which a display unit (liquid crystal screen) and an operation unit (operation button group) are separated is disclosed.

JP 2009-069440 A

  No prior attempt has been made to apply the pseudo dual view function disclosed in this document to the display of a secure screen such as an authentication screen.

  Therefore, an object of the present invention is to provide an electronic device that improves the safety against peeping of personal information by using a pseudo multi-screen display.

  The electronic device of the present invention includes a display unit, a mirror, an angle detection unit, a display control unit, a coordinate identification unit, and an operation recognition unit.

  The display unit displays different images for each direction when observed from a plurality of directions. The mirror is provided corresponding to at least one of a plurality of directions. The angle detection unit detects an angle formed by the display surface of the display unit and the reflection surface of the mirror. The display control unit sets an image displayed in a direction corresponding to the mirror as an image including an operation target object to be operated by the user, and executes display control of the image. The coordinate specifying unit recognizes the user's operation on the display unit, estimates the coordinates on the display surface designated by the user by the recognized operation, and information on the size and relative position of the display unit and mirror given in advance Then, based on the detected angle and the estimated coordinates, the coordinates on the display surface of the virtual image of the display unit corresponding to the estimated coordinates are specified. The operation recognizing unit recognizes an operation by assuming that the user has performed an operation on the operation target object corresponding to the specified coordinates in the image including the operation target object.

  According to the electronic device of the present invention, it is possible to improve safety against peeping of personal information by using a pseudo multi-screen display.

FIG. 6 is a schematic cross-sectional view showing a configuration example of a liquid crystal panel of an information display device of Patent Document 1. FIG. 3 is a perspective view illustrating an appearance of the electronic apparatus according to the first embodiment. FIG. 6 is a perspective view illustrating a variation in the number of mirrors in the electronic apparatus according to the first embodiment. 1 is a block diagram illustrating a configuration of an electronic device according to a first embodiment. 6 is a flowchart showing the operation of the electronic apparatus of the first embodiment. The figure which shows the example of an operation target object and auxiliary display. The figure explaining the relationship between the coordinate on the display surface which the user specified, and the coordinate on the display surface of the virtual image corresponding to this. FIG. 15 is a block diagram illustrating a configuration example of a general-purpose system or a computer device that can be used to realize the electronic apparatus of the invention.

  Hereinafter, embodiments of the present invention will be described in detail. In addition, the same number is attached | subjected to the structure part which has the same function, and duplication description is abbreviate | omitted.

  Hereinafter, with reference to FIG. 2 and FIG. 3, an external configuration of the electronic apparatus according to the first embodiment will be described. FIG. 2 is a perspective view illustrating an appearance of the electronic apparatus 1 according to the present embodiment. FIG. 3 is a perspective view illustrating a variation in the number of mirrors in the electronic apparatus 1 of this embodiment.

  As shown in FIG. 2, the electronic apparatus 1 according to the present embodiment includes a display unit 11. Similar to the information display device of Patent Literature 1, the display unit 11 can display different images for each direction when observed from a plurality of directions. For example, the display unit 11 may be capable of displaying different images in the left and right directions (each referred to as a left-side visual field image and a right-side visual field image), or different images (up and down directions) in two vertical directions or four vertical and horizontal directions. The images viewed from above may be displayed as an upper view image and a lower view image, respectively. In the example of FIG. 2, it is assumed that the display unit 11 can display different images in two directions.

  The attachment 2 that can be attached to the electronic device 1 includes a mirror 21T. The attachment 2 is configured such that the mirror 21 </ b> T is disposed adjacent to the display unit 11 when attached to the electronic device 1. The attachment 2 may include a leg portion 22 that supports and fixes the mirror 21T so that the reflection surface of the mirror 21T and the display surface of the display unit 11 form a predetermined angle. In this embodiment, the electronic device 1 and the attachment 2 are defined as separate constituent requirements. However, the present invention is not limited to this, and the configurations of the electronic device 1 and the attachment 2 may be simply referred to as an electronic device. When the configuration corresponding to the device 1 and the attachment 2 is inseparably configured, it may be simply referred to as an electronic device.

  In this embodiment, the attachment 2 includes one mirror (mirror 21T). However, the number of mirrors included in the attachment 2 is arbitrary, and usually depends on the number of directions that can be displayed on the display unit 11. To do. In the example of FIG. 2, the mirror 21T is adjacent to the upper side of the display unit 11 (upward and upward when the short direction of the electronic device 1 is the vertical vertical direction) and is output from the display unit 11 when the attachment is mounted. The upper visual field image is supported at an angle that allows reflection.

  In this embodiment, the electronic device 1 is treated as a mobile terminal, a tablet, or a PDA. However, the electronic device of the present invention is not limited to this, and any device can be used as long as it includes a display unit that can be touch-operated. It may be. For example, the electronic device of the present invention may be a desktop personal computer including a display unit capable of touch operation, a game machine, a copy machine, other home appliances, or an industrial device.

  As described above, the attachment 2 can be provided with a plurality of mirrors, but the number of mirrors and the arrangement of the mirrors depend on the specifications of the display unit 11. When the display unit 11 can perform more complicated directional control such as four directions of not only left and right and up and down but also four directions up and down and left and right, a plurality of mirrors may be arranged according to the number of directions. For example, as shown in FIG. 3, the attachment 2 may include not only the mirror 21T but also the mirror 21R.

  In this case, the mirror 21R is adjacent to the right side of the display unit 11 when the attachment is mounted (right side of the electronic device 1 when facing the display unit 11 of the electronic device 1 with the short direction of the electronic device 1 being the vertical vertical direction). The right-side visual field image output from the display unit 11 is supported at an angle that allows reflection.

  2 and 3 exemplify a state in which the angle formed by the mirror surface of the mirror 21T (mirror 21R) and the display surface of the display unit 11 is 90 ° or more, this angle is 90 ° or 90 °. It may be less than °. Hereinafter, the configuration of the electronic apparatus of this embodiment will be described with reference to FIG. FIG. 4 is a block diagram illustrating a configuration of the electronic apparatus 1 according to the present embodiment. As shown in FIG. 4, the electronic apparatus 1 according to the present embodiment includes a display unit 11, an angle detection unit 12, a display control unit 13, a coordinate identification unit 14, an operation recognition unit 15, and a position related information storage unit. 16 is included. The position related information storage unit 16 stores in advance information necessary for executing step S14 described later. Specifically, the position related information storage unit 16 stores information on the size and relative position of the display unit 11 and the mirrors 21T and 21R. The attachment 2 includes a mirror 21T, a mirror 21R,. As described above, the attachment 2 may include three or more mirrors, or only one mirror.

  Hereinafter, the operation of the electronic apparatus 1 according to the present embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a flowchart showing the operation of the electronic apparatus 1 of the present embodiment. FIG. 6 is a diagram illustrating an example of an operation target object and auxiliary display.

  The angle detection unit 12 detects an angle formed by the display surface of the display unit 11 and the reflection surface of the mirror (mirror 21T in the example of FIG. 6) (S12). The angle detection unit 12 can be realized by, for example, a distance measuring sensor using an infrared light source or an acceleration sensor mounted on the display unit 11 and the attachment 2. For example, as shown in FIG. 6, the angle detection unit 12 includes a distance measuring sensor that irradiates infrared light in a direction indicated by an arrow 8 b (substantially short direction of the electronic device 1). An angle formed by 21T and the display unit 11 may be detected.

  Next, the display control unit 13 displays an image displayed in a direction corresponding to the mirror (mirror 21T in the example of FIG. 6) as an image including the operation target object to be operated by the user (the operation target in the example of FIG. 6). The image including the object group 7) and display control of the image is executed (S13).

  Next, the coordinate specifying unit 14 recognizes the user's operation 31 on the display unit 11 and estimates the coordinates on the display surface designated by the user through the recognized operation 31. In the coordinate estimation, for example, a distribution of capacitance measured on the display surface of the display unit 11, a time change of coordinates at which the capacitance reaches a maximum value (maximum value), or the like may be used as the feature amount.

  The coordinate specifying unit 14 includes information on the size and relative position of the display unit 11 and mirror (mirror 21T in the example of FIG. 6) stored in advance in the position related information storage unit 16, the angle detected in step S12, Based on the coordinates estimated in the step, the coordinates on the display surface of the virtual image of the display unit 11 corresponding to the estimated coordinates are specified (S14).

Step S14 will be described in more detail with reference to FIG. FIG. 7 is a diagram for explaining the relationship between the coordinates on the display surface designated by the user and the corresponding coordinates on the display surface of the virtual image. In the example of FIG. 7, information on the observation position (information on the position of the user's eyes, three-dimensional coordinate information) is represented as (x _eye , y _eye , z _eye ). In addition, the coordinates on the display surface estimated in step S14 are (x _finger , y _finger , z _finger ). Further, the coordinates on the display surface of the virtual image corresponding to the coordinates estimated in step S14 are (x _virtual , y _virtual , z _virtual ). As described above, the position related information storage unit 16 stores information on the sizes and relative positions of the display unit 11 and the mirror 21T. The angle detected in step S12 is represented as angle α in FIG. Based on these pieces of information, the coordinate specifying unit 14 specifies coordinates (x _virtual , y _virtual , z _virtual ) on the display surface of the virtual image corresponding to the estimated coordinates (x _finger , y _finger , z _finger ). . The coordinate specifying unit 14 converts (x _virtual , y _virtual , z _virtual ) into coordinates (Zx, Zy) of the two-dimensional coordinate system on the display surface of the virtual image, and outputs these as specified coordinates (S14). ).

  Next, the operation recognizing unit 15 selects the operation target object (Zx, Zy) corresponding to the specified coordinates (Zx, Zy) in the image including the operation target object (in the example of FIG. 6, the image displayed on the mirror 21T). In the example of FIG. 6, it is assumed that the user has performed the operation on the operation target object representing the number “3”, and the operation is recognized (S15). As shown in FIG. 6, the user can perform an operation while observing the mirror image 51a with respect to the operation finger 31a, and the coordinates (Zx, Zy) specified in step S14 are the tips of the fingers of the mirror image 51a. In order to approximate the position, the result of the user's operation also follows the position of the mirror image 51a. That is, the user selects a desired operation target object while confirming the operation target object group 7 displayed on the mirror 21T and the position of the mirror image 51a corresponding to the operation finger 31a.

  As described above, since the user selects the operation target object group 7 mainly displayed on the mirror 21T by using the mirror image 51a of the operation finger reflected on the mirror 21T, nothing is displayed on the display unit 11. You don't have to. In addition, it is good also as displaying only the auxiliary display (for example, auxiliary display 4 of FIG. 6) which assists a user's input on the display part 11. FIG. The auxiliary display 4 will be described in detail below.

<Auxiliary display 4>
When the user tries to select the operation target object displayed on the mirror 21T using the mirror image 51a as a guide, the actual moving direction of the operation finger 31a may be different from the moving direction of the mirror image 51a. Disturbs intuitive input and operation. For example, in the example of FIG. 6, when the tip of the operation finger 31a moves from the near side to the far side as viewed from the user, the tip of the finger of the mirror image 51a moves in a direction from the far side toward the near side. For example, as shown in FIG. 6, when the user places the tip of the finger of the mirror image 51a on the “3” key displayed on the mirror 21T, and the user wants to press the “6” key after this, There is a case where 31a is accidentally caught from the back side to the near side. Here, the operation of moving the operation finger 31a from the near side to the far side is correct.

  In order to alleviate the complexity that occurs when the user handles a mirror image as described above, the display control unit 13 causes the display unit 11 to upside down the operation target object group 7 displayed on the mirror 21T, for example. Then, an image only for the frame may be displayed as the auxiliary display 4. The auxiliary display is not limited to the example in FIG. 6, and any auxiliary display may be used as long as the user can confirm the relationship between the coordinates on the display surface and the coordinates on the reflection surface.

  The user can intuitively understand the correspondence between the coordinates on the display surface and the coordinates on the reflection surface by performing operations and inputs while referring to the auxiliary display 4 as appropriate.

  According to the electronic apparatus 1 of the present embodiment, a screen including personal information and secret information (for example, an authentication screen) is displayed in a mirror using a pseudo multi-screen display function. Succeeded in making the screen hard to be seen by others.

  In a conventional smartphone, since a secure screen such as an authentication screen is only displayed on the display unit 11 as usual, it is possible to steal from a variety of angles. For example, when a user is sitting and operating a smartphone on a desk, the smartphone is easily peeped by people standing around the desk or people walking around the desk. . On the other hand, in the electronic device 1 of the present embodiment, the user's back or the like often forms a blind spot, so that the mirror image projected on the mirror surface cannot be easily observed (peeps).

<Supplementary note>
The device of the present invention can communicate with an input unit 11000 to which a keyboard or the like can be connected, an output unit 12000 to which a liquid crystal display or the like can be connected, and a hardware entity as a single hardware entity as shown in FIG. A communication unit 13000 to which various communication devices (for example, a communication cable) can be connected, a CPU 14000 (which may include a central processing unit, a cache memory, a register, etc.), a RAM 15000 and ROM 16000 that are memories, The input unit 11000, the output unit 12000, the communication unit 13000, the CPU 14000, the RAM 15000, the ROM 16000, and the bus 18000 are connected so that data can be exchanged between the external storage devices 17000. If necessary, the hardware entity may be provided with a device (drive) 19000 that can read and write a recording medium such as a CD-ROM. A physical entity having such hardware resources includes a general-purpose computer.

  The external storage device of the hardware entity stores a program necessary for realizing the above functions and data necessary for processing the program (not limited to the external storage device, for example, reading a program) It may be stored in a ROM that is a dedicated storage device). Data obtained by the processing of these programs is appropriately stored in a RAM or an external storage device.

  In the hardware entity, each program stored in an external storage device (or ROM or the like) and data necessary for processing each program are read into a memory as necessary, and are interpreted and executed by a CPU as appropriate. . As a result, the CPU realizes a predetermined function (respective component requirements expressed as the above-described unit, unit, etc.).

  The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the present invention. In addition, the processing described in the above embodiment may be executed not only in time series according to the order of description but also in parallel or individually as required by the processing capability of the apparatus that executes the processing. .

  As described above, when the processing functions in the hardware entity (the apparatus of the present invention) described in the above embodiments are realized by a computer, the processing contents of the functions that the hardware entity should have are described by a program. Then, by executing this program on a computer, the processing functions in the hardware entity are realized on the computer.

  The program describing the processing contents can be recorded on a computer-readable recording medium. As the computer-readable recording medium, for example, any recording medium such as a magnetic recording device, an optical disk, a magneto-optical recording medium, and a semiconductor memory may be used. Specifically, for example, as a magnetic recording device, a hard disk device, a flexible disk, a magnetic tape or the like, and as an optical disk, a DVD (Digital Versatile Disc), a DVD-RAM (Random Access Memory), a CD-ROM (Compact Disc Read Only). Memory), CD-R (Recordable) / RW (ReWritable), etc., magneto-optical recording medium, MO (Magneto-Optical disc), etc., semiconductor memory, EEP-ROM (Electronically Erasable and Programmable-Read Only Memory), etc. Can be used.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of the server computer and transferring the program from the server computer to another computer via a network.

  A computer that executes such a program first stores, for example, a program recorded on a portable recording medium or a program transferred from a server computer in its own storage device. When executing the process, the computer reads a program stored in its own recording medium and executes a process according to the read program. As another execution form of the program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and the program is transferred from the server computer to the computer. Each time, the processing according to the received program may be executed sequentially. Also, the program is not transferred from the server computer to the computer, and the above-described processing is executed by a so-called ASP (Application Service Provider) type service that realizes the processing function only by the execution instruction and result acquisition. It is good. Note that the program in this embodiment includes information that is used for processing by an electronic computer and that conforms to the program (data that is not a direct command to the computer but has a property that defines the processing of the computer).

  In this embodiment, a hardware entity is configured by executing a predetermined program on a computer. However, at least a part of these processing contents may be realized by hardware.

Claims (3)

A display unit that displays different images for each direction when observed from a plurality of directions;
A mirror corresponding to at least one of the plurality of directions;
An angle detection unit that detects an angle formed by the display surface of the display unit and the reflection surface of the mirror;
An image displayed in a direction corresponding to the mirror is an image including an operation target object to be operated by the user, and a display control unit that executes display control of the image;
Recognizing the user's operation on the display unit, estimating the coordinates on the display surface specified by the user by the recognized operation, the size and relative position of the display unit and the mirror given in advance A coordinate specifying unit that specifies coordinates on a display surface of a virtual image of a display unit corresponding to the estimated coordinates, based on the information on the detected angle and the estimated coordinates; and An operation recognizing unit that recognizes the operation by assuming that the user has performed an operation on the operation target object corresponding to the identified coordinates in the image including the image;
Including electronic equipment. The electronic device according to claim 1,
The display control unit
An electronic device that executes display control for displaying an auxiliary display on the display unit for allowing the user to confirm a relationship between coordinates on the display surface and coordinates on the reflection surface.   A program for causing a computer to function as the electronic apparatus according to claim 1.

Images