WO2016199415A1 - Information input device and matching system - Google Patents

Information input device and matching system Download PDF

Info

Publication number
WO2016199415A1
WO2016199415A1 PCT/JP2016/002781 JP2016002781W WO2016199415A1 WO 2016199415 A1 WO2016199415 A1 WO 2016199415A1 JP 2016002781 W JP2016002781 W JP 2016002781W WO 2016199415 A1 WO2016199415 A1 WO 2016199415A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
display
unit
input device
display information
Prior art date
Application number
PCT/JP2016/002781
Other languages
French (fr)
Japanese (ja)
Inventor
藤男 奥村
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2017523113A priority Critical patent/JP6693518B2/en
Publication of WO2016199415A1 publication Critical patent/WO2016199415A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • G09G5/37—Details of the operation on graphic patterns
    • G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns

Definitions

  • the present invention relates to an information input device and a verification system.
  • the present invention relates to an information input device and a verification system used for inputting information such as an authentication password.
  • An input device for inputting information such as an authentication password is installed in a system such as ATM (Automatic Teller Machine) installed in a public place.
  • a system such as ATM (Automatic Teller Machine) installed in a public place.
  • the system user inputs information according to a numeric keypad displayed on the touch panel of the input device.
  • a third party may look into the information.
  • Patent Document 1 discloses a display system that prevents peeping by a third party.
  • effective display information to be recognized by the user and dummy display information of the same type and different content from the effective display information are switched at high speed and displayed on the display unit.
  • the user recognizes effective display information displayed on the display unit through a shutter that opens and closes in synchronization with an image that switches at high speed.
  • a third party cannot recognize which display information displayed on the display unit is effective display information. Therefore, the user can input information to the input device so that a third party cannot recognize it.
  • the frame rate of an image that can be displayed on the display device of the system of Patent Document 1 is about 360 frames per second (hereinafter referred to as fps: frames per second). With such a frame rate, there is a possibility that an image group displayed on the display unit is recognized without taking a shutter by shooting with a high-speed camera of 1000 fps class. For this reason, in the system of Patent Document 1, a candidate of information input by the user is obtained by photographing an image included in the image group displayed on the display unit and the movement of the user's finger using a high-speed camera. May be squeezed.
  • An object of the present invention is to provide an information input device capable of improving the confidentiality of input information by switching display information at high speed in order to solve the above-described problems.
  • An information input apparatus includes a spatial modulation element having a display section divided into a plurality of display areas, and a light source including a plurality of light emitting sections associated with each of the plurality of display areas.
  • Projection means for projecting display information formed on the display area of the spatial modulation element based on the light to the operation area, and effective display information included in the display information is displayed in the operation area.
  • a shutter mechanism that opens in accordance with the timing to be operated, an imaging means for acquiring the operation content on the operation area as image information, and a display for displaying a pattern for displaying display information in the operation area on the display unit of the spatial modulation element
  • Control conditions including a condition and a synchronization condition that matches a timing for switching a plurality of light emitting units and a timing for opening the shutter mechanism, and the image information acquired by the imaging unit is set.
  • control means for outputting an operation information associated with a the determined operation content and effective display information from.
  • a collation system of the present invention includes a spatial modulation element having a display section divided into a plurality of display areas, and a light source including a plurality of light emitting sections associated with each of the plurality of display areas.
  • Projection means for projecting display information formed on the light irradiated onto the display section of the modulation element to the operation area, and effective display information included in the display information is displayed in the operation area.
  • a shutter mechanism that opens in accordance with the timing to be operated, an imaging means for acquiring operation contents on the operation area as image information, and a display condition for displaying a pattern for displaying display information in the operation area on the display unit of the spatial modulation element And a control condition that includes a timing for switching a plurality of light emitting units and a synchronization condition for matching the timing for opening the shutter mechanism, and the image information acquired by the imaging means.
  • Information input device comprising a control means for outputting operation information in which the operation content determined from the information and the effective display information are associated with each other, and authentication information acquired from the information input device via the network and stored in the own device And a server that transmits the verification result of the operation information and the authentication information to the host system.
  • an information input device capable of improving the confidentiality of input information by switching display information at high speed.
  • FIG. It is a block diagram which shows the structure of the key arrangement
  • FIG. 1 shows an appearance of an information input device 10 according to the first embodiment of the present invention.
  • FIG. 1 is an image in which a user inputs information to the information input device 10.
  • the information input device 10 is a terminal provided with an interface device 11 that projects display information on an operation area 12 that receives a user operation and images an operation performed on the operation area 12.
  • the interface device 11 is provided with a camera window 112 for the built-in image sensor to image the operation area 12 and a projection window 113 for projecting display information.
  • the interface device 11 includes a projecting unit including a phase modulation type spatial modulation element and a light source having a plurality of light emitting units for irradiating light to the display unit of the spatial modulation element.
  • the interface device 11 reflects the light emitted from the light source by the display unit of the spatial modulation element, and projects the display information on the operation area 12.
  • the display unit of the spatial modulation element of the interface device 11 is divided into a plurality of display areas, and different images can be displayed in each display area.
  • the plurality of light emitting units constituting the light source of the interface device 11 are provided in association with each display region of the spatial modulation element.
  • the interface apparatus 11 switches the display area to which light is irradiated by switching the light emission part which radiate
  • the information input device 10 includes an optical shutter 13 (also referred to as a shutter mechanism) for recognizing display information displayed in the operation area 12.
  • the optical shutter 13 is disposed above the operation area 12.
  • the optical shutter 13 is disposed so as to be positioned between the user and the operation area 12 when the user performs an operation on the operation area 12. The user recognizes the operation area 12 through the optical shutter 13 when operating the operation area 12.
  • the optical shutter 13 opens at a timing when display information (hereinafter referred to as effective display information) to be recognized by the user by the interface device 11 is displayed in the operation area 12, and closes at a timing when other display information is displayed in the operation area 12. To be controlled.
  • the optical shutter 13 opens in accordance with the timing at which the effective display information included in the plurality of display information is displayed in the operation area 12. Therefore, only the user who is looking at the operation area 12 through the optical shutter 13 can recognize the effective display information displayed in the operation area 12.
  • the optical shutter 13 can be realized by, for example, a MEMS (Micro Electro Mechanical Systems) shutter as described in Non-Patent Document 1 below. If a MEMS shutter is used, a response of about 20 microseconds is possible.
  • Non-Patent Document 1 N. Hagood et.al., “A Direct-View MEMS Display for Mobile Applications,” SID Symposium Digest of Technical Papers, Vol.1 (1), May 2007, pp.1278-1281 (2007 )
  • the optical shutter 13 can also be realized by a liquid crystal shutter composed of a pair of polarizers that cross each other with a liquid crystal cell interposed therebetween.
  • the liquid crystal shutter can be controlled to open and close by applying a driving voltage to realign liquid crystal molecules contained in the liquid crystal cell and changing the phase difference of light passing through the liquid crystal cell. If a response speed of several tens of microseconds to several milliseconds is sufficient, a liquid crystal shutter can be applied to the optical shutter 13.
  • the interface device 11 projects, for example, a key arrangement (also referred to as display information) in a matrix format including 12 symbols “0 to 1, X, #” to the operation area 12. At this time, the interface device 11 projects a dummy key arrangement (dummy display information) different from the effective key arrangement to the operation area 12 one after another along with the effective key arrangement (also referred to as effective display information) to be presented to the user.
  • a key arrangement also referred to as display information
  • dummy display information different from the effective key arrangement to the operation area 12 one after another along with the effective key arrangement (also referred to as effective display information) to be presented to the user.
  • FIG. 2 is an example of display information projected on the operation area 12.
  • the display information projected on the operation area 12 is recognized as an unintelligible image in which many symbols overlap as shown in the left diagram of FIG.
  • the operation area 12 is viewed through the optical shutter 13
  • an effective key arrangement as shown in the left diagram of FIG. 2 is recognized. Therefore, the user can perform an appropriate operation on the effective key arrangement projected on the operation area 12 by viewing the operation area 12 through the optical shutter 13.
  • the interface device 11 projects each symbol constituting the key array to a predetermined position in the operation area 12 according to the arrangement order of the symbols constituting the key array. Therefore, if the effective key arrangement is determined, it is possible to specify at which position in the operation area 12 each symbol is arranged.
  • the first column from the left is “2, 5, 1, 7”, the second column is “#, 6, 9, 3”, and the third column is “4, 8, 0”. , X ”.
  • the matrix-type key arrangement starts with the symbols in the first column and the first row from the left, and represents the symbols in order from the top row for each column.
  • a comma “,” is written after the symbol in the bottom row, and thereafter, the symbols in the column on the right are arranged in order from the top.
  • the key layout in the right diagram of FIG. 2 is expressed as “2517, # 693, 480X”. Note that commas may be omitted.
  • the user views the operation area 12 through the optical shutter 13. Therefore, it is impossible for a person other than the user to look directly into the optical shutter 13 during the user's operation.
  • the display information displayed in the operation area is switched as the light source is switched. Therefore, according to the present embodiment, high-speed image switching that is not limited by the response speed of the liquid crystal can be performed.
  • FIG. 3 is a conceptual diagram showing a configuration of the verification system 1 including the information input device 10 of the present embodiment.
  • the verification system 1 performs user authentication based on the key operation information acquired by the information input device 10.
  • the verification system 1 is a system that is connected to an upper system such as ATM and performs user authentication of a user who uses the upper system.
  • the collation system 1 includes an information input device 10 and a server 102 connected to the information input device 10 via a network 101.
  • the network 101 is a general communication line such as the Internet or an intranet.
  • the server 102 is a general server having an arithmetic function, a control function, a storage function, and the like.
  • the server 102 acquires key operation information from the information processing apparatus 10 and collates the key operation information with user authentication information. Then, when the key operation information matches the user authentication information, the verification system 1 permits the user to log in to the host system.
  • FIG. 4 is a block diagram showing a functional configuration of the information input device 10.
  • the information input device 10 includes an imaging unit 20, a projection unit 30, a control unit 40 and an optical shutter 13.
  • the imaging unit 20, the projection unit 30, and the control unit 40 constitute the interface device 11.
  • an operation area 12 that accepts input of user information is set.
  • the operation area 12 is set at a location where display information can be projected from the interface device 11, such as the housing or the inside of the information input device 10.
  • the operation area 12 may be set outside the information input device 10.
  • FIG. 5 is a conceptual diagram showing how the interface device 11 projects the display information 300 on the operation area 12 and images the operation area 12.
  • the control means 40 controls the projection means 30 so that different display information 300 is projected onto the operation area 12 one after another. Further, the control means 40 controls to open the optical shutter 13 at a timing when the effective display information is displayed as the display information 300 in the operation area 12. And the control means 40 controls the imaging means 20 so that the operation area
  • FIG. 6 is a block diagram illustrating a configuration of the imaging unit 20.
  • the imaging unit 20 includes an imaging device 21, an image processor 23, an internal memory 25, and a data output unit 27.
  • the imaging element 21 is an element for imaging an area including the operation area 12 and acquiring image information.
  • the imaging element 21 is a photoelectric conversion element in which semiconductor components are integrated into an integrated circuit.
  • the image sensor 21 can be realized by a solid-state image sensor such as a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor).
  • the imaging element 21 is configured by an element that captures light in the visible region, but may be configured by an element that can capture and detect electromagnetic waves such as infrared rays, ultraviolet rays, X-rays, gamma rays, radio waves, and microwaves.
  • the image processor 23 performs integrated processing for performing image processing such as dark current correction, interpolation calculation, color space conversion, gamma correction, aberration correction, noise reduction, and image compression on the image information captured by the image sensor 21. Circuit. Note that when the image information is output without being processed, the image processor 23 may be omitted.
  • the image processor 23 can be realized by a processor designed so that the information input apparatus 10 according to the present embodiment performs processing.
  • the internal memory 25 is a storage element that temporarily stores image information that cannot be processed when image processing is performed by the image processor 23 and processed image information. Note that the image information captured by the image sensor 21 may be temporarily stored in the internal memory 25.
  • the internal memory 25 may be configured by a general memory.
  • the data output unit 27 outputs the image information processed by the image processor 23 to the control means 40.
  • FIG. 7 is a block diagram showing the configuration of the projection means 30 according to this embodiment.
  • FIG. 8 is a conceptual diagram for explaining the optical configuration of the projection unit 30 according to the present embodiment.
  • the projection unit 30 includes a control condition acquisition unit 31, a light source control unit 32, a light source 33, a modulation element control unit 35, a spatial modulation element 36, and a projection unit 38.
  • a control condition acquisition unit 31 a light source control unit 32, a light source 33, a modulation element control unit 35, a spatial modulation element 36, and a projection unit 38.
  • the control condition acquisition unit 31 acquires a control condition for controlling the light source 33 and the spatial modulation element 35.
  • the control conditions include a synchronization condition for synchronizing the operations of the light source 33 and the optical shutter 13 and a display condition for causing the spatial modulation element 35 to display the phase distribution at an appropriate timing.
  • the control condition acquisition unit 31 outputs the synchronization condition to the light source control unit 32 and outputs the display condition to the modulation element control unit 35.
  • the light source control unit 32 performs control to switch a plurality of light emitting units constituting the light source 33 at a predetermined timing based on the synchronization condition, and to change the light emitting unit that emits light.
  • the light source 33 includes a plurality of light emitting units that emit light 340 having a specific wavelength. Usually, the light source 33 is configured to emit light 340 in the visible region. The light source 33 may be configured to emit light 340 other than the visible region such as the infrared region and the ultraviolet region. The light emitted from the light source 33 is converted into coherent light 340 by the collimator 34 and is incident on the display unit of the spatial modulation element 36.
  • the incident angle of the light 340 is made non-perpendicular with respect to the display unit of the spatial modulation element 36. That is, the emission axis of the light 340 emitted from the light source 33 is inclined with respect to the display unit of the spatial modulation element 36. If the emission axis of the light 340 is set obliquely with respect to the display unit of the spatial modulation element 36, the efficiency can be improved because the light 340 can be incident on the display unit of the spatial modulation element 36 without using a beam splitter. .
  • FIG. 9 is a conceptual diagram illustrating an arrangement example of a plurality of light emitting units 330 included in the light source 33.
  • Symbols such as A1 and A2 shown in the light emitting unit 330 in FIG. 9 indicate the position of each light emitting unit 330.
  • the rows of the plurality of light emitting units 330 arranged in a matrix are A, B, and C from the top, and the columns are 1, 2, 3, 4, and 5 from the left.
  • the light emitting unit A1, the light emitting unit A2, the several light emission part 330 which comprises the light source 33 can be comprised by arbitrary number of rows and columns.
  • the plurality of light emitting units 330 may be arranged in a concentric or spiral shape instead of a matrix shape.
  • the plurality of light emitting units 330 are controlled to emit light at timings independent of each other.
  • the light emitting unit 330 is controlled to emit light in the order of the light emitting unit A1, the light emitting unit A2,..., The light emitting unit C5.
  • the timing which makes the some light emission part 330 light-emit can be set to arbitrary orders. For example, it may be controlled to switch the light emitting units 330 in a predetermined order at predetermined time intervals, or may be controlled to switch the light emitting units 330 by changing the order at random time intervals.
  • FIG. 10 is a conceptual diagram of a laser array 331 that realizes the light source 33 of FIG.
  • the laser array 331 includes a plurality of light emitting units 332 that are driven and controlled at different timings.
  • the laser array 331 is preferably provided with a heat sink 333 for radiating heat generated by laser irradiation. Further, in order to collimate the laser emitted from the laser array 331, it is preferable to install a collimating lens array 341 in which a collimator is arranged corresponding to each light emitting unit 332 in the subsequent stage of the laser array 331.
  • the laser array 331 may be configured by combining a plurality of color lasers. If the laser array 331 is composed of a combination of a plurality of colors, display information can be multicolored. That is, the light source 33 includes a first light emitting unit that emits light in the first wavelength region, and a second light emitting unit that emits light in a wavelength region different from the light emitted from the first light emitting unit. It can be set as the structure which has at least. The light source 33 may be configured to emit three or more colors.
  • the spatial modulation element 36 displays the phase distribution of the display information projected on the operation area 12 on its own display unit under the control of the modulation element control unit 35.
  • the display unit of the spatial modulation element 36 is divided into a plurality of display areas. Each display area displays a phase distribution corresponding to display information at an independent timing.
  • the spatial modulation element 36 is a phase modulation type spatial modulation element that receives the coherent light 340 having the same phase and modulates the phase of the incident light 340.
  • the spatial modulation element 36 emits the modulated modulated light 370 toward the projection unit 38.
  • the spatial modulation element 36 may be an element of a system different from the phase modulation type as long as display information can be projected onto the operation area 12.
  • the phase distribution of the display information projected on the operation area 12 is displayed.
  • the modulated light 370 reflected from the display area of the spatial modulation element 36 becomes an image in which a kind of diffraction grating forms an aggregate, and display information is formed by collecting the light diffracted by these diffraction gratings.
  • the phase distribution displayed on the display unit of the spatial modulation element may be described as a pattern.
  • the spatial modulation element 36 is realized by a spatial modulation element using, for example, a ferroelectric liquid crystal, a homogeneous liquid crystal, a vertical alignment liquid crystal, or the like.
  • the spatial modulation element 36 can be realized by LCOS (Liquid Crystal Crystal on Silicon).
  • the spatial modulation element 36 may be realized by, for example, MEMS (Micro Electro Mechanical System).
  • the modulation element control unit 35 displays each phase distribution at an appropriate timing on the display unit of the spatial modulation element 36.
  • the modulation element control unit 35 changes the parameter that determines the difference between the phase of the light 340 applied to the display area of the spatial modulation element 36 and the phase of the modulation light 370 reflected from the display area. To control.
  • Parameters that determine the difference between the phase of the light 340 applied to the display unit of the spatial modulation element 36 and the phase of the modulated light 370 reflected by the display unit are, for example, parameters relating to optical characteristics such as refractive index and optical path length. It is.
  • the modulation element control unit 35 changes the refractive index of the display unit by controlling the voltage applied to the display unit of the spatial modulation element 36. As a result, the light 340 applied to the display unit is appropriately diffracted based on the refractive index of the display unit.
  • the phase distribution of the light 340 irradiated on the spatial modulation element 36 is modulated according to the optical characteristics of the display unit.
  • the control of the spatial modulation element 36 by the modulation element control unit 35 is not limited to the above.
  • FIG. 11 is a conceptual diagram in which the response of the liquid crystal of the spatial modulation element 36 is associated with the switching timing of each light emitting unit 330 constituting the light source 33.
  • the response timing of the liquid crystal is controlled by the modulation element control unit 35.
  • the switching timing of each light emitting unit 330 is controlled by the light source control unit 32.
  • each light emitting unit 330 is switched at one liquid crystal response timing.
  • FIG. 11 an example in which the light emitting units 330 are switched in the order of A1 to C5 is shown, but the order of switching is arbitrarily set.
  • the projection unit 38 projects light 340 emitted from the light source 33 as signal light 390.
  • the projection unit 38 includes a Fourier transform lens 381, an aperture 382, and a projection lens 383.
  • the modulated light 370 modulated by the spatial modulation element 36 is projected onto the operation area 12 as signal light 390 by the projection unit 38.
  • the Fourier transform lens 381 is an optical lens for forming an image formed when the modulated light 370 reflected by the display unit of the spatial modulation element 36 is projected at infinity at a nearby focal position.
  • the aperture 382 has a function of erasing higher-order light included in the light focused by the Fourier transform lens 381 and specifying an image region.
  • the opening of the aperture 382 is smaller than the image area of the display information at the position of the aperture 382, and is installed so as to block the peripheral area of the display information at the position of the aperture 382.
  • the opening of the aperture 382 is formed to be rectangular or circular.
  • the aperture 382 is preferably installed at the focal position of the Fourier transform lens 381, but may be shifted from the focal position as long as the function of erasing high-order light can be exhibited.
  • the projection lens 383 is an optical lens that magnifies and projects the light focused by the Fourier transform lens 381.
  • the projection lens 383 projects the signal light 390 so that the target image corresponding to the phase distribution input to the spatial modulation element 36 is displayed on the projection surface.
  • the signal light 380 projected from the projection unit 38 is not projected uniformly on the operation area 12 but concentratedly projected on portions such as characters, symbols, and frames constituting the display information.
  • the projection unit 30 according to the present embodiment is used for the purpose of projecting line drawings such as characters, symbols, and frames, the irradiation amount of the light 340 can be substantially reduced, so that the overall light output can be suppressed. it can. That is, the light source 33 can be composed of a small and low-power light source and a low-output power source that drives the light source.
  • FIG. 12 shows an example in which the display unit of the spatial modulation element 36 is divided into display areas of 3 rows ⁇ 5 columns.
  • the display area of the spatial modulation element 36 may be divided by a method different from that in FIG.
  • each row of the display area constituting the display unit of the spatial modulation element 36 is A, B, and C in order from the top.
  • each column is 1, 2, 3, 4, 5 in order from the left.
  • Each display area is described by combining a row number and a column number.
  • the display area in the m-th row from the top and the n-th column from the left is denoted as “display area mn”.
  • m is A, B or C
  • n is 1, 2, 3, 4 or 5.
  • phase distribution of the display information projected on the operation area 12 is displayed in each display area.
  • the display information itself is shown.
  • the display information itself is shown as a phase distribution for ease of explanation.
  • each light emitting unit 330 of the light source 33 is associated with each display area of the spatial modulation element 36.
  • the display area A1 in FIG. 12 is irradiated with light 340 emitted from the light emitting unit A1 in FIG.
  • the other light emitting units 330 correspond to the respective display areas. Note that the columns of the light emitting units 330 in FIG. 9 and the columns of the display region in FIG. 12 are shown in opposite positions because the light 340 emitted from the light source 33 is reflected by the display unit of the spatial modulation element 36. Because.
  • FIG. 13 shows an example in which the same pattern is displayed in an array on each display area of the spatial modulation element 36. For example, an array pattern of 4 rows ⁇ 4 columns is displayed in the display area A1.
  • the key arrangement of each display area of FIG. 12 is displayed in an array.
  • a plurality of key arrays to be displayed in the display area A1 of FIG. 12 are displayed.
  • the irradiation area of the light 340 can be narrowed down within the broken-line circle in FIG.
  • the irradiation area of the light 340 overlaps with an adjacent display area, and noise may be generated.
  • the irradiation area of the light 340 can be prevented from overlapping with an adjacent display area, so that generation of noise can be suppressed.
  • FIG. 14 is a block diagram showing the configuration of the control means 40 according to this embodiment.
  • the control means 40 includes a processing unit 41, an imaging control unit 42, a projection control unit 43, and a shutter control unit 44.
  • the processing unit 41 acquires key arrangement information including a plurality of key arrangements, and sets the phase distribution of display information to be projected on the projection means 30 using the key arrangement information. Then, the processing unit 41 sets a timing for displaying the phase distribution on the display unit of the spatial modulation element 36. That is, the processing unit 41 sets display conditions including the phase distribution of display information to be projected on the projection unit 30 and the timing for displaying the phase distribution on the display unit of the spatial modulation element 36. The processing unit 41 outputs the set display condition to the projection control unit 43.
  • the processing unit 41 sets the switching timing of the light emitting unit 330 constituting the light source 33. At this time, the processing unit 41 sets a synchronization condition for synchronizing the switching timing of the light emitting unit 330 and the timing of opening the optical shutter 13. The processing unit 41 outputs the set synchronization condition to the projection control unit 43 and the shutter control unit 44.
  • the processing unit 41 instructs the imaging unit 20 to image the operation area 12.
  • the processing unit 41 acquires image information of the operation area 12 from the imaging unit 20, recognizes the user's key operation from the image information, and outputs key operation information (also referred to as operation information) including the key operation performed by the user. To do.
  • the imaging control unit 42 performs control for causing the imaging unit 20 to image the operation area 12 in accordance with an instruction from the processing unit 41.
  • the imaging control unit 42 outputs image information captured by the imaging unit 20 to the processing unit 41.
  • the projection control unit 43 acquires the display condition and the synchronization condition output by the processing unit 41, and outputs the display condition and the synchronization condition to the projection unit 30.
  • the shutter control unit 44 acquires the synchronization condition output by the processing unit 41 and outputs the synchronization condition to the optical shutter 13.
  • the imaging control unit 42, the projection control unit 43, and the shutter control unit 44 are illustrated as different configurations, but these configurations may be combined.
  • FIG. 15 is a conceptual diagram illustrating an example in which display information is projected onto the operation area 12 by the projecting unit 30 and the image capturing area 12 is imaged by the camera 200 which is the image capturing unit 20.
  • the light emitted from the light source 33 is reflected by the display unit of the spatial modulation element 36 and projected on the operation area 12 as display information.
  • the information input device 10 captures the operation area 12 with the camera 200 and acquires the user's operation for the effective display information.
  • the control unit 40 may acquire the time when the user operation is performed and the position indicated by the operation from the image information captured by the camera 200. If the position indicated by the user's operation and the valid key array are associated with each other at the same time, the information input by the user can be specified.
  • FIG. 16 is a block diagram illustrating a configuration of the processing unit 41.
  • the processing unit 41 includes a key array storage unit 412, a control condition generation unit 413, and an operation information generation unit 415. Each component in FIG. 16 will be described in detail with reference to individual drawings.
  • FIG. 17 is a block diagram showing a configuration of the key array storage unit 412 (also referred to as a display information storage unit).
  • the key array storage unit 412 includes a key array receiver 421, a key array storage unit 422, and a key array output unit 423.
  • the key arrangement receiving unit 421 receives key arrangement information including information relating to the key arrangement and the phase distribution corresponding to the key arrangement from the server 102 constituting the verification system 1.
  • the key array receiving unit 421 may receive only the key array as key array information without receiving the phase distribution corresponding to the key array.
  • the key arrangement storage unit 422 stores the key arrangement information received by the key arrangement reception unit 421.
  • the key layout storage unit 422 may store only the key layout as key layout information.
  • the key arrangement output unit 423 outputs the key arrangement information stored in the key arrangement storage unit 422 to the control condition generation unit 413 in response to a request from the control condition generation unit 413.
  • FIG. 18 is an example of a key layout table 4221 that stores the key layout stored in the key layout storage unit 422.
  • the key array table 4221 stores a plurality of key arrays.
  • the key layout storage unit 422 may store the key layout in a format different from that of the key layout table 4221. In FIG. 18 and the like, a comma “,” is inserted into the key array, but a comma may not be inserted into the actual key array.
  • the key arrangement storage unit 422 stores as many key arrangements as possible. This is because as the number of key arrangements to be prepared increases, the number of dummy key arrangements can be increased, so that it becomes difficult to identify effective key arrangements. However, since the storage capacity of the key array storage unit 422 is also limited, the key array storage unit 422 may be configured to include a minimum number of key arrays that make it difficult to identify effective key arrays.
  • FIG. 19 shows an example of a key arrangement table 4231 including key arrangement information output from the key arrangement output unit 423.
  • the key arrangement table 4231 includes a selection of a number of key arrangements that satisfy the request of the control condition generation unit 413 among the plurality of key arrangements included in the key arrangement table 4221.
  • the key layout output unit 423 may output key layout information in a format different from that of the key layout table 4231.
  • FIG. 20 is a block diagram illustrating a configuration of the control condition generation unit 413.
  • the control condition generation unit 413 includes a key arrangement selection unit 431, an effective key arrangement output unit 432, a pattern storage unit 433, a pattern selection unit 434, a control condition setting unit 435, and a control condition output unit 436.
  • the key array selection unit 431 acquires a plurality of key array information (also referred to as display information) from the key array storage unit 412.
  • the key layout selection unit 431 selects any key layout included in the acquired key layout information as a valid key layout (also referred to as valid display information). For example, as shown in FIG. 21, the key arrangement selection unit 431 generates a key arrangement information table 4311 in which a flag (hereinafter referred to as an effective flag) is added to the selected effective key arrangement.
  • the valid flag of the valid key array is “1”, and the valid flags of the other key arrays are “0”.
  • the key arrangement selection unit 431 may indicate that the key arrangement is an effective key arrangement by another method instead of the table format such as the key arrangement information table 4311.
  • the key arrangement selection unit 431 outputs key arrangement information including the effective key arrangement to the pattern selection unit 434 and outputs the selected effective key arrangement to the effective key arrangement output unit 432. Note that the key arrangement selection unit 431 may output key arrangement information including the effective key arrangement to the effective key arrangement output unit 432.
  • the effective key array output unit 432 (also referred to as an effective display information output unit) acquires the effective key array from the key array selection unit 431, and outputs the effective key array to the operation information generation unit 415.
  • the pattern storage unit 433 stores a pattern to be displayed on the display surface of the spatial modulation element 36.
  • the pattern storage unit 433 stores phase distributions corresponding to a plurality of key arrays.
  • the pattern storage unit 433 may acquire a phase distribution corresponding to each key arrangement from the server 102 or the like in advance.
  • the pattern storage unit 433 preferably stores the phase distribution as digital data.
  • the pattern storage unit 433 stores the phase distribution in the form of a phase distribution table 4331 in which the phase distribution is associated with each key arrangement as shown in FIG. In FIG. 22, not the phase distribution of the display information corresponding to the key arrangement but the display information itself is shown.
  • the pattern storage unit 433 may store the phase distribution in a format different from that of the phase distribution table 4331.
  • the pattern selection unit 434 acquires key arrangement information including an effective key arrangement from the key arrangement selection unit 431, and acquires a phase distribution corresponding to display information corresponding to the acquired key arrangement from the pattern storage unit 433. At this time, the pattern selection unit 434 attaches a valid flag to the phase distribution corresponding to the valid key array to indicate that the phase distribution corresponds to the valid key array.
  • the pattern selection unit 434 generates a phase distribution table 4341 in which the phase distribution is associated with each selected key array as shown in FIG.
  • the pattern selection unit 434 attaches a valid flag to the valid key array.
  • the valid flag of the valid key array is “1”, and the valid flags of the other key arrays are “0”.
  • the pattern selection unit 434 may generate the phase distribution selected in association with each key arrangement including the effective key arrangement in a format different from the phase distribution table 4341.
  • the pattern selection unit 434 outputs the selected phase distribution to the control condition setting unit 435 in association with each key arrangement including the effective key arrangement.
  • the pattern selection unit 434 may output the phase distribution table 4341 when generating the phase distribution table 4341 as shown in FIG.
  • the control condition setting unit 435 acquires the phase distribution associated with each key arrangement including the effective key arrangement from the pattern selection unit 434.
  • the control condition setting unit 435 sets display conditions including the phase distribution corresponding to the display information to be projected on the projection unit 30 and the timing for displaying the phase distribution on the display unit of the spatial modulation element 36.
  • the control condition setting unit 435 outputs the set display condition to the control condition output unit 436.
  • FIG. 24 is a display condition table 4361 as an example of display conditions set by the control condition setting unit 435.
  • the display condition table 4361 is a table that summarizes the phase distributions to be displayed in the display areas of the display unit of the spatial modulation element 36 at a specific time. Note that the phase distribution corresponding to each display area is also stored in the display condition table 4361 other than the time shown in the display condition table 4361.
  • FIG. 25 is a display condition table 4362 as another example of display conditions set by the control condition setting unit 435.
  • the display condition table 4362 is a table in which times for displaying the respective phase distributions are collected with respect to the display area of the display unit of the spatial modulation element 36. Note that the phase distribution corresponding to each time is also stored in the display condition table 4361 outside the display area shown in the display condition table 4362.
  • each phase distribution can be displayed in an appropriate display area in accordance with the display timing.
  • the display condition tables 4361 and 4362 include the key arrangement itself, the key arrangement itself may not be included in the display condition tables 4361 and 4362.
  • control condition setting unit 435 sets a synchronization condition for synchronizing the switching timing of the light emitting unit 330 and the timing of opening the optical shutter 13.
  • the control condition setting unit 435 outputs the set synchronization condition to the control condition output unit 436.
  • the control condition setting unit 435 sets a synchronization condition for opening the optical shutter 13 in synchronization with the timing at which the light emitting unit 330 emits light in the display area where the phase distribution with the valid key flag is displayed.
  • the control condition setting unit 435 sets a condition for opening the optical shutter 13 for a predetermined time in a time range included in the time zone in which the light emitting unit 330 emits light at the position of the phase distribution to which the valid key flag is attached.
  • FIG. 26 is a synchronization condition table 4371 as an example of the synchronization condition set by the control condition setting unit 435.
  • the synchronization condition table 4371 includes a specific time, a light emitting unit 330 operated at that time, and a shutter open flag indicating whether or not to open the optical shutter 13 at that time.
  • the shutter open flag is “1” in the synchronization condition table 4371
  • the optical shutter 13 is controlled to open.
  • the shutter open flag is “1”
  • the optical shutter 13 may be set to be closed when a predetermined time elapses after the optical shutter 13 is opened.
  • the shutter open flag is “0”, it indicates that the optical shutter 13 is kept closed.
  • the light emitting unit A1 is controlled to emit light.
  • the shutter open flag of the synchronization condition table 4371 is “0”
  • the optical shutter 13 remains closed.
  • the time “AA: BB: CC” indicates AA hour BB minute CC second, and the period “.” Or less indicates a time shorter than 1 second.
  • the light emitting unit A4 is controlled to emit light.
  • the shutter open flag of the synchronization condition table 4371 is “1”
  • the optical shutter 13 is controlled to open.
  • the optical shutter 13 may be controlled to open at the same time as the time “AA: BB: CC.000400”, but for a predetermined time (such as time “AA: BB: CC.000410”).
  • the optical shutter 13 may be controlled to open after the first time) has elapsed.
  • the opened optical shutter 13 is set to close when a predetermined time (second time) elapses.
  • the second time is set to a time range included between the time when the shutter opening flag is set to “1” and the next time.
  • the second time is included in the time range (0.0001 seconds) between the time “AA: BB: CC.000400” and the time “AA: BB: CC.000500”.
  • the optical shutter 13 is opened at the time “AA: BB: CC.000410” and the time “AA: BB”. : CC.000490 ”.
  • the phase distribution of the display condition table 4361 is displayed in each display area of the spatial modulation element 36 at time “AA: BB: CC.000100”. Then, in accordance with the time “AA: BB: CC.000100”, the light emitting unit A1 irradiates the display area A1 of the spatial modulation element 36 with the light 340. The light emitting unit 330 is switched every 0.0001 seconds. At time “AA: BB: CC.000400”, the light emitting unit A4 irradiates the display area A4 with light 340. At this time, the optical shutter 13 is opened when the first time has elapsed from the time “AA: BB: CC.000400” and the second time has elapsed from the time “AA: BB: CC.000400”. Closed.
  • the optical shutter 13 is opened. Therefore, since the user views the operation area 12 through the optical shutter 13, the user can recognize an effective key arrangement from a plurality of key arrangements displayed one after another in the operation area 12.
  • FIG. 27 is a conceptual diagram in which the light irradiation timing of the light source 33 is associated with the shutter opening timing of the optical shutter 13.
  • the response of the liquid crystal corresponds to the timing at which the phase distribution is displayed on the display unit of the spatial modulation element 36.
  • a key arrangement is displayed in each display area of the display section of the spatial modulation element 36 as shown in FIG. Note that the images displayed in the display areas in FIG. 12 are actually phase distributions.
  • the plurality of light emitting units 330 of the light source 33 emit light toward a display area corresponding to each light emitting unit 330 under the control of the light source control unit 32.
  • FIG. 27 shows that 15 light emitting units 330 are switched one after another within one liquid crystal response period to emit light.
  • the on / off state of the liquid crystal, the switching of the light emitting unit 330, and the opening timing of the shutter 13 may be constant or may not be constant. In other words, the shutter 13 may be set to open at the timing when the effective key arrangement which is a desired image is displayed in the operation area 12.
  • the shutter control unit 44 controls to open the optical shutter 13 at the timing when the effective key array is irradiated with light on the display area of the spatial modulation element 36 when the 15 light emitting units 330 are switched.
  • the shutter control unit 44 can open the optical shutter 13 at the timing when the effective key array is projected onto the operation area 12 by following the synchronization condition acquired from the control condition generation unit 413.
  • the control condition output unit 436 acquires display conditions and synchronization conditions from the control condition setting unit 435.
  • the control condition output unit 436 outputs a control condition including the acquired display condition and synchronization condition to the projection unit 30.
  • FIG. 28 is a block diagram illustrating a configuration of the operation information generation unit 415.
  • the operation information generation unit 415 includes an image information reception unit 451, an operation content determination unit 452, an effective key array reception unit 453, an effective key array storage unit 454, an operation information generation unit 455, and an operation information output unit 456.
  • the image information receiving unit 451 acquires the image information of the operation area 12 captured by the imaging unit 20.
  • the image information receiving unit 451 outputs the acquired image information to the operation content determination unit 452.
  • the operation content determination unit 452 analyzes the acquired image information and determines the operation content performed by the user in the operation area 12. For example, the operation content determination unit 452 determines the operation position pointed to the operation area 12 by the user at a certain time as the operation content, and generates operation position information in which time information is associated with the determined operation position. That is, the operation content determination unit 452 analyzes the image information captured by the imaging unit 20, determines the operation position instructed by the user to the operation area 12, and determines the time at which the user instructed the operation position and the operation position. Operation position information is generated by associating.
  • the operation content determination unit 452 can convert the determined operation position into coordinates of the orthogonal coordinate system.
  • the origin is set at the vertex of the lower left corner of the operation area 12.
  • Each symbol included in a 4 ⁇ 3 matrix matrix key pattern is projected to an operation position (dashed line) to which numbers 1 to 12 are assigned.
  • the operation position 1 is set within a rectangle having (X1, Y5), (X1, Y4), (X2, Y4), and (X2, Y5) as vertices. Other operation positions are set similarly.
  • the operation content determination unit 452 recognizes that an operation is performed in a rectangle having (X3, Y4), (X3, Y3), (X4, Y3), and (X4, Y4) as vertices at a certain time, It is determined that the operation position 10 is instructed at that time.
  • the operation content determination unit 452 outputs operation position information in which the operation position instructed by the user is associated with time information to the operation information generation unit 455. Note that the operation content determination unit 452 may be configured to output operation position information in which the coordinates of the operation position are associated with time information.
  • the valid key array receiving unit 453 receives the valid key array from the control condition generating unit 413.
  • the valid key array receiving unit 453 stores the received valid key array in the valid key array storage unit 454.
  • the effective key array storage unit 454 stores the received effective key array.
  • the operation information generation unit 455 associates the operation position in the operation area 12 determined by the operation content determination unit 452 with the valid key layout stored in the valid key layout storage unit 454, and performs the key operation performed by the user. Generate information. That is, the operation information generation unit 455 generates key operation information in which the operation position information determined by the operation content determination unit 452 is associated with valid display information.
  • the operation information output unit 456 outputs the key operation information generated by the operation information generation unit 455. For example, when assuming the collation system 1 as illustrated in FIG. 16, the operation information output unit 456 outputs the operation information to the server 102.
  • Each symbol included in the key array is projected to a predetermined position in the operation area 12 by the projection means 30.
  • the first symbol of the key arrangement is projected to the operation position 1
  • the second symbol is projected to the operation position 2,...
  • the fifteenth symbol is projected to the operation position 15.
  • the operation information generation unit 415 specifies the operation position in time series from the user's operation included in the image information, and associates the position where the symbols constituting the effective key array are projected with the operation position, and is input by the user Generate key operation information.
  • Patent Document 1 Japanese Patent No. 4911225 discloses a display system that switches a plurality of display information including effective display information to be recognized by a user at high speed.
  • the system of Patent Document 1 has an optical shutter that opens at the timing when valid display information is displayed. A lot of display information is displayed one after another on the display unit of the system of Patent Document 1. Therefore, a person watching the display unit without passing through the optical shutter recognizes meaningless information in which all display information is synthesized as shown in the left diagram of FIG.
  • the optical shutter opens at the display timing of the effective display information, the user who is looking at the display unit through the optical shutter can recognize the confidential information displayed on the display unit.
  • different display information displayed in different display areas of the spatial modulation element 36 is sequentially projected onto the operation area 12 by switching the plurality of light emitting units 330.
  • 15 types of phase images can be simultaneously written on the display unit of the spatial modulation element 36 by a single liquid crystal response. Therefore, in the present embodiment, switching of display information to be projected onto the operation area 12 is not limited by the response speed of the liquid crystal, and display information can be switched at a higher speed than the system of Patent Document 1.
  • the laser pulse may be set to about 20 microseconds, for example.
  • a MEMS type optical shutter 13 is used, a response of 20 microseconds is possible. If the response speed of the optical shutter 13 is set to 40 microseconds, the apparent operation speed is 25000 fps. In order to capture an image displayed at this operation speed, a camera of the 100,000 fps class is required. This class of high-speed camera is very special and large in size, so it is difficult to use it for peeking at effective display information.
  • the display pattern can be increased by increasing the number of divisions of the display area of the spatial modulation element.
  • the number of display patterns is about 300 to 450. At this level, it becomes difficult to narrow down combinations of user's finger movements and display patterns.
  • the information input device 10 can display 90 types of patterns per frame when writing is performed three times per frame on the display unit of the spatial modulation element 26. If all the patterns are different, the information input device 10 can project 5400 types of patterns in one second onto the operation area 12 in 5 seconds. If there are about 1000 patterns that are generated multiple times including valid display information, even if all the patterns are recorded, it is very many to examine the correspondence between the user's finger movements and patterns. You must try a combination.
  • the information input device of the present embodiment it is difficult to capture the display information with the camera by switching the display information projected onto the operation area at high speed, and the confidentiality of the input information is improved. It becomes possible to improve.
  • the number of display patterns per cycle is significantly increased, so the number of combinations of user operations and display patterns is dramatically increased, and user operations are estimated. It becomes difficult.
  • FIG. 30 is a schematic diagram of an information input device 10-1 according to a modification of the present embodiment.
  • the information input device 10-1 arranges a projection device 381 that projects display information on the back side of the operation area 12.
  • the projection device 381 projects display information onto the operation area 12 from the back side in the direction in which the user looks.
  • a rear type screen may be used for the operation area 12.
  • a mirror surface may be arranged between the projection device 381 and the operation region 12, and the projection direction of the display information by the projection device 381 may be guided to the operation region 12 by the mirror surface.
  • the phase distribution of the key arrangement (also referred to as display information) stored in the pattern storage unit 433 of the control condition generation unit 413 is stored not for each key arrangement but for each symbol constituting the key arrangement.
  • the information input device according to the present embodiment may have the same configuration as the information input device 10 according to the first embodiment.
  • FIG. 31 is an example of a phase distribution table 4342 stored in the information input device according to the present embodiment.
  • the phase distribution table 4342 stores a phase distribution of an image in which each symbol included in the key array is associated with each operation position in the operation area 12.
  • an identification symbol is attached to each phase distribution.
  • the positions of “X” and “#” are fixed at the lower right operation position.
  • the key array corresponding to the phase distribution of the phase distribution table 4342 may be referred to as a partial key array, and the phase distribution corresponding to the partial key array may be referred to as a partial pattern.
  • the phase distribution table 4342 stores 10 partial patterns corresponding to 10 operation positions for each of 10 symbols from 0 to 9. That is, the phase distribution table 4342 stores 100 partial patterns.
  • each partial pattern may be displayed at random in each display area of the spatial modulation element 26.
  • the spatial modulation element 26 may display the partial pattern according to a predetermined rule instead of random.
  • FIG. 32 is a conceptual diagram in which the light irradiation timing of the light source 33 and the timing of opening the shutter of the optical shutter 13 are associated in the present embodiment.
  • a partial key array that forms each symbol of 0 to 9 is selected one by one from the phase distribution displayed on the display unit of the spatial modulation element 26 to configure a key array. Therefore, in the present embodiment, as shown in FIG. 32, the optical shutter 13 may be opened a plurality of times at one writing timing with respect to the spatial modulation element 26.
  • 120 patterns can be written in four writes.
  • the key array is composed of 10 symbols 0 to 9
  • the pattern storage unit 433 stores a partial pattern in which a partial key arrangement in which at least one symbol is arranged among a plurality of symbols arranged in a matrix format is displayed in the operation area 12.
  • the pattern selection unit 434 selects a plurality of partial patterns from the pattern storage unit 433.
  • the control condition setting unit 435 sets a condition for displaying the key arrangement in the operation area 12 as a display condition by displaying a plurality of partial patterns on the display surface of the spatial modulation element 36. At this time, the control condition setting unit 435 sets a condition for opening the optical shutter 13 in accordance with the operation timing of the light emitting unit 330 that irradiates light to the display area where the partial pattern of the partial key arrangement constituting the effective key arrangement is displayed. Set as a synchronization condition.
  • the information input device can dramatically reduce the number of phase distributions of display information to be stored. Therefore, it is possible to reduce the storage area for the information input device to store the phase distribution.
  • the information input device according to the present embodiment has the same configuration as that of the information input device 10 according to the first embodiment, except for the configuration described below.
  • FIG. 33 is a block diagram showing the configuration of the key array storage unit 412-2 of the information input device according to this embodiment.
  • the key array storage unit 412-2 of this embodiment has a configuration in which a key array generation unit 425 is added to the key array storage unit 412 of the first embodiment.
  • the key array generation unit 425 generates a key array to be displayed in the operation area 12. For example, the key arrangement generation unit 425 generates the number of key arrangements according to the request of the control condition generation unit 413. The key array generation unit 425 may generate as many key arrays as the number of key arrays to be projected, or may generate an extra number of key arrays than the number of key arrays to be projected. The key array generation unit 425 outputs the generated key array to the key array reception unit 421.
  • the key arrangement receiving unit 421 transmits the key arrangement generated by the key arrangement generation unit 425 to the server 102 and requests a phase distribution corresponding to the key arrangement.
  • the key arrangement reception unit 421 transmits the phase distribution to the control condition generation unit 413 in association with the key arrangement.
  • the control condition generation unit 413 stores the received phase distribution in the phase distribution storage unit 433 in association with the key arrangement.
  • the number of phase distributions corresponding to the number of key arrays to be projected may be stored in the pattern storage unit 433. Therefore, according to the information input device according to the present embodiment, the storage capacity of the key array storage unit 422 and the pattern storage unit 433 can be reduced.
  • the information input device 10-3 includes a verification unit 50.
  • the collating unit 50 is a unit that collates authentication information of a user who uses the host system of the information input device 10-3.
  • FIG. 35 is a block diagram showing a configuration of the collation means 50 according to the present embodiment.
  • the verification unit 50 includes an operation information acquisition unit 501, an operation information verification unit 502, an authentication information storage unit 503, and a verification result output unit 504.
  • the operation information acquisition unit 501 acquires key operation information from the processing unit 41.
  • the operation information acquisition unit 501 outputs the acquired key operation information to the operation information collation unit 502.
  • the operation information matching unit 502 receives the key operation information from the operation information acquisition unit 501 and acquires the authentication information of the user who has input the received key operation information from the authentication information storage unit 503.
  • the authentication information storage unit 503 stores authentication information of users who use the host system of the information input device 10-3.
  • the operation information collation unit 502 collates the user's key operation included in the input key operation information with the user's authentication information acquired from the authentication information storage unit 503.
  • the operation information collation unit 502 outputs the collation result to the collation result output unit 504.
  • the collation result output unit 504 transmits the collation result to the host system.
  • the information input device can be completed within the device itself, so that delays and failures caused by the network can be avoided.
  • the storage device of the information input device is limited, it is suitable for applications where the number of users is limited.
  • the information input device according to the present embodiment is suitable for authentication or the like used when a registered small number of users enter a specific facility.
  • the computer 90 in FIG. 36 is a configuration example for enabling the information input device according to each embodiment, and does not limit the scope of the present invention.
  • the information input device according to each embodiment may be a microcomputer having the function of the computer 90 of FIG. 36 in the case of the interface device 11 as shown in FIG.
  • the computer 90 includes a processor 91, a main storage device 92, an auxiliary storage device 93, an input / output interface 95, and a communication interface 96.
  • the processor 91, the main storage device 92, the auxiliary storage device 93, the input / output interface 95, and the communication interface 96 are connected to each other via a bus 99 so as to exchange data.
  • the processor 91, the main storage device 92, the auxiliary storage device 93, and the input / output interface 95 are connected to a network such as the Internet or an intranet via a communication interface 96.
  • the computer 90 is connected to a host system server or computer via a network, and receives key layout information and the like from the host system.
  • the processor 91 expands the program stored in the auxiliary storage device 93 or the like in the main storage device 92, and executes the expanded program.
  • a configuration using a software program installed in the computer 90 may be adopted.
  • the processor 91 executes arithmetic processing and control processing of the information input device according to the present embodiment.
  • the main storage device 92 has an area where the program is expanded.
  • the main storage device 92 may be a volatile memory such as a DRAM (Dynamic Random Access Memory). Further, a nonvolatile memory such as MRAM (Magnetoresistive Random Access Memory) may be configured and added as the main storage device 92.
  • DRAM Dynamic Random Access Memory
  • MRAM Magnetic Random Access Memory
  • the auxiliary storage device 93 is means for storing data such as phase distribution of display information and key arrangement.
  • the auxiliary storage device 93 is configured by a local disk such as a hard disk or a flash memory. Note that the phase distribution of display information may be stored in the main storage device 92, and the auxiliary storage device 93 may be omitted.
  • the input / output interface 95 is a device that connects the computer 90 and peripheral devices based on the connection standard between the computer 90 and peripheral devices.
  • the communication interface 96 is an interface for connecting to a network such as the Internet or an intranet based on standards and specifications. In FIG. 36, the interface is abbreviated as I / F (Interface).
  • I / F Interface
  • the input / output interface 95 and the communication interface 96 may be shared as an interface connected to an external device.
  • the computer 90 may be configured so that input devices such as a keyboard, a mouse, and a touch panel can be connected as necessary. These input devices are used for inputting information and settings. Note that when the touch panel is used as an input device, the display unit of the display device may serve as the input unit of the input device. Data exchange between the processor 91 and the input device may be mediated by the input interface 95.
  • the communication interface 96 is connected to a host system such as another computer or server through a network.
  • the host system transmits key arrangement information including the phase distribution of the display information and the key arrangement used in each embodiment of the present invention to the computer 90 via the communication interface 96.
  • the host system may generate the phase distribution of the display information used in each embodiment of the present invention by itself or may acquire it from another device.
  • the computer 90 may be provided with a display device for displaying various information.
  • the computer 90 is preferably provided with a display control device (not shown) for controlling the display of the display device.
  • the display device may be connected to the computer 90 via the input interface 95.
  • the computer 90 may be provided with a reader / writer as necessary.
  • the reader / writer is connected to the bus 99 and reads a data program from the recording medium and writes a processing result of the computer 90 to the recording medium between the processor 91 and a recording medium (program recording medium) (not shown).
  • the recording medium can be realized by a semiconductor recording medium such as an SD (Secure Digital) card or a USB (Universal Serial Bus) memory.
  • the recording medium 516 may be realized by a magnetic recording medium such as a flexible disk, an optical recording medium such as a CD (Compact Disk) and a DVD (Digital Versatile Disk), and other recording media.
  • the above is an example of a hardware configuration for enabling the information input device according to each embodiment of the present invention.
  • the components of the information input device according to each embodiment of the present invention are realized as one function of hardware as shown in FIG.
  • FIG. 36 is an example of a hardware configuration for enabling the information input device according to each embodiment, and does not limit the scope of the present invention.
  • a processing program that causes a computer to execute processing by the information input device according to each embodiment is also included in the scope of the present invention.
  • a program recording medium recording the processing program according to each embodiment is also included in the scope of the present invention.
  • the information input device of the present invention can be used as an input device for a user to input authentication information such as an authentication password in an ATM (Automatic Teller Machine) or an entrance gate. Moreover, the information input device of the present invention can be used as a device for inputting information so that a user is not recognized by a third party.
  • authentication information such as an authentication password in an ATM (Automatic Teller Machine) or an entrance gate.
  • the information input device of the present invention can be used as a device for inputting information so that a user is not recognized by a third party.

Abstract

The purpose of the present invention is to allow the secrecy of inputted information to be improved. This information input device comprises: a projection means which has a spatial modulation element having a plurality of display regions and a light source including a plurality of light-emitting parts, and which projects display information in an operation region; a shutter mechanism that opens in correspondence with the timing when effective display information included in the display information is displayed in the operation region; an imaging means for acquiring the operation details in the operation region as image information; and a control means for setting control conditions including a display condition for displaying a pattern for displaying the display information in the operation region on the display part of the spatial modulation element and a synchronization condition used to match the timing for switching the plurality of light-emitting parts and the timing for opening the shutter mechanism while outputting operation information in which the image information acquired by the imaging means matches the effective display information.

Description

情報入力装置および照合システムInformation input device and verification system
　本発明は、情報入力装置および照合システムに関する。特に、認証パスワードなどの情報入力に用いられる情報入力装置および照合システムに関する。 The present invention relates to an information input device and a verification system. In particular, the present invention relates to an information input device and a verification system used for inputting information such as an authentication password.
　公共の場に設置されたＡＴＭ（Automatic Teller Machine）などのシステムには、認証パスワードなどの情報を入力するための入力装置が設置されている。例えば、システムの利用者は、入力装置のタッチパネルに表示されたテンキーに従って情報を入力する。一般的な入力装置では、利用者が入力装置に情報を入力している際に、第三者がその情報を覗き見る危険性がある。 An input device for inputting information such as an authentication password is installed in a system such as ATM (Automatic Teller Machine) installed in a public place. For example, the system user inputs information according to a numeric keypad displayed on the touch panel of the input device. In a general input device, when a user inputs information to the input device, there is a risk that a third party may look into the information.
　特許文献１には、第三者による覗き見を防止する表示システムについて開示されている。特許文献１の表示システムでは、利用者に認識させるべき有効表示情報と、その有効表示情報と同種で内容の異なるダミー表示情報とを高速で切り替えて表示部に表示する。利用者は、高速で切り替わる画像に同期して開閉するシャッタを通して表示部に表示された有効表示情報を認識する。それに対し、第三者は、表示部に表示されたどの表示情報が有効表示情報であるのかを認識することができない。そのため、利用者は、第三者が認識できないように情報を入力装置に入力することができる。 Patent Document 1 discloses a display system that prevents peeping by a third party. In the display system of Patent Document 1, effective display information to be recognized by the user and dummy display information of the same type and different content from the effective display information are switched at high speed and displayed on the display unit. The user recognizes effective display information displayed on the display unit through a shutter that opens and closes in synchronization with an image that switches at high speed. In contrast, a third party cannot recognize which display information displayed on the display unit is effective display information. Therefore, the user can input information to the input device so that a third party cannot recognize it.
特許第４９１１２２５号公報Japanese Patent No. 4911225
　特許文献１のシステムの表示装置に表示できる画像のフレームレートは、３６０フレーム毎秒（以下、ｆｐｓ：frames per second）程度である。この程度のフレームレートだと、１０００ｆｐｓクラスの高速度カメラで撮影することによって、シャッタを介さなくても表示部に表示された画像群が認識される可能性がある。そのため、特許文献１のシステムでは、表示部に表示された画像群に含まれる画像と、使用者の指の動きとを高速度カメラを用いて撮影することによって、使用者が入力した情報の候補を絞られる可能性がある。 The frame rate of an image that can be displayed on the display device of the system of Patent Document 1 is about 360 frames per second (hereinafter referred to as fps: frames per second). With such a frame rate, there is a possibility that an image group displayed on the display unit is recognized without taking a shutter by shooting with a high-speed camera of 1000 fps class. For this reason, in the system of Patent Document 1, a candidate of information input by the user is obtained by photographing an image included in the image group displayed on the display unit and the movement of the user's finger using a high-speed camera. May be squeezed.
　本発明の目的は、上述した課題を解決するため、表示情報を高速で切り替えることによって、入力された情報の秘密性を向上させることを可能とする情報入力装置を提供することにある。 An object of the present invention is to provide an information input device capable of improving the confidentiality of input information by switching display information at high speed in order to solve the above-described problems.
　本発明の情報入力装置は、複数の表示領域に区分けされる表示部を有する空間変調素子と、複数の表示領域のそれぞれに対応付けられた複数の発光部を含む光源とを有し、光源から空間変調素子の表示部に照射された光を基に形成される表示情報を操作領域に投射する投射手段と、操作領域の上方に配置され、表示情報に含まれる有効表示情報が操作領域に表示されるタイミングに合わせて開くシャッタ機構と、操作領域上での操作内容を画像情報として取得する撮像手段と、操作領域に表示情報を表示させるためのパターンを空間変調素子の表示部に表示させる表示条件と、複数の発光部を切り替えるタイミングとシャッタ機構を開くタイミングとを合わせる同期条件とを含む制御条件を設定するとともに、撮像手段に取得された画像情報から確定された操作内容と有効表示情報とを対応させた操作情報を出力する制御手段とを備える。 An information input apparatus according to the present invention includes a spatial modulation element having a display section divided into a plurality of display areas, and a light source including a plurality of light emitting sections associated with each of the plurality of display areas. Projection means for projecting display information formed on the display area of the spatial modulation element based on the light to the operation area, and effective display information included in the display information is displayed in the operation area. A shutter mechanism that opens in accordance with the timing to be operated, an imaging means for acquiring the operation content on the operation area as image information, and a display for displaying a pattern for displaying display information in the operation area on the display unit of the spatial modulation element Control conditions including a condition and a synchronization condition that matches a timing for switching a plurality of light emitting units and a timing for opening the shutter mechanism, and the image information acquired by the imaging unit is set. And control means for outputting an operation information associated with a the determined operation content and effective display information from.
　本発明の照合システムは、複数の表示領域に区分けされる表示部を有する空間変調素子と、複数の表示領域のそれぞれに対応付けられた複数の発光部を含む光源とを有し、光源から空間変調素子の表示部に照射された光を基に形成される表示情報を操作領域に投射する投射手段と、操作領域の上方に配置され、表示情報に含まれる有効表示情報が操作領域に表示されるタイミングに合わせて開くシャッタ機構と、操作領域上での操作内容を画像情報として取得する撮像手段と、操作領域に表示情報を表示させるためのパターンを空間変調素子の表示部に表示させる表示条件と、複数の発光部を切り替えるタイミングとシャッタ機構を開くタイミングとを合わせる同期条件とを含む制御条件を設定するとともに、撮像手段に取得された画像情報から確定された操作内容と有効表示情報とを対応させた操作情報を出力する制御手段とを備える情報入力装置と、情報入力装置から操作情報をネットワーク経由で取得し、自装置が記憶する認証情報と操作情報とを照合し、操作情報と認証情報との照合結果を上位システムに送信するサーバとを備える。 A collation system of the present invention includes a spatial modulation element having a display section divided into a plurality of display areas, and a light source including a plurality of light emitting sections associated with each of the plurality of display areas. Projection means for projecting display information formed on the light irradiated onto the display section of the modulation element to the operation area, and effective display information included in the display information is displayed in the operation area. A shutter mechanism that opens in accordance with the timing to be operated, an imaging means for acquiring operation contents on the operation area as image information, and a display condition for displaying a pattern for displaying display information in the operation area on the display unit of the spatial modulation element And a control condition that includes a timing for switching a plurality of light emitting units and a synchronization condition for matching the timing for opening the shutter mechanism, and the image information acquired by the imaging means. Information input device comprising a control means for outputting operation information in which the operation content determined from the information and the effective display information are associated with each other, and authentication information acquired from the information input device via the network and stored in the own device And a server that transmits the verification result of the operation information and the authentication information to the host system.
　本発明によれば、表示情報を高速で切り替えることによって、入力された情報の秘密性を向上させることを可能とする情報入力装置を提供することが可能になる。 According to the present invention, it is possible to provide an information input device capable of improving the confidentiality of input information by switching display information at high speed.
本発明の第１の実施形態に係る情報入力装置の外観を示す概念図である。It is a conceptual diagram which shows the external appearance of the information input device which concerns on the 1st Embodiment of this invention. 本発明の第１の実施形態に係る情報入力装置が操作領域に投射する表示情報の一例を示す概念図である。It is a conceptual diagram which shows an example of the display information which the information input device which concerns on the 1st Embodiment of this invention projects on an operation area | region. 本発明の第１の実施形態に係る情報入力装置がネットワークを介してサーバに接続されている照合システムの概念図である。It is a conceptual diagram of the collation system by which the information input device which concerns on the 1st Embodiment of this invention is connected to the server via the network. 本発明の第１の実施形態に係る情報入力装置の構成を示す概念図である。It is a conceptual diagram which shows the structure of the information input device which concerns on the 1st Embodiment of this invention. 本発明の第１の実施形態に係る情報入力装置によって表示情報を操作領域に投射し、その操作領域を撮像する一例を示す概念図である。It is a conceptual diagram which shows an example which projects display information on an operation area with the information input device which concerns on the 1st Embodiment of this invention, and images the operation area. 本発明の第１の実施形態に係る情報入力装置が備える撮像手段の構成を示すブロック図である。It is a block diagram which shows the structure of the imaging means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の構成を示すブロック図である。It is a block diagram which shows the structure of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の光学系の構成を示すブロック図である。It is a block diagram which shows the structure of the optical system of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の光源の構成を示すブロック図である。It is a block diagram which shows the structure of the light source of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の光源を実現化するレーザアレイの一例を示す概念図である。It is a conceptual diagram which shows an example of the laser array which implement | achieves the light source of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の光源の制御例を示す概念図である。It is a conceptual diagram which shows the example of control of the light source of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の空間変調素子の表示部にキー配列を割り当てる一例を示す概念図である。It is a conceptual diagram which shows an example which allocates a key arrangement | sequence to the display part of the spatial modulation element of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の空間変調素子の表示部にキー配列を割り当てる別の一例を示す概念図である。It is a conceptual diagram which shows another example which allocates a key arrangement | sequence to the display part of the spatial modulation element of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の構成を示すブロック図である。It is a block diagram which shows the structure of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える投射手段の光源によって表示情報を投射し、撮像手段であるカメラによってその表示情報を撮像する一例を示す概念図である。It is a conceptual diagram which shows an example which projects display information with the light source of the projection means with which the information input device which concerns on the 1st Embodiment of this invention is equipped, and images the display information with the camera which is an imaging means. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部の構成を示すブロック図である。It is a block diagram which shows the structure of the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれるキー配列格納部の構成を示すブロック図である。It is a block diagram which shows the structure of the key arrangement | sequence storage part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれるキー配列格納部のキー配列記憶部に記憶されるキー配列の一例を示すテーブルである。It is a table which shows an example of the key arrangement memorized by the key arrangement storage part of the key arrangement storage part contained in the processing part of the control means with which the information input device concerning a 1st embodiment of the present invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれるキー配列格納部のキー配列出力部から出力されるキー配列情報の一例を示すテーブルである。It is a table which shows an example of the key arrangement | sequence information output from the key arrangement | sequence output part of the key arrangement | sequence storage part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部の構成を示すブロック図である。It is a block diagram which shows the structure of the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部のキー配列選択部によってフラグが付けられたテーブルの一例である。It is an example of the table to which the flag was attached | subjected by the key arrangement selection part of the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部のパターン記憶部に記憶される位相分布の一例を示すテーブルである。It is a table which shows an example of phase distribution memorized by the pattern storage part of the control condition generation part contained in the processing part of the control means with which the information input device concerning a 1st embodiment of the present invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部の制御条件設定部によってフラグが付けられたテーブルの一例である。It is an example of the table to which the flag was attached | subjected by the control condition setting part of the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部によって生成される表示条件の一例を示すテーブルである。It is a table which shows an example of the display conditions produced | generated by the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部によって生成される表示条件の別の一例を示すテーブルである。It is a table which shows another example of the display conditions produced | generated by the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部によって生成される同期条件の一例を示すテーブルである。It is a table which shows an example of the synchronous condition produced | generated by the control condition production | generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が備える制御手段が、空間変調素子の表示部の液晶応答に対応させて光源の発光部を切り替えるタイミングと光シャッタを開くタイミングとを同期させる例を示す概念図である。An example in which the control means included in the information input device according to the first embodiment of the present invention synchronizes the timing of switching the light emitting unit of the light source and the timing of opening the optical shutter in response to the liquid crystal response of the display unit of the spatial modulation element. FIG. 本発明の第１の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる操作情報生成部の構成を示すブロック図である。It is a block diagram which shows the structure of the operation information generation part contained in the process part of the control means with which the information input device which concerns on the 1st Embodiment of this invention is provided. 本発明の第１の実施形態に係る情報入力装置が表示情報を投射する操作領域上に直交座標系を設定する一例である。It is an example which sets an orthogonal coordinate system on the operation area | region where the information input device which concerns on the 1st Embodiment of this invention projects display information. 本発明の第１の実施形態に係る情報入力装置の変形例の構成を示す概念図である。It is a conceptual diagram which shows the structure of the modification of the information input device which concerns on the 1st Embodiment of this invention. 本発明の第２の実施形態に係る情報入力装置が備える制御手段の処理部に含まれる制御条件生成部のパターン記憶部に記憶される位相分布の一例を示すテーブルである。It is a table which shows an example of phase distribution memorized by the pattern storage part of the control condition generation part contained in the processing part of the control means with which the information input device concerning a 2nd embodiment of the present invention is provided. 本発明の第２の実施形態に係る情報入力装置が備える制御手段が、空間変調素子の表示部の液晶応答に対応させて光源の発光部を切り替えるタイミングと光シャッタを開くタイミングとを同期させる例を示す概念図である。An example in which the control means provided in the information input device according to the second embodiment of the present invention synchronizes the timing of switching the light emitting unit of the light source and the timing of opening the optical shutter in response to the liquid crystal response of the display unit of the spatial modulation element. FIG. 本発明の第３の実施形態に係る情報入力装置が備える制御手段の処理部に含まれるキー配列格納部の構成を示すブロック図である。It is a block diagram which shows the structure of the key arrangement | sequence storage part contained in the process part of the control means with which the information input device which concerns on the 3rd Embodiment of this invention is provided. 本発明の第４の実施形態に係る情報入力装置の構成を示す概念図である。It is a conceptual diagram which shows the structure of the information input device which concerns on the 4th Embodiment of this invention. 本発明の第４の実施形態に係る情報入力装置が備える照合手段の構成を示すブロック図である。It is a block diagram which shows the structure of the collation means with which the information input device which concerns on the 4th Embodiment of this invention is provided. 本発明の各実施形態に係る情報入力装置のハードウェア構成の一例を示すブロック図である。It is a block diagram which shows an example of the hardware constitutions of the information input device which concerns on each embodiment of this invention.
　以下に、本発明を実施するための形態について図面を用いて説明する。ただし、以下に述べる実施形態には、本発明を実施するために技術的に好ましい限定がされているが、発明の範囲を以下に限定するものではない。なお、以下の実施形態の説明に用いる全図においては、特に理由が無い限り、同様箇所には同一符号を付す。また、以下の実施形態において、同様の構成・動作に関しては繰り返しの説明を省略する場合がある。 Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. However, the preferred embodiments described below are technically preferable for carrying out the present invention, but the scope of the invention is not limited to the following. In all the drawings used for the description of the following embodiments, the same reference numerals are given to the same parts unless there is a particular reason. In the following embodiments, repeated description of similar configurations and operations may be omitted.
　（実施形態）
　図１は、本発明の第１の実施形態に係る情報入力装置１０の外観を示す。図１は、ユーザが情報入力装置１０に情報を入力しているイメージである。 (Embodiment)
FIG. 1 shows an appearance of an information input device 10 according to the first embodiment of the present invention. FIG. 1 is an image in which a user inputs information to the information input device 10.
　情報入力装置１０は、ユーザの操作を受け付ける操作領域１２に表示情報を投射するとともに、操作領域１２になされた操作を撮像するインターフェース装置１１を備える端末である。インターフェース装置１１には、内蔵された撮像素子が操作領域１２を撮像するためのカメラ窓１１２と、表示情報を投射するための投射窓１１３とが設けられている。 The information input device 10 is a terminal provided with an interface device 11 that projects display information on an operation area 12 that receives a user operation and images an operation performed on the operation area 12. The interface device 11 is provided with a camera window 112 for the built-in image sensor to image the operation area 12 and a projection window 113 for projecting display information.
　インターフェース装置１１は、位相変調型の空間変調素子と、その空間変調素子の表示部に光を照射する複数の発光部を有する光源とを含む投射手段を備える。インターフェース装置１１は、光源から出射した光を空間変調素子の表示部で反射させ、操作領域１２に表示情報を投射する。 The interface device 11 includes a projecting unit including a phase modulation type spatial modulation element and a light source having a plurality of light emitting units for irradiating light to the display unit of the spatial modulation element. The interface device 11 reflects the light emitted from the light source by the display unit of the spatial modulation element, and projects the display information on the operation area 12.
　インターフェース装置１１の空間変調素子の表示部は、複数の表示領域に区切られており、各表示領域には互いに異なる画像を表示することができる。インターフェース装置１１の光源を構成する複数の発光部は、空間変調素子の各表示領域に対応付けて設けられている。インターフェース装置１１は、光を出射する発光部を切り替えることによって、光を照射する表示領域を切り替える。すなわち、インターフェース装置１１が光源を切り替えるたびに、操作領域１２に投射される表示情報が次々に切り替えわることになる。 The display unit of the spatial modulation element of the interface device 11 is divided into a plurality of display areas, and different images can be displayed in each display area. The plurality of light emitting units constituting the light source of the interface device 11 are provided in association with each display region of the spatial modulation element. The interface apparatus 11 switches the display area to which light is irradiated by switching the light emission part which radiate | emits light. That is, each time the interface device 11 switches the light source, the display information projected on the operation area 12 is sequentially switched.
　また、情報入力装置１０は、操作領域１２に表示された表示情報を認識するための光シャッタ１３（シャッタ機構とも呼ぶ）を備える。光シャッタ１３は、操作領域１２の上方に配置される。光シャッタ１３は、ユーザが操作領域１２に操作を行う際に、ユーザと操作領域１２との間に位置するように配置される。ユーザは、操作領域１２に操作を行う際に、光シャッタ１３を通して操作領域１２を認識する。 Further, the information input device 10 includes an optical shutter 13 (also referred to as a shutter mechanism) for recognizing display information displayed in the operation area 12. The optical shutter 13 is disposed above the operation area 12. The optical shutter 13 is disposed so as to be positioned between the user and the operation area 12 when the user performs an operation on the operation area 12. The user recognizes the operation area 12 through the optical shutter 13 when operating the operation area 12.
　光シャッタ１３は、インターフェース装置１１によってユーザが認識すべき表示情報（以下、有効表示情報）が操作領域１２に表示されたタイミングで開き、その他の表示情報が操作領域１２に表示されたタイミングでは閉じるように制御される。すなわち、光シャッタ１３は、複数の表示情報に含まれる有効表示情報が操作領域１２に表示されるタイミングに合わせて開く。そのため、光シャッタ１３を通して操作領域１２を見ているユーザのみが、操作領域１２に表示された有効表示情報を認識することができる。 The optical shutter 13 opens at a timing when display information (hereinafter referred to as effective display information) to be recognized by the user by the interface device 11 is displayed in the operation area 12, and closes at a timing when other display information is displayed in the operation area 12. To be controlled. In other words, the optical shutter 13 opens in accordance with the timing at which the effective display information included in the plurality of display information is displayed in the operation area 12. Therefore, only the user who is looking at the operation area 12 through the optical shutter 13 can recognize the effective display information displayed in the operation area 12.
　光シャッタ１３は、例えば以下の非特許文献１に記載されたようなＭＥＭＳ（Micro Electro Mechanical Systems）シャッタによって実現できる。ＭＥＭＳシャッタを用いれば、２０マイクロ秒程度の応答も可能である。
（非特許文献１）N.Hagood et.al., “A Direct-View MEMS Display for Mobile Applications,” SID Symposium Digest of Technical Papers, Vol.1(1), May 2007, pp.1278-1281(2007)
　また、光シャッタ１３は、液晶セルを挟んで互いに交差する一対の偏光子で構成された液晶シャッタによっても実現できる。液晶シャッタでは、駆動電圧を印可して液晶セルに含まれる液晶分子を再配向させ、液晶セルを通過する光の位相差を変化させることによって開閉制御することができる。数十マイクロ秒～数ミリ秒程度の応答速度でよければ、液晶シャッタを光シャッタ１３に適用することができる。 The optical shutter 13 can be realized by, for example, a MEMS (Micro Electro Mechanical Systems) shutter as described in Non-Patent Document 1 below. If a MEMS shutter is used, a response of about 20 microseconds is possible.
(Non-Patent Document 1) N. Hagood et.al., “A Direct-View MEMS Display for Mobile Applications,” SID Symposium Digest of Technical Papers, Vol.1 (1), May 2007, pp.1278-1281 (2007 )
The optical shutter 13 can also be realized by a liquid crystal shutter composed of a pair of polarizers that cross each other with a liquid crystal cell interposed therebetween. The liquid crystal shutter can be controlled to open and close by applying a driving voltage to realign liquid crystal molecules contained in the liquid crystal cell and changing the phase difference of light passing through the liquid crystal cell. If a response speed of several tens of microseconds to several milliseconds is sufficient, a liquid crystal shutter can be applied to the optical shutter 13.
　なお、本実施形態に係る光シャッタ１３を実現するものは、ＭＥＭＳシャッタや液晶シャッタに限らず、目的とする応答速度で動作するシャッタ機構であればよい。 In addition, what implement | achieves the optical shutter 13 which concerns on this embodiment is not restricted to a MEMS shutter and a liquid-crystal shutter, What is necessary is just the shutter mechanism which operate | moves with the target response speed.
　ここで、ＡＴＭ（Automatic Teller Machine）などの秘密情報を取り扱うシステムに情報入力装置１０を適用する利用シーンを想定する。 Here, a usage scene is assumed in which the information input device 10 is applied to a system that handles confidential information such as ATM (Automatic Teller Machine).
　インターフェース装置１１は、例えば「０～１、Ｘ、＃」の１２個の記号からなる行列形式のキー配列（表示情報とも呼ぶ）を操作領域１２に投射する。このとき、インターフェース装置１１は、ユーザに提示する有効キー配列（有効表示情報とも呼ぶ）とともに、有効キー配列とは異なるダミーのキー配列（ダミー表示情報）を次々に操作領域１２に投射する。 The interface device 11 projects, for example, a key arrangement (also referred to as display information) in a matrix format including 12 symbols “0 to 1, X, #” to the operation area 12. At this time, the interface device 11 projects a dummy key arrangement (dummy display information) different from the effective key arrangement to the operation area 12 one after another along with the effective key arrangement (also referred to as effective display information) to be presented to the user.
　図２は、操作領域１２に投射される表示情報の一例である。光シャッタ１３を通さない場合、操作領域１２に投射された表示情報は、図２の左図のように多くの記号が重なった意味不明な画像として認識される。一方、光シャッタ１３を通して操作領域１２を見る場合、図２の左図のような有効キー配列が認識される。そのため、ユーザは、光シャッタ１３を通して操作領域１２を見ることによって、操作領域１２に投射された有効キー配列に対して適切な操作をすることができる。 FIG. 2 is an example of display information projected on the operation area 12. When the optical shutter 13 is not passed, the display information projected on the operation area 12 is recognized as an unintelligible image in which many symbols overlap as shown in the left diagram of FIG. On the other hand, when the operation area 12 is viewed through the optical shutter 13, an effective key arrangement as shown in the left diagram of FIG. 2 is recognized. Therefore, the user can perform an appropriate operation on the effective key arrangement projected on the operation area 12 by viewing the operation area 12 through the optical shutter 13.
　なお、インターフェース装置１１は、キー配列を構成する各記号の並び順に従って、キー配列を構成する各記号を操作領域１２の所定の位置に投射する。そのため、有効キー配列が決まれば、操作領域１２のどの位置に各記号が配置されているのかを特定できる。 The interface device 11 projects each symbol constituting the key array to a predetermined position in the operation area 12 according to the arrangement order of the symbols constituting the key array. Therefore, if the effective key arrangement is determined, it is possible to specify at which position in the operation area 12 each symbol is arranged.
　例えば、図２の右図においては、左から１列目が「２、５、１、７」、２列目が「＃、６、９、３」、３列目が「４、８、０、Ｘ」の記号からなるキー配列である。これ以降、行列形式のキー配列は、左から１列目－１行目の記号を起点とし、各列に関して上の行から順番に記号を続けて表記する。そして、各列の右隣に列がある場合は、一番下の行の記号に続けてコンマ「，」を表記し、その後には右隣の列の記号を上から順番に並べて表記する。図２の右図のキー配列は、「２５１７，＃６９３，４８０Ｘ」と表記する。なお、コンマは省略してもよい。 For example, in the right diagram of FIG. 2, the first column from the left is “2, 5, 1, 7”, the second column is “#, 6, 9, 3”, and the third column is “4, 8, 0”. , X ”. Thereafter, the matrix-type key arrangement starts with the symbols in the first column and the first row from the left, and represents the symbols in order from the top row for each column. When there is a column to the right of each column, a comma “,” is written after the symbol in the bottom row, and thereafter, the symbols in the column on the right are arranged in order from the top. The key layout in the right diagram of FIG. 2 is expressed as “2517, # 693, 480X”. Note that commas may be omitted.
　「２５１７，＃６９３，４８０Ｘ」が有効キー配列として設定されると、４行×３列の行列形式において、１列目－１行目の位置に「２」、１列目－２行目の位置に「５」、・・・、３列目－４行目の位置に「Ｘ」が配置されることになる。すなわち、操作領域１２には、見た目では図２の左図のような意味不明な画像が表示されているが、実際には図２の右図のような有効キー配列が配置されていることになる。そのため、光シャッタ１３を通して操作領域１２を見たユーザによってなされた操作と、操作領域１２に配置された有効キー配列とを対応付けることによって、ユーザが入力した情報を特定することができる。 When “2517, # 693, 480X” is set as the valid key array, “2” is placed at the position of the first column and the first row in the 4 × 3 matrix format, and the first column and the second row. “5” at the position,..., “X” is arranged at the position of the third column to the fourth row. That is, in the operation area 12, an image whose meaning is not clear as shown in the left diagram of FIG. 2 is displayed, but an effective key layout as shown in the right diagram of FIG. 2 is actually arranged. Become. Therefore, the information input by the user can be specified by associating the operation performed by the user who viewed the operation area 12 through the optical shutter 13 with the effective key arrangement arranged in the operation area 12.
　図１のように、ユーザは、光シャッタ１３を通して操作領域１２を見る。そのため、ユーザ以外の人物は、ユーザの操作中に光シャッタ１３を直接覗き込むことは不可能である。本実施形態において、操作領域に表示される表示情報は、光源の切り替えに伴って切り替わる。そのため、本実施形態によれば、液晶の応答速度に律速されない高速な画像の切り替えが可能となる。 As shown in FIG. 1, the user views the operation area 12 through the optical shutter 13. Therefore, it is impossible for a person other than the user to look directly into the optical shutter 13 during the user's operation. In the present embodiment, the display information displayed in the operation area is switched as the light source is switched. Therefore, according to the present embodiment, high-speed image switching that is not limited by the response speed of the liquid crystal can be performed.
　図３は、本実施形態の情報入力装置１０を含む照合システム１の構成を示す概念図である。照合システム１は、情報入力装置１０によって取得されたキー操作情報に基づいてユーザ認証を行う。照合システム１は、ＡＴＭなどの上位システムに接続され、上位システムを利用するユーザのユーザ認証を行うシステムである。 FIG. 3 is a conceptual diagram showing a configuration of the verification system 1 including the information input device 10 of the present embodiment. The verification system 1 performs user authentication based on the key operation information acquired by the information input device 10. The verification system 1 is a system that is connected to an upper system such as ATM and performs user authentication of a user who uses the upper system.
　照合システム１は、情報入力装置１０と、その情報入力装置１０にネットワーク１０１を介して接続されたサーバ１０２とを備える。ネットワーク１０１は、インターネットやイントラネットなどの一般的な通信回線である。サーバ１０２は、演算機能や制御機能、記憶機能などを有する一般的なサーバである。 The collation system 1 includes an information input device 10 and a server 102 connected to the information input device 10 via a network 101. The network 101 is a general communication line such as the Internet or an intranet. The server 102 is a general server having an arithmetic function, a control function, a storage function, and the like.
　サーバ１０２は、情報処理装置１０からキー操作情報を取得し、そのキー操作情報とユーザの認証情報とを照合する。そして、照合システム１は、キー操作情報とユーザの認証情報とが一致した際に、そのユーザが上位システムにログインすることを許可する。 The server 102 acquires key operation information from the information processing apparatus 10 and collates the key operation information with user authentication information. Then, when the key operation information matches the user authentication information, the verification system 1 permits the user to log in to the host system.
　（構成）
　次に、本実施形態に係る情報入力装置１０の概略的な構成について図面を参照しながら説明する。 (Constitution)
Next, a schematic configuration of the information input device 10 according to the present embodiment will be described with reference to the drawings.
　図４は、情報入力装置１０の機能構成を示すブロック図である。 FIG. 4 is a block diagram showing a functional configuration of the information input device 10.
　情報入力装置１０は、撮像手段２０、投射手段３０、制御手段４０および光シャッタ１３を備える。撮像手段２０、投射手段３０および制御手段４０は、インターフェース装置１１を構成する。また、情報入力装置１０には、ユーザの情報の入力を受け付ける操作領域１２が設定される。なお、操作領域１２は、情報入力装置１０の筐体や内部など、インターフェース装置１１から表示情報を投射することができる箇所に設定される。操作領域１２は、情報入力装置１０の外部に設定されてもよい。 The information input device 10 includes an imaging unit 20, a projection unit 30, a control unit 40 and an optical shutter 13. The imaging unit 20, the projection unit 30, and the control unit 40 constitute the interface device 11. In the information input device 10, an operation area 12 that accepts input of user information is set. The operation area 12 is set at a location where display information can be projected from the interface device 11, such as the housing or the inside of the information input device 10. The operation area 12 may be set outside the information input device 10.
　図５は、インターフェース装置１１が、操作領域１２に表示情報３００を投射し、操作領域１２を撮像する様子の概念図である。 FIG. 5 is a conceptual diagram showing how the interface device 11 projects the display information 300 on the operation area 12 and images the operation area 12.
　制御手段４０は、異なる表示情報３００を操作領域１２に次々に投射するように投射手段３０を制御する。また、制御手段４０は、有効表示情報が表示情報３００として操作領域１２に表示されるタイミングで光シャッタ１３を開く制御をする。そして、制御手段４０は、操作領域１２を撮像するように撮像手段２０を制御する。 The control means 40 controls the projection means 30 so that different display information 300 is projected onto the operation area 12 one after another. Further, the control means 40 controls to open the optical shutter 13 at a timing when the effective display information is displayed as the display information 300 in the operation area 12. And the control means 40 controls the imaging means 20 so that the operation area | region 12 may be imaged.
　次に、本実施形態に係る情報入力装置１０の詳細な構成について図面を参照しながら説明する。 Next, a detailed configuration of the information input device 10 according to the present embodiment will be described with reference to the drawings.
　（撮像手段）
　図６は、撮像手段２０の構成を示すブロック図である。撮像手段２０は、撮像素子２１、画像処理プロセッサ２３、内部メモリ２５およびデータ出力部２７を有する。 (Imaging means)
FIG. 6 is a block diagram illustrating a configuration of the imaging unit 20. The imaging unit 20 includes an imaging device 21, an image processor 23, an internal memory 25, and a data output unit 27.
　撮像素子２１は、操作領域１２を含む領域を撮像し、画像情報を取得するための素子である。撮像素子２１は、半導体部品が集積回路化された光電変換素子である。撮像素子２１は、例えば、ＣＣＤ（Charge-Coupled Device）やＣＭＯＳ（Complementary Metal-Oxide-Semiconductor）などの固体撮像素子によって実現できる。通常、撮像素子２１は、可視領域の光を撮像する素子によって構成するが、赤外線や紫外線、Ｘ線、ガンマ線、電波、マイクロ波などの電磁波を撮像・検波できる素子によって構成してもよい。 The imaging element 21 is an element for imaging an area including the operation area 12 and acquiring image information. The imaging element 21 is a photoelectric conversion element in which semiconductor components are integrated into an integrated circuit. The image sensor 21 can be realized by a solid-state image sensor such as a CCD (Charge-Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). Normally, the imaging element 21 is configured by an element that captures light in the visible region, but may be configured by an element that can capture and detect electromagnetic waves such as infrared rays, ultraviolet rays, X-rays, gamma rays, radio waves, and microwaves.
　画像処理プロセッサ２３は、撮像素子２１によって撮像された画像情報に対して、暗電流補正や補間演算、色空間変換、ガンマ補正、収差の補正、ノイズリダクション、画像圧縮などの画像処理を実行する集積回路である。なお、画像情報を加工せずに出力する場合は、画像処理プロセッサ２３を省略してもよい。画像処理プロセッサ２３は、本実施形態に係る情報入力装置１０が処理を行うように設計されたプロセッサで実現できる。 The image processor 23 performs integrated processing for performing image processing such as dark current correction, interpolation calculation, color space conversion, gamma correction, aberration correction, noise reduction, and image compression on the image information captured by the image sensor 21. Circuit. Note that when the image information is output without being processed, the image processor 23 may be omitted. The image processor 23 can be realized by a processor designed so that the information input apparatus 10 according to the present embodiment performs processing.
　内部メモリ２５は、画像処理プロセッサ２３によって画像処理を行う際に処理しきれない画像情報や、処理済みの画像情報を一時的に格納する記憶素子である。なお、撮像素子２１によって撮像された画像情報を内部メモリ２５に一時的に記憶するように構成してもよい。内部メモリ２５は、一般的なメモリによって構成すればよい。 The internal memory 25 is a storage element that temporarily stores image information that cannot be processed when image processing is performed by the image processor 23 and processed image information. Note that the image information captured by the image sensor 21 may be temporarily stored in the internal memory 25. The internal memory 25 may be configured by a general memory.
　データ出力部２７は、画像処理プロセッサ２３によって処理された画像情報を制御手段４０に出力する。 The data output unit 27 outputs the image information processed by the image processor 23 to the control means 40.
　（投射手段）
　図７は、本実施形態に係る投射手段３０の構成を示すブロック図である。図８は、本実施形態に係る投射手段３０の光学的な構成について説明するための概念図である。 (Projection means)
FIG. 7 is a block diagram showing the configuration of the projection means 30 according to this embodiment. FIG. 8 is a conceptual diagram for explaining the optical configuration of the projection unit 30 according to the present embodiment.
　図７のように、投射手段３０は、制御条件取得部３１、光源制御部３２、光源３３、変調素子制御部３５、空間変調素子３６および投射部３８を有する。以下において、投射手段３０の各構成要素について詳細に説明する。 As shown in FIG. 7, the projection unit 30 includes a control condition acquisition unit 31, a light source control unit 32, a light source 33, a modulation element control unit 35, a spatial modulation element 36, and a projection unit 38. Below, each component of the projection means 30 is demonstrated in detail.
　（制御条件取得部）
　制御条件取得部３１は、光源３３および空間変調素子３５を制御するための制御条件を取得する。制御条件は、光源３３と光シャッタ１３の動作を同期させるための同期条件と、空間変調素子３５に位相分布を適切なタイミングで表示させるための表示条件とを含む。制御条件取得部３１は、同期条件を光源制御部３２に出力し、表示条件を変調素子制御部３５に出力する。 (Control condition acquisition unit)
The control condition acquisition unit 31 acquires a control condition for controlling the light source 33 and the spatial modulation element 35. The control conditions include a synchronization condition for synchronizing the operations of the light source 33 and the optical shutter 13 and a display condition for causing the spatial modulation element 35 to display the phase distribution at an appropriate timing. The control condition acquisition unit 31 outputs the synchronization condition to the light source control unit 32 and outputs the display condition to the modulation element control unit 35.
　（光源制御部）
　光源制御部３２は、同期条件に基づいて、光源３３を構成する複数の発光部を所定のタイミングで切り替え、光を出射する発光部を変更させる制御をする。 (Light source controller)
The light source control unit 32 performs control to switch a plurality of light emitting units constituting the light source 33 at a predetermined timing based on the synchronization condition, and to change the light emitting unit that emits light.
　（光源）
　光源３３は、特定波長の光３４０を発する複数の発光部を有する。通常、光源３３は、可視領域の光３４０を発するように構成する。なお、光源３３は、赤外領域や紫外領域などの可視領域以外の光３４０を発するように構成してもよい。光源３３が出射した光は、コリメータ３４によってコヒーレントな光３４０とし、空間変調素子３６の表示部に入射させる。 (light source)
The light source 33 includes a plurality of light emitting units that emit light 340 having a specific wavelength. Usually, the light source 33 is configured to emit light 340 in the visible region. The light source 33 may be configured to emit light 340 other than the visible region such as the infrared region and the ultraviolet region. The light emitted from the light source 33 is converted into coherent light 340 by the collimator 34 and is incident on the display unit of the spatial modulation element 36.
　図８のように、本実施形態においては、空間変調素子３６の表示部に対して光３４０の入射角を非垂直にする。すなわち、光源３３から出射される光３４０の出射軸を空間変調素子３６の表示部に対して斜めにする。空間変調素子３６の表示部に対して光３４０の出射軸を斜めに設定すれば、ビームスプリッタを用いなくても空間変調素子３６の表示部に光３４０を入射できるため効率を向上させることができる。 As shown in FIG. 8, in the present embodiment, the incident angle of the light 340 is made non-perpendicular with respect to the display unit of the spatial modulation element 36. That is, the emission axis of the light 340 emitted from the light source 33 is inclined with respect to the display unit of the spatial modulation element 36. If the emission axis of the light 340 is set obliquely with respect to the display unit of the spatial modulation element 36, the efficiency can be improved because the light 340 can be incident on the display unit of the spatial modulation element 36 without using a beam splitter. .
　図９は、光源３３に含まれる複数の発光部３３０の配置例を示す概念図である。図９中の発光部３３０に示すＡ１やＡ２などの記号は、各発光部３３０の位置を示す。図９においては、行列状に配置した複数の発光部３３０の各行を上からＡ、Ｂ、Ｃとし、各列を左から１、２、３、４、５とする。これ以降、各発光部３３０の個別にあらわす場合、発光部Ａ１、発光部Ａ２、・・・、発光部Ｃ５などと表記する。なお、光源３３を構成する複数の発光部３３０は、任意の数の行および列で構成することができる。また、複数の発光部３３０は、行列状ではなく、同心円状や螺旋状などの配置としてもよい。 FIG. 9 is a conceptual diagram illustrating an arrangement example of a plurality of light emitting units 330 included in the light source 33. Symbols such as A1 and A2 shown in the light emitting unit 330 in FIG. 9 indicate the position of each light emitting unit 330. In FIG. 9, the rows of the plurality of light emitting units 330 arranged in a matrix are A, B, and C from the top, and the columns are 1, 2, 3, 4, and 5 from the left. Hereinafter, when each light emitting unit 330 is represented individually, the light emitting unit A1, the light emitting unit A2,. In addition, the several light emission part 330 which comprises the light source 33 can be comprised by arbitrary number of rows and columns. Further, the plurality of light emitting units 330 may be arranged in a concentric or spiral shape instead of a matrix shape.
　複数の発光部３３０は、互いに独立したタイミングで発光するように制御される。例えば、発光部３３０は、発光部Ａ１、発光部Ａ２、・・・、発光部Ｃ５といった順番で発光するように制御される。なお、複数の発光部３３０を発光させるタイミングは、任意の順番に設定できる。例えば、所定の時間間隔で所定の順番で発光部３３０を切り替えるように制御してもよいし、ランダムな時間間隔で順番を入れ替えて発光部３３０を切り替えるように制御してもよい。 The plurality of light emitting units 330 are controlled to emit light at timings independent of each other. For example, the light emitting unit 330 is controlled to emit light in the order of the light emitting unit A1, the light emitting unit A2,..., The light emitting unit C5. In addition, the timing which makes the some light emission part 330 light-emit can be set to arbitrary orders. For example, it may be controlled to switch the light emitting units 330 in a predetermined order at predetermined time intervals, or may be controlled to switch the light emitting units 330 by changing the order at random time intervals.
　図１０は、図９の光源３３を実現するレーザアレイ３３１の概念図である。レーザアレイ３３１は、異なるタイミングで駆動制御される複数の発光部３３２を有する。レーザアレイ３３１には、レーザを照射することによって発生した熱を発散するためのヒートシンク３３３が設けられることが好ましい。また、レーザアレイ３３１から出射されたレーザをコリメートするために、各発光部３３２に対応させてコリメータが配置されたコリメートレンズアレイ３４１をレーザアレイ３３１の後段に設置することが好ましい。 FIG. 10 is a conceptual diagram of a laser array 331 that realizes the light source 33 of FIG. The laser array 331 includes a plurality of light emitting units 332 that are driven and controlled at different timings. The laser array 331 is preferably provided with a heat sink 333 for radiating heat generated by laser irradiation. Further, in order to collimate the laser emitted from the laser array 331, it is preferable to install a collimating lens array 341 in which a collimator is arranged corresponding to each light emitting unit 332 in the subsequent stage of the laser array 331.
　レーザアレイ３３１は、複数の色のレーザを組み合わせて構成してもよい。レーザアレイ３３１を複数の色の組み合わせで構成すれば、表示情報を多色化することができる。すなわち、光源３３は、第１の波長領域の光を出射する第１の発光部と、前記第１の発光部が出射する光とは異なる波長領域の光を出射する第２の発光部とを少なくとも有する構成とすることができる。なお、光源３３は、３色以上の色を出射するように構成してもよい。 The laser array 331 may be configured by combining a plurality of color lasers. If the laser array 331 is composed of a combination of a plurality of colors, display information can be multicolored. That is, the light source 33 includes a first light emitting unit that emits light in the first wavelength region, and a second light emitting unit that emits light in a wavelength region different from the light emitted from the first light emitting unit. It can be set as the structure which has at least. The light source 33 may be configured to emit three or more colors.
　例えば、多色化すれば、通常は緑色の有効キー配列をユーザに認識させ、何かしらの問題がある場合は赤色の有効キー配列をユーザに認識させるというような設定も可能となる。 For example, if the number of colors is increased, it is possible to set the user so that the user normally recognizes the green effective key arrangement, and if there is any problem, the user can recognize the red effective key arrangement.
　（空間変調素子）
　空間変調素子３６は、変調素子制御部３５の制御に応じて、操作領域１２に投射される表示情報の位相分布を自身の表示部に表示する。空間変調素子３６の表示部は複数の表示領域に区分される。各表示領域は、独立したタイミングで表示情報に対応する位相分布を表示する。 (Spatial modulation element)
The spatial modulation element 36 displays the phase distribution of the display information projected on the operation area 12 on its own display unit under the control of the modulation element control unit 35. The display unit of the spatial modulation element 36 is divided into a plurality of display areas. Each display area displays a phase distribution corresponding to display information at an independent timing.
　空間変調素子３６は、位相がそろったコヒーレントな光３４０の入射を受け、入射された光３４０の位相を変調する位相変調型の空間変調素子である。空間変調素子３６は、変調された変調光３７０を投射部３８に向けて出射する。なお、空間変調素子３６は、操作領域１２に表示情報を投射できるのであれば、位相変調型とは異なる方式の素子であってもよい。 The spatial modulation element 36 is a phase modulation type spatial modulation element that receives the coherent light 340 having the same phase and modulates the phase of the incident light 340. The spatial modulation element 36 emits the modulated modulated light 370 toward the projection unit 38. The spatial modulation element 36 may be an element of a system different from the phase modulation type as long as display information can be projected onto the operation area 12.
　空間変調素子３６上の表示領域には、操作領域１２に投射される表示情報の位相分布が表示される。空間変調素子３６の表示領域で反射された変調光３７０は、一種の回折格子が集合体を形成したような画像になり、これらの回折格子で回折された光が集まることによって表示情報が形成される。なお、空間変調素子の表示部に表示される位相分布をパターンと記載することもある。 In the display area on the spatial modulation element 36, the phase distribution of the display information projected on the operation area 12 is displayed. The modulated light 370 reflected from the display area of the spatial modulation element 36 becomes an image in which a kind of diffraction grating forms an aggregate, and display information is formed by collecting the light diffracted by these diffraction gratings. The The phase distribution displayed on the display unit of the spatial modulation element may be described as a pattern.
　空間変調素子３６は、例えば、強誘電性液晶やホモジーニアス液晶、垂直配向液晶などを用いた空間変調素子によって実現される。空間変調素子３６は、具体的には、ＬＣＯＳ（Liquid Crystal on Silicon）によって実現できる。また、空間変調素子３６は、例えば、ＭＥＭＳ（Micro Electro Mechanical System）によって実現してもよい。 The spatial modulation element 36 is realized by a spatial modulation element using, for example, a ferroelectric liquid crystal, a homogeneous liquid crystal, a vertical alignment liquid crystal, or the like. Specifically, the spatial modulation element 36 can be realized by LCOS (Liquid Crystal Crystal on Silicon). The spatial modulation element 36 may be realized by, for example, MEMS (Micro Electro Mechanical System).
　（変調素子制御部）
　変調素子制御部３５は、空間変調素子３６の表示部に各位相分布を適切なタイミングで表示させる。変調素子制御部３５は、空間変調素子３６の表示領域に照射される光３４０の位相と、表示領域で反射される変調光３７０の位相との差分を決定づけるパラメータが変化するように空間変調素子３６を制御する。 (Modulation element controller)
The modulation element control unit 35 displays each phase distribution at an appropriate timing on the display unit of the spatial modulation element 36. The modulation element control unit 35 changes the parameter that determines the difference between the phase of the light 340 applied to the display area of the spatial modulation element 36 and the phase of the modulation light 370 reflected from the display area. To control.
　空間変調素子３６の表示部に照射される光３４０の位相と、表示部で反射される変調光３７０の位相との差分を決定づけるパラメータは、例えば、屈折率や光路長などの光学的特性に関するパラメータである。例えば、変調素子制御部３５は、空間変調素子３６の表示部に印可する電圧を制御することによって、表示部の屈折率を変化させる。その結果、表示部に照射された光３４０は、表示部の屈折率に基づいて適宜回折される。 Parameters that determine the difference between the phase of the light 340 applied to the display unit of the spatial modulation element 36 and the phase of the modulated light 370 reflected by the display unit are, for example, parameters relating to optical characteristics such as refractive index and optical path length. It is. For example, the modulation element control unit 35 changes the refractive index of the display unit by controlling the voltage applied to the display unit of the spatial modulation element 36. As a result, the light 340 applied to the display unit is appropriately diffracted based on the refractive index of the display unit.
　すなわち、空間変調素子３６に照射された光３４０の位相分布は、表示部の光学的特性に応じて変調される。なお、変調素子制御部３５による空間変調素子３６の制御はここで挙げた限りではない。 That is, the phase distribution of the light 340 irradiated on the spatial modulation element 36 is modulated according to the optical characteristics of the display unit. The control of the spatial modulation element 36 by the modulation element control unit 35 is not limited to the above.
　図１１は、空間変調素子３６の液晶の応答と、光源３３を構成する各発光部３３０の切り替えタイミングとを対応させた概念図である。液晶の応答タイミングは、変調素子制御部３５によって制御される。一方、各発光部３３０の切り替えタイミングは、光源制御部３２によって制御される。 FIG. 11 is a conceptual diagram in which the response of the liquid crystal of the spatial modulation element 36 is associated with the switching timing of each light emitting unit 330 constituting the light source 33. The response timing of the liquid crystal is controlled by the modulation element control unit 35. On the other hand, the switching timing of each light emitting unit 330 is controlled by the light source control unit 32.
　本実施形態においては、一回の液晶の応答タイミングにおいて、各発光部３３０の切り替えを行う。なお、図１１の例では、各発光部３３０をＡ１～Ｃ５の順番に切り替える例を示しているが、切り替えの順番は任意に設定される。 In the present embodiment, each light emitting unit 330 is switched at one liquid crystal response timing. In the example of FIG. 11, an example in which the light emitting units 330 are switched in the order of A1 to C5 is shown, but the order of switching is arbitrarily set.
　（投射部）
　投射部３８は、光源３３から出射された光３４０を信号光３９０として投射する。図８のように、投射部３８は、フーリエ変換レンズ３８１、アパーチャ３８２および投射レンズ３８３を有する。空間変調素子３６で変調された変調光３７０は、投射部３８によって信号光３９０として操作領域１２に投射される。 (Projection part)
The projection unit 38 projects light 340 emitted from the light source 33 as signal light 390. As shown in FIG. 8, the projection unit 38 includes a Fourier transform lens 381, an aperture 382, and a projection lens 383. The modulated light 370 modulated by the spatial modulation element 36 is projected onto the operation area 12 as signal light 390 by the projection unit 38.
　フーリエ変換レンズ３８１は、空間変調素子３６の表示部で反射された変調光３７０を無限遠に投射した際に形成される像を、近傍の焦点位置に形成させるための光学レンズである。 The Fourier transform lens 381 is an optical lens for forming an image formed when the modulated light 370 reflected by the display unit of the spatial modulation element 36 is projected at infinity at a nearby focal position.
　アパーチャ３８２は、フーリエ変換レンズ３８１によって集束された光に含まれる高次光を消去し、画像領域を特定する機能を有する。アパーチャ３８２の開口部は、アパーチャ３８２の位置における表示情報の画像領域よりも小さく開口され、アパーチャ３８２の位置における表示情報の周辺領域を遮るように設置される。例えば、アパーチャ３８２の開口部は、矩形状や円形上になるように形成される。アパーチャ３８２は、フーリエ変換レンズ３８１の焦点位置に設置されることが好ましいが、高次光を消去する機能を発揮できれば、焦点位置からずれていても構わない。 The aperture 382 has a function of erasing higher-order light included in the light focused by the Fourier transform lens 381 and specifying an image region. The opening of the aperture 382 is smaller than the image area of the display information at the position of the aperture 382, and is installed so as to block the peripheral area of the display information at the position of the aperture 382. For example, the opening of the aperture 382 is formed to be rectangular or circular. The aperture 382 is preferably installed at the focal position of the Fourier transform lens 381, but may be shifted from the focal position as long as the function of erasing high-order light can be exhibited.
　投射レンズ３８３は、フーリエ変換レンズ３８１によって集束された光を拡大して投射する光学レンズである。投射レンズ３８３は、空間変調素子３６に入力された位相分布に対応する目的画像が被投射面上に表示されるように信号光３９０を投射する。 The projection lens 383 is an optical lens that magnifies and projects the light focused by the Fourier transform lens 381. The projection lens 383 projects the signal light 390 so that the target image corresponding to the phase distribution input to the spatial modulation element 36 is displayed on the projection surface.
　投射部３８から投射された信号光３８０は、操作領域１２に均一に投射されるのではなく、表示情報を構成する文字や記号、枠などの部分に集中的に投射される。本実施形態に係る投射手段３０が文字や記号、枠などの線画を投射する用途に用いられる場合、光３４０の照射量を実質的に減らすことができるため、全体的な光出力を抑えることができる。すなわち、光源３３は、小型かつ低電力の光源と、その光源を駆動する低出力の電源とで構成できる。 The signal light 380 projected from the projection unit 38 is not projected uniformly on the operation area 12 but concentratedly projected on portions such as characters, symbols, and frames constituting the display information. When the projection unit 30 according to the present embodiment is used for the purpose of projecting line drawings such as characters, symbols, and frames, the irradiation amount of the light 340 can be substantially reduced, so that the overall light output can be suppressed. it can. That is, the light source 33 can be composed of a small and low-power light source and a low-output power source that drives the light source.
　以上が、投射手段３０の各構成要素の詳細についての説明である。 This completes the description of the details of each component of the projection means 30.
　ここで、図１２を用いて、空間変調素子３６の表示部に表示されるパターンについて説明する。なお、図１２には、空間変調素子３６の表示部を３行×５列の表示領域に区分けする例を示す。空間変調素子３６の表示領域は、図１２とは異なる方法で区分けしてもよい。 Here, the pattern displayed on the display unit of the spatial modulation element 36 will be described with reference to FIG. FIG. 12 shows an example in which the display unit of the spatial modulation element 36 is divided into display areas of 3 rows × 5 columns. The display area of the spatial modulation element 36 may be divided by a method different from that in FIG.
　図１２において、空間変調素子３６の表示部を構成する表示領域の各行は、上から順番に、Ａ、Ｂ、Ｃとする。同様に、各列は、左から順番に、１、２、３、４、５とする。そして、各表示領域は、行番号と列番号とを組み合わせて表記する。例えば、上からｍ行目、左からｎ列目の表示領域は、「表示領域ｍｎ」と表記する。なお、ｍはＡ、ＢまたはＣであり、ｎは１、２、３、４または５である。 12, each row of the display area constituting the display unit of the spatial modulation element 36 is A, B, and C in order from the top. Similarly, each column is 1, 2, 3, 4, 5 in order from the left. Each display area is described by combining a row number and a column number. For example, the display area in the m-th row from the top and the n-th column from the left is denoted as “display area mn”. Here, m is A, B or C, and n is 1, 2, 3, 4 or 5.
　図１２において、各表示領域には、操作領域１２に投射する表示情報の位相分布が表示される。なお、図１２においては、位相分布ではなく表示情報そのものを図示している。なお、これ以降の図面においては、説明しやすくするために、位相分布として表示情報そのものを図示する。 In FIG. 12, the phase distribution of the display information projected on the operation area 12 is displayed in each display area. In FIG. 12, not the phase distribution but the display information itself is shown. In the following drawings, the display information itself is shown as a phase distribution for ease of explanation.
　本実施形態においては、空間変調素子３６の各表示領域に、光源３３の各発光部３３０を対応させる。例えば、図１２の表示領域Ａ１には、図９の発光部Ａ１から出射された光３４０を照射する。発光部Ａ１と同様に、他の発光部３３０を各表示領域に対応させる。なお、図９の発光部３３０の列と、図１２の表示領域の列とが反対の位置に図示されているのは、光源３３から出射した光３４０を空間変調素子３６の表示部で反射させるためである。 In the present embodiment, each light emitting unit 330 of the light source 33 is associated with each display area of the spatial modulation element 36. For example, the display area A1 in FIG. 12 is irradiated with light 340 emitted from the light emitting unit A1 in FIG. Similar to the light emitting unit A1, the other light emitting units 330 correspond to the respective display areas. Note that the columns of the light emitting units 330 in FIG. 9 and the columns of the display region in FIG. 12 are shown in opposite positions because the light 340 emitted from the light source 33 is reflected by the display unit of the spatial modulation element 36. Because.
　図１３は、空間変調素子３６の個々の表示領域に同じパターンをアレイ状に表示する例である。例えば、表示領域Ａ１には、４行×４列のアレイ状のパターンを表示させる。図１３の例では、図１２の各表示領域のキー配列をアレイ状に表示させることを示す。図１３の表示領域Ａ１には、図１２の表示領域Ａ１に表示させるキー配列が複数表示される。 FIG. 13 shows an example in which the same pattern is displayed in an array on each display area of the spatial modulation element 36. For example, an array pattern of 4 rows × 4 columns is displayed in the display area A1. In the example of FIG. 13, the key arrangement of each display area of FIG. 12 is displayed in an array. In the display area A1 of FIG. 13, a plurality of key arrays to be displayed in the display area A1 of FIG. 12 are displayed.
　図１３のように区分けすると、例えば表示領域Ｃ５に表示された位相分布を投射する際に、図１３中の破線の円内に光３４０の照射領域を絞ることができる。図１２のような場合、各表示領域に光３４０を照射する際には、隣接する表示領域に光３４０の照射領域が重なり、ノイズが発生する可能性がある。図１３のように、個々の表示領域に複数の同じパターンを表示すれば、光３４０の照射領域が隣接する表示領域に重なることを防ぐことができるため、ノイズの発生を抑制することができる。 When divided as shown in FIG. 13, for example, when projecting the phase distribution displayed in the display area C5, the irradiation area of the light 340 can be narrowed down within the broken-line circle in FIG. In the case of FIG. 12, when the light 340 is irradiated to each display area, the irradiation area of the light 340 overlaps with an adjacent display area, and noise may be generated. As shown in FIG. 13, if a plurality of the same patterns are displayed in each display area, the irradiation area of the light 340 can be prevented from overlapping with an adjacent display area, so that generation of noise can be suppressed.
　（制御手段）
　図１４は、本実施形態に係る制御手段４０の構成を示すブロック図である。制御手段４０は、処理部４１、撮像制御部４２、投射制御部４３およびシャッタ制御部４４を有する。 (Control means)
FIG. 14 is a block diagram showing the configuration of the control means 40 according to this embodiment. The control means 40 includes a processing unit 41, an imaging control unit 42, a projection control unit 43, and a shutter control unit 44.
　処理部４１は、複数のキー配列を含むキー配列情報を取得し、そのキー配列情報を用いて投射手段３０に投射させる表示情報の位相分布を設定する。そして、処理部４１は、その位相分布を空間変調素子３６の表示部に表示させるタイミングを設定する。すなわち、処理部４１は、投射手段３０に投射させる表示情報の位相分布と、その位相分布を空間変調素子３６の表示部に表示させるタイミングとを含む表示条件を設定する。処理部４１は、設定した表示条件を投射制御部４３に出力する。 The processing unit 41 acquires key arrangement information including a plurality of key arrangements, and sets the phase distribution of display information to be projected on the projection means 30 using the key arrangement information. Then, the processing unit 41 sets a timing for displaying the phase distribution on the display unit of the spatial modulation element 36. That is, the processing unit 41 sets display conditions including the phase distribution of display information to be projected on the projection unit 30 and the timing for displaying the phase distribution on the display unit of the spatial modulation element 36. The processing unit 41 outputs the set display condition to the projection control unit 43.
　また、処理部４１は、光源３３を構成する発光部３３０の切り替えタイミングを設定する。このとき、処理部４１は、発光部３３０の切り替えタイミングと、光シャッタ１３を開くタイミングとを同期させるための同期条件を設定する。処理部４１は、設定した同期条件を投射制御部４３およびシャッタ制御部４４に出力する。 Further, the processing unit 41 sets the switching timing of the light emitting unit 330 constituting the light source 33. At this time, the processing unit 41 sets a synchronization condition for synchronizing the switching timing of the light emitting unit 330 and the timing of opening the optical shutter 13. The processing unit 41 outputs the set synchronization condition to the projection control unit 43 and the shutter control unit 44.
　さらに、処理部４１は、撮像手段２０に操作領域１２を撮像させる指示を出す。処理部４１は、撮像手段２０から操作領域１２の画像情報を取得し、その画像情報からユーザのキー操作を認識し、ユーザが行ったキー操作を含むキー操作情報（操作情報とも呼ぶ）を出力する。 Furthermore, the processing unit 41 instructs the imaging unit 20 to image the operation area 12. The processing unit 41 acquires image information of the operation area 12 from the imaging unit 20, recognizes the user's key operation from the image information, and outputs key operation information (also referred to as operation information) including the key operation performed by the user. To do.
　撮像制御部４２は、処理部４１の指示に応じて、撮像手段２０に操作領域１２を撮像させる制御を行う。撮像制御部４２は、撮像手段２０によって撮像された画像情報を処理部４１に出力する。 The imaging control unit 42 performs control for causing the imaging unit 20 to image the operation area 12 in accordance with an instruction from the processing unit 41. The imaging control unit 42 outputs image information captured by the imaging unit 20 to the processing unit 41.
　投射制御部４３は、処理部４１によって出力された表示条件および同期条件を取得し、その表示条件および同期条件を投射手段３０に出力する。 The projection control unit 43 acquires the display condition and the synchronization condition output by the processing unit 41, and outputs the display condition and the synchronization condition to the projection unit 30.
　シャッタ制御部４４は、処理部４１によって出力された同期条件を取得し、その同期条件を光シャッタ１３に出力する。 The shutter control unit 44 acquires the synchronization condition output by the processing unit 41 and outputs the synchronization condition to the optical shutter 13.
　図１４においては、撮像制御部４２、投射制御部４３およびシャッタ制御部４４を異なる構成として図示したが、これらの構成はまとめてもよい。 In FIG. 14, the imaging control unit 42, the projection control unit 43, and the shutter control unit 44 are illustrated as different configurations, but these configurations may be combined.
　ここで、光源から出射した光を操作領域に表示し、その表示情報をカメラで撮像する一例を示す。 Here, an example in which the light emitted from the light source is displayed in the operation area and the display information is captured by the camera is shown.
　図１５は、投射手段３０によって操作領域１２に表示情報を投射し、撮像手段２０であるカメラ２００によって撮像領域１２を撮像する一例を示す概念図である。光源３３から出射された光は、空間変調素子３６の表示部で反射され、操作領域１２に表示情報として投射される。情報入力装置１０は、カメラ２００によって操作領域１２を撮像し、有効表示情報に対するユーザの操作を取得する。 FIG. 15 is a conceptual diagram illustrating an example in which display information is projected onto the operation area 12 by the projecting unit 30 and the image capturing area 12 is imaged by the camera 200 which is the image capturing unit 20. The light emitted from the light source 33 is reflected by the display unit of the spatial modulation element 36 and projected on the operation area 12 as display information. The information input device 10 captures the operation area 12 with the camera 200 and acquires the user's operation for the effective display information.
　投射手段３０から操作領域１２に投射される表示情報は次々に切り替えられるため、カメラ２００によって撮像された画像情報のみから表示情報のキー配列とユーザの操作とを対応させることはできない。そのため、制御手段４０は、カメラ２００によって撮像された画像情報から、ユーザの操作が行われた時刻とその操作が示す位置とを関連付けて取得すればよい。同一時刻において、ユーザの操作が示す位置と、有効キー配列とを対応させればユーザが入力した情報を特定することができる。 Since the display information projected from the projection unit 30 onto the operation area 12 is switched one after another, the key arrangement of the display information cannot be associated with the user operation only from the image information captured by the camera 200. Therefore, the control unit 40 may acquire the time when the user operation is performed and the position indicated by the operation from the image information captured by the camera 200. If the position indicated by the user's operation and the valid key array are associated with each other at the same time, the information input by the user can be specified.
　（処理部）
　次に、制御手段４０に含まれる処理部４１の詳細な構成について図面を用いて説明する。 (Processing part)
Next, a detailed configuration of the processing unit 41 included in the control unit 40 will be described with reference to the drawings.
　図１６は、処理部４１の構成を示すブロック図である。処理部４１は、キー配列格納部４１２、制御条件生成部４１３および操作情報生成部４１５を有する。図１６の各構成要素については、個別の図面を用いて詳細に説明する。 FIG. 16 is a block diagram illustrating a configuration of the processing unit 41. The processing unit 41 includes a key array storage unit 412, a control condition generation unit 413, and an operation information generation unit 415. Each component in FIG. 16 will be described in detail with reference to individual drawings.
　図１７は、キー配列格納部４１２（表示情報格納部とも呼ぶ）の構成を示すブロック図である。キー配列格納部４１２は、キー配列受信部４２１、キー配列記憶部４２２およびキー配列出力部４２３を含む。 FIG. 17 is a block diagram showing a configuration of the key array storage unit 412 (also referred to as a display information storage unit). The key array storage unit 412 includes a key array receiver 421, a key array storage unit 422, and a key array output unit 423.
　キー配列受信部４２１は、照合システム１を構成するサーバ１０２から、キー配列やそのキー配列に対応する位相分布に関する情報を含むキー配列情報を受信する。なお、キー配列受信部４２１は、キー配列に対応する位相分布を受信せず、キー配列のみをキー配列情報として受信するようにしてもよい。 The key arrangement receiving unit 421 receives key arrangement information including information relating to the key arrangement and the phase distribution corresponding to the key arrangement from the server 102 constituting the verification system 1. The key array receiving unit 421 may receive only the key array as key array information without receiving the phase distribution corresponding to the key array.
　キー配列記憶部４２２は、キー配列受信部４２１が受信したキー配列情報を記憶する。キー配列記憶部４２２は、キー配列のみをキー配列情報として記憶してもよい。 The key arrangement storage unit 422 stores the key arrangement information received by the key arrangement reception unit 421. The key layout storage unit 422 may store only the key layout as key layout information.
　キー配列出力部４２３は、制御条件生成部４１３からの要求に応じて、キー配列記憶部４２２に記憶されたキー配列情報を制御条件生成部４１３に出力する。 The key arrangement output unit 423 outputs the key arrangement information stored in the key arrangement storage unit 422 to the control condition generation unit 413 in response to a request from the control condition generation unit 413.
　図１８は、キー配列記憶部４２２が記憶するキー配列を格納するキー配列テーブル４２２１の一例である。キー配列テーブル４２２１は、複数のキー配列を格納する。なお、キー配列記憶部４２２は、キー配列テーブル４２２１とは異なる形式でキー配列を記憶してもよい。また、図１８などにおいては、キー配列にコンマ「，」を挿入しているが、実際のキー配列にはコンマを挿入しなくてもよい。 FIG. 18 is an example of a key layout table 4221 that stores the key layout stored in the key layout storage unit 422. The key array table 4221 stores a plurality of key arrays. The key layout storage unit 422 may store the key layout in a format different from that of the key layout table 4221. In FIG. 18 and the like, a comma “,” is inserted into the key array, but a comma may not be inserted into the actual key array.
　キー配列記憶部４２２は、できる限り多くのキー配列を記憶しておくことが好ましい。なぜならば、準備しておくキー配列が多いほどダミーのキー配列を増やすことができるため、有効キー配列が判明しにくくなるためである。ただし、キー配列記憶部４２２の記憶容量にも限りがあるので、キー配列記憶部４２２は、有効キー配列が判明しにくくなる最低限の数のキー配列を含むように構成してもよい。 It is preferable that the key arrangement storage unit 422 stores as many key arrangements as possible. This is because as the number of key arrangements to be prepared increases, the number of dummy key arrangements can be increased, so that it becomes difficult to identify effective key arrangements. However, since the storage capacity of the key array storage unit 422 is also limited, the key array storage unit 422 may be configured to include a minimum number of key arrays that make it difficult to identify effective key arrays.
　図１９は、キー配列出力部４２３が出力するキー配列情報を含むキー配列テーブル４２３１の一例である。キー配列テーブル４２３１は、キー配列テーブル４２２１に含まれる複数のキー配列のうち、制御条件生成部４１３の要求を満たす数のキー配列を選択したものを含む。なお、キー配列出力部４２３は、キー配列テーブル４２３１とは異なる形式でキー配列情報を出力してもよい。 FIG. 19 shows an example of a key arrangement table 4231 including key arrangement information output from the key arrangement output unit 423. The key arrangement table 4231 includes a selection of a number of key arrangements that satisfy the request of the control condition generation unit 413 among the plurality of key arrangements included in the key arrangement table 4221. Note that the key layout output unit 423 may output key layout information in a format different from that of the key layout table 4231.
　図２０は、制御条件生成部４１３の構成を示すブロック図である。制御条件生成部４１３は、キー配列選択部４３１、有効キー配列出力部４３２、パターン記憶部４３３、パターン選択部４３４、制御条件設定部４３５および制御条件出力部４３６を含む。 FIG. 20 is a block diagram illustrating a configuration of the control condition generation unit 413. The control condition generation unit 413 includes a key arrangement selection unit 431, an effective key arrangement output unit 432, a pattern storage unit 433, a pattern selection unit 434, a control condition setting unit 435, and a control condition output unit 436.
　キー配列選択部４３１（表示情報選択部とも呼ぶ）は、キー配列格納部４１２から複数のキー配列情報（表示情報とも呼ぶ）を取得する。キー配列選択部４３１は、取得したキー配列情報に含まれるいずれかのキー配列を有効キー配列（有効表示情報とも呼ぶ）として選択する。例えば、図２１のように、キー配列選択部４３１は、選択した有効キー配列にフラグ（以下、有効フラグ）を付けたキー配列情報テーブル４３１１を生成する。図２１の例では、有効キー配列の有効フラグを「１」とし、その他のキー配列の有効フラグは「０」としている。なお、キー配列選択部４３１は、キー配列情報テーブル４３１１のようなテーブル形式ではなく、他の方法でそのキー配列が有効キー配列であることを示すようにしてもよい。 The key array selection unit 431 (also referred to as a display information selection unit) acquires a plurality of key array information (also referred to as display information) from the key array storage unit 412. The key layout selection unit 431 selects any key layout included in the acquired key layout information as a valid key layout (also referred to as valid display information). For example, as shown in FIG. 21, the key arrangement selection unit 431 generates a key arrangement information table 4311 in which a flag (hereinafter referred to as an effective flag) is added to the selected effective key arrangement. In the example of FIG. 21, the valid flag of the valid key array is “1”, and the valid flags of the other key arrays are “0”. Note that the key arrangement selection unit 431 may indicate that the key arrangement is an effective key arrangement by another method instead of the table format such as the key arrangement information table 4311.
　キー配列選択部４３１は、有効キー配列を含むキー配列情報をパターン選択部４３４に出力するとともに、選択した有効キー配列を有効キー配列出力部４３２に出力する。なお、キー配列選択部４３１は、有効キー配列を含むキー配列情報を有効キー配列出力部４３２に出力するようにしてもよい。 The key arrangement selection unit 431 outputs key arrangement information including the effective key arrangement to the pattern selection unit 434 and outputs the selected effective key arrangement to the effective key arrangement output unit 432. Note that the key arrangement selection unit 431 may output key arrangement information including the effective key arrangement to the effective key arrangement output unit 432.
　有効キー配列出力部４３２（有効表示情報出力部とも呼ぶ）は、キー配列選択部４３１から有効キー配列を取得し、その有効キー配列を操作情報生成部４１５に出力する。 The effective key array output unit 432 (also referred to as an effective display information output unit) acquires the effective key array from the key array selection unit 431, and outputs the effective key array to the operation information generation unit 415.
　パターン記憶部４３３は、空間変調素子３６の表示面に表示させるパターンを記憶する。本実施形態において、パターン記憶部４３３は、複数のキー配列に対応する位相分布を記憶する。パターン記憶部４３３は、事前にサーバ１０２などから各キー配列に対応する位相分布を取得しておけばよい。パターン記憶部４３３は、位相分布をデジタルデータとして記憶しておくことが好ましい。 The pattern storage unit 433 stores a pattern to be displayed on the display surface of the spatial modulation element 36. In the present embodiment, the pattern storage unit 433 stores phase distributions corresponding to a plurality of key arrays. The pattern storage unit 433 may acquire a phase distribution corresponding to each key arrangement from the server 102 or the like in advance. The pattern storage unit 433 preferably stores the phase distribution as digital data.
　例えば、パターン記憶部４３３は、図２２のように、各キー配列に位相分布を対応させた位相分布テーブル４３３１の形式で位相分布を格納する。なお、図２２においては、キー配列に対応する表示情報の位相分布ではなく、表示情報そのものを図示している。また、パターン記憶部４３３は、位相分布テーブル４３３１とは異なる形式で位相分布を記憶してもよい。 For example, the pattern storage unit 433 stores the phase distribution in the form of a phase distribution table 4331 in which the phase distribution is associated with each key arrangement as shown in FIG. In FIG. 22, not the phase distribution of the display information corresponding to the key arrangement but the display information itself is shown. The pattern storage unit 433 may store the phase distribution in a format different from that of the phase distribution table 4331.
　パターン選択部４３４は、キー配列選択部４３１から有効キー配列を含むキー配列情報を取得し、取得したキー配列に対応する表示情報に対応する位相分布をパターン記憶部４３３から取得する。このとき、パターン選択部４３４は、有効キー配列に対応する位相分布には、その位相分布が有効キー配列に対応するものであることを示す有効フラグを付ける。 The pattern selection unit 434 acquires key arrangement information including an effective key arrangement from the key arrangement selection unit 431, and acquires a phase distribution corresponding to display information corresponding to the acquired key arrangement from the pattern storage unit 433. At this time, the pattern selection unit 434 attaches a valid flag to the phase distribution corresponding to the valid key array to indicate that the phase distribution corresponds to the valid key array.
　例えば、パターン選択部４３４は、図２３のように、選択した各キー配列に位相分布を対応させた位相分布テーブル４３４１を生成する。パターン選択部４３４は、有効キー配列には有効フラグを付ける。図２３の例では、有効キー配列の有効フラグを「１」とし、その他のキー配列の有効フラグは「０」としている。なお、パターン選択部４３４は、位相分布テーブル４３４１とは異なる形式で有効キー配列を含む各キー配列に対応付けて選択した位相分布を生成してもよい。 For example, the pattern selection unit 434 generates a phase distribution table 4341 in which the phase distribution is associated with each selected key array as shown in FIG. The pattern selection unit 434 attaches a valid flag to the valid key array. In the example of FIG. 23, the valid flag of the valid key array is “1”, and the valid flags of the other key arrays are “0”. Note that the pattern selection unit 434 may generate the phase distribution selected in association with each key arrangement including the effective key arrangement in a format different from the phase distribution table 4341.
　パターン選択部４３４は、有効キー配列を含む各キー配列に対応付けて、選択した位相分布を制御条件設定部４３５に出力する。例えば、パターン選択部４３４は、図２３のような位相分布テーブル４３４１を生成する場合、位相分布テーブル４３４１を出力すればよい。 The pattern selection unit 434 outputs the selected phase distribution to the control condition setting unit 435 in association with each key arrangement including the effective key arrangement. For example, the pattern selection unit 434 may output the phase distribution table 4341 when generating the phase distribution table 4341 as shown in FIG.
　制御条件設定部４３５は、有効キー配列を含む各キー配列に対応付けられた位相分布をパターン選択部４３４から取得する。制御条件設定部４３５は、投射手段３０に投射させる表示情報に対応する位相分布と、その位相分布を空間変調素子３６の表示部に表示させるタイミングとを含む表示条件を設定する。制御条件設定部４３５は、表示条件を設定すると、設定した表示条件を制御条件出力部４３６に出力する。 The control condition setting unit 435 acquires the phase distribution associated with each key arrangement including the effective key arrangement from the pattern selection unit 434. The control condition setting unit 435 sets display conditions including the phase distribution corresponding to the display information to be projected on the projection unit 30 and the timing for displaying the phase distribution on the display unit of the spatial modulation element 36. When the display condition is set, the control condition setting unit 435 outputs the set display condition to the control condition output unit 436.
　図２４は、制御条件設定部４３５が設定した表示条件の一例の表示条件テーブル４３６１である。表示条件テーブル４３６１は、特定の時刻において、空間変調素子３６の表示部の各表示領域に表示する位相分布をまとめたテーブルである。なお、表示条件テーブル４３６１に示した時刻以外についても、各表示領域に対応させた位相分布を表示条件テーブル４３６１に格納する。 FIG. 24 is a display condition table 4361 as an example of display conditions set by the control condition setting unit 435. The display condition table 4361 is a table that summarizes the phase distributions to be displayed in the display areas of the display unit of the spatial modulation element 36 at a specific time. Note that the phase distribution corresponding to each display area is also stored in the display condition table 4361 other than the time shown in the display condition table 4361.
　図２５は、制御条件設定部４３５が設定した表示条件の別の一例の表示条件テーブル４３６２である。表示条件テーブル４３６２は、空間変調素子３６の表示部の表示領域に関して、各位相分布を表示する時刻をまとめたテーブルである。なお、表示条件テーブル４３６２に示した表示領域以外についても、各時刻に対応させた位相分布を表示条件テーブル４３６１に格納する。 FIG. 25 is a display condition table 4362 as another example of display conditions set by the control condition setting unit 435. The display condition table 4362 is a table in which times for displaying the respective phase distributions are collected with respect to the display area of the display unit of the spatial modulation element 36. Note that the phase distribution corresponding to each time is also stored in the display condition table 4361 outside the display area shown in the display condition table 4362.
　表示条件テーブル４３６１や４３６２を用いれば、各位相分布を表示タイミングに合わせて適切な表示領域に表示することができる。なお、表示条件テーブル４３６１や４３６２にはキー配列そのものを含めているが、キー配列そのものは表示条件テーブル４３６１や４３６２に含めなくてもよい。 If the display condition tables 4361 and 4362 are used, each phase distribution can be displayed in an appropriate display area in accordance with the display timing. Although the display condition tables 4361 and 4362 include the key arrangement itself, the key arrangement itself may not be included in the display condition tables 4361 and 4362.
　また、制御条件設定部４３５は、発光部３３０の切り替えタイミングと、光シャッタ１３を開くタイミングとを同期させるための同期条件を設定する。制御条件設定部４３５は、同期条件を設定すると、設定した同期条件を制御条件出力部４３６に出力する。 Further, the control condition setting unit 435 sets a synchronization condition for synchronizing the switching timing of the light emitting unit 330 and the timing of opening the optical shutter 13. When the synchronization condition is set, the control condition setting unit 435 outputs the set synchronization condition to the control condition output unit 436.
　制御条件設定部４３５は、有効キーフラグが付けられた位相分布が表示された表示領域に発光部３３０が光を照射するタイミングに同期させて光シャッタ１３を開く同期条件を設定する。制御条件設定部４３５は、有効キーフラグが付けられた位相分布の位置に発光部３３０が光を照射する時間帯に含まれる時間範囲において、光シャッタ１３を所定の時間だけ開く条件を設定する。 The control condition setting unit 435 sets a synchronization condition for opening the optical shutter 13 in synchronization with the timing at which the light emitting unit 330 emits light in the display area where the phase distribution with the valid key flag is displayed. The control condition setting unit 435 sets a condition for opening the optical shutter 13 for a predetermined time in a time range included in the time zone in which the light emitting unit 330 emits light at the position of the phase distribution to which the valid key flag is attached.
　図２６は、制御条件設定部４３５が設定した同期条件の一例の同期条件テーブル４３７１である。同期条件テーブル４３７１は、特定の時刻と、その時刻に動作される発光部３３０と、その時刻に合わせて光シャッタ１３を開くか否かを示すシャッタ開フラグとを含む。同期条件テーブル４３７１においてシャッタ開フラグが「１」の場合、光シャッタ１３が開くように制御される。なお、シャッタ開フラグが「１」の場合、光シャッタ１３が開いてから所定の時間が経過すると、光シャッタ１３を閉じるように設定すればよい。また、シャッタ開フラグが「０」の場合は、光シャッタ１３を閉じたままにしておくことを示す。 FIG. 26 is a synchronization condition table 4371 as an example of the synchronization condition set by the control condition setting unit 435. The synchronization condition table 4371 includes a specific time, a light emitting unit 330 operated at that time, and a shutter open flag indicating whether or not to open the optical shutter 13 at that time. When the shutter open flag is “1” in the synchronization condition table 4371, the optical shutter 13 is controlled to open. When the shutter open flag is “1”, the optical shutter 13 may be set to be closed when a predetermined time elapses after the optical shutter 13 is opened. When the shutter open flag is “0”, it indicates that the optical shutter 13 is kept closed.
　ここで、図２６の同期条件テーブル４３７１に従って、発光部３３０および光シャッタ１３を制御する例について説明する。なお、同期条件テーブル４３７１中の時刻は「０．０００１００」秒ごとに設定されているものとする。 Here, an example of controlling the light emitting unit 330 and the optical shutter 13 according to the synchronization condition table 4371 of FIG. 26 will be described. It is assumed that the time in the synchronization condition table 4371 is set every “0.000100” seconds.
　まず、時刻「ＡＡ：ＢＢ：ＣＣ．０００１００」になると、発光部Ａ１が発光するように制御される。このとき、同期条件テーブル４３７１のシャッタ開フラグは「０」なので、光シャッタ１３は閉じたままである。ただし、時刻「ＡＡ：ＢＢ：ＣＣ」はＡＡ時ＢＢ分ＣＣ秒を示し、ピリオド「．」以下は１秒未満の時間を示す。 First, at time “AA: BB: CC.000100”, the light emitting unit A1 is controlled to emit light. At this time, since the shutter open flag of the synchronization condition table 4371 is “0”, the optical shutter 13 remains closed. However, the time “AA: BB: CC” indicates AA hour BB minute CC second, and the period “.” Or less indicates a time shorter than 1 second.
　同期条件テーブル４３７１によると、時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」になると、発光部Ａ４が発光するように制御される。このとき、同期条件テーブル４３７１のシャッタ開フラグは「１」なので、光シャッタ１３が開くように制御される。このとき、時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」になるのと同時に光シャッタ１３を開く制御をしてもよいが、時刻「ＡＡ：ＢＢ：ＣＣ．０００４１０」などのように、所定の時間（第１の時間）が経過してから光シャッタ１３を開くように制御してもよい。 According to the synchronization condition table 4371, when the time “AA: BB: CC.000400” is reached, the light emitting unit A4 is controlled to emit light. At this time, since the shutter open flag of the synchronization condition table 4371 is “1”, the optical shutter 13 is controlled to open. At this time, the optical shutter 13 may be controlled to open at the same time as the time “AA: BB: CC.000400”, but for a predetermined time (such as time “AA: BB: CC.000410”). The optical shutter 13 may be controlled to open after the first time) has elapsed.
　開かれた光シャッタ１３は、所定の時間（第２の時間）が経過すると閉じるように設定される。第２の時間は、シャッタ開フラグは「１」が付けられた時刻と、その次の時刻との間に含まれる時間範囲に設定される。同期条件テーブル４３７１に従う場合、時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」と、時刻「ＡＡ：ＢＢ：ＣＣ．０００５００」との間の時間範囲（０．０００１秒）に含まれるように第２の時間を設定する。例えば、第１の時間を０．００００１０秒、第２の時間を０．００００８０秒に設定する場合、光シャッタ１３は、時刻「ＡＡ：ＢＢ：ＣＣ．０００４１０」に開かれ、時刻「ＡＡ：ＢＢ：ＣＣ．０００４９０」に閉じるように制御される。 The opened optical shutter 13 is set to close when a predetermined time (second time) elapses. The second time is set to a time range included between the time when the shutter opening flag is set to “1” and the next time. When the synchronization condition table 4371 is followed, the second time is included in the time range (0.0001 seconds) between the time “AA: BB: CC.000400” and the time “AA: BB: CC.000500”. Set. For example, when the first time is set to 0.000010 seconds and the second time is set to 0.000080 seconds, the optical shutter 13 is opened at the time “AA: BB: CC.000410” and the time “AA: BB”. : CC.000490 ”.
　図２４および図２６の例では、時刻「ＡＡ：ＢＢ：ＣＣ．０００１００」において、空間変調素子３６の各表示領域に表示条件テーブル４３６１の位相分布を表示する。そして、時刻「ＡＡ：ＢＢ：ＣＣ．０００１００」に合わせて、発光部Ａ１は、空間変調素子３６の表示領域Ａ１に光３４０を照射する。発光部３３０は、０．０００１秒経過するごとに切り替えられる。時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」になると、発光部Ａ４が表示領域Ａ４に光３４０を照射する。このとき、光シャッタ１３は、時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」から第１の時間が経過した段階で開かれ、時刻「ＡＡ：ＢＢ：ＣＣ．０００４００」から第２の時間が経過した段階で閉ざされる。 24 and FIG. 26, the phase distribution of the display condition table 4361 is displayed in each display area of the spatial modulation element 36 at time “AA: BB: CC.000100”. Then, in accordance with the time “AA: BB: CC.000100”, the light emitting unit A1 irradiates the display area A1 of the spatial modulation element 36 with the light 340. The light emitting unit 330 is switched every 0.0001 seconds. At time “AA: BB: CC.000400”, the light emitting unit A4 irradiates the display area A4 with light 340. At this time, the optical shutter 13 is opened when the first time has elapsed from the time “AA: BB: CC.000400” and the second time has elapsed from the time “AA: BB: CC.000400”. Closed.
　すなわち、有効キー配列が操作領域１２に表示されているときに、光シャッタ１３が開くことになる。そのため、ユーザは、光シャッタ１３を通して操作領域１２を見ているため、操作領域１２に次々に表示される複数のキー配列の中から有効キー配列を認識することができる。 That is, when the effective key array is displayed in the operation area 12, the optical shutter 13 is opened. Therefore, since the user views the operation area 12 through the optical shutter 13, the user can recognize an effective key arrangement from a plurality of key arrangements displayed one after another in the operation area 12.
　図２７は、光源３３の光照射タイミングと、光シャッタ１３のシャッタ開タイミングとを対応させた概念図である。液晶の応答は、空間変調素子３６の表示部に位相分布を表示するタイミングに相当する。一回の液晶の応答で、空間変調素子３６の表示部の各表示領域に、図１２のようにキー配列が表示される。なお、図１２の各表示領域に表示される画像は、実際には位相分布である。 FIG. 27 is a conceptual diagram in which the light irradiation timing of the light source 33 is associated with the shutter opening timing of the optical shutter 13. The response of the liquid crystal corresponds to the timing at which the phase distribution is displayed on the display unit of the spatial modulation element 36. A key arrangement is displayed in each display area of the display section of the spatial modulation element 36 as shown in FIG. Note that the images displayed in the display areas in FIG. 12 are actually phase distributions.
　光源３３の複数の発光部３３０は、光源制御部３２の制御に応じて、各発光部３３０に対応する表示領域に向けて光を出射する。図２７では、一回の液晶の応答期間内に、１５個の発光部３３０が次々に切り替えられて発光することを示す。 The plurality of light emitting units 330 of the light source 33 emit light toward a display area corresponding to each light emitting unit 330 under the control of the light source control unit 32. FIG. 27 shows that 15 light emitting units 330 are switched one after another within one liquid crystal response period to emit light.
　液晶のオンオフ、発光部３３０の切り替え、シャッタ１３を開くタイミングは一定となるようにしてもよいし、一定にしなくてもよい。すなわち、所望の画像である有効キー配列が操作領域１２に表示されるタイミングでシャッタ１３が開くように設定すればよい。 The on / off state of the liquid crystal, the switching of the light emitting unit 330, and the opening timing of the shutter 13 may be constant or may not be constant. In other words, the shutter 13 may be set to open at the timing when the effective key arrangement which is a desired image is displayed in the operation area 12.
　シャッタ制御部４４は、１５個の発光部３３０が切り替えられる際に、有効キー配列が空間変調素子３６の表示領域に光が照射されているタイミングで光シャッタ１３を開く制御をする。シャッタ制御部４４は、制御条件生成部４１３から取得した同期条件に従うことによって、有効キー配列が操作領域１２に投射されたタイミングで光シャッタ１３を開くことができる。 The shutter control unit 44 controls to open the optical shutter 13 at the timing when the effective key array is irradiated with light on the display area of the spatial modulation element 36 when the 15 light emitting units 330 are switched. The shutter control unit 44 can open the optical shutter 13 at the timing when the effective key array is projected onto the operation area 12 by following the synchronization condition acquired from the control condition generation unit 413.
　制御条件出力部４３６は、制御条件設定部４３５から表示条件および同期条件を取得する。制御条件出力部４３６は、取得した表示条件および同期条件を含む制御条件を投射手段３０に出力する。 The control condition output unit 436 acquires display conditions and synchronization conditions from the control condition setting unit 435. The control condition output unit 436 outputs a control condition including the acquired display condition and synchronization condition to the projection unit 30.
　図２８は、操作情報生成部４１５の構成を示すブロック図である。操作情報生成部４１５は、画像情報受信部４５１、操作内容確定部４５２、有効キー配列受信部４５３、有効キー配列記憶部４５４、操作情報生成部４５５および操作情報出力部４５６を有する。 FIG. 28 is a block diagram illustrating a configuration of the operation information generation unit 415. The operation information generation unit 415 includes an image information reception unit 451, an operation content determination unit 452, an effective key array reception unit 453, an effective key array storage unit 454, an operation information generation unit 455, and an operation information output unit 456.
　画像情報受信部４５１は、撮像手段２０が撮像した操作領域１２の画像情報を取得する。画像情報受信部４５１は、取得した画像情報を操作内容確定部４５２に出力する。 The image information receiving unit 451 acquires the image information of the operation area 12 captured by the imaging unit 20. The image information receiving unit 451 outputs the acquired image information to the operation content determination unit 452.
　操作内容確定部４５２は、取得した画像情報を解析し、ユーザが操作領域１２で行った操作内容を確定する。例えば、操作内容確定部４５２は、ある時刻においてユーザが操作領域１２に指し示した操作位置を操作内容として確定し、確定した操作位置に時間情報を関連付けた操作位置情報を生成する。すなわち、操作内容確定部４５２は、撮像手段２０が撮像した画像情報を解析し、ユーザが操作領域１２に指示した操作位置を確定し、ユーザがその操作位置を指示した時刻とその操作位置とを関連付けることによって操作位置情報を生成する。 The operation content determination unit 452 analyzes the acquired image information and determines the operation content performed by the user in the operation area 12. For example, the operation content determination unit 452 determines the operation position pointed to the operation area 12 by the user at a certain time as the operation content, and generates operation position information in which time information is associated with the determined operation position. That is, the operation content determination unit 452 analyzes the image information captured by the imaging unit 20, determines the operation position instructed by the user to the operation area 12, and determines the time at which the user instructed the operation position and the operation position. Operation position information is generated by associating.
　例えば、図２９のように、操作領域１２に直交座標系が設定されると、操作内容確定部４５２は、確定した操作位置を直交座標系の座標に変換することができる。図２９の直交座標系の例では、操作領域１２の左下角の頂点に原点を設定する。４行×３列の行列形式のキー配列に含まれる各記号は、１～１２の数字を付与した操作位置（破線）に投射される。操作位置１は、（Ｘ１、Ｙ５）、（Ｘ１、Ｙ４）、（Ｘ２、Ｙ４）および（Ｘ２、Ｙ５）を頂点とする矩形内に設定される。その他の操作位置も同様に設定される。 For example, as shown in FIG. 29, when an orthogonal coordinate system is set in the operation area 12, the operation content determination unit 452 can convert the determined operation position into coordinates of the orthogonal coordinate system. In the example of the orthogonal coordinate system of FIG. 29, the origin is set at the vertex of the lower left corner of the operation area 12. Each symbol included in a 4 × 3 matrix matrix key pattern is projected to an operation position (dashed line) to which numbers 1 to 12 are assigned. The operation position 1 is set within a rectangle having (X1, Y5), (X1, Y4), (X2, Y4), and (X2, Y5) as vertices. Other operation positions are set similarly.
　例えば、操作内容確定部４５２は、ある時刻において、（Ｘ３、Ｙ４）、（Ｘ３、Ｙ３）、（Ｘ４、Ｙ３）および（Ｘ４、Ｙ４）を頂点とする矩形内に操作がなされたと認識すると、その時刻に操作位置１０が指示されたものと確定する。 For example, when the operation content determination unit 452 recognizes that an operation is performed in a rectangle having (X3, Y4), (X3, Y3), (X4, Y3), and (X4, Y4) as vertices at a certain time, It is determined that the operation position 10 is instructed at that time.
　操作内容確定部４５２は、ユーザによって指示された操作位置を時間情報に関連付けた操作位置情報を操作情報生成部４５５に出力する。なお、操作内容確定部４５２は、操作位置の座標を時間情報に関連付けた操作位置情報を出力するように構成してもよい。 The operation content determination unit 452 outputs operation position information in which the operation position instructed by the user is associated with time information to the operation information generation unit 455. Note that the operation content determination unit 452 may be configured to output operation position information in which the coordinates of the operation position are associated with time information.
　有効キー配列受信部４５３は、制御条件生成部４１３から有効キー配列を受信する。有効キー配列受信部４５３は、受信した有効キー配列を有効キー配列記憶部４５４に記憶させる。 The valid key array receiving unit 453 receives the valid key array from the control condition generating unit 413. The valid key array receiving unit 453 stores the received valid key array in the valid key array storage unit 454.
　有効キー配列記憶部４５４は、受信した有効キー配列を記憶する。 The effective key array storage unit 454 stores the received effective key array.
　操作情報生成部４５５は、操作内容確定部４５２によって確定された操作領域１２内の操作位置と、有効キー配列記憶部４５４に記憶された有効キー配列とを対応させて、ユーザが行ったキー操作情報を生成する。すなわち、操作情報生成部４５５は、操作内容確定部４５２によって確定された操作位置情報と有効表示情報とを関連付けたキー操作情報を生成する。 The operation information generation unit 455 associates the operation position in the operation area 12 determined by the operation content determination unit 452 with the valid key layout stored in the valid key layout storage unit 454, and performs the key operation performed by the user. Generate information. That is, the operation information generation unit 455 generates key operation information in which the operation position information determined by the operation content determination unit 452 is associated with valid display information.
　操作情報出力部４５６は、操作情報生成部４５５によって生成されたキー操作情報を出力する。例えば、図１６のような照合システム１を想定する場合、操作情報出力部４５６は、操作情報をサーバ１０２に出力する。 The operation information output unit 456 outputs the key operation information generated by the operation information generation unit 455. For example, when assuming the collation system 1 as illustrated in FIG. 16, the operation information output unit 456 outputs the operation information to the server 102.
　キー配列に含まれる各記号は、投射手段３０によって操作領域１２の所定の位置に投射される。例えば、キー配列の１番目の記号は操作位置１に、２番目の記号は操作位置２に、・・・、１５番目の記号は操作位置１５に投射される。操作情報生成部４１５は、画像情報に含まれるユーザの操作から操作位置を時系列で特定し、有効キー配列を構成する記号が投射された位置と操作位置とを対応させて、ユーザが入力したキー操作情報を生成する。 Each symbol included in the key array is projected to a predetermined position in the operation area 12 by the projection means 30. For example, the first symbol of the key arrangement is projected to the operation position 1, the second symbol is projected to the operation position 2,..., And the fifteenth symbol is projected to the operation position 15. The operation information generation unit 415 specifies the operation position in time series from the user's operation included in the image information, and associates the position where the symbols constituting the effective key array are projected with the operation position, and is input by the user Generate key operation information.
　特許文献１（特許第４９１１２２５号公報）には、使用者に認識させるべき有効表示情報を含む複数の表示情報を高速に切り替える表示システムについて開示されている。特許文献１のシステムは、有効表示情報が表示されたタイミングで開く光シャッタを有する。特許文献１のシステムの表示部にはたくさんの表示情報が次々に表示される。そのため、光シャッタを通さずに表示部を見ている人は、図２の左図のように、全ての表示情報が合成された意味のない情報を認識することになる。一方、光シャッタは有効表示情報の表示タイミングで開くため、光シャッタを通して表示部を見ているユーザは、表示部に表示された秘匿情報を認識することができる。 Patent Document 1 (Japanese Patent No. 4911225) discloses a display system that switches a plurality of display information including effective display information to be recognized by a user at high speed. The system of Patent Document 1 has an optical shutter that opens at the timing when valid display information is displayed. A lot of display information is displayed one after another on the display unit of the system of Patent Document 1. Therefore, a person watching the display unit without passing through the optical shutter recognizes meaningless information in which all display information is synthesized as shown in the left diagram of FIG. On the other hand, since the optical shutter opens at the display timing of the effective display information, the user who is looking at the display unit through the optical shutter can recognize the confidential information displayed on the display unit.
　ところで、特許文献１のシステムで用いられる一般的な表示装置は、液晶に表示された表示情報を切り替えるため、３６０フレーム毎秒（以下、ｆｐｓ：frames per second）程度でしか表示情報を切り替えられない。現状、一般的に入手可能な高速カメラであれば、１０００ｆｐｓ以上の撮影が可能である。そのため、特許文献１のシステムでは、一般的な高速カメラを用いれば、表示部に表示された表示情報を認識される可能性がある。 By the way, since a general display device used in the system of Patent Document 1 switches display information displayed on a liquid crystal, the display information can be switched only at about 360 frames per second (hereinafter referred to as “fps”). Currently, a generally available high-speed camera can shoot at 1000 fps or higher. Therefore, in the system of Patent Document 1, if a general high-speed camera is used, display information displayed on the display unit may be recognized.
　それに対し、本実施形態では、複数の発光部３３０を切り替えることによって、空間変調素子３６の異なる表示領域に表示された異なる表示情報が操作領域１２に次々に投射される。本実施形態によれば、例えば図１２のように、一回の液晶の応答で、１５種類の位相画像を空間変調素子３６の表示部に同時に書き込むことができる。そのため、本実施形態では、操作領域１２に投射する表示情報の切り替えが液晶の応答速度に律速されず、特許文献１のシステムと比較して高速で表示情報を切り替えることができる。 On the other hand, in the present embodiment, different display information displayed in different display areas of the spatial modulation element 36 is sequentially projected onto the operation area 12 by switching the plurality of light emitting units 330. According to the present embodiment, for example, as shown in FIG. 12, 15 types of phase images can be simultaneously written on the display unit of the spatial modulation element 36 by a single liquid crystal response. Therefore, in the present embodiment, switching of display information to be projected onto the operation area 12 is not limited by the response speed of the liquid crystal, and display information can be switched at a higher speed than the system of Patent Document 1.
　例えば、発光部３３０にレーザ光源を用いる場合、レーザパルスを例えば２０マイクロ秒程度に設定すればよい。また、光シャッタ１３にＭＥＭＳ式のものを用いれば２０マイクロ秒の応答も可能である。光シャッタ１３の応答速度を４０マイクロ秒に設定すれば、見かけ上の動作速度は２５０００ｆｐｓとなる。この動作速度で表示された画像を撮像するには、１０００００ｆｐｓクラスのカメラが必要となる。このクラスの高速カメラは非常に特殊である上に大型であるので、有効表示情報を覗き見る目的に用いることは困難である。 For example, when a laser light source is used for the light emitting unit 330, the laser pulse may be set to about 20 microseconds, for example. In addition, if a MEMS type optical shutter 13 is used, a response of 20 microseconds is possible. If the response speed of the optical shutter 13 is set to 40 microseconds, the apparent operation speed is 25000 fps. In order to capture an image displayed at this operation speed, a camera of the 100,000 fps class is required. This class of high-speed camera is very special and large in size, so it is difficult to use it for peeking at effective display information.
　また、特許文献１のシステムでは、１フレーム（６０ヘルツ）の表示情報の数は６程度であるため、ユーザの指の動きと表示パターンとの組み合わせの数は２０～３０程度である。この程度の数の組み合わせでは、ユーザの指の動きと表示パターンとの組み合わせを絞り込むことによって、ユーザが入力した情報を推測することができてしまう。 Further, in the system of Patent Document 1, since the number of display information for one frame (60 Hz) is about 6, the number of combinations of user's finger movements and display patterns is about 20-30. With this number of combinations, information input by the user can be estimated by narrowing down the combinations of the user's finger movements and display patterns.
　それに対し、本実施形態に係る情報入力装置１０では、空間変調素子の表示領域の分割数を増やすことによって表示パターンを増やすことができる。例えば、図１２のように、空間変調素子の表示部を１５個の表示領域に分割する場合、表示パターンの数は３００～４５０程度になる。この程度になると、ユーザの指の動きと表示パターンとの組み合わせを絞り込むことは困難になる。 On the other hand, in the information input device 10 according to the present embodiment, the display pattern can be increased by increasing the number of divisions of the display area of the spatial modulation element. For example, as shown in FIG. 12, when the display unit of the spatial modulation element is divided into 15 display areas, the number of display patterns is about 300 to 450. At this level, it becomes difficult to narrow down combinations of user's finger movements and display patterns.
　表示領域を５行×６列とすれば、空間変調素子２６の表示部に３０種類のパターンを同時に表示させることができる。例えば、情報入力装置１０は、空間変調素子２６の表示部に１フレーム当たり３回の書き込みを行うと、１フレーム当たり９０種類のパターンを表示することができる。全てを異なるパターンとすると、情報入力装置１０は、１秒間に５４００種類のパターン、１０秒間では５４０００種類のパターンを操作領域１２に投射することができる。有効表示情報を含めて複数回発生するパターンを１０００個程度作っておけば、仮に全てのパターンが記録されたとしても、ユーザの指の動きとパターンとの対応を検討するのに非常に多くの組み合わせを試さなければならない。 If the display area is 5 rows × 6 columns, 30 types of patterns can be simultaneously displayed on the display unit of the spatial modulation element 26. For example, the information input device 10 can display 90 types of patterns per frame when writing is performed three times per frame on the display unit of the spatial modulation element 26. If all the patterns are different, the information input device 10 can project 5400 types of patterns in one second onto the operation area 12 in 5 seconds. If there are about 1000 patterns that are generated multiple times including valid display information, even if all the patterns are recorded, it is very many to examine the correspondence between the user's finger movements and patterns. You must try a combination.
　以上のように、本実施形態の情報入力装置によれば、操作領域に投射する表示情報を高速で切り替えることによって、表示情報をカメラで撮像することを困難にし、入力された情報の秘密性を向上させることが可能になる。また、本実施形態に係る情報入力装置によれば、１サイクルあたりの表示パターンが大幅に増えるため、ユーザの操作と表示パターンとの組み合わせの数が飛躍的に増大し、ユーザの操作を推測することが困難になる。 As described above, according to the information input device of the present embodiment, it is difficult to capture the display information with the camera by switching the display information projected onto the operation area at high speed, and the confidentiality of the input information is improved. It becomes possible to improve. In addition, according to the information input device according to the present embodiment, the number of display patterns per cycle is significantly increased, so the number of combinations of user operations and display patterns is dramatically increased, and user operations are estimated. It becomes difficult.
　（変形例）
　図３０は、本実施形態の変形例に係る情報入力装置１０－１の概略図である。情報入力装置１０－１は、表示情報を投射する投射装置３８１を操作領域１２の裏側に配置する。投射装置３８１は、ユーザが見る方向の裏側から操作領域１２に表示情報を投射する。本変形例のように、裏側から操作領域１２に表示情報を投射する場合、操作領域１２にはリア型スクリーンを用いればよい。なお、投射装置３８１と操作領域１２との間に鏡面を配置し、投射装置３８１による表示情報の投射方向を鏡面によって操作領域１２に導くように構成してもよい。 (Modification)
FIG. 30 is a schematic diagram of an information input device 10-1 according to a modification of the present embodiment. The information input device 10-1 arranges a projection device 381 that projects display information on the back side of the operation area 12. The projection device 381 projects display information onto the operation area 12 from the back side in the direction in which the user looks. When the display information is projected from the back side to the operation area 12 as in this modification, a rear type screen may be used for the operation area 12. In addition, a mirror surface may be arranged between the projection device 381 and the operation region 12, and the projection direction of the display information by the projection device 381 may be guided to the operation region 12 by the mirror surface.
　（第２の実施形態）
　次に、本発明の第２の実施形態に係る情報入力装置について説明する。本実施形態においては、制御条件生成部４１３のパターン記憶部４３３に記憶するキー配列（表示情報ともよぶ）の位相分布をキー配列ごとではなく、キー配列を構成する記号ごとに記憶する。なお、本実施形態に係る情報入力装置は、第１の実施形態に係る情報入力装置１０と同様の構成でよい。 (Second Embodiment)
Next, an information input device according to a second embodiment of the present invention will be described. In the present embodiment, the phase distribution of the key arrangement (also referred to as display information) stored in the pattern storage unit 433 of the control condition generation unit 413 is stored not for each key arrangement but for each symbol constituting the key arrangement. Note that the information input device according to the present embodiment may have the same configuration as the information input device 10 according to the first embodiment.
　図３１は、本実施形態に係る情報入力装置が記憶する位相分布テーブル４３４２の一例である。位相分布テーブル４３４２は、キー配列に含まれる各記号を操作領域１２の各操作位置に対応させた画像の位相分布を格納する。位相分布テーブル４３４２では、各位相分布に識別記号を付けている。なお、位相分布テーブル４３４２では、「Ｘ」と「＃」の位置を右下の操作位置に固定している。これ以降、位相分布テーブル４３４２の位相分布に対応するキー配列を部分キー配列と呼び、部分キー配列に対応する位相分布を部分パターンと呼ぶことがある。 FIG. 31 is an example of a phase distribution table 4342 stored in the information input device according to the present embodiment. The phase distribution table 4342 stores a phase distribution of an image in which each symbol included in the key array is associated with each operation position in the operation area 12. In the phase distribution table 4342, an identification symbol is attached to each phase distribution. In the phase distribution table 4342, the positions of “X” and “#” are fixed at the lower right operation position. Hereinafter, the key array corresponding to the phase distribution of the phase distribution table 4342 may be referred to as a partial key array, and the phase distribution corresponding to the partial key array may be referred to as a partial pattern.
　位相分布テーブル４３４２には、０～９の１０個の記号のそれぞれに関して、１０個の操作位置に対応させた１０通りの部分パターンが格納される。すなわち、位相分布テーブル４３４２は、１００個の部分パターンを格納する。 The phase distribution table 4342 stores 10 partial patterns corresponding to 10 operation positions for each of 10 symbols from 0 to 9. That is, the phase distribution table 4342 stores 100 partial patterns.
　一方、図２２のように、１０個の記号を全て配置させたキー配列の位相分布を全ての記号の組み合わせに対して用意すると、１０！個（３６２８８００個）の位相分布が必要となる。そのため、本実施形態によれば、パターン記憶部４３３の容量を飛躍的に削減することができる。 On the other hand, as shown in FIG. 22, if a phase distribution of a key arrangement in which all 10 symbols are arranged is prepared for all combinations of symbols, 10! (3628800) phase distributions are required. Therefore, according to the present embodiment, the capacity of the pattern storage unit 433 can be dramatically reduced.
　例えば、本実施形態においては、空間変調素子２６の各表示領域に各部分パターンをランダムに表示すればよい。なお、空間変調素子２６は、ランダムではなく所定の規則に従って部分パターンを表示してもよい。 For example, in the present embodiment, each partial pattern may be displayed at random in each display area of the spatial modulation element 26. The spatial modulation element 26 may display the partial pattern according to a predetermined rule instead of random.
　図３２は、本実施形態において、光源３３の光照射タイミングと、光シャッタ１３のシャッタを開くタイミングとを対応させた概念図である。本実施形態においては、空間変調素子２６の表示部に表示する位相分布のうち、０～９の各記号を形成する部分キー配列を一つずつ選択してキー配列を構成する。そのため、本実施形態においては、図３２のように、空間変調素子２６に対する１回の書き込みタイミングで光シャッタ１３を複数回開くこともある。 FIG. 32 is a conceptual diagram in which the light irradiation timing of the light source 33 and the timing of opening the shutter of the optical shutter 13 are associated in the present embodiment. In the present embodiment, a partial key array that forms each symbol of 0 to 9 is selected one by one from the phase distribution displayed on the display unit of the spatial modulation element 26 to configure a key array. Therefore, in the present embodiment, as shown in FIG. 32, the optical shutter 13 may be opened a plurality of times at one writing timing with respect to the spatial modulation element 26.
　例えば、空間変調素子２６に対する１回の書き込みタイミングで３０パターンを書き込む場合、４回の書き込みで１２０パターンを書き込むことができる。０～９の１０個の記号によってキー配列を構成する場合、書き込んだ１２０パターンから０～９の記号を一つずつ含む１０個のパターンを選択して有効キー配列を形成すればよい。この場合、パターンに含まれる記号が規則的に並んでいたとしても、光シャッタ１３を開くタイミングが知られなければ第３者が有効キー配列を知ることはない。 For example, when 30 patterns are written in one write timing to the spatial modulation element 26, 120 patterns can be written in four writes. When the key array is composed of 10 symbols 0 to 9, it is only necessary to select 10 patterns each including 0 to 9 symbols from the written 120 patterns to form an effective key array. In this case, even if the symbols included in the pattern are regularly arranged, the third party does not know the effective key arrangement if the timing for opening the optical shutter 13 is not known.
　すなわち、本実施形態において、パターン記憶部４３３は、行列形式で配置された複数の記号のうち少なくとも一つの記号が配置された部分キー配列が操作領域１２に表示される部分パターンを記憶する。パターン選択部４３４は、パターン記憶部４３３から複数の部分パターンを選択する。制御条件設定部４３５は、複数の部分パターンを空間変調素子３６の表示面に表示させることによって、操作領域１２にキー配列が表示される条件を表示条件として設定する。このとき、制御条件設定部４３５は、有効キー配列を構成する部分キー配列の部分パターンが表示された表示領域に光を照射する発光部３３０の動作タイミングに合わせて、光シャッタ１３を開く条件を同期条件として設定する。 That is, in the present embodiment, the pattern storage unit 433 stores a partial pattern in which a partial key arrangement in which at least one symbol is arranged among a plurality of symbols arranged in a matrix format is displayed in the operation area 12. The pattern selection unit 434 selects a plurality of partial patterns from the pattern storage unit 433. The control condition setting unit 435 sets a condition for displaying the key arrangement in the operation area 12 as a display condition by displaying a plurality of partial patterns on the display surface of the spatial modulation element 36. At this time, the control condition setting unit 435 sets a condition for opening the optical shutter 13 in accordance with the operation timing of the light emitting unit 330 that irradiates light to the display area where the partial pattern of the partial key arrangement constituting the effective key arrangement is displayed. Set as a synchronization condition.
　本実施形態に係る情報入力装置によれば、記憶しておく表示情報の位相分布の数を飛躍的に少なくすることができる。そのため、情報入力装置が位相分布を記憶するための記憶領域を削減することが可能となる。 The information input device according to this embodiment can dramatically reduce the number of phase distributions of display information to be stored. Therefore, it is possible to reduce the storage area for the information input device to store the phase distribution.
　（第３の実施形態）
　次に、本発明の第３の実施形態に係る情報入力装置について説明する。本実施形態においては、キー配列を自装置内で生成する。なお、本実施形態に係る情報入力装置は、以下で説明する構成以外は、第１の実施形態に係る情報入力装置１０と同様の構成である。 (Third embodiment)
Next, an information input device according to a third embodiment of the present invention will be described. In the present embodiment, the key arrangement is generated in the own device. The information input device according to the present embodiment has the same configuration as that of the information input device 10 according to the first embodiment, except for the configuration described below.
　図３３は、本実施形態に係る情報入力装置のキー配列格納部４１２－２の構成を示すブロック図である。本実施形態のキー配列格納部４１２－２は、第１の実施形態のキー配列格納部４１２にキー配列生成部４２５を追加した構成をもつ。 FIG. 33 is a block diagram showing the configuration of the key array storage unit 412-2 of the information input device according to this embodiment. The key array storage unit 412-2 of this embodiment has a configuration in which a key array generation unit 425 is added to the key array storage unit 412 of the first embodiment.
　キー配列生成部４２５は、操作領域１２に表示させるキー配列を生成する。例えば、キー配列生成部４２５は、制御条件生成部４１３の要求に応じた数のキー配列を生成する。なお、キー配列生成部４２５は、投射するキー配列の数だけキー配列を生成してもよいし、投射するキー配列の数よりも余分な数のキー配列を生成してもよい。キー配列生成部４２５は、生成したキー配列をキー配列受信部４２１に出力する。 The key array generation unit 425 generates a key array to be displayed in the operation area 12. For example, the key arrangement generation unit 425 generates the number of key arrangements according to the request of the control condition generation unit 413. The key array generation unit 425 may generate as many key arrays as the number of key arrays to be projected, or may generate an extra number of key arrays than the number of key arrays to be projected. The key array generation unit 425 outputs the generated key array to the key array reception unit 421.
　キー配列受信部４２１は、キー配列生成部４２５が生成したキー配列をサーバ１０２に送信し、それらのキー配列に対応する位相分布を要求する。キー配列受信部４２１は、要求したキー配列に対応する位相分布を受信すると、それらの位相分布をキー配列に対応付けて制御条件生成部４１３に送信する。 The key arrangement receiving unit 421 transmits the key arrangement generated by the key arrangement generation unit 425 to the server 102 and requests a phase distribution corresponding to the key arrangement. When receiving the phase distribution corresponding to the requested key arrangement, the key arrangement reception unit 421 transmits the phase distribution to the control condition generation unit 413 in association with the key arrangement.
　制御条件生成部４１３は、受信した位相分布をキー配列に対応付けて位相分布記憶手段４３３に記憶する。 The control condition generation unit 413 stores the received phase distribution in the phase distribution storage unit 433 in association with the key arrangement.
　本実施形態に係る情報入力装置においては、投射するキー配列の数に応じた数の位相分布をパターン記憶部４３３に記憶しておけばよい。そのため、本実施形態に係る情報入力装置によれば、キー配列記憶部４２２やパターン記憶部４３３の記憶容量を減らすことができる。 In the information input device according to the present embodiment, the number of phase distributions corresponding to the number of key arrays to be projected may be stored in the pattern storage unit 433. Therefore, according to the information input device according to the present embodiment, the storage capacity of the key array storage unit 422 and the pattern storage unit 433 can be reduced.
　（第４の実施形態）
　次に、本発明の第４の実施形態に係る情報入力装置について説明する。 (Fourth embodiment)
Next, an information input device according to a fourth embodiment of the present invention will be described.
　図３４のように、本実施形態に係る情報入力装置１０－３は照合手段５０を備える。照合手段５０は、情報入力装置１０－３の上位システムを利用するユーザの認証情報を照合する手段である。 As shown in FIG. 34, the information input device 10-3 according to the present embodiment includes a verification unit 50. The collating unit 50 is a unit that collates authentication information of a user who uses the host system of the information input device 10-3.
　図３５は、本実施形態に係る照合手段５０の構成を示すブロック図である。照合手段５０は、操作情報取得部５０１、操作情報照合部５０２、認証情報記憶部５０３および照合結果出力部５０４を有する。 FIG. 35 is a block diagram showing a configuration of the collation means 50 according to the present embodiment. The verification unit 50 includes an operation information acquisition unit 501, an operation information verification unit 502, an authentication information storage unit 503, and a verification result output unit 504.
　操作情報取得部５０１は、処理部４１からキー操作情報を取得する。操作情報取得部５０１は、取得したキー操作情報を操作情報照合部５０２に出力する。 The operation information acquisition unit 501 acquires key operation information from the processing unit 41. The operation information acquisition unit 501 outputs the acquired key operation information to the operation information collation unit 502.
　操作情報照合部５０２は、操作情報取得部５０１からキー操作情報を受信し、受信したキー操作情報を入力したユーザの認証情報を認証情報記憶部５０３から取得する。 The operation information matching unit 502 receives the key operation information from the operation information acquisition unit 501 and acquires the authentication information of the user who has input the received key operation information from the authentication information storage unit 503.
　認証情報記憶部５０３は、情報入力装置１０－３の上位システムを利用するユーザの認証情報を記憶する。 The authentication information storage unit 503 stores authentication information of users who use the host system of the information input device 10-3.
　操作情報照合部５０２は、入力されたキー操作情報に含まれるユーザのキー操作と、認証情報記憶部５０３から取得したそのユーザの認証情報とを照合する。操作情報照合部５０２は、照合した結果を照合結果出力部５０４に出力する。 The operation information collation unit 502 collates the user's key operation included in the input key operation information with the user's authentication information acquired from the authentication information storage unit 503. The operation information collation unit 502 outputs the collation result to the collation result output unit 504.
　照合結果出力部５０４は、照合結果を上位システムに送信する。 The collation result output unit 504 transmits the collation result to the host system.
　本実施形態に係る情報入力装置によれば、自装置内でユーザ認証を完結することができるため、ネットワークを原因とする遅延や障害を回避することができる。ただし、情報入力装置の記憶装置には限りがあるため、ユーザ数が限られた用途に向いている。例えば、本実施形態に係る情報入力装置は、登録された少人数のユーザが特定の施設に入場する際に用いる認証などに適している。 According to the information input device according to the present embodiment, user authentication can be completed within the device itself, so that delays and failures caused by the network can be avoided. However, since the storage device of the information input device is limited, it is suitable for applications where the number of users is limited. For example, the information input device according to the present embodiment is suitable for authentication or the like used when a registered small number of users enter a specific facility.
　（ハードウェア構成）
　次に、本発明の各実施形態に係る情報入力装置を可能とするためのハードウェア構成について、図３６のコンピュータ９０を一例として挙げて説明する。なお、図３６のコンピュータ９０は、各実施形態に係る情報入力装置を可能とするための一構成例であって、本発明の範囲を限定するものではない。また、各実施形態に係る情報入力装置は、図３のようなインターフェース装置１１の形態とする場合、図３６のコンピュータ９０の機能を有するマイクロコンピュータとしてもよい。 (Hardware configuration)
Next, a hardware configuration for enabling the information input device according to each embodiment of the present invention will be described using the computer 90 of FIG. 36 as an example. Note that the computer 90 in FIG. 36 is a configuration example for enabling the information input device according to each embodiment, and does not limit the scope of the present invention. In addition, the information input device according to each embodiment may be a microcomputer having the function of the computer 90 of FIG. 36 in the case of the interface device 11 as shown in FIG.
　図３６のように、コンピュータ９０は、プロセッサ９１、主記憶装置９２、補助記憶装置９３、入出力インターフェース９５、通信インターフェース９６を備える。プロセッサ９１、主記憶装置９２、補助記憶装置９３、入出力インターフェース９５および通信インターフェース９６は、バス９９を介して互いにデータ授受可能に接続される。また、プロセッサ９１、主記憶装置９２、補助記憶装置９３および入出力インターフェース９５は、通信インターフェース９６を介して、インターネットやイントラネットなどのネットワークと接続する。コンピュータ９０は、ネットワークを介して上位システムのサーバやコンピュータに接続され、キー配列情報などを上位システムから受信する。 36, the computer 90 includes a processor 91, a main storage device 92, an auxiliary storage device 93, an input / output interface 95, and a communication interface 96. The processor 91, the main storage device 92, the auxiliary storage device 93, the input / output interface 95, and the communication interface 96 are connected to each other via a bus 99 so as to exchange data. The processor 91, the main storage device 92, the auxiliary storage device 93, and the input / output interface 95 are connected to a network such as the Internet or an intranet via a communication interface 96. The computer 90 is connected to a host system server or computer via a network, and receives key layout information and the like from the host system.
　プロセッサ９１は、補助記憶装置９３等に格納されたプログラムを主記憶装置９２に展開し、展開されたプログラムを実行する。本実施形態においては、コンピュータ９０にインストールされたソフトウェアプログラムを用いる構成とすればよい。プロセッサ９１は、本実施形態に係る情報入力装置の演算処理や制御処理を実行する。 The processor 91 expands the program stored in the auxiliary storage device 93 or the like in the main storage device 92, and executes the expanded program. In the present embodiment, a configuration using a software program installed in the computer 90 may be adopted. The processor 91 executes arithmetic processing and control processing of the information input device according to the present embodiment.
　主記憶装置９２は、プログラムが展開される領域を有する。主記憶装置９２は、例えばＤＲＡＭ（Dynamic Random Access Memory）などの揮発性メモリとすればよい。また、ＭＲＡＭ（Magnetoresistive Random Access Memory）などの不揮発性メモリを主記憶装置９２として構成・追加してもよい。 The main storage device 92 has an area where the program is expanded. The main storage device 92 may be a volatile memory such as a DRAM (Dynamic Random Access Memory). Further, a nonvolatile memory such as MRAM (Magnetoresistive Random Access Memory) may be configured and added as the main storage device 92.
　補助記憶装置９３は、表示情報の位相分布やキー配列などのデータを記憶する手段である。補助記憶装置９３は、ハードディスクやフラッシュメモリなどのローカルディスクによって構成される。なお、表示情報の位相分布を主記憶装置９２に記憶させる構成とし、補助記憶装置９３を省略することも可能である。 The auxiliary storage device 93 is means for storing data such as phase distribution of display information and key arrangement. The auxiliary storage device 93 is configured by a local disk such as a hard disk or a flash memory. Note that the phase distribution of display information may be stored in the main storage device 92, and the auxiliary storage device 93 may be omitted.
　入出力インターフェース９５は、コンピュータ９０と周辺機器との接続規格に基づいて、コンピュータ９０と周辺機器とを接続する装置である。通信インターフェース９６は、規格や仕様に基づいて、インターネットやイントラネットなどのネットワークに接続するためのインターフェースである。なお、図３６においては、インターフェースをＩ／Ｆ（Interface）と略して表記している。入出力インターフェース９５および通信インターフェース９６は、外部機器と接続するインターフェースとして共通化してもよい。 The input / output interface 95 is a device that connects the computer 90 and peripheral devices based on the connection standard between the computer 90 and peripheral devices. The communication interface 96 is an interface for connecting to a network such as the Internet or an intranet based on standards and specifications. In FIG. 36, the interface is abbreviated as I / F (Interface). The input / output interface 95 and the communication interface 96 may be shared as an interface connected to an external device.
　コンピュータ９０には、必要に応じて、キーボードやマウス、タッチパネルなどといった入力機器を接続できるように構成してもよい。それらの入力機器は、情報や設定の入力に使用される。なお、タッチパネルを入力機器として用いる場合は、表示機器の表示部が入力機器の入力部を兼ねる構成とすればよい。プロセッサ９１と入力機器との間のデータ授受は、入力インターフェース９５に仲介させればよい。 The computer 90 may be configured so that input devices such as a keyboard, a mouse, and a touch panel can be connected as necessary. These input devices are used for inputting information and settings. Note that when the touch panel is used as an input device, the display unit of the display device may serve as the input unit of the input device. Data exchange between the processor 91 and the input device may be mediated by the input interface 95.
　通信インターフェース９６は、ネットワークを通じて、別のコンピュータやサーバなどの上位システムに接続される。上位システムは、通信インターフェース９６を介して、本発明の各実施形態で用いる表示情報の位相分布やキー配列を含むキー配列情報をコンピュータ９０に送信する。上位システムは、本発明の各実施形態で用いる表示情報の位相分布を自装置で生成してもよいし、別の装置から取得してもよい。 The communication interface 96 is connected to a host system such as another computer or server through a network. The host system transmits key arrangement information including the phase distribution of the display information and the key arrangement used in each embodiment of the present invention to the computer 90 via the communication interface 96. The host system may generate the phase distribution of the display information used in each embodiment of the present invention by itself or may acquire it from another device.
　また、コンピュータ９０は、各種の情報を表示するための表示機器を備え付けてもよい。表示機器を備え付ける場合、コンピュータ９０には、表示機器の表示を制御するための表示制御装置（図示しない）を備えることが好ましい。表示機器は、入力インターフェース９５を介してコンピュータ９０に接続すればよい。 Further, the computer 90 may be provided with a display device for displaying various information. When the display device is provided, the computer 90 is preferably provided with a display control device (not shown) for controlling the display of the display device. The display device may be connected to the computer 90 via the input interface 95.
　また、コンピュータ９０には、必要に応じて、リーダライタを備え付けてもよい。リーダライタは、バス９９に接続され、プロセッサ９１と図示しない記録媒体（プログラム記録媒体）との間で、記録媒体からのデータ・プログラムの読み出し、コンピュータ９０の処理結果の記録媒体への書き込みなどを仲介する。記録媒体は、例えばＳＤ（Secure Digital）カードやＵＳＢ（Universal Serial Bus）メモリなどの半導体記録媒体などで実現できる。また、記録媒体５１６は、フレキシブルディスクなどの磁気記録媒体、ＣＤ（Compact Disk）やＤＶＤ（Digital Versatile Disc）などの光学記録媒体やその他の記録媒体によって実現してもよい。 Further, the computer 90 may be provided with a reader / writer as necessary. The reader / writer is connected to the bus 99 and reads a data program from the recording medium and writes a processing result of the computer 90 to the recording medium between the processor 91 and a recording medium (program recording medium) (not shown). Mediate. The recording medium can be realized by a semiconductor recording medium such as an SD (Secure Digital) card or a USB (Universal Serial Bus) memory. The recording medium 516 may be realized by a magnetic recording medium such as a flexible disk, an optical recording medium such as a CD (Compact Disk) and a DVD (Digital Versatile Disk), and other recording media.
　以上が、本発明の各実施形態に係る情報入力装置を可能とするためのハードウェア構成の一例である。本発明の各実施形態に係る情報入力装置の構成要素は、図３６のようなハードウェアの一機能として実現される。 The above is an example of a hardware configuration for enabling the information input device according to each embodiment of the present invention. The components of the information input device according to each embodiment of the present invention are realized as one function of hardware as shown in FIG.
　なお、図３６のハードウェア構成は、各実施形態に係る情報入力装置を可能とするためのハードウェア構成の一例であって、本発明の範囲を限定するものではない。また、各実施形態に係る情報入力装置による処理をコンピュータに実行させる処理プログラムも本発明の範囲に含まれる。さらに、各実施形態に係る処理プログラムを記録したプログラム記録媒体も本発明の範囲に含まれる。 Note that the hardware configuration of FIG. 36 is an example of a hardware configuration for enabling the information input device according to each embodiment, and does not limit the scope of the present invention. A processing program that causes a computer to execute processing by the information input device according to each embodiment is also included in the scope of the present invention. Furthermore, a program recording medium recording the processing program according to each embodiment is also included in the scope of the present invention.
　以上、実施形態を参照して本発明を説明してきたが、本発明は上記実施形態に限定されるものではない。本発明の構成や詳細には、本発明のスコープ内で当業者が理解し得る様々な変更をすることができる。 Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
　本発明の情報入力装置は、ＡＴＭ（Automatic Teller Machine）や入場門などにおいて、ユーザが認証パスワードなどの認証情報を入力するための入力装置に利用することができる。また、本発明の情報入力装置は、ユーザが第３者に認識されないように情報を入力する装置に利用することができる。 The information input device of the present invention can be used as an input device for a user to input authentication information such as an authentication password in an ATM (Automatic Teller Machine) or an entrance gate. Moreover, the information input device of the present invention can be used as a device for inputting information so that a user is not recognized by a third party.
　この出願は、２０１５年６月１２日に出願された日本出願特願２０１５－１１８７９６を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2015-118796 filed on June 12, 2015, the entire disclosure of which is incorporated herein.
　１０　　情報入力装置
　１１　　インターフェース装置
　１３　　光シャッタ
　２０　　撮像手段
　２１　　撮像素子
　２３　　画像処理プロセッサ
　２５　　内部メモリ
　２７　　データ出力部
　３０　　投射手段
　３１　　制御条件取得部
　３２　　光源制御部
　３３　　光源
　３５　　変調素子制御部
　３６　　空間変調素子
　３８　　投射部
　４０　　制御手段
　４１　　処理部
　４２　　撮像制御部
　４３　　投射制御部
　４４　　シャッタ制御部
　５０　　照合手段
　９０　　コンピュータ
　９１　　プロセッサ
　９２　　主記憶装置
　９３　　補助記憶装置
　９５　　入出力インターフェース
　９６　　通信インターフェース
　９９　　バス
　４１２　　キー配列格納部
　４１３　　制御条件生成部
　４１５　　操作情報生成部
　４２１　　キー配列受信部
　４２２　　キー配列記憶部
　４２３　　キー配列出力部
　４２５　　キー配列生成部
　４３１　　キー配列選択部
　４３２　　有効キー配列出力部
　４３３　　パターン記憶部
　４３４　　パターン選択部
　４３５　　制御条件設定部
　４３６　　制御条件出力部
　４５１　　画像情報受信部
　４５２　　操作内容確定部
　４５３　　有効キー配列受信部
　４５４　　有効キー配列記憶部
　４５５　　操作情報生成部
　４５６　　操作情報出力部
　５０１　　操作情報取得部
　５０２　　操作情報照合部
　５０３　　認証情報記憶部
　５０４　　照合結果出力部 DESCRIPTION OF SYMBOLS 10 Information input device 11 Interface apparatus 13 Optical shutter 20 Imaging means 21 Imaging element 23 Image processor 25 Internal memory 27 Data output part 30 Projection means 31 Control condition acquisition part 32 Light source control part 33 Light source 35 Modulation element control part 36 Spatial modulation element 38 Projection Unit 40 Control Unit 41 Processing Unit 42 Imaging Control Unit 43 Projection Control Unit 44 Projection Control Unit 44 Shutter Control Unit 50 Verification Unit 90 Computer 91 Processor 92 Main Storage Device 93 Auxiliary Storage Device 95 Input / Output Interface 96 Communication Interface 99 Bus 412 Key Arrangement Storage Unit 413 Control condition generation unit 415 Operation information generation unit 421 Key array reception unit 422 Key array storage unit 423 Key array output unit 425 Key array generation unit 431 Key array selection unit 432 Existence Key arrangement output unit 433 Pattern storage unit 434 Pattern selection unit 435 Control condition setting unit 436 Control condition output unit 451 Image information reception unit 452 Operation content determination unit 453 Effective key arrangement reception unit 454 Effective key arrangement storage unit 455 Operation information generation unit 456 Operation information output unit 501 Operation information acquisition unit 502 Operation information verification unit 503 Authentication information storage unit 504 Verification result output unit

Claims (17)

  1. 　複数の表示領域に区分けされる表示手段を有する空間変調素子と、前記複数の表示領域のそれぞれに対応付けられた複数の発光手段を含む光源とを有し、前記光源から前記空間変調素子の表示手段に照射された光を基に形成される表示情報を操作領域に投射する投射手段と、
    　前記操作領域の上方に配置され、前記表示情報に含まれる有効表示情報が前記操作領域に表示されるタイミングに合わせて開くシャッタ機構と、
    　前記操作領域上での操作内容を画像情報として取得する撮像手段と、
    　前記操作領域に前記表示情報を表示させるためのパターンを前記空間変調素子の表示手段に表示させる表示条件と、前記複数の発光手段を切り替えるタイミングと前記シャッタ機構を開くタイミングとを合わせる同期条件とを含む制御条件を設定するとともに、前記撮像手段に取得された画像情報から確定された操作内容と前記有効表示情報とを対応させた操作情報を出力する制御手段とを備える情報入力装置。     A spatial modulation element having display means divided into a plurality of display areas; and a light source including a plurality of light emission means associated with each of the plurality of display areas. Projection means for projecting display information formed on the basis of the light irradiated to the means to the operation area;
    A shutter mechanism that is arranged above the operation area and opens in accordance with a timing at which effective display information included in the display information is displayed in the operation area;
    Imaging means for acquiring operation information on the operation area as image information;
    A display condition for displaying a pattern for displaying the display information in the operation area on the display means of the spatial modulation element, and a synchronization condition for combining a timing for switching the plurality of light emitting means and a timing for opening the shutter mechanism. An information input device comprising: a control unit that sets control conditions including the output and outputs operation information in which the operation content determined from the image information acquired by the imaging unit is associated with the effective display information.
  2. 　前記制御手段は、
    　前記空間変調素子の表示手段に表示させるパターンと、前記空間変調素子の表示手段に前記パターンを表示させるタイミングとを含む条件を前記表示条件として設定し、
    　前記投射手段は、
    　前記表示条件に基づいて前記空間変調素子の表示手段に前記パターンを表示させる請求項１に記載の情報入力装置。     The control means includes
    A condition including a pattern to be displayed on the display unit of the spatial modulation element and a timing for displaying the pattern on the display unit of the spatial modulation element is set as the display condition.
    The projection means includes
    The information input device according to claim 1, wherein the pattern is displayed on a display unit of the spatial modulation element based on the display condition.
  3. 　前記制御手段は、
    　前記表示情報を格納する表示情報格納手段と、
    　前記表示情報格納手段から複数の前記表示情報を取得し、取得した前記複数の表示情報のうち少なくとも一つを前記有効表示情報に設定し、前記複数の表示情報に関する前記制御条件を生成する制御条件生成手段と、
    　前記画像情報から確定された操作内容と前記有効表示情報とを対応させて前記操作情報を生成する操作情報生成手段とを有する請求項２に記載の情報入力装置。     The control means includes
    Display information storage means for storing the display information;
    Control conditions for acquiring a plurality of the display information from the display information storage means, setting at least one of the acquired display information as the effective display information, and generating the control conditions for the plurality of display information Generating means;
    The information input device according to claim 2, further comprising operation information generation means for generating the operation information by associating the operation content determined from the image information with the effective display information.
  4. 　前記制御条件生成手段は、
    　前記複数の表示情報を前記表示情報格納手段から取得し、取得した前記複数の表示情報のうち少なくとも一つを前記有効表示情報として選択する表示情報選択手段と、
    　前記表示情報選択手段によって選択された前記有効表示情報を前記操作情報生成手段に出力する有効表示情報出力手段と、
    　前記表示情報を前記操作領域に投射する際に前記空間変調素子の表示手段に表示させるパターンを記憶するパターン記憶手段と、
    　前記複数の表示情報に対応する前記パターンを前記パターン記憶手段から選択するパターン選択手段と、
    　前記空間変調素子の表示手段に表示させるパターンと、前記空間変調素子の表示手段に前記パターンを表示させるタイミングとを含む前記表示条件を設定するとともに、前記有効表示情報のパターンを表示する表示領域に対応する前記発光手段から光を出射するタイミングと前記シャッタ機構を開くタイミングとを合わせるための前記同期条件を設定する制御条件設定手段と、
    　前記表示条件と前記同期条件とを含む前記制御条件を前記投射手段に出力する制御条件出力手段とを有する請求項３に記載の情報入力装置。     The control condition generating means
    Display information selection means for acquiring the plurality of display information from the display information storage means, and selecting at least one of the acquired display information as the effective display information;
    Effective display information output means for outputting the effective display information selected by the display information selection means to the operation information generating means;
    Pattern storage means for storing a pattern to be displayed on the display means of the spatial modulation element when projecting the display information onto the operation area;
    Pattern selection means for selecting the pattern corresponding to the plurality of display information from the pattern storage means;
    The display condition including a pattern to be displayed on the display unit of the spatial modulation element and a timing for displaying the pattern on the display unit of the spatial modulation element is set, and a display area for displaying the pattern of the effective display information is displayed. Control condition setting means for setting the synchronization condition for matching the timing of emitting light from the corresponding light emitting means and the timing of opening the shutter mechanism;
    The information input device according to claim 3, further comprising a control condition output unit that outputs the control condition including the display condition and the synchronization condition to the projection unit.
  5. 　前記操作情報生成手段は、
    　前記撮像手段から画像情報を取得する画像情報取得手段と、
    　前記画像情報を解析して前記操作内容を確定する操作内容確定手段と、
    　前記制御条件設定手段から前記有効表示情報を受信する有効表示情報受信手段と、
    　前記有効表示情報を記憶する有効表示情報記憶手段と、
    　前記操作内容確定手段によって確定された操作内容と前記有効表示情報とを対応させて前記操作情報を生成する操作情報生成手段と、
    　前記操作情報を出力する操作情報出力手段と有する請求項４に記載の情報入力装置。     The operation information generating means includes
    Image information acquisition means for acquiring image information from the imaging means;
    Operation content confirmation means for analyzing the image information and confirming the operation content;
    Effective display information receiving means for receiving the effective display information from the control condition setting means;
    Effective display information storage means for storing the effective display information;
    Operation information generating means for generating the operation information by associating the operation content determined by the operation content determination means with the effective display information;
    The information input device according to claim 4, further comprising operation information output means for outputting the operation information.
  6. 　前記操作内容確定手段は、
    　前記画像情報を解析し、操作領域１２上での操作位置を確定し、前記操作位置が指示された時刻と前記操作位置とを関連付けた操作位置情報を前記操作内容として生成し、
    　前記操作情報生成手段は、
    　前記操作位置情報と前記有効表示情報とを対応付けることによって前記操作情報を生成する請求項５に記載の情報入力装置。     The operation content determination means includes
    Analyzing the image information, determining an operation position on the operation area 12, generating operation position information associating the time at which the operation position is designated and the operation position as the operation content,
    The operation information generating means includes
    The information input device according to claim 5, wherein the operation information is generated by associating the operation position information with the effective display information.
  7. 　前記制御手段は、
    　前記表示領域ごとに複数の同じ前記パターンを行列形式に配置して表示させる制御をし、
    　前記投射手段は、
    　前記制御手段の制御に応じて、前記空間変調素子の表示手段の表示領域ごとに複数の同じ前記パターンを表示させるとともに、前記発光手段が出射する光の照射領域をそれぞれの前記表示領域の範囲内に設定する請求項１に記載の情報入力装置。     The control means includes
    A plurality of the same pattern for each display area is controlled to be arranged and displayed in a matrix format;
    The projection means includes
    Under the control of the control means, a plurality of the same patterns are displayed for each display area of the display means of the spatial modulation element, and the irradiation area of the light emitted by the light emitting means is within the range of the display area. The information input device according to claim 1, wherein
  8. 　前記表示情報格納手段は、
    　複数の記号が行列形式で配置されたキー配列を前記表示情報として格納し、
    　前記パターン記憶手段は、
    　複数の前記キー配列に対応する前記パターンを記憶し、
    　前記表示情報選択手段は、
    　複数の前記キー配列を前記表示情報格納手段から取得し、取得した前記複数のキー配列のうち少なくとも一つを前記有効表示情報に相当する有効キー配列として選択し、
    　前記有効表示情報出力手段は、
    　前記有効キー配列を前記操作情報生成手段に出力し、
    　前記パターン選択手段は、
    　前記表示情報選択手段が取得した前記キー配列に対応する前記パターンを選択し、
    　前記制御条件設定手段は、
    　前記表示情報選択手段が取得した前記キー配列を前記操作領域に投射するための前記制御条件を設定する請求項７に記載の情報入力装置。     The display information storage means includes
    A key arrangement in which a plurality of symbols are arranged in a matrix format is stored as the display information,
    The pattern storage means
    Storing the patterns corresponding to a plurality of the key arrangements;
    The display information selection means includes
    Obtaining a plurality of the key arrangements from the display information storage means, selecting at least one of the obtained key arrangements as an effective key arrangement corresponding to the effective display information;
    The effective display information output means includes
    Outputting the valid key arrangement to the operation information generating means;
    The pattern selection means includes
    Select the pattern corresponding to the key arrangement acquired by the display information selection means,
    The control condition setting means includes
    The information input device according to claim 7, wherein the control condition for projecting the key arrangement acquired by the display information selection unit to the operation area is set.
  9. 　前記パターン記憶手段は、
    　行列形式で配置された複数の記号のうち少なくとも一つの記号が配置された部分キー配列を前記操作領域に投射する際に前記空間変調素子の表示手段に表示させる部分パターンを記憶し、
    　前記パターン選択手段は、
    　前記パターン記憶手段から複数の前記部分パターンを選択し、
    　前記制御条件設定手段は、
    　前記操作領域に前記部分キー配列をランダムに表示させるために前記複数の部分パターンを前記空間変調素子の表示手段に表示させる条件を前記表示条件として設定するとともに、前記有効キー配列を構成する部分キー配列の前記部分パターンが表示された前記表示領域に光を照射する前記発光手段の動作タイミングに合わせて前記シャッタ機構を開く条件を前記同期条件として設定する請求項８に記載の情報入力装置。     The pattern storage means
    Storing a partial pattern to be displayed on the display means of the spatial modulation element when projecting a partial key arrangement in which at least one symbol is arranged among a plurality of symbols arranged in a matrix format onto the operation region;
    The pattern selection means includes
    Selecting the plurality of partial patterns from the pattern storage means;
    The control condition setting means includes
    In order to display the partial key arrangement at random in the operation area, a condition for displaying the plurality of partial patterns on the display means of the spatial modulation element is set as the display condition, and the partial keys constituting the effective key arrangement The information input device according to claim 8, wherein a condition for opening the shutter mechanism is set as the synchronization condition in accordance with an operation timing of the light emitting unit that irradiates the display area where the partial pattern of the array is displayed.
  10. 　前記キー配列格納手段は、
    　前記キー配列を生成するキー配列生成手段を含む請求項３に記載の情報入力装置。     The key array storage means includes
    The information input device according to claim 3, further comprising key array generation means for generating the key array.
  11. 　前記操作情報を取得する操作情報取得手段と、
    　認証情報を記憶する認証情報記憶手段と、
    　前記操作情報取得手段によって取得された前記操作情報と、前記認証情報記憶手段に記憶された前記認証情報とを照合する操作情報照合手段と、
    　前記操作情報照合手段の照合結果を上位システムに出力する照合結果出力手段とを有する照合手段を備える請求項１乃至１０のいずれか一項に記載の情報入力装置。     Operation information acquisition means for acquiring the operation information;
    Authentication information storage means for storing authentication information;
    Operation information collating means for collating the operation information acquired by the operation information acquiring means with the authentication information stored in the authentication information storage means;
    The information input device according to any one of claims 1 to 10, further comprising a collating unit including a collation result output unit that outputs a collation result of the operation information collating unit to a higher system.
  12. 　前記空間変調素子が位相変調型の素子であることを特徴とする請求項１乃至１１のいずれか一項に記載の情報入力装置。 The information input device according to any one of claims 1 to 11, wherein the spatial modulation element is a phase modulation type element.
  13. 　前記パターン記憶手段は、
    　前記複数の表示情報に対応する位相分布を前記パターンとして記憶し、
    　前記制御手段は、
    　前記空間変調素子の表示手段の表示領域ごとに前記複数の表示情報に対応する前記位相分布を表示させる条件を前記表示条件として設定し、
    　前記投射手段は、
    　前記制御手段が設定した前記表示条件に基づいて、前記空間変調素子の表示手段の表示領域ごとに前記複数の表示情報に対応する前記位相分布を表示する請求項４に記載の情報入力装置。     The pattern storage means
    Storing a phase distribution corresponding to the plurality of display information as the pattern;
    The control means includes
    A condition for displaying the phase distribution corresponding to the plurality of display information for each display region of the display means of the spatial modulation element is set as the display condition,
    The projection means includes
    The information input device according to claim 4, wherein the phase distribution corresponding to the plurality of display information is displayed for each display region of the display unit of the spatial modulation element based on the display condition set by the control unit.
  14. 　前記シャッタ機構をＭＥＭＳ（Micro Electro Mechanical System）シャッタで構成する請求項１乃至１３のいずれか一項に記載の情報入力装置。 The information input device according to any one of claims 1 to 13, wherein the shutter mechanism is configured by a MEMS (Micro Electro Mechanical System) shutter.
  15. 　前記シャッタ機構を液晶シャッタで構成する請求項１乃至１３のいずれか一項に記載の情報入力装置。 The information input device according to any one of claims 1 to 13, wherein the shutter mechanism is configured by a liquid crystal shutter.
  16. 　前記光源は、
    　第１の波長領域の光を出射する第１の発光手段と、前記第１の発光手段が出射する光とは異なる波長領域の光を出射する第２の発光手段とを少なくとも有する請求項１乃至１５のいずれか一項に記載の情報入力装置。     The light source is
    The first light emitting means for emitting light in the first wavelength region and at least second light emitting means for emitting light in a wavelength region different from the light emitted by the first light emitting means. The information input device according to any one of 15.
  17. 　複数の表示領域に区分けされる表示手段を有する空間変調素子と、前記複数の表示領域のそれぞれに対応付けられた複数の発光手段を含む光源とを有し、前記光源から前記空間変調素子の表示手段に照射された光を基に形成される表示情報を操作領域に投射する投射手段と、前記操作領域の上方に配置され、前記表示情報に含まれる有効表示情報が前記操作領域に表示されるタイミングに合わせて開くシャッタ機構と、前記操作領域上での操作内容を画像情報として取得する撮像手段と、前記操作領域に前記表示情報を表示させるためのパターンを前記空間変調素子の表示手段に表示させる表示条件と、前記複数の発光手段を切り替えるタイミングと前記シャッタ機構を開くタイミングとを合わせる同期条件とを含む制御条件を設定するとともに、前記撮像手段に取得された画像情報から確定された操作内容と前記有効表示情報とを対応させた操作情報を出力する制御手段とを備える情報入力装置と、
    　前記情報入力装置から前記操作情報をネットワーク経由で取得し、自装置が記憶する認証情報と前記操作情報とを照合し、前記操作情報と前記認証情報との照合結果を上位システムに送信するサーバとを備える照合システム。     A spatial modulation element having display means divided into a plurality of display areas; and a light source including a plurality of light emission means associated with each of the plurality of display areas. Projection means for projecting display information formed on the basis of the light irradiated on the means to the operation area, and effective display information included in the display information is displayed on the operation area. A shutter mechanism that opens in accordance with the timing, an imaging unit that acquires the operation content on the operation region as image information, and a pattern for displaying the display information in the operation region is displayed on the display unit of the spatial modulation element And setting a control condition including a display condition to be synchronized, and a synchronization condition for matching the timing for switching the plurality of light emitting means and the timing for opening the shutter mechanism To an information input device and a control means for outputting the operation information associated with the with the determined operation content from the acquired image information to the image pickup means and the effective display information,
    A server that obtains the operation information from the information input device via a network, collates authentication information stored in the own device and the operation information, and transmits a collation result of the operation information and the authentication information to a host system; A collation system comprising:
PCT/JP2016/002781 2015-06-12 2016-06-08 Information input device and matching system WO2016199415A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2017523113A JP6693518B2 (en) 2015-06-12 2016-06-08 Information input device and collation system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015118796 2015-06-12
JP2015-118796 2015-06-12

Publications (1)

Publication Number Publication Date
WO2016199415A1 true WO2016199415A1 (en) 2016-12-15

Family

ID=57503393

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/002781 WO2016199415A1 (en) 2015-06-12 2016-06-08 Information input device and matching system

Country Status (2)

Country Link
JP (1) JP6693518B2 (en)
WO (1) WO2016199415A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021117403A1 (en) * 2019-12-12 2021-06-17 Ｎｅｃプラットフォームズ株式会社 Light transmitting device, communication system, and light transmitting method

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06110403A (en) * 1992-09-30 1994-04-22 Hitachi Ltd Display device and display panel
JP2001255844A (en) * 2000-01-12 2001-09-21 Internatl Business Mach Corp <Ibm> Method for providing data which can privately be seen on display which can be seen by public
WO2009022483A1 (en) * 2007-08-16 2009-02-19 Nec Corporation Display system and display method
JP2009204948A (en) * 2008-02-28 2009-09-10 Toshiba Corp Image display apparatus and its method
JP2010113568A (en) * 2008-11-07 2010-05-20 Toyota Infotechnology Center Co Ltd Motion detector and operation system using the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH06110403A (en) * 1992-09-30 1994-04-22 Hitachi Ltd Display device and display panel
JP2001255844A (en) * 2000-01-12 2001-09-21 Internatl Business Mach Corp <Ibm> Method for providing data which can privately be seen on display which can be seen by public
WO2009022483A1 (en) * 2007-08-16 2009-02-19 Nec Corporation Display system and display method
JP2009204948A (en) * 2008-02-28 2009-09-10 Toshiba Corp Image display apparatus and its method
JP2010113568A (en) * 2008-11-07 2010-05-20 Toyota Infotechnology Center Co Ltd Motion detector and operation system using the same

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021117403A1 (en) * 2019-12-12 2021-06-17 Ｎｅｃプラットフォームズ株式会社 Light transmitting device, communication system, and light transmitting method
JP2021093663A (en) * 2019-12-12 2021-06-17 Ｎｅｃプラットフォームズ株式会社 Light transmitting device, communication system and light transmitting method

Also Published As

Publication number Publication date
JP6693518B2 (en) 2020-05-13
JPWO2016199415A1 (en) 2018-04-05

Similar Documents

Publication Publication Date Title
US10225529B2 (en) Projection device using a spatial modulation element, projection method, and program storage medium
CN104487981B (en) Portable multimedia display
CN108885692A (en) Face is identified in face-recognition procedure and feedback is provided
US20120182461A1 (en) Imaging terminal having focus control
JP6048819B2 (en) Display device, display method, integrated circuit, program
JP6763434B2 (en) Information input device and information input method
JP2016529532A (en) Application specific dual mode projection system and method
JP6911759B2 (en) Projection equipment, projection system and interface equipment
EP3064994B1 (en) System and method for increased spatial resolution
JP2014023083A (en) Display device, imaging device, and image editing program
US11392014B2 (en) Projection device, interface device, and projection method
JPWO2018101097A1 (en) Projection device, projection method and program
CN105247404B (en) phased backlight
JP5777264B1 (en) Bar code display device, operation method and program for bar code display device
JP6693518B2 (en) Information input device and collation system
JP2017101965A (en) Device
JP2009303191A (en) Method of encrypting image information, device for encrypting image information, and computer program for encrypting image
US9860495B2 (en) Projector with rotating refractive actuator
JP6645588B2 (en) Display system
US20160156834A1 (en) Apparatus and method for capturing lightfield image
CN110063054A (en) Control equipment, control method and program
JP6763368B2 (en) Control devices, control methods and programs
JP2009176009A (en) Display device, display method, and program
JP2016180786A (en) Projection device, terminal, projection system, and projection method
US20220417478A1 (en) Light transmitting device, communication system, and light transmitting method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16807122

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017523113

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16807122

Country of ref document: EP

Kind code of ref document: A1