EP4028826A1 - Secure testing device with optical element - Google Patents
Secure testing device with optical elementInfo
- Publication number
- EP4028826A1 EP4028826A1 EP20862545.9A EP20862545A EP4028826A1 EP 4028826 A1 EP4028826 A1 EP 4028826A1 EP 20862545 A EP20862545 A EP 20862545A EP 4028826 A1 EP4028826 A1 EP 4028826A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- housing
- test
- camera system
- person
- taker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003287 optical effect Effects 0.000 title claims description 23
- 238000012360 testing method Methods 0.000 title abstract description 89
- 210000000554 iris Anatomy 0.000 claims abstract description 68
- 210000001508 eye Anatomy 0.000 claims abstract description 58
- 210000003128 head Anatomy 0.000 claims abstract description 42
- 238000003384 imaging method Methods 0.000 claims abstract description 20
- 210000001061 forehead Anatomy 0.000 claims description 7
- 238000010191 image analysis Methods 0.000 claims description 5
- 239000006117 anti-reflective coating Substances 0.000 claims description 4
- 239000011248 coating agent Substances 0.000 claims description 4
- 238000000576 coating method Methods 0.000 claims description 4
- 238000003909 pattern recognition Methods 0.000 claims description 4
- 230000000284 resting effect Effects 0.000 claims description 4
- 239000011521 glass Substances 0.000 description 23
- 238000013461 design Methods 0.000 description 21
- 238000000034 method Methods 0.000 description 21
- 238000004891 communication Methods 0.000 description 15
- 239000010408 film Substances 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 8
- 230000003190 augmentative effect Effects 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 7
- 230000007246 mechanism Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 210000000988 bone and bone Anatomy 0.000 description 4
- 238000005286 illumination Methods 0.000 description 4
- 238000013507 mapping Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 210000001525 retina Anatomy 0.000 description 3
- 230000002207 retinal effect Effects 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000017531 blood circulation Effects 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000010287 polarization Effects 0.000 description 2
- 239000004984 smart glass Substances 0.000 description 2
- 238000001228 spectrum Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010010099 Combined immunodeficiency Diseases 0.000 description 1
- 241000481265 Iris cathayensis Species 0.000 description 1
- 244000140747 Iris setosa Species 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003213 activating effect Effects 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000004026 adhesive bonding Methods 0.000 description 1
- 230000002547 anomalous effect Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000004397 blinking Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 238000001360 collision-induced dissociation Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000000994 depressogenic effect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 239000010409 thin film Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B7/00—Electrically-operated teaching apparatus or devices working with questions and answers
- G09B7/06—Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers
- G09B7/07—Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers providing for individual presentation of questions to a plurality of student stations
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
- G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
- G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
Definitions
- the present invention relates generally to the field of a computer-based system and method for taking a test while ensuring that the test-taker is not receiving assistance from another person or otherwise cheating while taking the test, and that a device used for displaying or taking the test has not been breached and is not being breached or otherwise compromised.
- test is any type of question-based application that requires consideration or analysis by a person taking the test and a potential response from this person.
- a test may therefore be considered an examination, a quiz, an assessment, an evaluation, a trial and/or an analysis.
- the test may be used to certify an individual as qualified to perform a specific task or ability, e.g., a driving test.
- a test-taker is a person taking such a test.
- a test-taker does not necessarily have to be a student of a course, i.e., someone subjected to education on a regular basis.
- the present invention is directed at addressing and ideally solving the problem of guaranteeing with high certainty that a test-taker taking a test is acting alone without the aid of a consultant or other helper or otherwise cheating.
- a device that can achieve this object includes a frame configured to be situated on a person’s head, a display section on the frame having a first portion and a second portion, and a combiner arranged on the frame in a position at least partly in front of right and left eyes of the person when the frame is on the person’s head.
- the combiner an optic or optical element, allows simultaneous viewing by the person of an environment in front of the person and content on the display section.
- the combiner reflects content of the first portion of the display section to the person’ s left eye when the frame is on the person’s head and reflecting content of the second portion of the display section to the person’s right eye when the frame is on the person’s head.
- a crossview camera system on the frame a images from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and images from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner.
- An iris camera system arranged on the frame images the left eye of the person on which the frame is situated, and image the right eye of the person on which the frame is situated.
- a forward-looking camera system arranged on the frame images an area in front of the frame.
- a processor is coupled to the crossview camera system, iris camera system and forward-looking camera system and analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and analyzes images obtained by the forward-looking camera system to determine presence of specific objects.
- the crossview camera system may include a first crossview camera on the first lateral side of the frame and arranged to image inward of the first lateral side of the frame and below the combiner, and a second crossview camera on the second lateral side of the frame and arranged to image inward of the second lateral side of the frame and below the combiner.
- the iris camera system may include a first iris camera arranged on the frame to image the left eye of the person on which the frame is situated, and a second iris camera arranged on the frame to image the right eye of the person on which the frame is situated.
- iris camera will mean any imaging device which images the iris, a portion of the face around and including the iris, retina, a portion of the face around and including the retina, or face portion optionally including the iris and/or retina.
- the first and second portions of the display section may be positioned horizontally alongside one another
- the combiner optionally includes a semi-reflective coating on an inside surface in an optical path between the first and second portions of the display section and the person’s eyes when the frame is on the person’s head.
- the combiner is positioned in front of the person’s eyes when the frame is on the person’s head to allow view of ambient environment in front of the person when the frame is on the person’s head.
- the combiner could include an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment.
- the processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data. Similarly, the processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system to determine presence of imaging devices in any obtained images. To this end, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and/or when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
- a forehead resting pad may be arranged at a front of the frame in a position to contact a forehead of the person when the frame is on the person’s head.
- the frame may be considered to include a front portion including the display section, combiner, crossview camera system, iris camera system, forward-looking camera system, and processor, and a first elongate band having first and second opposite ends and being coupled at the first and second ends to the front portion.
- the frame includes a second elongate band adjacent the front portion and which is in contact with the person’s skin when the frame is on the person’ s head, the second band including a contact microphone and a contact speaker.
- a chassis intrusion detector system may be arranged over the front portion of any embodiment.
- a device includes a housing comprising a display section including at least one display for displaying content, an optical element coupled to the housing and arranged in an optical path of the at least one display section and that reflects at least a portion of content when displayed on the at least one display and allows viewing therethrough, a crossview camera system coupled to the housing and that images from locations on each lateral side of the housing toward an opposite lateral side of the housing portion and below the optical element, an iris camera system coupled to the housing and that images an area rearward of the housing from locations on the housing rearward, and a forward-looking camera system coupled to the housing and that images an area in front of the housing from locations on the housing.
- a processor is arranged in the housing and coupled to the crossview camera system, the iris camera system and the forward-looking camera system.
- the processor analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, images obtained by the iris camera system to determine presence and position of irises, and images obtained by the forward-looking camera system to determine presence of specific objects.
- a first elongate band has first and second opposite ends and is coupled at the first and second ends to the housing. The first band extends rearward from the housing to form an enclosure in which a person’ s head is positionable.
- the crossview camera system may include a first crossview camera on the first lateral side of the housing and arranged to image inward of the first lateral side of the housing and below the combiner, and a second crossview camera on the second lateral side of the housing and arranged to image inward of the second lateral side of the housing and below the combiner.
- the combiner may include a semi-reflective coating on an inside surface in the optical path of the at least one display section, and an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment.
- the at least one display section may include two display sections positioned horizontally alongside one another.
- the processor optionally, but preferably, analyzes images obtained by the iris camera system to determine presence of imaging devices in any obtained images. Also, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine presence and position of irises, and when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
- the device could include a forehead resting pad arranged at a front of the housing, a second elongate band adjacent the housing and including a contact microphone and a contact speaker, and a chassis intrusion detector system arranged over the housing.
- Additional devices which can be part of the electronics assembly and which are designed to operate through the security film include:
- a camera for obtaining iris, retinal or partial facial scans 1.
- a microphone for monitoring sound in the vicinity of the test- taker or emitted by the test- taker is provided.
- a sound maker used for testing the microphone sensitivity 4.
- a contact microphone for detecting sound emanating from the mouth of the test-taker, primarily talking, i.e., words.
- a device mounted in connection with the contact microphone for detecting the presence of the test-taker’s skin can comprise a blood flow sensor comprising a LED and light sensor positioned so that the reflection of the LED is in the field of view of the light sensor only when the device is in close proximity to the skin.
- Skin presence sensors can also comprise a temperature sensor, camera, capacitance sensor or any other device capable of determining the presence of the test taker’s skin.
- ECG EKG
- FIGS. 1-4 illustrate a preferred version of the monitor.
- FIG. 5 illustrates a method of attaching a USB connector for supplying power to the monitor through the CID.
- FIGS. 6 and 7 illustrate use of a contact speaker with a contact microphone to verify that the contact speaker contacts the test-taker’s face and further, use of an EKG biometric for additional verification of proper placement of the contact microphone and to obtain an additional biometric.
- FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device is attached to a central computer through a USB port.
- FIG. 9 is a view like FIG. 8 with a wireless connection through a wireless transmitter box associated with each desk and where the test-takers are using paper to record their test answers.
- FIG. 10 is a perspective view of a head worn glasses type device containing an electronics assembly with several sensors, cameras and a display all protected with a chassis intrusion detector prepared using the teachings of this disclosure.
- FIG. 11 is a perspective view of the apparatus of FIG. 10 seen from the rear.
- FIGS. 12-17 illustrate a preferred design of the monitor for two eyes utilizing a single display.
- FIGS. 18-26 illustrate a preferred design of the monitor for two eyes utilizing two large displays.
- FIGS. 27-30 illustrate the device of FIGS. 18-26 with the chassis intrusion detector installed.
- FIGS. 1-10 a simple direct projection display has been illustrated where the display is in the form of a projector directing the image directly into the eye.
- Alternative reflection displays have also been disclosed.
- the direct projection display has the disadvantage of blocking a view of the surrounding environment when the image is not being viewed. Similarly, this design is usually limited to implementation for a single eye.
- Other options include reflective displays where the projector sends the image directly toward a lens or combiner in front of the eye, and waveguide displays, where the maximum freedom is provided for the location of the display device relative to the eyes.
- Both the reflection and waveguide displays require a display element that displays the image for further processing by the optical system.
- Preferred technologies include Liquid Crystal on Silicon (LCoS) and Active Matrix Organic Light Emitting Diodes (AMOLED) or simply LCD displays.
- the reflector design disclosed in US 20170061212, FIGS. 2A and 2B can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of another reflector display. Another prior art reflector design is disclosed in US 20170336634.
- the waveguide display design of US 10,180,572, FIG. 1, can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of a waveguide display.
- FIG. 1 is a front view of a version of the monitor which has many of the features of other monitors disclosed herein and the same or similar functionality.
- electronics are contained in a housing 1002 and a display is shown at 1004.
- Knobs 1003 and 1005 are used to clamp the housing of the electronics and display assembly at a desired orientation and to permit rotation about lateral and vertical axes.
- Knobs 1003, 1005 can be configured such that rotation of each knob 1003, 1005 causes a change in the distance between the housing 1002 and the frame. This allows the test-taker to adjust the display 1004 to properly align the display with the test-taker’s eye.
- the housing 1002 and the display 1004 are therefore adjustable in position relative to the eyeglasses frame. Any adjustment mechanism to provide for this variable position may be used, with the knobs 1003, 1005 being only an exemplifying embodiment. This design is somewhat larger than previous designs as essentially all the required electronics are contained in the housing.
- FIG. 2 is a view of the monitor 1000 from the rear showing a glasses frame 1006 and adjustable clamping mechanism 1007 for attaching the housing containing the electronics to a temple of the glasses frame 1006.
- Clamping mechanism 1007 includes the two knobs 1003, 1005 that provide for the adjustment of housing portion relative to the glasses frame 1006.
- Clamping mechanism 1007 is clamped to the glasses frame by tightening screw 1011 which allows the entire assembly to be positioned relative to the glasses frame 1006.
- a contact microphone 1012 is provided and presses against the skin of the test-taker by means of spring 1013 connected to housing 1002.
- Spring 1013 extends from the housing 1002 inward, i.e., toward the opposite temple.
- the contact microphone 1012 is arranged proximate or at an inward end of the spring 1013 and is biased to be further outward from the temple so that when the monitor 1000 is worn, the spring 1013 may be compressed and thus exerts a force against the skin of the wearer thereby maintaining contact between the contact microphone 1012 and the skin of the wearer or test-taker.
- a sound generator, such as a contact speaker 1014 is provided on the other temple of the glasses frame 1006.
- Microphone 1012 and speaker 1014 are in electronic communications with the processor in housing 1002 to operate as disclosed above.
- the contact speaker also called a bone speaker, emits an audible sound as well as a vibration to the skin and/or bone of the test taker. This audible sound can be used to test the audio microphone replacing the sound creator.
- the test-taker is generally forbidden from talking during the test, to prevent the test-taker from orally supplying test questions to an accomplice.
- the microphone could be used for monitoring the test taker’s talking, however, other sounds in the environment would also be recorded by such a microphone and it may be difficult to differentiate the communication by the test-taker from sounds that might be in the environment.
- a contact microphone will only detect sound vibrations coming through the skin of the test-taker and ignore all other sounds. Therefore, it is a preferred method of determining whether the test-taker is talking.
- the contact microphone 1012 must be in contact with the skin of the test-taker.
- the contact speaker 1014 can be placed on the opposite side of the test- taker’s head.
- Contact speaker 1014 can be programmed to periodically transmit a sound through the head of the test-taker to the contact microphone 1012 and to the audio microphone 24. If both contact devices are in contact with the skin of the test-taker, the transmission will be detected by the contact microphone 1014 thereby confirming that the monitor 1000 is properly in place.
- the bone or contact microphone should be activated with voice recognition whenever it hears anything.
- the audio microphone should be activated whenever there is a transmission from the audio speaker and when it hears talking. If the test-taker finds a way to defeat the contact microphone and talks, the audio microphone should pick it up. If the environment is too noisy then the test can be paused until the noise quiets down. The test-taker should not be taking a test in an environment where there is excessive talking.
- the test-taker Prior to the start of a test, the test-taker can be asked to state his name and both microphones should be able to record this. If there is any doubt about the activation of the bone microphone, or at other random times, the test can ask the test-taker to restate his name or some other announcement. Both microphones should register the response without an unreasonable delay. In a later version it may be desirable to have more than one microphone in the headset so that the location of the sound source can be triangulated. Some triangulation can occur even with the two microphones described here.
- FIG. 3 illustrates use of chassis intrusion detector, CID, 1016, like CID 22 described above or any other CID disclosed herein, with this design.
- FIG. 4 additionally shows electronics 1018 from an inside view that is covered by CID 1016. Display 1022 is similarly covered by the CID 1016.
- FIG. 5 illustrates an exemplifying method of attaching a USB connector for supplying power to a monitor through a CID 1056 or CID 22 or any other CID disclosed herein.
- CID 1056 is shown covering a portion of a PC board 1054.
- a USB connector 1050 is attached to housing 1052.
- USB connector pins 1058 pass through small holes 1060 provided in the CID 1056. These holes 1060 are sufficiently small that it would be very difficult for anyone to defeat the CID 1056 through these holes 1060.
- the illustrated monitor may be any of the monitors disclosed herein.
- FIG. 6 is a view like FIG. 2 showing the contact speaker 1014 and contact microphone 1012.
- Contact speaker 1014 has been moved forward on the temple of the glasses frame 1006 in order to accommodate bearded test-takers.
- a movable connection of the contact speaker 1014 to the temple is provided.
- the connection from the speaker 1014 to the electronics is through wire 1009 that may pass through an interior space in the temple and lens portion.
- Wire 1010 goes from the USB connector described in FIG. 5 to a source of power such as a wall outlet.
- FIG. 7 illustrates the addition of an EKG sensor in the form of a thin film 1110 which is placed on top of the contact microphone 1012 (to form a microphone assembly) and the contact speaker 1014 (to form a speaker assembly).
- both the contact microphone 1012 and contact speaker 1014, with EKG sensors, are moved forward on the temples of the glasses frame 1006 so that they contact skin of bearded people.
- the contact microphone 1014 is covered with the CID whereas the contact speaker 1012 is not. Both devices could be covered with CIDs but it may not be necessary to cover the contact speaker.
- the EKG sensors also known as electrocardiogram sensors or ECG sensors, allow for the measurement of the heartbeat shape and serves as a further verification that the contact speaker and microphone are in contact with the skin.
- An EKG also provides an alternate biometric verification of the identity of the test-taker. Since the signal levels for EKG measurements are very low, the sensor pads cannot be covered by the CID. This issue can be resolved by allowing two conductors to be placed through the CID allowing the EKG pads to be glued to the outside of the CID. The remainder of the contact microphone can be placed inside the CID cover.
- any of the disclosed monitors may be used for tests that require written answers. For such tests, the monitor is equipped with a high definition display permitting multiple lines of text to be displayed.
- the monitor should also be capable of displaying a virtual keyboard preventing the test-taker from typing on a desk or table, which will be observed by the forward-facing camera.
- a virtual keyboard is described in US 10180572.
- the test-taker When provided with a question requiring a text response, the test-taker will use the virtual keyboard on the display to type the answer which will then appear on the display. In this manner, a response by the test-taker cannot be observed by an associate looking over his shoulder while the test is being taken.
- a written response to a test will be required especially when a mathematical derivation or the hand writing of mathematical expressions is required.
- the test-taker can be provided with a tablet onto which his hand-written response will be entered. The tablet will not show the test-taker’s handwriting but will be linked to the monitor in such a manner that only the monitor receives the hand-written response. This response will be displayed on to the display for review and correction by the test taker.
- electrochromic glass or film on plastic can be used for this function, as described in US 10180572.
- the electrochromic glass will be turned totally black or opaque by a control mechanism so that the contents of the display cannot be seen from a person standing in front of the test-taker.
- Another approach is to use polarized lenses for the glasses and display where the angle of polarization is rotated 90 degrees.
- the glasses can be vertically polarized and the display horizontally polarized. In this case, light from the display will not pass through the glasses preventing it from being observed by anyone standing in front of the test-taker.
- an equipped monitor obtains a second biometric system for identifying the test-taker and for verifying that the test-taker is in fact wearing the monitor.
- the EKG pads on opposite sides of the test-taker’s head will record the shape of the heartbeat of the test-taker which is unique to that test- taker and thus is a biometric identifier of the test-taker.
- test-taker can use his voice to enter commands to the monitor. Although this could be used as an alternative to the mouse described above for answering test questions, it can also be used for other commands such as initiating the test or controlling the display of the test questions for example.
- the test-taker can say “next question”, “I need a break”, “test finished” etc.
- the contact microphone will pick up the words spoken by the test-taker and thus can perform the various commands.
- Voice entry can also be used for answering essay type questions where it is obvious that the test-taker is not using his voice to request help from an accomplice.
- tiny microphones can be provided which are inserted into the ears of the test-taker in order to hear if the test-taker is using a speaker inserted into his ear. Such a speaker would be like a hearing aid.
- Such microphones can be tiny devices measuring no more than a cubic millimeter. They can be inserted into the test-taker’s ear when the test-taker is wearing the monitor. Such microphones will also pick up the voice of the test-taker and therefore on command of the monitor that test-taker can say something to test that the in-ear microphones are properly installed. Talking can also be used to test operation of the contact microphone, although, as described above, other tests based on the contact speaker and the EKG devices are provided for this function.
- Other methods can be used with the monitor to permit the test-taker to enter commands to the monitor.
- One such method using the iris camera is track the eye motion which is usable to select answers to the questions or control operation of the monitor. Eye blinking and time/duration of closing also can be used for this purpose.
- Another such method is to use gestures which can be seen by the forward-facing camera and interpreted by appropriate software. Teeth clicking can even be used for controlling the test and in particular for choosing answers to multiple choice test questions.
- the lenses of the glasses can be made easily replaceable permitting different prescription lenses to be used for different test-takers.
- the devices disclosed herein are not required to be used for testing purposes and may be used for other purposes, e.g., gaming, entertainment.
- FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device can be attached to a central computer 1306 through a USB port, for example.
- each test-taker 1302 is provided with a keyboard and/or a mouse or other input device, and a display 1304.
- Each device can be connected to a central computer 1306. Otherwise, the operation of the Test Glasses is as described herein.
- Each test-taker is presented a different version of the scrambled test and uses the keyboard and/or mouse to answer the test questions.
- the central computer knows which test version is being answered by each test-taker so that the information can be used for grading the test. Since each test-taker is provided a different scrambled version of the test, the answer provided by one test-taker cannot help another provided talking is not permitted.
- FIG. 9 is a view similar to FIG. 8 where the answers are placed on a piece of paper which will be collected by the test proctor at the conclusion of the test. Again, since each test-taker will be taking the same test with the questions randomly reordered, there is little advantage in a test-taker surreptitiously communicating an answer to another test-taker. Thus, by virtue of the arrangements depicted in FIGS. 8 and 9, the Test Glasses can be used either remotely or in a classroom environment.
- FIG. 10 is a perspective view of a head worn glasses type device, the Test Glasses or Monitor, containing an electronics assembly with several sensors, cameras and a display, all protected with a chassis intrusion detector as described elsewhere herein, prepared using the teachings herein.
- a head worn display and electronics device constructed in accordance with the invention is shown generally at 1410 in FIGS. 10 and 11.
- a housing 1420 extends from a frame 1422.
- Housing 1420 is substantially L-shaped with a first portion extending straight outward from an edge of the frame 1422 and second portion perpendicular to the first portion and positioned in front of the frame 1422.
- a display 1412 is arranged on or in the housing 1420 and pointed toward the right eye of test- taker displays the test questions (although alternatively, a display can be pointed toward the left eye of the test-taker).
- a forward viewing camera 1414 representative of an imaging device, is also arranged on or in the housing 1420 and monitors the field of view of the test-taker outward from the device 1410. The camera 1414 can have a field of view of approximately 120°.
- a microphone 1416 is also arranged on or in housing 1420 and monitors talking (sounds) which can take place while the test is in progress.
- a sound maker or speaker 1418 is arranged on or in the housing 1420 and periodically provides a sound detectable by the microphone 1416 to verify that the microphone 1416 has not somehow been rendered inoperable. The speaker 1418 may be placed further away from the microphone 1416 and insulated from the housing 1420 so that the microphone 1416 does not receive the sound from the speaker 1418 through the housing 1420 instead of the air surrounding the device 1410.
- the display 1412 is arranged at a terminal end of the second housing portion.
- the forward viewing camera 1414, or more generally an imaging device, the microphone 1416 and the speaker 1418 are also arranged on the second housing portion (FIG. 10).
- Each of these components 1412, 1414, 1416, 1418 is connected to a processor-containing electronics package in housing 1420 which is mounted to the glasses frame 1422 in a manner known to those skilled in the art to which this invention pertains.
- a cable emanates from the electronics package in housing 1420 and can contain a USB connector 1424 for connecting onto an external device such as a computer, battery pack or wall power supply.
- Iris or retinal scan camera 1426 is arranged on housing 1420, pointing inward toward the wearer, and measures biometrics of the test-taker.
- biometrics can include an iris or retinal scan or a scan of the portion of the face surrounding the eye.
- Illumination of the eye can be provided by LEDs 1428 arranged on housing 1420 which can be in the IR or visible portions of the electromagnetic spectrum. If white LEDs are used, provision can be made to limit the intensity or the time that they are turned on so as not to annoy the test taker. Two or more different levels of visible illumination can be provided to cause the iris to be seen at different openings to check for an artificial iris painted onto a contact lens.
- Iris scan camera 1426 and LEDs 1428 are arranged on the second housing portion.
- a camera 1430 can also be provided on or in housing 1420 to check for any anomalous activity which might take place in the vicinity of the device 1410 (FIG. 11). Such a camera 1430 can enable detection of whether an image capture device has been either temporarily or permanently affixed to the device 1410 or to the face of the test-taker which can capture the image on the display 1412. Similarly, camera 1430 can monitor the space surrounding the left eye of the test-taker to assure that such an image capturing device and or another display for providing aid to the test-taker is not being employed by the test-taker in conjunction with his left eye.
- the camera 1430 or more generally an imaging device, is arranged on the first housing portion and oriented to image most of the frame 1412 (FIG. 11).
- Software and a processor which controls administration of tests can be resident on an external computer, in the electronics package in housing 1420, or in another device which attaches to the device 10 through connector 1424.
- a test-taker will have access to a keyboard and/or a mouse for interacting with this computer. Using a keyboard, the test-taker can initiate the test taking process through communication with the test provider. When the test is ready for execution by the test-taker, and encrypted version of the test is transmitted to the computer and relayed to the device 1410.
- the electronics package in housing 1420 e.g., including a processor, utilizes a private decryption key to decrypt the test questions and cause them to be displayed on display 1412. The test-taker then enters the answers to the questions using the keyboard and the computer display.
- FIGS. 12-17 An alternate monitor design 1800 which provides an image to both eyes using a single microdisplay is illustrated in FIGS. 12-17.
- the components, which must be protected by the CID, are more closely arranged to simplify the CID design.
- a single (micro)display 1828 is used to illuminate lenses 1830 seen by each eye.
- Two iris cameras 1802, two crossview cameras 1806, and two forward cameras 1818 can be implemented in this design. Since the display 1828 will be seen by both eyes, both must be monitored to guarantee that the device has not been rotated or in some manner pulled away from either eye to permit a foreign camera to be inserted.
- the crossview cameras 1806 similarly must now watch both sides of the test-taker’s head to search for nefarious cameras inserted by the test-taker.
- Sensor assemblies 1810 and 1812 are provided on each side of the forehead (FIG. 17). These sensor assemblies 1810, 1812 measure the EKG and sound emitted by the test-taker’s head.
- Sensor assembly 1810 for example, can contain a contact speaker and contact microphone, one in each sensor.
- sensor assembly 1812 can contain an ECG (EKG) sensor.
- EKG ECG
- the contact microphone will determine when the test-taker is emitting sounds and the contact speaker will be used to test that the contact microphone is in contact with the test-taker’s skin, as described in the other monitor examples.
- the contact speaker can also emit an audio sound and thus can be used to test the audio speaker, if present. Since the EKG sensor pads must be sensitive to very low voltages, they generally will be placed on the outside of the CID.
- a small pair of contacts can be placed in the CID to permit signals to be passed from the EKG sensors to the interior electronics.
- the EKG sensor pads can be appropriately attached to the CID by gluing in such a manner that any attempt to remove the EKG pads will destroy the CID.
- Two forward or front view cameras 1818 are provided in order to increase the field of view of the sensor system and to permit future 3D images to be created when augmented reality is implemented into this design.
- the optical system can be arranged such that alternately polarized frames can be fed to the right and left eyes of the test-taker, wherein the single display panel can pass the information to the eyes to permit 3D holographic viewing by selectively polarizing successive frames or even in the same frame.
- Monitor 1800 in this example contains a headband 1808 with an adjustment knob 1816 to permit the apparatus to the securely mounted to the test-taker’s head (FIG. 13).
- a battery 1814 can also be integrated with the device and placed at the rear of the device to balance the forces from the monitor 1800 on the head of the test-taker. In this manner, the center of gravity of the monitor 1800 can be adjusted to be placed near the center of the test-taker’s head. Under these circumstances, there should be little tendency for the monitor 1800 to slip forward or backward.
- the battery 1814 now can be considerably larger than in previous designs and designed to provide many hours of operation without an external power source.
- a wire can lead from the battery 1814 to a wall charger or, alternately, a receptacle can be provided in the battery case for that purpose.
- the display panel 1828 projects downward through lenses 1854 to a polarizing beamsplitter and mirror assembly 1856 which sends alternately polarized light to the left and to the right.
- the display image is split into two images alternately polarized.
- Birdbath mirrors 1820 then project the light down toward the lenses, or combiners, 1804 which contain reflecting surfaces and reflect the light into the eyes.
- Each lens 1854 can be differently polarized so that the light which is polarized horizontally for the right eye, for example, interacts with a vertically polarized film on the right lens. This has the effect of making the right lens act as a mirror preventing the image from being seen from in front of the monitor 1800.
- the polarized image for the left eye which can be polarized vertically, for example, would interact with a horizontally polarized film for the left eye. Rather than polarizing vertically and horizontally, naturally polarized light from the environment will have less effect if the polarization angles are +45 degrees and -45 degrees.
- the lenses can be a compound lens arrangement whereby the outer lens corrects for prescription lens as needed for people with different requirements.
- the inner lens can be the one from which the reflections to the eyes are made. These two sets of lenses can be designed so that the outer lenses are interchangeable depending on the visual needs of the test-taker.
- the inner lens can be incorporated within the CID eliminating the possibility of a test-taker placing a camera that could see the inner lens and thus the display.
- the focus of the display can be changed by moving various optical components. Under this arrangement, the field of view can be controlled so that it can only be seen by the test-taker’s eyes.
- augmented reality devices such as a virtual smartphone, mouse or keyboard for use by the test-taker. These can require that the fingers of the test- taker be recognized and mapped in such a way that the motion of the fingers can be accurately tracked and understood.
- the virtual keyboard can be attached to a location near the test-taker’s fingers or to a table that is either virtual or appears in the environment.
- FIGS. 18-26 illustrate another preferred design of the monitor 1900 for two eyes, in this case utilizing two larger displays 1908 forming a display section in a housing of the monitor 1900.
- Two displays 1908 are positioned approximately horizontally in the monitor 1900 alongside one another as shown in FIG. 23. Images from the displays 1908 reflect off a combiner 1902.
- Combiner 1902 preferably has a semi-reflective coating on the inside surface, i.e., that surface in the optical path between the display 1908 and the eyes of the test-taker, which reflects only a percentage, for example 50%, of the incident light from the displays 1908 toward the test-taker’s eyes (the test-taker being the person on whose head the monitor 1900 is supported) when the monitor 1900 is placed or otherwise situated on the test-taker’ s head. The balance of the light is passed vertically downward.
- the combiner 1902 allows the test-taker to simultaneously view the environment, since the combiner 1902 is positioned on the frame or housing of the monitor 1900 to be in front of the test- taker’s eyes when the monitor 1900 is on the test-taker’s head, as well as reflection of content from the displays 1908.
- the combiner 1902 therefore does not block out all of the light from the environment in front of the test-taker, in contrast to some virtual reality goggles that entirely cover the eyes of the wearer and prevent the wearer from seeing outside of the device.
- the combiner 1902 does not have to contact or conform to the shape of the wearer’ s face at the bottom edge and so there is often a gap between the bottom edge of the combiner 1902 and the person’s face.
- the combiner 1902 preferably has an antireflective coating on the outside surface to potentially allow the maximum light to pass through the combiner 1902 from the environment.
- the combiner 1902 can also have a privacy film which prevents light from being seen from outside except in a direction approximately perpendicular to the surface of the combiner 1902. Such a film thus blocks the light which normally passes through the combiner 1902 in the vertical direction and could thus otherwise be seen from below.
- the combiner 1902 represents a singular combiner or multiple combiners that cooperate to provide the functionality described above.
- An upper edge region of the combiner 1902 is attached to the frame or housing of the monitor 1900 so that the combiner 1902 is below the frame.
- the combiner 1902 and frame or housing are components of a front portion of the monitor 1900.
- the edges of the front portion are not configured to conform to the face of a wearer.
- the combiner 1902 may also be provided with side sections, one on each side of the front section. As such, the person can see in front of them or to the sides only through the combiner 1902 and its associated structure.
- Displays 1908 can also have privacy films attached to their surfaces to accurately direct the light in a direction perpendicular to the display surface making it difficult to see the display 1908 from below. Privacy films work best in preventing light transmission in horizontal or vertical directions and therefore two such films may be required for the displays.
- the combiner can also comprise a film of electrochromic material whose transmissivity can be electrically controlled. Thus, the amount of light passing through the combiner from the environment can thus be controlled. This permits the view of the reflected image from the combiners under conditions of bright ambient light. Alternates to electrochromic material include Kerr cells.
- the crossview cameras 1910 are provided to monitor the space surrounding and below the combiner to search for unwanted cameras.
- Two iris cameras 1904 are provided to monitor the irises of the test-taker to make sure that the eyes of the test-taker are in the proper position during test taking while the display is illuminated, and the monitor 1900 is on the test-taker’ s head.
- the cameras 1904 are also used for biometric identification purposes.
- the iris cameras 1904 can have a much wider field of view than necessary to observe the iris and thus they can also be used to monitor for hidden cameras placed by an test-taker to transfer the contents of the test to an accomplice his cameras 1904 are part of an iris camera system arranged on the frame of the monitor 1900 and which is generally configured to image the eyes of the test-taker when the monitor 1900 is on the test-taker’s head.
- the iris camera system may include a different number of iris cameras 1904, so long as the left and right eyes are imaged.
- the iris camera system is arranged on the front portion of the monitor 1900.
- Crossview cameras 1910 are provided to monitor the volume between the displays, combiner and eyes of the test-taker (test-taker) to check for the placement of hidden cameras to transfer the contents of the test to an accomplice.
- the iris and crossview cameras 1904, 1910 it should not be possible to hide an imaging device within the volume encompassed by the monitor 1900 and the face of the test-taker.
- Crossview cameras 1910 are part of a crossview camera system arranged on the frame of the monitor 1900 and which is generally configured to image from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and image from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner when the monitor 1900 is on the test-taker’ s head.
- the crossview camera system may include a different number of crossview cameras 1910, so long as the volume encompassed by the monitor 1900 and the face of the test-taker is imaged.
- the crossview camera system is arranged on the front portion of the monitor 1900.
- Two forward-looking cameras 1906 are also provided for monitoring the environment surrounding the monitor 1900 and test-taker. These cameras 1906, which together will encompass a large field of view, can be used to monitor for the existence of notes, textbooks, or other apparatus which could aid the test-taker in answering the test questions, but which are prohibited by the rules of the test. The existence of a computer which the test-taker could use to access the Internet can be determined. Similarly, if the test-taker is typing on a keyboard, that action can be detected. In short, the forward-looking cameras 1906 can detect any forbidden activity undertaken by the test- taker. They can also determine the presence of potential accomplices trying to help the test-taker during the test taking process.
- the forward cameras 1906 can be provided with LED or other illumination which can be in the visual or infrared (IR) portion of the electromagnetic spectrum.
- the cameras 1906 need to be sensitive to IR if IR illumination is used.
- Forward-looking cameras 1906 are part of a forward looking camera system arranged on the frame of the monitor 1900 and which is generally configured to image an area in front of the frame, and ideally to the outward sides of the frame when the monitor 1900 is on the test- taker’ s head.
- the forward looking camera system may include a different number of forward looking cameras 1906, so long as the environment around the monitor 1900 is are imaged.
- the forward looking camera system is arranged on the front portion of the monitor 1900.
- the images obtained by the six cameras discussed above may be analyzed using trained neural networks or Deep Learning technology, for example.
- a processor is provided on the monitor 1900, usually in the front portion or housing (e.g., including or on printed circuit board 1920 shown in FIG. 26).
- This processor is coupled to the cross-view camera system, the iris camera system and the forward looking camera system and performs various image analysis.
- the processor analyzes images obtained by the cross-view camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the test-taker on which the monitor 1900 is situated (and optionally imaging devices), and analyzes images obtained by the forward-looking camera system to determine presence of specific objects.
- the processor may also be configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data.
- the processor can use pattern recognition when analyzing images, or be otherwise trained, programmed or configured to provide the desired output of the presence of or lack of imaging devices in images. When used for testing purposes, determination of the presence of an imaging device, or person, or unauthorized testing aid or person, can result in the test being terminated.
- the monitor 1900 is held in position on the test-taker’s head by means of forehead resting pad 1912 coupled with an elongate band 1914 which is preferably adjustable for tension by adjustment knob 1918 (FIG. 24).
- Band 1914 is connected at one end to the front portion of the monitor 1900 and also connected at the opposite end to the front portion of the monitor 1900.
- Other bands and length adjustment mechanisms may be used in the invention.
- Another elongate band 1926 which holds the contact microphone 1922 and contact speaker 1924 in position against the forehead of the test-taker, also contributes to the proper positioning of the monitor on the head of the test-taker.
- Band 1926 is part of the front portion of the monitor 1900.
- the electronic printed circuit boards are illustrated generally at 1920 and are powered by a battery 1916 through wires which are not illustrated.
- Printed circuit board 1920 should be considered to represent a processor or processor means or data processor used for performing the functions need for operability of the monitor 1900, including but not limited to the image analysis.
- Monitor 1900 may include additional features, including those features of any embodiments of a monitor or glasses disclosed herein. Use of the monitor 1900 may be testing purposes in any of the ways disclosed herein.
- FIGS. 27-30 illustrate key components of the device as covered with the chassis intrusion detector (CID) 1952. The operation the CID is discussed elsewhere and will not be repeated here. The assembly covered by the CID is shown generally at 1950.
- CID chassis intrusion detector
- CID 1952 there is a contact microphone 1954, contact speaker 1956, interfaces 1958 between the forward and iris cameras with a PC board 1960, cross-view cameras 1962, forward cameras 1964, and iris cameras 1966.
- Displays 1968 are connected to the PCB board 1960 by ribbon cables 1970.
- the CID 1952 is represented by a smooth envelope. In practice, the CID 1952 will adhere to the surfaces of the various components. In some cases, it will be necessary to add additional structure to position the CID 1952 properly relative to the various components that it is meant to protect.
- the CID 1952 may be attached directly to the cameras 1962, 1964, 1966 and displays 1968 in such a way as to provide a smooth surface that does not distort the images being acquired or displayed by these devices.
- the CID 1952 preferably covers just what is shown in FIGS. 27 and 30. The CID 1952 does not cover the side shield (a portion of the combiner 1902) or the band 1914.
- the intrusion protected device may be formed by covering the front portion or housing, and its associated cameras, with the CID 1952 and then snapping it into a frame with a wire coming out from this covered device going to a battery and a receptacle on the battery for connecting to the wall power.
- Forward monitoring cameras can be used to monitor positions and motions of the test-taker’s hands and fingers and thus can be used to record gestures.
- the gestures can be used to control various functions of the monitor.
- Gestures for example, can be used to control information displayed on the displays and for selecting he answers in multiple choice tests. Gestures can replace touch screen functions, for example.
- the motions of the hands and fingers can replace a mouse or keyboard, further improving the security and versatility of the monitor.
- a virtual mouse and/or keyboard can be provided for such uses.
- sensors that are mounted to the monitor such as fingerprint sensors, touch sensors etc. can be added to the monitor.
- many other sensors that are not integral to the monitor can communicate with the monitor through WiFi, Bluetooth or other wireless or wired communication protocols.
- the monitor can be used to control off monitor devices such as room temperature, lights, garage door, door locks etc through its connection to the Internet or to another external controller.
- Communication from the monitor to the Internet and other devices generally involves use of Wi-Fi and BluetoothTM. Communication generally can involve the sending of test questions and answers between the monitor and an Internet resident server. In some versions of the monitor, direct cellphone communication will also be available. This will become increasingly important as cellphone data transmission speeds increase. The best method of communicating with the Internet may soon be through 5G and thus Wi-Fi, although available, may be used less and less.
- the CID provides excellent hardware security, but the possibility still exists for software malware to enter the monitor through one of the communication channels.
- One method of guarding against such malware becoming resident on the monitor is to require that all communications other than BluetoothTM with the monitor take place through a secure Internet resident server. This server would scan all transmissions intended for the monitor to make sure that no malware is present.
- the monitor When using the monitor, it may be desirable to use the computational resources of external devices such as smart phones and PC computers. This can be accomplished using various input methods to send data and commands to the external device. These methods include using a physical or virtual mouse and or keyboard or orally.
- alternative data input devices may be utilized with the monitor providing the proper software and hardware is provided.
- One such device is a clicker which can be used to answer multiple choice questions.
- Another is a ring that has many of the functions of a mouse but resides on the finger of the test-taker. Such a ring, in some cases, can have a camera which can be useful for taking a picture of the test-taker to help in verifying his or her identity.
- the monitor can also be used to control external devices such as radio or TV stations, lights, door locks, etc as already mentioned.
- the lens through which the user views the surrounding environment can incorporate a Kerr or Pockels cell or an electrochromic film which turns dark, for example, when the test is underway.
- the same apparatus can be used to control the relative brightness of the room or ambient light relative to the display to enhance the display contrast.
- An IMU can be added where the knowledge of the kinematic or rotational motion of the head of the test-taker is desirable. Such a device can be used, for example, to register head motions for the control of various functions depending on the programs present and running on the monitor CPU.
- a GPS can be added where it is desirable to know the location of the monitor.
- the GPS and IMU can work with the various cameras to map the environment where the monitor is in use which can permit the placement of augmented devices as in augmented reality. Additionally, the display can be pinned to the environment allowing, for example, the use of multiple screen images where the user can move from screen to screen merely by moving his or her head as if the room where the test-taker is situated had multiple TV screens.
- a magnetometer can Additionally be added to help orient the monitor.
- a preferred mapping system can use the techniques disclosed in US 20190271550 for road mapping.
- the monitor has one or more cameras and the head of the test-taker is frequently moving allowing, in conjunction with the IMU, GPS and other related apparatus, the accurately mapping of the environment using stereographic techniques as disclosed in the ‘793 publication.
- a magnetic compass or magnetometer can also be included in the monitor to aid in the orientation or mapping process.
- the test-taker can use a laser pointer to allow selection of a point in the surrounding environment. This can be used in conjunction with augmented reality to locate a particular point where the augmented reality device should appear. This laser pointer can be augmented with lidar capabilities to allow, on a limited basis, the determination of the distance to the object that is being selected. See, for example, US Pat. No. 10,152,141.
- structured light can also be used to map the geometry in the surrounding area relative to the monitor.
- patterned light beams can be sent from, for example, different sides of the monitor and the interference or relative position of these structured patterns can determine the distance from the monitor. See, for example, US Pat. No. 7,182,465.
- a 360-degree camera can be mounted onto the top of the monitor through using a separate strap which provides the capability of monitoring and photographing the entire space surrounding the test- taker. Alternately, cameras can be mounted to the sides and rear of the monitor to get a 360-degree view of the environment surrounding the test-taker.
- the iris camera can be used to sense the blink of an eye which can additionally be used to control the display or other features or capabilities of the monitor.
- motions of the hands and fingers can be used as gestures to control monitor displays or other functions as discussed above.
- a virtual keyboard can be displayed in the field of view of the test-taker as can be his hands relative to the keyboard. By watching the test-taker typing the characters that are intended to be depressed, this can be recorded and converted to characters on the display.
- a physical keyboard can be used; however, this poses some unique problems.
- the keyboard must not have the capability of transmitting data to any place other than the monitor. If it can do so, then the keyboard can be used to type questions to a consultant.
- a keyboard can be designed with a hidden switch which sends a wireless signal to the consultant which is not registered by the monitor.
- the monitor determines that the test-taker is typing but it is not receiving the result of that typing, then the test can be terminated.
- the keyboard can be covered with a CID and can communicate to the monitor using encryption.
- a virtual keyboard may be picked up by an infrastructure mounted camera, although this would be difficult and easily defeated by moving the keyboard slightly.
- Additional sensors can be mounted on the monitor to monitor the health state of the test-taker, for example, a heart rate monitor, a temperature sensor and an EEC are three possibilities.
- Some versions of the monitor have an EKG (ECG) sensor which can be used for biometric identification as well as health monitoring as discussed above.
- EKG EKG
- An ambient light sensor can be added to aid in the control of the various cameras.
- a capacitance sensor or microscope lens can also be added to determine contact with the skin by the contact microphone.
- a blood flow sensor can also be used for that purpose as well as a skin temperature sensor.
- a picture of the face skin can be used to measure the distance to the skin by having a very small depth of field or by using structured light or just a laser shined at an oblique angle.
- An endfire microphone array can also be used in order to determine the direction of incoming sound. This can augment the contact microphone for determining when the test- taker is speaking or otherwise creating sounds. Other combinations of multiple microphones can be used to localize source of speech.
- An earbud for example, can include additional sensors such as a microphone or array of microphones. In some embodiments, at least two microphones from a microphone array can be arranged along a line pointed towards or at least near the mouth of a user. By using information received by the orientation sensor or sensors, a controller within the earbud, or other device, can determine which microphones of a microphone array should be activated to obtain this configuration. By activating only those microphones arranged along a vector pointed at or near the mouth, ambient audio signals not originating near the mouth can be ignored by applying a spatial filtering process.
- Ultrasonic, IR, RF, and similar sensors can be added if the need arises.
- Tactile or touch sensors can be added to allow for finger control of the monitor. Such sensors are used on Google Glass for example.
- Systems are under development to allow direct communication from a person’s brain to a device separate from the body.
- the concept is to allow for direct brain to Internet communication.
- Such a system could be used to defeat the cheating prevention systems described herein and therefore a device can be added to the monitor to sense for such communications when that technology becomes available.
- Various hand mounted sensors including a camera, RF transmitter, and LED, can also be used to control monitor functions.
- An advantage in locking the display view to a physical location is that the view can be changed by the test-taker simply moving his or her head.
- multiple screens can be available containing multiple websites or TV stations and the test-taker can switch between them merely by head movements.
- each screen can be equivalent to a large screen TV. Sound that accompanies each screen can be controlled since the monitor will know which screen is being observed by the test-taker.
- MOOCs or other educational classes can be watched by students. After taking a MOOC course, for example, the student can immediately take a secure test for credit.
- Various software modules that can be resident in the Monitor include: a. Iris capture b. Eyeball location c. EKG capture and biometric recognition d. Finger and hand recognition and monitoring e. Voice recognition biometric f. Sounds emanating from the test-taker’s mouth g. Nefarious object presence recognition in iris or cross view camera images. h. Cryptographic key set determination from an iris code. i. CID broken wire detection j. School registration software
- Various software modules that can be resident on the server which interacts with the monitor include: a. Communication with universities or other test suppliers b. Test reception, scrambling and encryption c. Iris recognition d. Communication with monitors
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Evolutionary Computation (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Artificial Intelligence (AREA)
- General Engineering & Computer Science (AREA)
- Ophthalmology & Optometry (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Eye Examination Apparatus (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/564,905 US20190392724A1 (en) | 2014-08-22 | 2019-09-09 | Secure Testing Device |
US16/717,020 US20200118456A1 (en) | 2014-08-22 | 2019-12-17 | Secure Testing Device With Combiner |
PCT/US2020/049504 WO2021050392A1 (en) | 2019-09-09 | 2020-09-04 | Secure testing device with optical element |
Publications (2)
Publication Number | Publication Date |
---|---|
EP4028826A1 true EP4028826A1 (en) | 2022-07-20 |
EP4028826A4 EP4028826A4 (en) | 2023-10-11 |
Family
ID=74866782
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP20862545.9A Pending EP4028826A4 (en) | 2019-09-09 | 2020-09-04 | Secure testing device with optical element |
Country Status (7)
Country | Link |
---|---|
EP (1) | EP4028826A4 (en) |
KR (1) | KR20220063194A (en) |
CN (1) | CN114585959A (en) |
AU (1) | AU2020345715A1 (en) |
CA (1) | CA3153968A1 (en) |
TW (1) | TW202121360A (en) |
WO (1) | WO2021050392A1 (en) |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8477425B2 (en) * | 2010-02-28 | 2013-07-02 | Osterhout Group, Inc. | See-through near-eye display glasses including a partially reflective, partially transmitting optical element |
US20130278631A1 (en) * | 2010-02-28 | 2013-10-24 | Osterhout Group, Inc. | 3d positioning of augmented reality information |
CN103033936A (en) * | 2011-08-30 | 2013-04-10 | 微软公司 | Head mounted display with iris scan profiling |
CN106662746B (en) * | 2014-08-22 | 2020-10-23 | 国际智能技术公司 | Secure examination device, system and method |
JP2017049762A (en) * | 2015-09-01 | 2017-03-09 | 株式会社東芝 | System and method |
US10810773B2 (en) * | 2017-06-14 | 2020-10-20 | Dell Products, L.P. | Headset display control based upon a user's pupil state |
WO2019104413A1 (en) * | 2017-12-03 | 2019-06-06 | Frank Jones | Enhancing the performance of near-to-eye vision systems |
-
2020
- 2020-09-04 EP EP20862545.9A patent/EP4028826A4/en active Pending
- 2020-09-04 CN CN202080062930.3A patent/CN114585959A/en not_active Withdrawn
- 2020-09-04 KR KR1020227010802A patent/KR20220063194A/en unknown
- 2020-09-04 WO PCT/US2020/049504 patent/WO2021050392A1/en unknown
- 2020-09-04 CA CA3153968A patent/CA3153968A1/en active Pending
- 2020-09-04 AU AU2020345715A patent/AU2020345715A1/en active Pending
- 2020-09-09 TW TW109130935A patent/TW202121360A/en unknown
Also Published As
Publication number | Publication date |
---|---|
EP4028826A4 (en) | 2023-10-11 |
WO2021050392A1 (en) | 2021-03-18 |
AU2020345715A1 (en) | 2022-04-21 |
KR20220063194A (en) | 2022-05-17 |
TW202121360A (en) | 2021-06-01 |
CA3153968A1 (en) | 2021-03-18 |
CN114585959A (en) | 2022-06-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200118456A1 (en) | Secure Testing Device With Combiner | |
US20190392724A1 (en) | Secure Testing Device | |
EP3029550B1 (en) | Virtual reality system | |
US20160035233A1 (en) | Secure Testing System and Method | |
US20150037781A1 (en) | Monitoring device and system for remote test taking | |
US20220068154A1 (en) | Secure Testing Device with Combiner | |
US11355024B2 (en) | Methods for administering and taking a test employing secure testing biometric techniques | |
US11982809B2 (en) | Electronic device with inner display and externally accessible input-output device | |
US20200301150A1 (en) | Secure testing device with liquid crystal shutter | |
KR20150134666A (en) | Glass type terminal and control method thereof | |
US10410535B2 (en) | Secure testing device | |
CN103033936A (en) | Head mounted display with iris scan profiling | |
JPWO2016157485A1 (en) | Head mounted display | |
CN110866230B (en) | Authenticated device assisted user authentication | |
US20210081047A1 (en) | Head-Mounted Display With Haptic Output | |
CN105027140B (en) | Portable information code reading device | |
KR20210045530A (en) | VR type wearable treatment device | |
EP4028826A1 (en) | Secure testing device with optical element | |
WO2015148607A1 (en) | Secure testing system and method | |
US11508249B1 (en) | Secure testing using a smartphone | |
CN209690628U (en) | System and headset equipment | |
US20240184114A1 (en) | Method for securing a testing device | |
US11899214B1 (en) | Head-mounted device with virtually shifted component locations using a double-folded light path | |
WO2015093221A1 (en) | Electronic device and program | |
CN112534489A (en) | Safety examination equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20220329 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
A4 | Supplementary search report drawn up and despatched |
Effective date: 20230912 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 3/01 20060101ALI20230906BHEP Ipc: G09B 7/07 20060101ALI20230906BHEP Ipc: G02B 27/01 20060101AFI20230906BHEP |