EP4028826A1 - Secure testing device with optical element - Google Patents

Secure testing device with optical element

Info

Publication number
EP4028826A1
EP4028826A1 EP20862545.9A EP20862545A EP4028826A1 EP 4028826 A1 EP4028826 A1 EP 4028826A1 EP 20862545 A EP20862545 A EP 20862545A EP 4028826 A1 EP4028826 A1 EP 4028826A1
Authority
EP
European Patent Office
Prior art keywords
housing
test
camera system
person
taker
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20862545.9A
Other languages
German (de)
French (fr)
Other versions
EP4028826A4 (en
Inventor
David S Breed
Wilbur E Duvall
Serhii SHOSTAK
Oleksandr SHOSTAK
Vyacheslav Sokurenko
Aron Sereny
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Securetest LLC
Original Assignee
Securetest LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/564,905 external-priority patent/US20190392724A1/en
Priority claimed from US16/717,020 external-priority patent/US20200118456A1/en
Application filed by Securetest LLC filed Critical Securetest LLC
Publication of EP4028826A1 publication Critical patent/EP4028826A1/en
Publication of EP4028826A4 publication Critical patent/EP4028826A4/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B7/00Electrically-operated teaching apparatus or devices working with questions and answers
    • G09B7/06Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers
    • G09B7/07Electrically-operated teaching apparatus or devices working with questions and answers of the multiple-choice answer-type, i.e. where a given question is provided with a series of answers and a choice has to be made from the answers providing for individual presentation of questions to a plurality of student stations
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]

Definitions

  • the present invention relates generally to the field of a computer-based system and method for taking a test while ensuring that the test-taker is not receiving assistance from another person or otherwise cheating while taking the test, and that a device used for displaying or taking the test has not been breached and is not being breached or otherwise compromised.
  • test is any type of question-based application that requires consideration or analysis by a person taking the test and a potential response from this person.
  • a test may therefore be considered an examination, a quiz, an assessment, an evaluation, a trial and/or an analysis.
  • the test may be used to certify an individual as qualified to perform a specific task or ability, e.g., a driving test.
  • a test-taker is a person taking such a test.
  • a test-taker does not necessarily have to be a student of a course, i.e., someone subjected to education on a regular basis.
  • the present invention is directed at addressing and ideally solving the problem of guaranteeing with high certainty that a test-taker taking a test is acting alone without the aid of a consultant or other helper or otherwise cheating.
  • a device that can achieve this object includes a frame configured to be situated on a person’s head, a display section on the frame having a first portion and a second portion, and a combiner arranged on the frame in a position at least partly in front of right and left eyes of the person when the frame is on the person’s head.
  • the combiner an optic or optical element, allows simultaneous viewing by the person of an environment in front of the person and content on the display section.
  • the combiner reflects content of the first portion of the display section to the person’ s left eye when the frame is on the person’s head and reflecting content of the second portion of the display section to the person’s right eye when the frame is on the person’s head.
  • a crossview camera system on the frame a images from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and images from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner.
  • An iris camera system arranged on the frame images the left eye of the person on which the frame is situated, and image the right eye of the person on which the frame is situated.
  • a forward-looking camera system arranged on the frame images an area in front of the frame.
  • a processor is coupled to the crossview camera system, iris camera system and forward-looking camera system and analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and analyzes images obtained by the forward-looking camera system to determine presence of specific objects.
  • the crossview camera system may include a first crossview camera on the first lateral side of the frame and arranged to image inward of the first lateral side of the frame and below the combiner, and a second crossview camera on the second lateral side of the frame and arranged to image inward of the second lateral side of the frame and below the combiner.
  • the iris camera system may include a first iris camera arranged on the frame to image the left eye of the person on which the frame is situated, and a second iris camera arranged on the frame to image the right eye of the person on which the frame is situated.
  • iris camera will mean any imaging device which images the iris, a portion of the face around and including the iris, retina, a portion of the face around and including the retina, or face portion optionally including the iris and/or retina.
  • the first and second portions of the display section may be positioned horizontally alongside one another
  • the combiner optionally includes a semi-reflective coating on an inside surface in an optical path between the first and second portions of the display section and the person’s eyes when the frame is on the person’s head.
  • the combiner is positioned in front of the person’s eyes when the frame is on the person’s head to allow view of ambient environment in front of the person when the frame is on the person’s head.
  • the combiner could include an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment.
  • the processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data. Similarly, the processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system to determine presence of imaging devices in any obtained images. To this end, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and/or when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
  • a forehead resting pad may be arranged at a front of the frame in a position to contact a forehead of the person when the frame is on the person’s head.
  • the frame may be considered to include a front portion including the display section, combiner, crossview camera system, iris camera system, forward-looking camera system, and processor, and a first elongate band having first and second opposite ends and being coupled at the first and second ends to the front portion.
  • the frame includes a second elongate band adjacent the front portion and which is in contact with the person’s skin when the frame is on the person’ s head, the second band including a contact microphone and a contact speaker.
  • a chassis intrusion detector system may be arranged over the front portion of any embodiment.
  • a device includes a housing comprising a display section including at least one display for displaying content, an optical element coupled to the housing and arranged in an optical path of the at least one display section and that reflects at least a portion of content when displayed on the at least one display and allows viewing therethrough, a crossview camera system coupled to the housing and that images from locations on each lateral side of the housing toward an opposite lateral side of the housing portion and below the optical element, an iris camera system coupled to the housing and that images an area rearward of the housing from locations on the housing rearward, and a forward-looking camera system coupled to the housing and that images an area in front of the housing from locations on the housing.
  • a processor is arranged in the housing and coupled to the crossview camera system, the iris camera system and the forward-looking camera system.
  • the processor analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, images obtained by the iris camera system to determine presence and position of irises, and images obtained by the forward-looking camera system to determine presence of specific objects.
  • a first elongate band has first and second opposite ends and is coupled at the first and second ends to the housing. The first band extends rearward from the housing to form an enclosure in which a person’ s head is positionable.
  • the crossview camera system may include a first crossview camera on the first lateral side of the housing and arranged to image inward of the first lateral side of the housing and below the combiner, and a second crossview camera on the second lateral side of the housing and arranged to image inward of the second lateral side of the housing and below the combiner.
  • the combiner may include a semi-reflective coating on an inside surface in the optical path of the at least one display section, and an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment.
  • the at least one display section may include two display sections positioned horizontally alongside one another.
  • the processor optionally, but preferably, analyzes images obtained by the iris camera system to determine presence of imaging devices in any obtained images. Also, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine presence and position of irises, and when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
  • the device could include a forehead resting pad arranged at a front of the housing, a second elongate band adjacent the housing and including a contact microphone and a contact speaker, and a chassis intrusion detector system arranged over the housing.
  • Additional devices which can be part of the electronics assembly and which are designed to operate through the security film include:
  • a camera for obtaining iris, retinal or partial facial scans 1.
  • a microphone for monitoring sound in the vicinity of the test- taker or emitted by the test- taker is provided.
  • a sound maker used for testing the microphone sensitivity 4.
  • a contact microphone for detecting sound emanating from the mouth of the test-taker, primarily talking, i.e., words.
  • a device mounted in connection with the contact microphone for detecting the presence of the test-taker’s skin can comprise a blood flow sensor comprising a LED and light sensor positioned so that the reflection of the LED is in the field of view of the light sensor only when the device is in close proximity to the skin.
  • Skin presence sensors can also comprise a temperature sensor, camera, capacitance sensor or any other device capable of determining the presence of the test taker’s skin.
  • ECG EKG
  • FIGS. 1-4 illustrate a preferred version of the monitor.
  • FIG. 5 illustrates a method of attaching a USB connector for supplying power to the monitor through the CID.
  • FIGS. 6 and 7 illustrate use of a contact speaker with a contact microphone to verify that the contact speaker contacts the test-taker’s face and further, use of an EKG biometric for additional verification of proper placement of the contact microphone and to obtain an additional biometric.
  • FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device is attached to a central computer through a USB port.
  • FIG. 9 is a view like FIG. 8 with a wireless connection through a wireless transmitter box associated with each desk and where the test-takers are using paper to record their test answers.
  • FIG. 10 is a perspective view of a head worn glasses type device containing an electronics assembly with several sensors, cameras and a display all protected with a chassis intrusion detector prepared using the teachings of this disclosure.
  • FIG. 11 is a perspective view of the apparatus of FIG. 10 seen from the rear.
  • FIGS. 12-17 illustrate a preferred design of the monitor for two eyes utilizing a single display.
  • FIGS. 18-26 illustrate a preferred design of the monitor for two eyes utilizing two large displays.
  • FIGS. 27-30 illustrate the device of FIGS. 18-26 with the chassis intrusion detector installed.
  • FIGS. 1-10 a simple direct projection display has been illustrated where the display is in the form of a projector directing the image directly into the eye.
  • Alternative reflection displays have also been disclosed.
  • the direct projection display has the disadvantage of blocking a view of the surrounding environment when the image is not being viewed. Similarly, this design is usually limited to implementation for a single eye.
  • Other options include reflective displays where the projector sends the image directly toward a lens or combiner in front of the eye, and waveguide displays, where the maximum freedom is provided for the location of the display device relative to the eyes.
  • Both the reflection and waveguide displays require a display element that displays the image for further processing by the optical system.
  • Preferred technologies include Liquid Crystal on Silicon (LCoS) and Active Matrix Organic Light Emitting Diodes (AMOLED) or simply LCD displays.
  • the reflector design disclosed in US 20170061212, FIGS. 2A and 2B can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of another reflector display. Another prior art reflector design is disclosed in US 20170336634.
  • the waveguide display design of US 10,180,572, FIG. 1, can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of a waveguide display.
  • FIG. 1 is a front view of a version of the monitor which has many of the features of other monitors disclosed herein and the same or similar functionality.
  • electronics are contained in a housing 1002 and a display is shown at 1004.
  • Knobs 1003 and 1005 are used to clamp the housing of the electronics and display assembly at a desired orientation and to permit rotation about lateral and vertical axes.
  • Knobs 1003, 1005 can be configured such that rotation of each knob 1003, 1005 causes a change in the distance between the housing 1002 and the frame. This allows the test-taker to adjust the display 1004 to properly align the display with the test-taker’s eye.
  • the housing 1002 and the display 1004 are therefore adjustable in position relative to the eyeglasses frame. Any adjustment mechanism to provide for this variable position may be used, with the knobs 1003, 1005 being only an exemplifying embodiment. This design is somewhat larger than previous designs as essentially all the required electronics are contained in the housing.
  • FIG. 2 is a view of the monitor 1000 from the rear showing a glasses frame 1006 and adjustable clamping mechanism 1007 for attaching the housing containing the electronics to a temple of the glasses frame 1006.
  • Clamping mechanism 1007 includes the two knobs 1003, 1005 that provide for the adjustment of housing portion relative to the glasses frame 1006.
  • Clamping mechanism 1007 is clamped to the glasses frame by tightening screw 1011 which allows the entire assembly to be positioned relative to the glasses frame 1006.
  • a contact microphone 1012 is provided and presses against the skin of the test-taker by means of spring 1013 connected to housing 1002.
  • Spring 1013 extends from the housing 1002 inward, i.e., toward the opposite temple.
  • the contact microphone 1012 is arranged proximate or at an inward end of the spring 1013 and is biased to be further outward from the temple so that when the monitor 1000 is worn, the spring 1013 may be compressed and thus exerts a force against the skin of the wearer thereby maintaining contact between the contact microphone 1012 and the skin of the wearer or test-taker.
  • a sound generator, such as a contact speaker 1014 is provided on the other temple of the glasses frame 1006.
  • Microphone 1012 and speaker 1014 are in electronic communications with the processor in housing 1002 to operate as disclosed above.
  • the contact speaker also called a bone speaker, emits an audible sound as well as a vibration to the skin and/or bone of the test taker. This audible sound can be used to test the audio microphone replacing the sound creator.
  • the test-taker is generally forbidden from talking during the test, to prevent the test-taker from orally supplying test questions to an accomplice.
  • the microphone could be used for monitoring the test taker’s talking, however, other sounds in the environment would also be recorded by such a microphone and it may be difficult to differentiate the communication by the test-taker from sounds that might be in the environment.
  • a contact microphone will only detect sound vibrations coming through the skin of the test-taker and ignore all other sounds. Therefore, it is a preferred method of determining whether the test-taker is talking.
  • the contact microphone 1012 must be in contact with the skin of the test-taker.
  • the contact speaker 1014 can be placed on the opposite side of the test- taker’s head.
  • Contact speaker 1014 can be programmed to periodically transmit a sound through the head of the test-taker to the contact microphone 1012 and to the audio microphone 24. If both contact devices are in contact with the skin of the test-taker, the transmission will be detected by the contact microphone 1014 thereby confirming that the monitor 1000 is properly in place.
  • the bone or contact microphone should be activated with voice recognition whenever it hears anything.
  • the audio microphone should be activated whenever there is a transmission from the audio speaker and when it hears talking. If the test-taker finds a way to defeat the contact microphone and talks, the audio microphone should pick it up. If the environment is too noisy then the test can be paused until the noise quiets down. The test-taker should not be taking a test in an environment where there is excessive talking.
  • the test-taker Prior to the start of a test, the test-taker can be asked to state his name and both microphones should be able to record this. If there is any doubt about the activation of the bone microphone, or at other random times, the test can ask the test-taker to restate his name or some other announcement. Both microphones should register the response without an unreasonable delay. In a later version it may be desirable to have more than one microphone in the headset so that the location of the sound source can be triangulated. Some triangulation can occur even with the two microphones described here.
  • FIG. 3 illustrates use of chassis intrusion detector, CID, 1016, like CID 22 described above or any other CID disclosed herein, with this design.
  • FIG. 4 additionally shows electronics 1018 from an inside view that is covered by CID 1016. Display 1022 is similarly covered by the CID 1016.
  • FIG. 5 illustrates an exemplifying method of attaching a USB connector for supplying power to a monitor through a CID 1056 or CID 22 or any other CID disclosed herein.
  • CID 1056 is shown covering a portion of a PC board 1054.
  • a USB connector 1050 is attached to housing 1052.
  • USB connector pins 1058 pass through small holes 1060 provided in the CID 1056. These holes 1060 are sufficiently small that it would be very difficult for anyone to defeat the CID 1056 through these holes 1060.
  • the illustrated monitor may be any of the monitors disclosed herein.
  • FIG. 6 is a view like FIG. 2 showing the contact speaker 1014 and contact microphone 1012.
  • Contact speaker 1014 has been moved forward on the temple of the glasses frame 1006 in order to accommodate bearded test-takers.
  • a movable connection of the contact speaker 1014 to the temple is provided.
  • the connection from the speaker 1014 to the electronics is through wire 1009 that may pass through an interior space in the temple and lens portion.
  • Wire 1010 goes from the USB connector described in FIG. 5 to a source of power such as a wall outlet.
  • FIG. 7 illustrates the addition of an EKG sensor in the form of a thin film 1110 which is placed on top of the contact microphone 1012 (to form a microphone assembly) and the contact speaker 1014 (to form a speaker assembly).
  • both the contact microphone 1012 and contact speaker 1014, with EKG sensors, are moved forward on the temples of the glasses frame 1006 so that they contact skin of bearded people.
  • the contact microphone 1014 is covered with the CID whereas the contact speaker 1012 is not. Both devices could be covered with CIDs but it may not be necessary to cover the contact speaker.
  • the EKG sensors also known as electrocardiogram sensors or ECG sensors, allow for the measurement of the heartbeat shape and serves as a further verification that the contact speaker and microphone are in contact with the skin.
  • An EKG also provides an alternate biometric verification of the identity of the test-taker. Since the signal levels for EKG measurements are very low, the sensor pads cannot be covered by the CID. This issue can be resolved by allowing two conductors to be placed through the CID allowing the EKG pads to be glued to the outside of the CID. The remainder of the contact microphone can be placed inside the CID cover.
  • any of the disclosed monitors may be used for tests that require written answers. For such tests, the monitor is equipped with a high definition display permitting multiple lines of text to be displayed.
  • the monitor should also be capable of displaying a virtual keyboard preventing the test-taker from typing on a desk or table, which will be observed by the forward-facing camera.
  • a virtual keyboard is described in US 10180572.
  • the test-taker When provided with a question requiring a text response, the test-taker will use the virtual keyboard on the display to type the answer which will then appear on the display. In this manner, a response by the test-taker cannot be observed by an associate looking over his shoulder while the test is being taken.
  • a written response to a test will be required especially when a mathematical derivation or the hand writing of mathematical expressions is required.
  • the test-taker can be provided with a tablet onto which his hand-written response will be entered. The tablet will not show the test-taker’s handwriting but will be linked to the monitor in such a manner that only the monitor receives the hand-written response. This response will be displayed on to the display for review and correction by the test taker.
  • electrochromic glass or film on plastic can be used for this function, as described in US 10180572.
  • the electrochromic glass will be turned totally black or opaque by a control mechanism so that the contents of the display cannot be seen from a person standing in front of the test-taker.
  • Another approach is to use polarized lenses for the glasses and display where the angle of polarization is rotated 90 degrees.
  • the glasses can be vertically polarized and the display horizontally polarized. In this case, light from the display will not pass through the glasses preventing it from being observed by anyone standing in front of the test-taker.
  • an equipped monitor obtains a second biometric system for identifying the test-taker and for verifying that the test-taker is in fact wearing the monitor.
  • the EKG pads on opposite sides of the test-taker’s head will record the shape of the heartbeat of the test-taker which is unique to that test- taker and thus is a biometric identifier of the test-taker.
  • test-taker can use his voice to enter commands to the monitor. Although this could be used as an alternative to the mouse described above for answering test questions, it can also be used for other commands such as initiating the test or controlling the display of the test questions for example.
  • the test-taker can say “next question”, “I need a break”, “test finished” etc.
  • the contact microphone will pick up the words spoken by the test-taker and thus can perform the various commands.
  • Voice entry can also be used for answering essay type questions where it is obvious that the test-taker is not using his voice to request help from an accomplice.
  • tiny microphones can be provided which are inserted into the ears of the test-taker in order to hear if the test-taker is using a speaker inserted into his ear. Such a speaker would be like a hearing aid.
  • Such microphones can be tiny devices measuring no more than a cubic millimeter. They can be inserted into the test-taker’s ear when the test-taker is wearing the monitor. Such microphones will also pick up the voice of the test-taker and therefore on command of the monitor that test-taker can say something to test that the in-ear microphones are properly installed. Talking can also be used to test operation of the contact microphone, although, as described above, other tests based on the contact speaker and the EKG devices are provided for this function.
  • Other methods can be used with the monitor to permit the test-taker to enter commands to the monitor.
  • One such method using the iris camera is track the eye motion which is usable to select answers to the questions or control operation of the monitor. Eye blinking and time/duration of closing also can be used for this purpose.
  • Another such method is to use gestures which can be seen by the forward-facing camera and interpreted by appropriate software. Teeth clicking can even be used for controlling the test and in particular for choosing answers to multiple choice test questions.
  • the lenses of the glasses can be made easily replaceable permitting different prescription lenses to be used for different test-takers.
  • the devices disclosed herein are not required to be used for testing purposes and may be used for other purposes, e.g., gaming, entertainment.
  • FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device can be attached to a central computer 1306 through a USB port, for example.
  • each test-taker 1302 is provided with a keyboard and/or a mouse or other input device, and a display 1304.
  • Each device can be connected to a central computer 1306. Otherwise, the operation of the Test Glasses is as described herein.
  • Each test-taker is presented a different version of the scrambled test and uses the keyboard and/or mouse to answer the test questions.
  • the central computer knows which test version is being answered by each test-taker so that the information can be used for grading the test. Since each test-taker is provided a different scrambled version of the test, the answer provided by one test-taker cannot help another provided talking is not permitted.
  • FIG. 9 is a view similar to FIG. 8 where the answers are placed on a piece of paper which will be collected by the test proctor at the conclusion of the test. Again, since each test-taker will be taking the same test with the questions randomly reordered, there is little advantage in a test-taker surreptitiously communicating an answer to another test-taker. Thus, by virtue of the arrangements depicted in FIGS. 8 and 9, the Test Glasses can be used either remotely or in a classroom environment.
  • FIG. 10 is a perspective view of a head worn glasses type device, the Test Glasses or Monitor, containing an electronics assembly with several sensors, cameras and a display, all protected with a chassis intrusion detector as described elsewhere herein, prepared using the teachings herein.
  • a head worn display and electronics device constructed in accordance with the invention is shown generally at 1410 in FIGS. 10 and 11.
  • a housing 1420 extends from a frame 1422.
  • Housing 1420 is substantially L-shaped with a first portion extending straight outward from an edge of the frame 1422 and second portion perpendicular to the first portion and positioned in front of the frame 1422.
  • a display 1412 is arranged on or in the housing 1420 and pointed toward the right eye of test- taker displays the test questions (although alternatively, a display can be pointed toward the left eye of the test-taker).
  • a forward viewing camera 1414 representative of an imaging device, is also arranged on or in the housing 1420 and monitors the field of view of the test-taker outward from the device 1410. The camera 1414 can have a field of view of approximately 120°.
  • a microphone 1416 is also arranged on or in housing 1420 and monitors talking (sounds) which can take place while the test is in progress.
  • a sound maker or speaker 1418 is arranged on or in the housing 1420 and periodically provides a sound detectable by the microphone 1416 to verify that the microphone 1416 has not somehow been rendered inoperable. The speaker 1418 may be placed further away from the microphone 1416 and insulated from the housing 1420 so that the microphone 1416 does not receive the sound from the speaker 1418 through the housing 1420 instead of the air surrounding the device 1410.
  • the display 1412 is arranged at a terminal end of the second housing portion.
  • the forward viewing camera 1414, or more generally an imaging device, the microphone 1416 and the speaker 1418 are also arranged on the second housing portion (FIG. 10).
  • Each of these components 1412, 1414, 1416, 1418 is connected to a processor-containing electronics package in housing 1420 which is mounted to the glasses frame 1422 in a manner known to those skilled in the art to which this invention pertains.
  • a cable emanates from the electronics package in housing 1420 and can contain a USB connector 1424 for connecting onto an external device such as a computer, battery pack or wall power supply.
  • Iris or retinal scan camera 1426 is arranged on housing 1420, pointing inward toward the wearer, and measures biometrics of the test-taker.
  • biometrics can include an iris or retinal scan or a scan of the portion of the face surrounding the eye.
  • Illumination of the eye can be provided by LEDs 1428 arranged on housing 1420 which can be in the IR or visible portions of the electromagnetic spectrum. If white LEDs are used, provision can be made to limit the intensity or the time that they are turned on so as not to annoy the test taker. Two or more different levels of visible illumination can be provided to cause the iris to be seen at different openings to check for an artificial iris painted onto a contact lens.
  • Iris scan camera 1426 and LEDs 1428 are arranged on the second housing portion.
  • a camera 1430 can also be provided on or in housing 1420 to check for any anomalous activity which might take place in the vicinity of the device 1410 (FIG. 11). Such a camera 1430 can enable detection of whether an image capture device has been either temporarily or permanently affixed to the device 1410 or to the face of the test-taker which can capture the image on the display 1412. Similarly, camera 1430 can monitor the space surrounding the left eye of the test-taker to assure that such an image capturing device and or another display for providing aid to the test-taker is not being employed by the test-taker in conjunction with his left eye.
  • the camera 1430 or more generally an imaging device, is arranged on the first housing portion and oriented to image most of the frame 1412 (FIG. 11).
  • Software and a processor which controls administration of tests can be resident on an external computer, in the electronics package in housing 1420, or in another device which attaches to the device 10 through connector 1424.
  • a test-taker will have access to a keyboard and/or a mouse for interacting with this computer. Using a keyboard, the test-taker can initiate the test taking process through communication with the test provider. When the test is ready for execution by the test-taker, and encrypted version of the test is transmitted to the computer and relayed to the device 1410.
  • the electronics package in housing 1420 e.g., including a processor, utilizes a private decryption key to decrypt the test questions and cause them to be displayed on display 1412. The test-taker then enters the answers to the questions using the keyboard and the computer display.
  • FIGS. 12-17 An alternate monitor design 1800 which provides an image to both eyes using a single microdisplay is illustrated in FIGS. 12-17.
  • the components, which must be protected by the CID, are more closely arranged to simplify the CID design.
  • a single (micro)display 1828 is used to illuminate lenses 1830 seen by each eye.
  • Two iris cameras 1802, two crossview cameras 1806, and two forward cameras 1818 can be implemented in this design. Since the display 1828 will be seen by both eyes, both must be monitored to guarantee that the device has not been rotated or in some manner pulled away from either eye to permit a foreign camera to be inserted.
  • the crossview cameras 1806 similarly must now watch both sides of the test-taker’s head to search for nefarious cameras inserted by the test-taker.
  • Sensor assemblies 1810 and 1812 are provided on each side of the forehead (FIG. 17). These sensor assemblies 1810, 1812 measure the EKG and sound emitted by the test-taker’s head.
  • Sensor assembly 1810 for example, can contain a contact speaker and contact microphone, one in each sensor.
  • sensor assembly 1812 can contain an ECG (EKG) sensor.
  • EKG ECG
  • the contact microphone will determine when the test-taker is emitting sounds and the contact speaker will be used to test that the contact microphone is in contact with the test-taker’s skin, as described in the other monitor examples.
  • the contact speaker can also emit an audio sound and thus can be used to test the audio speaker, if present. Since the EKG sensor pads must be sensitive to very low voltages, they generally will be placed on the outside of the CID.
  • a small pair of contacts can be placed in the CID to permit signals to be passed from the EKG sensors to the interior electronics.
  • the EKG sensor pads can be appropriately attached to the CID by gluing in such a manner that any attempt to remove the EKG pads will destroy the CID.
  • Two forward or front view cameras 1818 are provided in order to increase the field of view of the sensor system and to permit future 3D images to be created when augmented reality is implemented into this design.
  • the optical system can be arranged such that alternately polarized frames can be fed to the right and left eyes of the test-taker, wherein the single display panel can pass the information to the eyes to permit 3D holographic viewing by selectively polarizing successive frames or even in the same frame.
  • Monitor 1800 in this example contains a headband 1808 with an adjustment knob 1816 to permit the apparatus to the securely mounted to the test-taker’s head (FIG. 13).
  • a battery 1814 can also be integrated with the device and placed at the rear of the device to balance the forces from the monitor 1800 on the head of the test-taker. In this manner, the center of gravity of the monitor 1800 can be adjusted to be placed near the center of the test-taker’s head. Under these circumstances, there should be little tendency for the monitor 1800 to slip forward or backward.
  • the battery 1814 now can be considerably larger than in previous designs and designed to provide many hours of operation without an external power source.
  • a wire can lead from the battery 1814 to a wall charger or, alternately, a receptacle can be provided in the battery case for that purpose.
  • the display panel 1828 projects downward through lenses 1854 to a polarizing beamsplitter and mirror assembly 1856 which sends alternately polarized light to the left and to the right.
  • the display image is split into two images alternately polarized.
  • Birdbath mirrors 1820 then project the light down toward the lenses, or combiners, 1804 which contain reflecting surfaces and reflect the light into the eyes.
  • Each lens 1854 can be differently polarized so that the light which is polarized horizontally for the right eye, for example, interacts with a vertically polarized film on the right lens. This has the effect of making the right lens act as a mirror preventing the image from being seen from in front of the monitor 1800.
  • the polarized image for the left eye which can be polarized vertically, for example, would interact with a horizontally polarized film for the left eye. Rather than polarizing vertically and horizontally, naturally polarized light from the environment will have less effect if the polarization angles are +45 degrees and -45 degrees.
  • the lenses can be a compound lens arrangement whereby the outer lens corrects for prescription lens as needed for people with different requirements.
  • the inner lens can be the one from which the reflections to the eyes are made. These two sets of lenses can be designed so that the outer lenses are interchangeable depending on the visual needs of the test-taker.
  • the inner lens can be incorporated within the CID eliminating the possibility of a test-taker placing a camera that could see the inner lens and thus the display.
  • the focus of the display can be changed by moving various optical components. Under this arrangement, the field of view can be controlled so that it can only be seen by the test-taker’s eyes.
  • augmented reality devices such as a virtual smartphone, mouse or keyboard for use by the test-taker. These can require that the fingers of the test- taker be recognized and mapped in such a way that the motion of the fingers can be accurately tracked and understood.
  • the virtual keyboard can be attached to a location near the test-taker’s fingers or to a table that is either virtual or appears in the environment.
  • FIGS. 18-26 illustrate another preferred design of the monitor 1900 for two eyes, in this case utilizing two larger displays 1908 forming a display section in a housing of the monitor 1900.
  • Two displays 1908 are positioned approximately horizontally in the monitor 1900 alongside one another as shown in FIG. 23. Images from the displays 1908 reflect off a combiner 1902.
  • Combiner 1902 preferably has a semi-reflective coating on the inside surface, i.e., that surface in the optical path between the display 1908 and the eyes of the test-taker, which reflects only a percentage, for example 50%, of the incident light from the displays 1908 toward the test-taker’s eyes (the test-taker being the person on whose head the monitor 1900 is supported) when the monitor 1900 is placed or otherwise situated on the test-taker’ s head. The balance of the light is passed vertically downward.
  • the combiner 1902 allows the test-taker to simultaneously view the environment, since the combiner 1902 is positioned on the frame or housing of the monitor 1900 to be in front of the test- taker’s eyes when the monitor 1900 is on the test-taker’s head, as well as reflection of content from the displays 1908.
  • the combiner 1902 therefore does not block out all of the light from the environment in front of the test-taker, in contrast to some virtual reality goggles that entirely cover the eyes of the wearer and prevent the wearer from seeing outside of the device.
  • the combiner 1902 does not have to contact or conform to the shape of the wearer’ s face at the bottom edge and so there is often a gap between the bottom edge of the combiner 1902 and the person’s face.
  • the combiner 1902 preferably has an antireflective coating on the outside surface to potentially allow the maximum light to pass through the combiner 1902 from the environment.
  • the combiner 1902 can also have a privacy film which prevents light from being seen from outside except in a direction approximately perpendicular to the surface of the combiner 1902. Such a film thus blocks the light which normally passes through the combiner 1902 in the vertical direction and could thus otherwise be seen from below.
  • the combiner 1902 represents a singular combiner or multiple combiners that cooperate to provide the functionality described above.
  • An upper edge region of the combiner 1902 is attached to the frame or housing of the monitor 1900 so that the combiner 1902 is below the frame.
  • the combiner 1902 and frame or housing are components of a front portion of the monitor 1900.
  • the edges of the front portion are not configured to conform to the face of a wearer.
  • the combiner 1902 may also be provided with side sections, one on each side of the front section. As such, the person can see in front of them or to the sides only through the combiner 1902 and its associated structure.
  • Displays 1908 can also have privacy films attached to their surfaces to accurately direct the light in a direction perpendicular to the display surface making it difficult to see the display 1908 from below. Privacy films work best in preventing light transmission in horizontal or vertical directions and therefore two such films may be required for the displays.
  • the combiner can also comprise a film of electrochromic material whose transmissivity can be electrically controlled. Thus, the amount of light passing through the combiner from the environment can thus be controlled. This permits the view of the reflected image from the combiners under conditions of bright ambient light. Alternates to electrochromic material include Kerr cells.
  • the crossview cameras 1910 are provided to monitor the space surrounding and below the combiner to search for unwanted cameras.
  • Two iris cameras 1904 are provided to monitor the irises of the test-taker to make sure that the eyes of the test-taker are in the proper position during test taking while the display is illuminated, and the monitor 1900 is on the test-taker’ s head.
  • the cameras 1904 are also used for biometric identification purposes.
  • the iris cameras 1904 can have a much wider field of view than necessary to observe the iris and thus they can also be used to monitor for hidden cameras placed by an test-taker to transfer the contents of the test to an accomplice his cameras 1904 are part of an iris camera system arranged on the frame of the monitor 1900 and which is generally configured to image the eyes of the test-taker when the monitor 1900 is on the test-taker’s head.
  • the iris camera system may include a different number of iris cameras 1904, so long as the left and right eyes are imaged.
  • the iris camera system is arranged on the front portion of the monitor 1900.
  • Crossview cameras 1910 are provided to monitor the volume between the displays, combiner and eyes of the test-taker (test-taker) to check for the placement of hidden cameras to transfer the contents of the test to an accomplice.
  • the iris and crossview cameras 1904, 1910 it should not be possible to hide an imaging device within the volume encompassed by the monitor 1900 and the face of the test-taker.
  • Crossview cameras 1910 are part of a crossview camera system arranged on the frame of the monitor 1900 and which is generally configured to image from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and image from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner when the monitor 1900 is on the test-taker’ s head.
  • the crossview camera system may include a different number of crossview cameras 1910, so long as the volume encompassed by the monitor 1900 and the face of the test-taker is imaged.
  • the crossview camera system is arranged on the front portion of the monitor 1900.
  • Two forward-looking cameras 1906 are also provided for monitoring the environment surrounding the monitor 1900 and test-taker. These cameras 1906, which together will encompass a large field of view, can be used to monitor for the existence of notes, textbooks, or other apparatus which could aid the test-taker in answering the test questions, but which are prohibited by the rules of the test. The existence of a computer which the test-taker could use to access the Internet can be determined. Similarly, if the test-taker is typing on a keyboard, that action can be detected. In short, the forward-looking cameras 1906 can detect any forbidden activity undertaken by the test- taker. They can also determine the presence of potential accomplices trying to help the test-taker during the test taking process.
  • the forward cameras 1906 can be provided with LED or other illumination which can be in the visual or infrared (IR) portion of the electromagnetic spectrum.
  • the cameras 1906 need to be sensitive to IR if IR illumination is used.
  • Forward-looking cameras 1906 are part of a forward looking camera system arranged on the frame of the monitor 1900 and which is generally configured to image an area in front of the frame, and ideally to the outward sides of the frame when the monitor 1900 is on the test- taker’ s head.
  • the forward looking camera system may include a different number of forward looking cameras 1906, so long as the environment around the monitor 1900 is are imaged.
  • the forward looking camera system is arranged on the front portion of the monitor 1900.
  • the images obtained by the six cameras discussed above may be analyzed using trained neural networks or Deep Learning technology, for example.
  • a processor is provided on the monitor 1900, usually in the front portion or housing (e.g., including or on printed circuit board 1920 shown in FIG. 26).
  • This processor is coupled to the cross-view camera system, the iris camera system and the forward looking camera system and performs various image analysis.
  • the processor analyzes images obtained by the cross-view camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the test-taker on which the monitor 1900 is situated (and optionally imaging devices), and analyzes images obtained by the forward-looking camera system to determine presence of specific objects.
  • the processor may also be configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data.
  • the processor can use pattern recognition when analyzing images, or be otherwise trained, programmed or configured to provide the desired output of the presence of or lack of imaging devices in images. When used for testing purposes, determination of the presence of an imaging device, or person, or unauthorized testing aid or person, can result in the test being terminated.
  • the monitor 1900 is held in position on the test-taker’s head by means of forehead resting pad 1912 coupled with an elongate band 1914 which is preferably adjustable for tension by adjustment knob 1918 (FIG. 24).
  • Band 1914 is connected at one end to the front portion of the monitor 1900 and also connected at the opposite end to the front portion of the monitor 1900.
  • Other bands and length adjustment mechanisms may be used in the invention.
  • Another elongate band 1926 which holds the contact microphone 1922 and contact speaker 1924 in position against the forehead of the test-taker, also contributes to the proper positioning of the monitor on the head of the test-taker.
  • Band 1926 is part of the front portion of the monitor 1900.
  • the electronic printed circuit boards are illustrated generally at 1920 and are powered by a battery 1916 through wires which are not illustrated.
  • Printed circuit board 1920 should be considered to represent a processor or processor means or data processor used for performing the functions need for operability of the monitor 1900, including but not limited to the image analysis.
  • Monitor 1900 may include additional features, including those features of any embodiments of a monitor or glasses disclosed herein. Use of the monitor 1900 may be testing purposes in any of the ways disclosed herein.
  • FIGS. 27-30 illustrate key components of the device as covered with the chassis intrusion detector (CID) 1952. The operation the CID is discussed elsewhere and will not be repeated here. The assembly covered by the CID is shown generally at 1950.
  • CID chassis intrusion detector
  • CID 1952 there is a contact microphone 1954, contact speaker 1956, interfaces 1958 between the forward and iris cameras with a PC board 1960, cross-view cameras 1962, forward cameras 1964, and iris cameras 1966.
  • Displays 1968 are connected to the PCB board 1960 by ribbon cables 1970.
  • the CID 1952 is represented by a smooth envelope. In practice, the CID 1952 will adhere to the surfaces of the various components. In some cases, it will be necessary to add additional structure to position the CID 1952 properly relative to the various components that it is meant to protect.
  • the CID 1952 may be attached directly to the cameras 1962, 1964, 1966 and displays 1968 in such a way as to provide a smooth surface that does not distort the images being acquired or displayed by these devices.
  • the CID 1952 preferably covers just what is shown in FIGS. 27 and 30. The CID 1952 does not cover the side shield (a portion of the combiner 1902) or the band 1914.
  • the intrusion protected device may be formed by covering the front portion or housing, and its associated cameras, with the CID 1952 and then snapping it into a frame with a wire coming out from this covered device going to a battery and a receptacle on the battery for connecting to the wall power.
  • Forward monitoring cameras can be used to monitor positions and motions of the test-taker’s hands and fingers and thus can be used to record gestures.
  • the gestures can be used to control various functions of the monitor.
  • Gestures for example, can be used to control information displayed on the displays and for selecting he answers in multiple choice tests. Gestures can replace touch screen functions, for example.
  • the motions of the hands and fingers can replace a mouse or keyboard, further improving the security and versatility of the monitor.
  • a virtual mouse and/or keyboard can be provided for such uses.
  • sensors that are mounted to the monitor such as fingerprint sensors, touch sensors etc. can be added to the monitor.
  • many other sensors that are not integral to the monitor can communicate with the monitor through WiFi, Bluetooth or other wireless or wired communication protocols.
  • the monitor can be used to control off monitor devices such as room temperature, lights, garage door, door locks etc through its connection to the Internet or to another external controller.
  • Communication from the monitor to the Internet and other devices generally involves use of Wi-Fi and BluetoothTM. Communication generally can involve the sending of test questions and answers between the monitor and an Internet resident server. In some versions of the monitor, direct cellphone communication will also be available. This will become increasingly important as cellphone data transmission speeds increase. The best method of communicating with the Internet may soon be through 5G and thus Wi-Fi, although available, may be used less and less.
  • the CID provides excellent hardware security, but the possibility still exists for software malware to enter the monitor through one of the communication channels.
  • One method of guarding against such malware becoming resident on the monitor is to require that all communications other than BluetoothTM with the monitor take place through a secure Internet resident server. This server would scan all transmissions intended for the monitor to make sure that no malware is present.
  • the monitor When using the monitor, it may be desirable to use the computational resources of external devices such as smart phones and PC computers. This can be accomplished using various input methods to send data and commands to the external device. These methods include using a physical or virtual mouse and or keyboard or orally.
  • alternative data input devices may be utilized with the monitor providing the proper software and hardware is provided.
  • One such device is a clicker which can be used to answer multiple choice questions.
  • Another is a ring that has many of the functions of a mouse but resides on the finger of the test-taker. Such a ring, in some cases, can have a camera which can be useful for taking a picture of the test-taker to help in verifying his or her identity.
  • the monitor can also be used to control external devices such as radio or TV stations, lights, door locks, etc as already mentioned.
  • the lens through which the user views the surrounding environment can incorporate a Kerr or Pockels cell or an electrochromic film which turns dark, for example, when the test is underway.
  • the same apparatus can be used to control the relative brightness of the room or ambient light relative to the display to enhance the display contrast.
  • An IMU can be added where the knowledge of the kinematic or rotational motion of the head of the test-taker is desirable. Such a device can be used, for example, to register head motions for the control of various functions depending on the programs present and running on the monitor CPU.
  • a GPS can be added where it is desirable to know the location of the monitor.
  • the GPS and IMU can work with the various cameras to map the environment where the monitor is in use which can permit the placement of augmented devices as in augmented reality. Additionally, the display can be pinned to the environment allowing, for example, the use of multiple screen images where the user can move from screen to screen merely by moving his or her head as if the room where the test-taker is situated had multiple TV screens.
  • a magnetometer can Additionally be added to help orient the monitor.
  • a preferred mapping system can use the techniques disclosed in US 20190271550 for road mapping.
  • the monitor has one or more cameras and the head of the test-taker is frequently moving allowing, in conjunction with the IMU, GPS and other related apparatus, the accurately mapping of the environment using stereographic techniques as disclosed in the ‘793 publication.
  • a magnetic compass or magnetometer can also be included in the monitor to aid in the orientation or mapping process.
  • the test-taker can use a laser pointer to allow selection of a point in the surrounding environment. This can be used in conjunction with augmented reality to locate a particular point where the augmented reality device should appear. This laser pointer can be augmented with lidar capabilities to allow, on a limited basis, the determination of the distance to the object that is being selected. See, for example, US Pat. No. 10,152,141.
  • structured light can also be used to map the geometry in the surrounding area relative to the monitor.
  • patterned light beams can be sent from, for example, different sides of the monitor and the interference or relative position of these structured patterns can determine the distance from the monitor. See, for example, US Pat. No. 7,182,465.
  • a 360-degree camera can be mounted onto the top of the monitor through using a separate strap which provides the capability of monitoring and photographing the entire space surrounding the test- taker. Alternately, cameras can be mounted to the sides and rear of the monitor to get a 360-degree view of the environment surrounding the test-taker.
  • the iris camera can be used to sense the blink of an eye which can additionally be used to control the display or other features or capabilities of the monitor.
  • motions of the hands and fingers can be used as gestures to control monitor displays or other functions as discussed above.
  • a virtual keyboard can be displayed in the field of view of the test-taker as can be his hands relative to the keyboard. By watching the test-taker typing the characters that are intended to be depressed, this can be recorded and converted to characters on the display.
  • a physical keyboard can be used; however, this poses some unique problems.
  • the keyboard must not have the capability of transmitting data to any place other than the monitor. If it can do so, then the keyboard can be used to type questions to a consultant.
  • a keyboard can be designed with a hidden switch which sends a wireless signal to the consultant which is not registered by the monitor.
  • the monitor determines that the test-taker is typing but it is not receiving the result of that typing, then the test can be terminated.
  • the keyboard can be covered with a CID and can communicate to the monitor using encryption.
  • a virtual keyboard may be picked up by an infrastructure mounted camera, although this would be difficult and easily defeated by moving the keyboard slightly.
  • Additional sensors can be mounted on the monitor to monitor the health state of the test-taker, for example, a heart rate monitor, a temperature sensor and an EEC are three possibilities.
  • Some versions of the monitor have an EKG (ECG) sensor which can be used for biometric identification as well as health monitoring as discussed above.
  • EKG EKG
  • An ambient light sensor can be added to aid in the control of the various cameras.
  • a capacitance sensor or microscope lens can also be added to determine contact with the skin by the contact microphone.
  • a blood flow sensor can also be used for that purpose as well as a skin temperature sensor.
  • a picture of the face skin can be used to measure the distance to the skin by having a very small depth of field or by using structured light or just a laser shined at an oblique angle.
  • An endfire microphone array can also be used in order to determine the direction of incoming sound. This can augment the contact microphone for determining when the test- taker is speaking or otherwise creating sounds. Other combinations of multiple microphones can be used to localize source of speech.
  • An earbud for example, can include additional sensors such as a microphone or array of microphones. In some embodiments, at least two microphones from a microphone array can be arranged along a line pointed towards or at least near the mouth of a user. By using information received by the orientation sensor or sensors, a controller within the earbud, or other device, can determine which microphones of a microphone array should be activated to obtain this configuration. By activating only those microphones arranged along a vector pointed at or near the mouth, ambient audio signals not originating near the mouth can be ignored by applying a spatial filtering process.
  • Ultrasonic, IR, RF, and similar sensors can be added if the need arises.
  • Tactile or touch sensors can be added to allow for finger control of the monitor. Such sensors are used on Google Glass for example.
  • Systems are under development to allow direct communication from a person’s brain to a device separate from the body.
  • the concept is to allow for direct brain to Internet communication.
  • Such a system could be used to defeat the cheating prevention systems described herein and therefore a device can be added to the monitor to sense for such communications when that technology becomes available.
  • Various hand mounted sensors including a camera, RF transmitter, and LED, can also be used to control monitor functions.
  • An advantage in locking the display view to a physical location is that the view can be changed by the test-taker simply moving his or her head.
  • multiple screens can be available containing multiple websites or TV stations and the test-taker can switch between them merely by head movements.
  • each screen can be equivalent to a large screen TV. Sound that accompanies each screen can be controlled since the monitor will know which screen is being observed by the test-taker.
  • MOOCs or other educational classes can be watched by students. After taking a MOOC course, for example, the student can immediately take a secure test for credit.
  • Various software modules that can be resident in the Monitor include: a. Iris capture b. Eyeball location c. EKG capture and biometric recognition d. Finger and hand recognition and monitoring e. Voice recognition biometric f. Sounds emanating from the test-taker’s mouth g. Nefarious object presence recognition in iris or cross view camera images. h. Cryptographic key set determination from an iris code. i. CID broken wire detection j. School registration software
  • Various software modules that can be resident on the server which interacts with the monitor include: a. Communication with universities or other test suppliers b. Test reception, scrambling and encryption c. Iris recognition d. Communication with monitors

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

Secure testing device includes a frame positionable on a person's head, a display section, and a combiner arranged at least partly in front of the eyes of the person and which allows simultaneous viewing of an environment in front of the person and content on the display section, e.g., test questions. A crossview camera system images from locations on each lateral side of the frame toward the opposite lateral side and below the combiner. An iris camera system images the eyes of the person. A forward-looking camera system images an area in front of the frame. A processor analyzes images obtained by the crossview camera system to determine presence of imaging devices, images obtained by the iris camera system to determine position of irises of the person and optionally imaging devices, and images obtained by the forward-looking camera system to determine presence of specific objects.

Description

SECURE TESTING DEVICE WITH OPTICAL ELEMENT
TECHNICAL FIELD
The present invention relates generally to the field of a computer-based system and method for taking a test while ensuring that the test-taker is not receiving assistance from another person or otherwise cheating while taking the test, and that a device used for displaying or taking the test has not been breached and is not being breached or otherwise compromised.
BACKGROUND ART
There are many ways that a consultant can obtain a copy of questions on an exam and transmit the answers to the test taker that are not and cannot be detected by proctoring services. Such ways are discuss in US 10410535.
As generally used herein, a "test" is any type of question-based application that requires consideration or analysis by a person taking the test and a potential response from this person. A test may therefore be considered an examination, a quiz, an assessment, an evaluation, a trial and/or an analysis. The test may be used to certify an individual as qualified to perform a specific task or ability, e.g., a driving test. A test-taker is a person taking such a test. A test-taker does not necessarily have to be a student of a course, i.e., someone subjected to education on a regular basis.
SUMMARY OF THE INVENTION
The present invention is directed at addressing and ideally solving the problem of guaranteeing with high certainty that a test-taker taking a test is acting alone without the aid of a consultant or other helper or otherwise cheating.
A device that can achieve this object includes a frame configured to be situated on a person’s head, a display section on the frame having a first portion and a second portion, and a combiner arranged on the frame in a position at least partly in front of right and left eyes of the person when the frame is on the person’s head. The combiner, an optic or optical element, allows simultaneous viewing by the person of an environment in front of the person and content on the display section. Thus, the combiner reflects content of the first portion of the display section to the person’ s left eye when the frame is on the person’s head and reflecting content of the second portion of the display section to the person’s right eye when the frame is on the person’s head. A crossview camera system on the frame a images from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and images from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner. An iris camera system arranged on the frame images the left eye of the person on which the frame is situated, and image the right eye of the person on which the frame is situated. A forward-looking camera system arranged on the frame images an area in front of the frame. A processor is coupled to the crossview camera system, iris camera system and forward-looking camera system and analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and analyzes images obtained by the forward-looking camera system to determine presence of specific objects.
The crossview camera system may include a first crossview camera on the first lateral side of the frame and arranged to image inward of the first lateral side of the frame and below the combiner, and a second crossview camera on the second lateral side of the frame and arranged to image inward of the second lateral side of the frame and below the combiner. The iris camera system may include a first iris camera arranged on the frame to image the left eye of the person on which the frame is situated, and a second iris camera arranged on the frame to image the right eye of the person on which the frame is situated. Hereinafter, the term iris camera will mean any imaging device which images the iris, a portion of the face around and including the iris, retina, a portion of the face around and including the retina, or face portion optionally including the iris and/or retina. The first and second portions of the display section may be positioned horizontally alongside one another
The combiner optionally includes a semi-reflective coating on an inside surface in an optical path between the first and second portions of the display section and the person’s eyes when the frame is on the person’s head. The combiner is positioned in front of the person’s eyes when the frame is on the person’s head to allow view of ambient environment in front of the person when the frame is on the person’s head. Also, the combiner could include an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment.
The processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data. Similarly, the processor may be trained, programmed or otherwise configured to analyze images obtained by the iris camera system to determine presence of imaging devices in any obtained images. To this end, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine position of irises of the person on which the frame is situated, and/or when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
A forehead resting pad may be arranged at a front of the frame in a position to contact a forehead of the person when the frame is on the person’s head. The frame may be considered to include a front portion including the display section, combiner, crossview camera system, iris camera system, forward-looking camera system, and processor, and a first elongate band having first and second opposite ends and being coupled at the first and second ends to the front portion. The frame includes a second elongate band adjacent the front portion and which is in contact with the person’s skin when the frame is on the person’ s head, the second band including a contact microphone and a contact speaker. A chassis intrusion detector system may be arranged over the front portion of any embodiment.
Another embodiment of a device includes a housing comprising a display section including at least one display for displaying content, an optical element coupled to the housing and arranged in an optical path of the at least one display section and that reflects at least a portion of content when displayed on the at least one display and allows viewing therethrough, a crossview camera system coupled to the housing and that images from locations on each lateral side of the housing toward an opposite lateral side of the housing portion and below the optical element, an iris camera system coupled to the housing and that images an area rearward of the housing from locations on the housing rearward, and a forward-looking camera system coupled to the housing and that images an area in front of the housing from locations on the housing. A processor is arranged in the housing and coupled to the crossview camera system, the iris camera system and the forward-looking camera system. The processor analyzes images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, images obtained by the iris camera system to determine presence and position of irises, and images obtained by the forward-looking camera system to determine presence of specific objects. A first elongate band has first and second opposite ends and is coupled at the first and second ends to the housing. The first band extends rearward from the housing to form an enclosure in which a person’ s head is positionable.
The crossview camera system may include a first crossview camera on the first lateral side of the housing and arranged to image inward of the first lateral side of the housing and below the combiner, and a second crossview camera on the second lateral side of the housing and arranged to image inward of the second lateral side of the housing and below the combiner. The combiner may include a semi-reflective coating on an inside surface in the optical path of the at least one display section, and an antireflective coating on an outside surface to allow maximum light to pass through the combiner from the environment. The at least one display section may include two display sections positioned horizontally alongside one another.
The processor optionally, but preferably, analyzes images obtained by the iris camera system to determine presence of imaging devices in any obtained images. Also, the processor could use pattern recognition when analyzing images obtained by the crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by the iris camera system to determine presence and position of irises, and when analyzing images obtained by the forward-looking camera system to determine presence of specific objects.
The device could include a forehead resting pad arranged at a front of the housing, a second elongate band adjacent the housing and including a contact microphone and a contact speaker, and a chassis intrusion detector system arranged over the housing.
Additional devices which can be part of the electronics assembly and which are designed to operate through the security film include:
1. A camera for obtaining iris, retinal or partial facial scans.
2. A microphone for monitoring sound in the vicinity of the test- taker or emitted by the test- taker.
3. A sound maker used for testing the microphone sensitivity. 4. A camera for monitoring the area between the display and the test-taker’s eyes.
5. A contact microphone for detecting sound emanating from the mouth of the test-taker, primarily talking, i.e., words.
6. A contact speaker for testing that the contact microphone is in contact with the test-taker’s skin.
7. A device mounted in connection with the contact microphone for detecting the presence of the test-taker’s skin. Such a device can comprise a blood flow sensor comprising a LED and light sensor positioned so that the reflection of the LED is in the field of view of the light sensor only when the device is in close proximity to the skin. Skin presence sensors can also comprise a temperature sensor, camera, capacitance sensor or any other device capable of determining the presence of the test taker’s skin.
8. Two or more ECG (EKG) pads for detecting and recording the electrocardiogram of the test-taker.
DESCRIPTION OF DRAWINGS
The following drawings are illustrative of embodiments of the system developed or adapted using the teachings of at least one of the embodiments disclosed herein and are not meant to limit the scope of the disclosure as encompassed by the claims.
FIGS. 1-4 illustrate a preferred version of the monitor.
FIG. 5 illustrates a method of attaching a USB connector for supplying power to the monitor through the CID.
FIGS. 6 and 7 illustrate use of a contact speaker with a contact microphone to verify that the contact speaker contacts the test-taker’s face and further, use of an EKG biometric for additional verification of proper placement of the contact microphone and to obtain an additional biometric.
FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device is attached to a central computer through a USB port.
FIG. 9 is a view like FIG. 8 with a wireless connection through a wireless transmitter box associated with each desk and where the test-takers are using paper to record their test answers.
FIG. 10 is a perspective view of a head worn glasses type device containing an electronics assembly with several sensors, cameras and a display all protected with a chassis intrusion detector prepared using the teachings of this disclosure.
FIG. 11 is a perspective view of the apparatus of FIG. 10 seen from the rear.
FIGS. 12-17 illustrate a preferred design of the monitor for two eyes utilizing a single display.
FIGS. 18-26 illustrate a preferred design of the monitor for two eyes utilizing two large displays.
FIGS. 27-30 illustrate the device of FIGS. 18-26 with the chassis intrusion detector installed.
BEST MODE FOR CARRYING OUT INVENTION 1. Administration and System Operation Various concepts of the invention are similar to those in US 10410535, and this invention is an improvement to those disclosed in US 10410535.
2. Initial Designs
In FIGS. 1-10, a simple direct projection display has been illustrated where the display is in the form of a projector directing the image directly into the eye. Alternative reflection displays have also been disclosed. The direct projection display has the disadvantage of blocking a view of the surrounding environment when the image is not being viewed. Similarly, this design is usually limited to implementation for a single eye.
Other options include reflective displays where the projector sends the image directly toward a lens or combiner in front of the eye, and waveguide displays, where the maximum freedom is provided for the location of the display device relative to the eyes.
Both the reflection and waveguide displays require a display element that displays the image for further processing by the optical system. Preferred technologies include Liquid Crystal on Silicon (LCoS) and Active Matrix Organic Light Emitting Diodes (AMOLED) or simply LCD displays.
The reflector design disclosed in US 20170061212, FIGS. 2A and 2B, can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of another reflector display. Another prior art reflector design is disclosed in US 20170336634.
The waveguide display design of US 10,180,572, FIG. 1, can be modified to incorporate the CID, iris, forward and crossview cameras, contact microphone and speakers, EKG sensor and other features disclosed herein. It is included here as an example of the use of a waveguide display.
FIG. 1 is a front view of a version of the monitor which has many of the features of other monitors disclosed herein and the same or similar functionality. In this embodiment, shown generally at 1000, electronics are contained in a housing 1002 and a display is shown at 1004. Knobs 1003 and 1005 are used to clamp the housing of the electronics and display assembly at a desired orientation and to permit rotation about lateral and vertical axes. Knobs 1003, 1005 can be configured such that rotation of each knob 1003, 1005 causes a change in the distance between the housing 1002 and the frame. This allows the test-taker to adjust the display 1004 to properly align the display with the test-taker’s eye. The housing 1002 and the display 1004 are therefore adjustable in position relative to the eyeglasses frame. Any adjustment mechanism to provide for this variable position may be used, with the knobs 1003, 1005 being only an exemplifying embodiment. This design is somewhat larger than previous designs as essentially all the required electronics are contained in the housing.
FIG. 2 is a view of the monitor 1000 from the rear showing a glasses frame 1006 and adjustable clamping mechanism 1007 for attaching the housing containing the electronics to a temple of the glasses frame 1006. Clamping mechanism 1007 includes the two knobs 1003, 1005 that provide for the adjustment of housing portion relative to the glasses frame 1006. Clamping mechanism 1007 is clamped to the glasses frame by tightening screw 1011 which allows the entire assembly to be positioned relative to the glasses frame 1006.
Power is supplied to the monitor 1000, e.g., through wire 1010. A contact microphone 1012 is provided and presses against the skin of the test-taker by means of spring 1013 connected to housing 1002. Spring 1013 extends from the housing 1002 inward, i.e., toward the opposite temple. The contact microphone 1012 is arranged proximate or at an inward end of the spring 1013 and is biased to be further outward from the temple so that when the monitor 1000 is worn, the spring 1013 may be compressed and thus exerts a force against the skin of the wearer thereby maintaining contact between the contact microphone 1012 and the skin of the wearer or test-taker. A sound generator, such as a contact speaker 1014, is provided on the other temple of the glasses frame 1006. Microphone 1012 and speaker 1014 are in electronic communications with the processor in housing 1002 to operate as disclosed above. The contact speaker, also called a bone speaker, emits an audible sound as well as a vibration to the skin and/or bone of the test taker. This audible sound can be used to test the audio microphone replacing the sound creator.
The test-taker is generally forbidden from talking during the test, to prevent the test-taker from orally supplying test questions to an accomplice. The microphone could be used for monitoring the test taker’s talking, however, other sounds in the environment would also be recorded by such a microphone and it may be difficult to differentiate the communication by the test-taker from sounds that might be in the environment. A contact microphone will only detect sound vibrations coming through the skin of the test-taker and ignore all other sounds. Therefore, it is a preferred method of determining whether the test-taker is talking. For this system to work, the contact microphone 1012 must be in contact with the skin of the test-taker. Various techniques can be used to determine that this contact is taking place such as an optical sensor that looks for the skin of the test-taker, a capacitive sensor that determines the capacitance of the skin, a temperature sensor that measures the skin temperature among others. Each of these methods can potentially be defeated through such techniques as placing a sound-blocking material between the contact microphone and the skin such that the material does not interfere with the optical, capacitance or temperature sensors.
To address this issue, the contact speaker 1014 can be placed on the opposite side of the test- taker’s head. Contact speaker 1014 can be programmed to periodically transmit a sound through the head of the test-taker to the contact microphone 1012 and to the audio microphone 24. If both contact devices are in contact with the skin of the test-taker, the transmission will be detected by the contact microphone 1014 thereby confirming that the monitor 1000 is properly in place.
The bone or contact microphone should be activated with voice recognition whenever it hears anything. The audio microphone should be activated whenever there is a transmission from the audio speaker and when it hears talking. If the test-taker finds a way to defeat the contact microphone and talks, the audio microphone should pick it up. If the environment is too noisy then the test can be paused until the noise quiets down. The test-taker should not be taking a test in an environment where there is excessive talking.
Prior to the start of a test, the test-taker can be asked to state his name and both microphones should be able to record this. If there is any doubt about the activation of the bone microphone, or at other random times, the test can ask the test-taker to restate his name or some other announcement. Both microphones should register the response without an unreasonable delay. In a later version it may be desirable to have more than one microphone in the headset so that the location of the sound source can be triangulated. Some triangulation can occur even with the two microphones described here.
FIG. 3 illustrates use of chassis intrusion detector, CID, 1016, like CID 22 described above or any other CID disclosed herein, with this design. FIG. 4 additionally shows electronics 1018 from an inside view that is covered by CID 1016. Display 1022 is similarly covered by the CID 1016.
FIG. 5 illustrates an exemplifying method of attaching a USB connector for supplying power to a monitor through a CID 1056 or CID 22 or any other CID disclosed herein. CID 1056 is shown covering a portion of a PC board 1054. A USB connector 1050 is attached to housing 1052. USB connector pins 1058 pass through small holes 1060 provided in the CID 1056. These holes 1060 are sufficiently small that it would be very difficult for anyone to defeat the CID 1056 through these holes 1060. The illustrated monitor may be any of the monitors disclosed herein.
FIG. 6 is a view like FIG. 2 showing the contact speaker 1014 and contact microphone 1012. Contact speaker 1014 has been moved forward on the temple of the glasses frame 1006 in order to accommodate bearded test-takers. A movable connection of the contact speaker 1014 to the temple is provided. The connection from the speaker 1014 to the electronics is through wire 1009 that may pass through an interior space in the temple and lens portion. Wire 1010 goes from the USB connector described in FIG. 5 to a source of power such as a wall outlet.
FIG. 7 illustrates the addition of an EKG sensor in the form of a thin film 1110 which is placed on top of the contact microphone 1012 (to form a microphone assembly) and the contact speaker 1014 (to form a speaker assembly). In FIG. 7, both the contact microphone 1012 and contact speaker 1014, with EKG sensors, are moved forward on the temples of the glasses frame 1006 so that they contact skin of bearded people. Note that the contact microphone 1014 is covered with the CID whereas the contact speaker 1012 is not. Both devices could be covered with CIDs but it may not be necessary to cover the contact speaker.
The EKG sensors, also known as electrocardiogram sensors or ECG sensors, allow for the measurement of the heartbeat shape and serves as a further verification that the contact speaker and microphone are in contact with the skin. An EKG also provides an alternate biometric verification of the identity of the test-taker. Since the signal levels for EKG measurements are very low, the sensor pads cannot be covered by the CID. This issue can be resolved by allowing two conductors to be placed through the CID allowing the EKG pads to be glued to the outside of the CID. The remainder of the contact microphone can be placed inside the CID cover. In addition to multiple choice tests, any of the disclosed monitors may be used for tests that require written answers. For such tests, the monitor is equipped with a high definition display permitting multiple lines of text to be displayed. The monitor should also be capable of displaying a virtual keyboard preventing the test-taker from typing on a desk or table, which will be observed by the forward-facing camera. Such a virtual keyboard is described in US 10180572. When provided with a question requiring a text response, the test-taker will use the virtual keyboard on the display to type the answer which will then appear on the display. In this manner, a response by the test-taker cannot be observed by an associate looking over his shoulder while the test is being taken.
In some cases, a written response to a test will be required especially when a mathematical derivation or the hand writing of mathematical expressions is required. In such a case, the test-taker can be provided with a tablet onto which his hand-written response will be entered. The tablet will not show the test-taker’s handwriting but will be linked to the monitor in such a manner that only the monitor receives the hand-written response. This response will be displayed on to the display for review and correction by the test taker.
Instead of using a Kerr or Pockels cell to black out a forward part of the display to prevent observance of the display through the glasses by an accomplice, electrochromic glass or film on plastic can be used for this function, as described in US 10180572. In this case, the electrochromic glass will be turned totally black or opaque by a control mechanism so that the contents of the display cannot be seen from a person standing in front of the test-taker. Another approach is to use polarized lenses for the glasses and display where the angle of polarization is rotated 90 degrees. The glasses can be vertically polarized and the display horizontally polarized. In this case, light from the display will not pass through the glasses preventing it from being observed by anyone standing in front of the test-taker.
Using the EKG system disclosed herein, an equipped monitor obtains a second biometric system for identifying the test-taker and for verifying that the test-taker is in fact wearing the monitor. Thus, in addition to the iris biometric, obtained by the iris camera, the EKG pads on opposite sides of the test-taker’s head will record the shape of the heartbeat of the test-taker which is unique to that test- taker and thus is a biometric identifier of the test-taker.
In addition to using the mouse, the test-taker can use his voice to enter commands to the monitor. Although this could be used as an alternative to the mouse described above for answering test questions, it can also be used for other commands such as initiating the test or controlling the display of the test questions for example. The test-taker can say “next question”, “I need a break”, “test finished” etc. The contact microphone will pick up the words spoken by the test-taker and thus can perform the various commands. Voice entry can also be used for answering essay type questions where it is obvious that the test-taker is not using his voice to request help from an accomplice. In a version of the monitor, tiny microphones can be provided which are inserted into the ears of the test-taker in order to hear if the test-taker is using a speaker inserted into his ear. Such a speaker would be like a hearing aid. Such microphones can be tiny devices measuring no more than a cubic millimeter. They can be inserted into the test-taker’s ear when the test-taker is wearing the monitor. Such microphones will also pick up the voice of the test-taker and therefore on command of the monitor that test-taker can say something to test that the in-ear microphones are properly installed. Talking can also be used to test operation of the contact microphone, although, as described above, other tests based on the contact speaker and the EKG devices are provided for this function.
Scrambling of the order of the test questions is described above. Additionally, multiple-choice answers to the test questions can be similarly scrambled.
Other methods can be used with the monitor to permit the test-taker to enter commands to the monitor. One such method using the iris camera is track the eye motion which is usable to select answers to the questions or control operation of the monitor. Eye blinking and time/duration of closing also can be used for this purpose. Another such method is to use gestures which can be seen by the forward-facing camera and interpreted by appropriate software. Teeth clicking can even be used for controlling the test and in particular for choosing answers to multiple choice test questions.
The lenses of the glasses can be made easily replaceable permitting different prescription lenses to be used for different test-takers.
The devices disclosed herein are not required to be used for testing purposes and may be used for other purposes, e.g., gaming, entertainment.
3. Classroom Testing
FIG. 8 illustrates the use of the apparatus in accordance with the invention by a room full of test-takers where each device can be attached to a central computer 1306 through a USB port, for example. In this case, each test-taker 1302 is provided with a keyboard and/or a mouse or other input device, and a display 1304. Each device can be connected to a central computer 1306. Otherwise, the operation of the Test Glasses is as described herein. Each test-taker is presented a different version of the scrambled test and uses the keyboard and/or mouse to answer the test questions. The central computer knows which test version is being answered by each test-taker so that the information can be used for grading the test. Since each test-taker is provided a different scrambled version of the test, the answer provided by one test-taker cannot help another provided talking is not permitted.
FIG. 9 is a view similar to FIG. 8 where the answers are placed on a piece of paper which will be collected by the test proctor at the conclusion of the test. Again, since each test-taker will be taking the same test with the questions randomly reordered, there is little advantage in a test-taker surreptitiously communicating an answer to another test-taker. Thus, by virtue of the arrangements depicted in FIGS. 8 and 9, the Test Glasses can be used either remotely or in a classroom environment.
According to another simplified version of the monitor, a device constructed in accordance with the teachings of this invention is illustrated in FIG. 10 which is a perspective view of a head worn glasses type device, the Test Glasses or Monitor, containing an electronics assembly with several sensors, cameras and a display, all protected with a chassis intrusion detector as described elsewhere herein, prepared using the teachings herein. A head worn display and electronics device constructed in accordance with the invention is shown generally at 1410 in FIGS. 10 and 11.
A housing 1420 extends from a frame 1422. Housing 1420 is substantially L-shaped with a first portion extending straight outward from an edge of the frame 1422 and second portion perpendicular to the first portion and positioned in front of the frame 1422.
A display 1412 is arranged on or in the housing 1420 and pointed toward the right eye of test- taker displays the test questions (although alternatively, a display can be pointed toward the left eye of the test-taker). A forward viewing camera 1414, representative of an imaging device, is also arranged on or in the housing 1420 and monitors the field of view of the test-taker outward from the device 1410. The camera 1414 can have a field of view of approximately 120°. A microphone 1416 is also arranged on or in housing 1420 and monitors talking (sounds) which can take place while the test is in progress. A sound maker or speaker 1418 is arranged on or in the housing 1420 and periodically provides a sound detectable by the microphone 1416 to verify that the microphone 1416 has not somehow been rendered inoperable. The speaker 1418 may be placed further away from the microphone 1416 and insulated from the housing 1420 so that the microphone 1416 does not receive the sound from the speaker 1418 through the housing 1420 instead of the air surrounding the device 1410.
The display 1412 is arranged at a terminal end of the second housing portion. The forward viewing camera 1414, or more generally an imaging device, the microphone 1416 and the speaker 1418 are also arranged on the second housing portion (FIG. 10).
Each of these components 1412, 1414, 1416, 1418 is connected to a processor-containing electronics package in housing 1420 which is mounted to the glasses frame 1422 in a manner known to those skilled in the art to which this invention pertains. A cable emanates from the electronics package in housing 1420 and can contain a USB connector 1424 for connecting onto an external device such as a computer, battery pack or wall power supply.
Iris or retinal scan camera 1426 is arranged on housing 1420, pointing inward toward the wearer, and measures biometrics of the test-taker. Such biometrics can include an iris or retinal scan or a scan of the portion of the face surrounding the eye. Illumination of the eye can be provided by LEDs 1428 arranged on housing 1420 which can be in the IR or visible portions of the electromagnetic spectrum. If white LEDs are used, provision can be made to limit the intensity or the time that they are turned on so as not to annoy the test taker. Two or more different levels of visible illumination can be provided to cause the iris to be seen at different openings to check for an artificial iris painted onto a contact lens. Iris scan camera 1426 and LEDs 1428 are arranged on the second housing portion.
A camera 1430 can also be provided on or in housing 1420 to check for any anomalous activity which might take place in the vicinity of the device 1410 (FIG. 11). Such a camera 1430 can enable detection of whether an image capture device has been either temporarily or permanently affixed to the device 1410 or to the face of the test-taker which can capture the image on the display 1412. Similarly, camera 1430 can monitor the space surrounding the left eye of the test-taker to assure that such an image capturing device and or another display for providing aid to the test-taker is not being employed by the test-taker in conjunction with his left eye. The camera 1430, or more generally an imaging device, is arranged on the first housing portion and oriented to image most of the frame 1412 (FIG. 11).
Software and a processor which controls administration of tests can be resident on an external computer, in the electronics package in housing 1420, or in another device which attaches to the device 10 through connector 1424. A test-taker will have access to a keyboard and/or a mouse for interacting with this computer. Using a keyboard, the test-taker can initiate the test taking process through communication with the test provider. When the test is ready for execution by the test-taker, and encrypted version of the test is transmitted to the computer and relayed to the device 1410. The electronics package in housing 1420, e.g., including a processor, utilizes a private decryption key to decrypt the test questions and cause them to be displayed on display 1412. The test-taker then enters the answers to the questions using the keyboard and the computer display.
3. Smartglasses
An alternate monitor design 1800 which provides an image to both eyes using a single microdisplay is illustrated in FIGS. 12-17. The components, which must be protected by the CID, are more closely arranged to simplify the CID design. A single (micro)display 1828 is used to illuminate lenses 1830 seen by each eye. Two iris cameras 1802, two crossview cameras 1806, and two forward cameras 1818 can be implemented in this design. Since the display 1828 will be seen by both eyes, both must be monitored to guarantee that the device has not been rotated or in some manner pulled away from either eye to permit a foreign camera to be inserted. The crossview cameras 1806 similarly must now watch both sides of the test-taker’s head to search for nefarious cameras inserted by the test-taker. Sensor assemblies 1810 and 1812 are provided on each side of the forehead (FIG. 17). These sensor assemblies 1810, 1812 measure the EKG and sound emitted by the test-taker’s head. Sensor assembly 1810, for example, can contain a contact speaker and contact microphone, one in each sensor. Similarly, sensor assembly 1812 can contain an ECG (EKG) sensor. The contact microphone will determine when the test-taker is emitting sounds and the contact speaker will be used to test that the contact microphone is in contact with the test-taker’s skin, as described in the other monitor examples. The contact speaker can also emit an audio sound and thus can be used to test the audio speaker, if present. Since the EKG sensor pads must be sensitive to very low voltages, they generally will be placed on the outside of the CID. A small pair of contacts can be placed in the CID to permit signals to be passed from the EKG sensors to the interior electronics. The EKG sensor pads can be appropriately attached to the CID by gluing in such a manner that any attempt to remove the EKG pads will destroy the CID. Two forward or front view cameras 1818 are provided in order to increase the field of view of the sensor system and to permit future 3D images to be created when augmented reality is implemented into this design. The optical system can be arranged such that alternately polarized frames can be fed to the right and left eyes of the test-taker, wherein the single display panel can pass the information to the eyes to permit 3D holographic viewing by selectively polarizing successive frames or even in the same frame. Monitor 1800 in this example contains a headband 1808 with an adjustment knob 1816 to permit the apparatus to the securely mounted to the test-taker’s head (FIG. 13). A battery 1814 can also be integrated with the device and placed at the rear of the device to balance the forces from the monitor 1800 on the head of the test-taker. In this manner, the center of gravity of the monitor 1800 can be adjusted to be placed near the center of the test-taker’s head. Under these circumstances, there should be little tendency for the monitor 1800 to slip forward or backward. The battery 1814 now can be considerably larger than in previous designs and designed to provide many hours of operation without an external power source. A wire can lead from the battery 1814 to a wall charger or, alternately, a receptacle can be provided in the battery case for that purpose.
The display panel 1828 projects downward through lenses 1854 to a polarizing beamsplitter and mirror assembly 1856 which sends alternately polarized light to the left and to the right. Thus, the display image is split into two images alternately polarized. Birdbath mirrors 1820 then project the light down toward the lenses, or combiners, 1804 which contain reflecting surfaces and reflect the light into the eyes. Each lens 1854 can be differently polarized so that the light which is polarized horizontally for the right eye, for example, interacts with a vertically polarized film on the right lens. This has the effect of making the right lens act as a mirror preventing the image from being seen from in front of the monitor 1800. Similarly, the polarized image for the left eye which can be polarized vertically, for example, would interact with a horizontally polarized film for the left eye. Rather than polarizing vertically and horizontally, naturally polarized light from the environment will have less effect if the polarization angles are +45 degrees and -45 degrees.
In an alternate arrangement, light from the projectors will project to the rear of the device to locations on either side of the head where a mirror, such as a birdbath mirror would change the direction of the image and project it toward the polarized lenses for viewing by the test-taker. This method simplifies the design of the lenses eliminating the need for reflective surfaces to change the angle of the light to be integrated into the lenses.
Several adjustments will now be described. An adjustment of the projector angles, or the mirrors that reflect the image to the lenses, can be used to accurately aim the reflections into the test- taker’s eyes thereby accommodating variance in the inter-pupil distance for different people. The lenses can be a compound lens arrangement whereby the outer lens corrects for prescription lens as needed for people with different requirements. The inner lens can be the one from which the reflections to the eyes are made. These two sets of lenses can be designed so that the outer lenses are interchangeable depending on the visual needs of the test-taker. The inner lens can be incorporated within the CID eliminating the possibility of a test-taker placing a camera that could see the inner lens and thus the display. The focus of the display can be changed by moving various optical components. Under this arrangement, the field of view can be controlled so that it can only be seen by the test-taker’s eyes.
In this monitor design, provision can be made for augmented reality devices such as a virtual smartphone, mouse or keyboard for use by the test-taker. These can require that the fingers of the test- taker be recognized and mapped in such a way that the motion of the fingers can be accurately tracked and understood. The virtual keyboard can be attached to a location near the test-taker’s fingers or to a table that is either virtual or appears in the environment.
The arrangement in this design also lends itself for holographic presentations.
FIGS. 18-26 illustrate another preferred design of the monitor 1900 for two eyes, in this case utilizing two larger displays 1908 forming a display section in a housing of the monitor 1900. Two displays 1908 are positioned approximately horizontally in the monitor 1900 alongside one another as shown in FIG. 23. Images from the displays 1908 reflect off a combiner 1902. Combiner 1902 preferably has a semi-reflective coating on the inside surface, i.e., that surface in the optical path between the display 1908 and the eyes of the test-taker, which reflects only a percentage, for example 50%, of the incident light from the displays 1908 toward the test-taker’s eyes (the test-taker being the person on whose head the monitor 1900 is supported) when the monitor 1900 is placed or otherwise situated on the test-taker’ s head. The balance of the light is passed vertically downward.
The combiner 1902 allows the test-taker to simultaneously view the environment, since the combiner 1902 is positioned on the frame or housing of the monitor 1900 to be in front of the test- taker’s eyes when the monitor 1900 is on the test-taker’s head, as well as reflection of content from the displays 1908. The combiner 1902 therefore does not block out all of the light from the environment in front of the test-taker, in contrast to some virtual reality goggles that entirely cover the eyes of the wearer and prevent the wearer from seeing outside of the device. Also, the combiner 1902 does not have to contact or conform to the shape of the wearer’ s face at the bottom edge and so there is often a gap between the bottom edge of the combiner 1902 and the person’s face.
The combiner 1902 preferably has an antireflective coating on the outside surface to potentially allow the maximum light to pass through the combiner 1902 from the environment. The combiner 1902 can also have a privacy film which prevents light from being seen from outside except in a direction approximately perpendicular to the surface of the combiner 1902. Such a film thus blocks the light which normally passes through the combiner 1902 in the vertical direction and could thus otherwise be seen from below. The combiner 1902 represents a singular combiner or multiple combiners that cooperate to provide the functionality described above. An upper edge region of the combiner 1902 is attached to the frame or housing of the monitor 1900 so that the combiner 1902 is below the frame. Also, the combiner 1902 and frame or housing are components of a front portion of the monitor 1900. The edges of the front portion are not configured to conform to the face of a wearer. In addition to a front portion designed to be at least partly in front of the eyes of the test- taker when the monitor 1900 is on the test-taker’s head, the combiner 1902 may also be provided with side sections, one on each side of the front section. As such, the person can see in front of them or to the sides only through the combiner 1902 and its associated structure.
Displays 1908 can also have privacy films attached to their surfaces to accurately direct the light in a direction perpendicular to the display surface making it difficult to see the display 1908 from below. Privacy films work best in preventing light transmission in horizontal or vertical directions and therefore two such films may be required for the displays. The combiner can also comprise a film of electrochromic material whose transmissivity can be electrically controlled. Thus, the amount of light passing through the combiner from the environment can thus be controlled. This permits the view of the reflected image from the combiners under conditions of bright ambient light. Alternates to electrochromic material include Kerr cells. Finally, as discussed below, the crossview cameras 1910 are provided to monitor the space surrounding and below the combiner to search for unwanted cameras.
Two iris cameras 1904 are provided to monitor the irises of the test-taker to make sure that the eyes of the test-taker are in the proper position during test taking while the display is illuminated, and the monitor 1900 is on the test-taker’ s head. The cameras 1904 are also used for biometric identification purposes. The iris cameras 1904 can have a much wider field of view than necessary to observe the iris and thus they can also be used to monitor for hidden cameras placed by an test-taker to transfer the contents of the test to an accomplice his cameras 1904 are part of an iris camera system arranged on the frame of the monitor 1900 and which is generally configured to image the eyes of the test-taker when the monitor 1900 is on the test-taker’s head. The iris camera system may include a different number of iris cameras 1904, so long as the left and right eyes are imaged. The iris camera system is arranged on the front portion of the monitor 1900.
Crossview cameras 1910 are provided to monitor the volume between the displays, combiner and eyes of the test-taker (test-taker) to check for the placement of hidden cameras to transfer the contents of the test to an accomplice. Through the use of the iris and crossview cameras 1904, 1910, it should not be possible to hide an imaging device within the volume encompassed by the monitor 1900 and the face of the test-taker. Crossview cameras 1910 are part of a crossview camera system arranged on the frame of the monitor 1900 and which is generally configured to image from a location on a first lateral side of the frame toward a second lateral side of the frame opposite the first lateral side and below the combiner, and image from a location on the second lateral side of the frame toward the first lateral side of the frame and below the combiner when the monitor 1900 is on the test-taker’ s head. The crossview camera system may include a different number of crossview cameras 1910, so long as the volume encompassed by the monitor 1900 and the face of the test-taker is imaged. The crossview camera system is arranged on the front portion of the monitor 1900.
Two forward-looking cameras 1906 are also provided for monitoring the environment surrounding the monitor 1900 and test-taker. These cameras 1906, which together will encompass a large field of view, can be used to monitor for the existence of notes, textbooks, or other apparatus which could aid the test-taker in answering the test questions, but which are prohibited by the rules of the test. The existence of a computer which the test-taker could use to access the Internet can be determined. Similarly, if the test-taker is typing on a keyboard, that action can be detected. In short, the forward-looking cameras 1906 can detect any forbidden activity undertaken by the test- taker. They can also determine the presence of potential accomplices trying to help the test-taker during the test taking process. The forward cameras 1906 can be provided with LED or other illumination which can be in the visual or infrared (IR) portion of the electromagnetic spectrum. The cameras 1906 need to be sensitive to IR if IR illumination is used. Forward-looking cameras 1906 are part of a forward looking camera system arranged on the frame of the monitor 1900 and which is generally configured to image an area in front of the frame, and ideally to the outward sides of the frame when the monitor 1900 is on the test- taker’ s head. The forward looking camera system may include a different number of forward looking cameras 1906, so long as the environment around the monitor 1900 is are imaged. The forward looking camera system is arranged on the front portion of the monitor 1900.
The images obtained by the six cameras discussed above, may be analyzed using trained neural networks or Deep Learning technology, for example. To this end, a processor is provided on the monitor 1900, usually in the front portion or housing (e.g., including or on printed circuit board 1920 shown in FIG. 26). This processor is coupled to the cross-view camera system, the iris camera system and the forward looking camera system and performs various image analysis. For example, the processor, analyzes images obtained by the cross-view camera system to determine presence of imaging devices in any obtained images, analyzes images obtained by the iris camera system to determine position of irises of the test-taker on which the monitor 1900 is situated (and optionally imaging devices), and analyzes images obtained by the forward-looking camera system to determine presence of specific objects. The processor may also be configured to analyze images obtained by the iris camera system and perform a biometric identification, based on the image analysis and previously obtained biometric data. Generally, the processor can use pattern recognition when analyzing images, or be otherwise trained, programmed or configured to provide the desired output of the presence of or lack of imaging devices in images. When used for testing purposes, determination of the presence of an imaging device, or person, or unauthorized testing aid or person, can result in the test being terminated.
The monitor 1900 is held in position on the test-taker’s head by means of forehead resting pad 1912 coupled with an elongate band 1914 which is preferably adjustable for tension by adjustment knob 1918 (FIG. 24). Band 1914 is connected at one end to the front portion of the monitor 1900 and also connected at the opposite end to the front portion of the monitor 1900. Other bands and length adjustment mechanisms may be used in the invention. Another elongate band 1926, which holds the contact microphone 1922 and contact speaker 1924 in position against the forehead of the test-taker, also contributes to the proper positioning of the monitor on the head of the test-taker. Band 1926 is part of the front portion of the monitor 1900.
The electronic printed circuit boards are illustrated generally at 1920 and are powered by a battery 1916 through wires which are not illustrated. Printed circuit board 1920 should be considered to represent a processor or processor means or data processor used for performing the functions need for operability of the monitor 1900, including but not limited to the image analysis. Monitor 1900 may include additional features, including those features of any embodiments of a monitor or glasses disclosed herein. Use of the monitor 1900 may be testing purposes in any of the ways disclosed herein. FIGS. 27-30 illustrate key components of the device as covered with the chassis intrusion detector (CID) 1952. The operation the CID is discussed elsewhere and will not be repeated here. The assembly covered by the CID is shown generally at 1950.
Within the CID 1952, there is a contact microphone 1954, contact speaker 1956, interfaces 1958 between the forward and iris cameras with a PC board 1960, cross-view cameras 1962, forward cameras 1964, and iris cameras 1966. Displays 1968 are connected to the PCB board 1960 by ribbon cables 1970.
The CID 1952 is represented by a smooth envelope. In practice, the CID 1952 will adhere to the surfaces of the various components. In some cases, it will be necessary to add additional structure to position the CID 1952 properly relative to the various components that it is meant to protect. The CID 1952 may be attached directly to the cameras 1962, 1964, 1966 and displays 1968 in such a way as to provide a smooth surface that does not distort the images being acquired or displayed by these devices. The CID 1952 preferably covers just what is shown in FIGS. 27 and 30. The CID 1952 does not cover the side shield (a portion of the combiner 1902) or the band 1914. In practice, the intrusion protected device may be formed by covering the front portion or housing, and its associated cameras, with the CID 1952 and then snapping it into a frame with a wire coming out from this covered device going to a battery and a receptacle on the battery for connecting to the wall power.
4. Gestures
Forward monitoring cameras can be used to monitor positions and motions of the test-taker’s hands and fingers and thus can be used to record gestures. The gestures can be used to control various functions of the monitor. Gestures, for example, can be used to control information displayed on the displays and for selecting he answers in multiple choice tests. Gestures can replace touch screen functions, for example. In many cases, for example, the motions of the hands and fingers can replace a mouse or keyboard, further improving the security and versatility of the monitor. A virtual mouse and/or keyboard can be provided for such uses.
5. Processor
The various sensors do not all need to be continuously monitored. Once the iris image has been acquired, additional images of the eye can be acquired once per second or at some other rate which makes little use of the processor requirements. Initial models of the monitor have used the Raspberry Pi 0W and CM3 boards with their resident processors.
6. Sensors
Many additional sensors that are mounted to the monitor such as fingerprint sensors, touch sensors etc. can be added to the monitor. Additionally, many other sensors that are not integral to the monitor can communicate with the monitor through WiFi, Bluetooth or other wireless or wired communication protocols. In some implementations, for example, it may be desired to have one or more cameras located in the environment, such as a laptop camera, to monitor the activities of the test- taker or in the environment while a test is underway or at other times. Similarly, the monitor can be used to control off monitor devices such as room temperature, lights, garage door, door locks etc through its connection to the Internet or to another external controller.
7. Communications
Communication from the monitor to the Internet and other devices generally involves use of Wi-Fi and Bluetooth™. Communication generally can involve the sending of test questions and answers between the monitor and an Internet resident server. In some versions of the monitor, direct cellphone communication will also be available. This will become increasingly important as cellphone data transmission speeds increase. The best method of communicating with the Internet may soon be through 5G and thus Wi-Fi, although available, may be used less and less. The CID provides excellent hardware security, but the possibility still exists for software malware to enter the monitor through one of the communication channels. One method of guarding against such malware becoming resident on the monitor is to require that all communications other than Bluetooth™ with the monitor take place through a secure Internet resident server. This server would scan all transmissions intended for the monitor to make sure that no malware is present.
When using the monitor, it may be desirable to use the computational resources of external devices such as smart phones and PC computers. This can be accomplished using various input methods to send data and commands to the external device. These methods include using a physical or virtual mouse and or keyboard or orally. For some special applications, alternative data input devices may be utilized with the monitor providing the proper software and hardware is provided. One such device is a clicker which can be used to answer multiple choice questions. Another is a ring that has many of the functions of a mouse but resides on the finger of the test-taker. Such a ring, in some cases, can have a camera which can be useful for taking a picture of the test-taker to help in verifying his or her identity. As with cell phones, the monitor can also be used to control external devices such as radio or TV stations, lights, door locks, etc as already mentioned.
8. AR and Teaching Non-educational applications
Any of various capabilities can be incorporated into several of the monitor designs disclosed herein. Several of these will now be described.
In order to prevent any leakage of information from the combiner upon which the test-taker views the test to the outside world, the lens through which the user views the surrounding environment can incorporate a Kerr or Pockels cell or an electrochromic film which turns dark, for example, when the test is underway. The same apparatus can be used to control the relative brightness of the room or ambient light relative to the display to enhance the display contrast.
An IMU can be added where the knowledge of the kinematic or rotational motion of the head of the test-taker is desirable. Such a device can be used, for example, to register head motions for the control of various functions depending on the programs present and running on the monitor CPU. A GPS can be added where it is desirable to know the location of the monitor. The GPS and IMU can work with the various cameras to map the environment where the monitor is in use which can permit the placement of augmented devices as in augmented reality. Additionally, the display can be pinned to the environment allowing, for example, the use of multiple screen images where the user can move from screen to screen merely by moving his or her head as if the room where the test-taker is situated had multiple TV screens. A magnetometer can Additionally be added to help orient the monitor.
Although the patent literature on smartglasses provides examples of the use of lidar to map the environment, for example the room where the test-taker is situated, a preferred mapping system can use the techniques disclosed in US 20190271550 for road mapping. The monitor has one or more cameras and the head of the test-taker is frequently moving allowing, in conjunction with the IMU, GPS and other related apparatus, the accurately mapping of the environment using stereographic techniques as disclosed in the ‘793 publication. A magnetic compass or magnetometer can also be included in the monitor to aid in the orientation or mapping process.
The test-taker can use a laser pointer to allow selection of a point in the surrounding environment. This can be used in conjunction with augmented reality to locate a particular point where the augmented reality device should appear. This laser pointer can be augmented with lidar capabilities to allow, on a limited basis, the determination of the distance to the object that is being selected. See, for example, US Pat. No. 10,152,141.
In addition to cameras and lidar, structured light can also be used to map the geometry in the surrounding area relative to the monitor. In this case, patterned light beams can be sent from, for example, different sides of the monitor and the interference or relative position of these structured patterns can determine the distance from the monitor. See, for example, US Pat. No. 7,182,465.
A 360-degree camera can be mounted onto the top of the monitor through using a separate strap which provides the capability of monitoring and photographing the entire space surrounding the test- taker. Alternately, cameras can be mounted to the sides and rear of the monitor to get a 360-degree view of the environment surrounding the test-taker.
The iris camera can be used to sense the blink of an eye which can additionally be used to control the display or other features or capabilities of the monitor. In addition to typing on a virtual keyboard or operating a virtual mouse, motions of the hands and fingers can be used as gestures to control monitor displays or other functions as discussed above.
One way to add a functioning keyboard to the monitor is by a virtual keyboard. This virtual keyboard can be displayed in the field of view of the test-taker as can be his hands relative to the keyboard. By watching the test-taker typing the characters that are intended to be depressed, this can be recorded and converted to characters on the display. Alternatively, a physical keyboard can be used; however, this poses some unique problems. The keyboard must not have the capability of transmitting data to any place other than the monitor. If it can do so, then the keyboard can be used to type questions to a consultant. A keyboard can be designed with a hidden switch which sends a wireless signal to the consultant which is not registered by the monitor. If the monitor determines that the test-taker is typing but it is not receiving the result of that typing, then the test can be terminated. Alternatively, the keyboard can be covered with a CID and can communicate to the monitor using encryption. A virtual keyboard may be picked up by an infrastructure mounted camera, although this would be difficult and easily defeated by moving the keyboard slightly.
Additional sensors can be mounted on the monitor to monitor the health state of the test-taker, for example, a heart rate monitor, a temperature sensor and an EEC are three possibilities. Some versions of the monitor have an EKG (ECG) sensor which can be used for biometric identification as well as health monitoring as discussed above.
An ambient light sensor can be added to aid in the control of the various cameras. A capacitance sensor or microscope lens can also be added to determine contact with the skin by the contact microphone. As mentioned above, a blood flow sensor can also be used for that purpose as well as a skin temperature sensor. Additionally, a picture of the face skin can be used to measure the distance to the skin by having a very small depth of field or by using structured light or just a laser shined at an oblique angle.
An endfire microphone array, or similar device, can also be used in order to determine the direction of incoming sound. This can augment the contact microphone for determining when the test- taker is speaking or otherwise creating sounds. Other combinations of multiple microphones can be used to localize source of speech. An earbud, for example, can include additional sensors such as a microphone or array of microphones. In some embodiments, at least two microphones from a microphone array can be arranged along a line pointed towards or at least near the mouth of a user. By using information received by the orientation sensor or sensors, a controller within the earbud, or other device, can determine which microphones of a microphone array should be activated to obtain this configuration. By activating only those microphones arranged along a vector pointed at or near the mouth, ambient audio signals not originating near the mouth can be ignored by applying a spatial filtering process.
Ultrasonic, IR, RF, and similar sensors can be added if the need arises. Tactile or touch sensors can be added to allow for finger control of the monitor. Such sensors are used on Google Glass for example.
Systems are under development to allow direct communication from a person’s brain to a device separate from the body. The concept is to allow for direct brain to Internet communication. Such a system could be used to defeat the cheating prevention systems described herein and therefore a device can be added to the monitor to sense for such communications when that technology becomes available.
Various hand mounted sensors, including a camera, RF transmitter, and LED, can also be used to control monitor functions.
9. Locking the display to location
An advantage in locking the display view to a physical location is that the view can be changed by the test-taker simply moving his or her head. For example, depending on the size of available memory, multiple screens can be available containing multiple websites or TV stations and the test-taker can switch between them merely by head movements. By using the monitor design of FIGS. 18-26, for example, each screen can be equivalent to a large screen TV. Sound that accompanies each screen can be controlled since the monitor will know which screen is being observed by the test-taker.
10. Education
Although the descriptions and examples used herein have been primarily focused on test taking, the same monitors can be used for education. Using the large displays of FIGS. 18-26, MOOCs or other educational classes can be watched by students. After taking a MOOC course, for example, the student can immediately take a secure test for credit.
11. Software
Various software modules that can be resident in the Monitor include: a. Iris capture b. Eyeball location c. EKG capture and biometric recognition d. Finger and hand recognition and monitoring e. Voice recognition biometric f. Sounds emanating from the test-taker’s mouth g. Nefarious object presence recognition in iris or cross view camera images. h. Cryptographic key set determination from an iris code. i. CID broken wire detection j. School registration software
Various software modules that can be resident on the server which interacts with the monitor include: a. Communication with universities or other test suppliers b. Test reception, scrambling and encryption c. Iris recognition d. Communication with monitors
12. Summary
Although several preferred embodiments are illustrated and described above, there are possible combinations using other sensors, materials and different dimensions for the components that perform the same functions. At least one of the inventions disclosed herein is not limited to the above embodiments and should be determined by the following claims. Many changes, modifications, variations and other uses and applications of the subject invention will, however, become apparent to those skilled in the art after considering this specification and the accompanying drawings which disclose the preferred embodiments thereof. All such changes, modifications, variations and other uses and applications which do not depart from the spirit and scope of the invention are deemed to be covered by the invention which is limited only by the following claims.

Claims

1. A device, comprising: a housing comprising a display section including at least one display for displaying content; an optical element coupled to said housing and arranged in an optical path of said display section and that reflects content displayed by said display section and allows viewing therethrough by a person; a crossview camera system coupled to said housing and that images from locations on each lateral side of said housing toward an opposite lateral side of said housing and below said optical element; an iris camera system coupled to said housing and that images an area rearward of said housing from at least one location on said housing to include at least one of the left and right eye of the person; a forward-looking camera system coupled to said housing and that images an area in front of said housing from one or more locations on said housing; and a processor arranged in said housing and coupled to said crossview camera system, said iris camera system and said forward-looking camera system, said processor analyzing: images obtained by said crossview camera system to determine presence of imaging devices in any obtained images; images obtained by said iris camera system to determine presence and position of at least one iris of the person; and images obtained by said forward-looking camera system to determine presence of specific objects.
2. The device of claim 1, further comprising a first elongate band having first and second opposite ends and being coupled at said first and second ends to said housing, said first band extending rearward from said housing to form an enclosure in which the person’s head is positionable.
3. The device of claim 2, further comprising: a forehead resting pad arranged at a front of said housing; a second elongate band adjacent said housing and including a contact microphone and a contact speaker; and a chassis intrusion detector system arranged over said housing.
4. The device of claim 1, wherein said crossview camera system comprises: a first crossview camera on a first lateral side of said housing and arranged to image inward of said first lateral side of said housing and below said optical element; and a second crossview camera on a second lateral side of said housing and arranged to image inward of said second lateral side of said housing and below said optical element.
5. The device of claim 1, wherein said display section comprises two display sections positioned horizontally alongside one another and said iris camera system comprises: a first iris camera arranged on said housing to image the left eye of the person; and a second iris camera arranged on said housing to image the right eye of the person.
6. The device of claim 1, wherein said processor analyzes images obtained by said iris camera system to determine presence of imaging devices in any obtained images.
7. The device of claim 1, wherein said processor is further configured to analyze images obtained by said iris camera system and perform a biometric identification based on the image analysis and previously obtained biometric data.
8. The device of claim 1, wherein said processor uses pattern recognition when analyzing images obtained by said crossview camera system to determine presence of imaging devices in any obtained images, when analyzing images obtained by said iris camera system to determine presence and position of irises, and when analyzing images obtained by said forward-looking camera system to determine presence of specific objects.
9. The device of claim 1, wherein said optical element comprises a semi-reflective coating on an inside surface in the optical path of said display section, and an antireflective coating on an outside surface to allow maximum light to pass through said optical element from the environment.
10. The device of claim 1, wherein said housing comprises a frame configured to be situated on the person’s head, said display section having a first portion and a second portion, said optical element comprising a combiner arranged on said frame in a position at least partly in front of eyes of the person when said frame is on the person’s head and configured to allow simultaneous viewing by the person of an environment in front of the person and the content displayed on said display section, said combiner reflecting content of said first portion of said display section to the person’s left eye and reflecting content of said second portion of said display section to the person’s right eye when said frame is on the person’s head.
EP20862545.9A 2019-09-09 2020-09-04 Secure testing device with optical element Pending EP4028826A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US16/564,905 US20190392724A1 (en) 2014-08-22 2019-09-09 Secure Testing Device
US16/717,020 US20200118456A1 (en) 2014-08-22 2019-12-17 Secure Testing Device With Combiner
PCT/US2020/049504 WO2021050392A1 (en) 2019-09-09 2020-09-04 Secure testing device with optical element

Publications (2)

Publication Number Publication Date
EP4028826A1 true EP4028826A1 (en) 2022-07-20
EP4028826A4 EP4028826A4 (en) 2023-10-11

Family

ID=74866782

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20862545.9A Pending EP4028826A4 (en) 2019-09-09 2020-09-04 Secure testing device with optical element

Country Status (7)

Country Link
EP (1) EP4028826A4 (en)
KR (1) KR20220063194A (en)
CN (1) CN114585959A (en)
AU (1) AU2020345715A1 (en)
CA (1) CA3153968A1 (en)
TW (1) TW202121360A (en)
WO (1) WO2021050392A1 (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8477425B2 (en) * 2010-02-28 2013-07-02 Osterhout Group, Inc. See-through near-eye display glasses including a partially reflective, partially transmitting optical element
US20130278631A1 (en) * 2010-02-28 2013-10-24 Osterhout Group, Inc. 3d positioning of augmented reality information
CN103033936A (en) * 2011-08-30 2013-04-10 微软公司 Head mounted display with iris scan profiling
CN106662746B (en) * 2014-08-22 2020-10-23 国际智能技术公司 Secure examination device, system and method
JP2017049762A (en) * 2015-09-01 2017-03-09 株式会社東芝 System and method
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
WO2019104413A1 (en) * 2017-12-03 2019-06-06 Frank Jones Enhancing the performance of near-to-eye vision systems

Also Published As

Publication number Publication date
EP4028826A4 (en) 2023-10-11
WO2021050392A1 (en) 2021-03-18
AU2020345715A1 (en) 2022-04-21
KR20220063194A (en) 2022-05-17
TW202121360A (en) 2021-06-01
CA3153968A1 (en) 2021-03-18
CN114585959A (en) 2022-06-03

Similar Documents

Publication Publication Date Title
US20200118456A1 (en) Secure Testing Device With Combiner
US20190392724A1 (en) Secure Testing Device
EP3029550B1 (en) Virtual reality system
US20160035233A1 (en) Secure Testing System and Method
US20150037781A1 (en) Monitoring device and system for remote test taking
US20220068154A1 (en) Secure Testing Device with Combiner
US11355024B2 (en) Methods for administering and taking a test employing secure testing biometric techniques
US11982809B2 (en) Electronic device with inner display and externally accessible input-output device
US20200301150A1 (en) Secure testing device with liquid crystal shutter
KR20150134666A (en) Glass type terminal and control method thereof
US10410535B2 (en) Secure testing device
CN103033936A (en) Head mounted display with iris scan profiling
JPWO2016157485A1 (en) Head mounted display
CN110866230B (en) Authenticated device assisted user authentication
US20210081047A1 (en) Head-Mounted Display With Haptic Output
CN105027140B (en) Portable information code reading device
KR20210045530A (en) VR type wearable treatment device
EP4028826A1 (en) Secure testing device with optical element
WO2015148607A1 (en) Secure testing system and method
US11508249B1 (en) Secure testing using a smartphone
CN209690628U (en) System and headset equipment
US20240184114A1 (en) Method for securing a testing device
US11899214B1 (en) Head-mounted device with virtually shifted component locations using a double-folded light path
WO2015093221A1 (en) Electronic device and program
CN112534489A (en) Safety examination equipment

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220329

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20230912

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/01 20060101ALI20230906BHEP

Ipc: G09B 7/07 20060101ALI20230906BHEP

Ipc: G02B 27/01 20060101AFI20230906BHEP