CA2471372A1 - Non-invasive polygraph technology based on optical analysis - Google Patents
Non-invasive polygraph technology based on optical analysis Download PDFInfo
- Publication number
- CA2471372A1 CA2471372A1 CA002471372A CA2471372A CA2471372A1 CA 2471372 A1 CA2471372 A1 CA 2471372A1 CA 002471372 A CA002471372 A CA 002471372A CA 2471372 A CA2471372 A CA 2471372A CA 2471372 A1 CA2471372 A1 CA 2471372A1
- Authority
- CA
- Canada
- Prior art keywords
- human subject
- radiation pulses
- subject
- transmitter
- accordance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/164—Lie detection
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Pathology (AREA)
- Heart & Thoracic Surgery (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Physics & Mathematics (AREA)
- Developmental Disabilities (AREA)
- Biophysics (AREA)
- Child & Adolescent Psychology (AREA)
- Biomedical Technology (AREA)
- Educational Technology (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
A system and method for unobtrusively and non-invasively subjecting a human subject (10) to tests for the purpose of determining whether that subject is truthful and/or is under stress. A series of laser or infrared pulses (18) a re directed to the human subject(10). These pulses are reflected or scattered (20) from the individual and are received by a receiver device (14). The receiver device (14) is connected to an information processing device (16) capable of determining various physiological characteristics exhibited by th e human subject (10). A display (24) associated with the information processin g device (16) would visually illustrate these physiological characteristics.</ SDOAB>
Description
NON-INVASIVE POLYGRAPH TECHNOLOGY
BASED ON OPTICAL ANALYSIS
BACKGROUND OF THE INVENTION
1. Field of the Invention This invention relates generally to polygraph systems and methods; and more particularly to such apparatus or procedures that require no mechanical contact with the subject.
BASED ON OPTICAL ANALYSIS
BACKGROUND OF THE INVENTION
1. Field of the Invention This invention relates generally to polygraph systems and methods; and more particularly to such apparatus or procedures that require no mechanical contact with the subject.
2. Related Art The art of the popularly designated "lie detector" is a mature one and well known. In it, ordinarily a subject to be interrogated is attached to various sensors for measurement of :heart rate, breathing rate, perhaps skin characteristics and body temperature, and sometimes other body parameters. This 'technology is generally effective and a helpful tool, although the legal system has been traditionally somewhat slow to accept it because of recognized susceptibility to both false positive results (i.e., incorrect apparent finding of a lie when the subject has actually been truthful) and a false negative result (i.e., failure to detect an actual lie, or in other words, an incorrect finding of truthfulness).
Polygraph testing and recording is either accompanied by, or part of, an interrogation of some kind, and in turn, commonly accompanied by audio and sometimes video recording.
Thus, in order to conduct a full examination, operation of the recording polygraph devices themselves is additive with respect to, for instance, a video camera with a sound track.
A drawback in conventional polygraphy is the need to attach the sensors before the examination and detach them afterward. Aside from the awkwardness of this procedure and the time consumed, some subj ects are uncooperative or violent and may be dangerous to the operators of the equipment - while others may poses a hazard by virtue of highly communicable diseases such as AIDS, hepatitis and ebola.
Polygraph testing and recording is either accompanied by, or part of, an interrogation of some kind, and in turn, commonly accompanied by audio and sometimes video recording.
Thus, in order to conduct a full examination, operation of the recording polygraph devices themselves is additive with respect to, for instance, a video camera with a sound track.
A drawback in conventional polygraphy is the need to attach the sensors before the examination and detach them afterward. Aside from the awkwardness of this procedure and the time consumed, some subj ects are uncooperative or violent and may be dangerous to the operators of the equipment - while others may poses a hazard by virtue of highly communicable diseases such as AIDS, hepatitis and ebola.
Another difficulty with the conventional technology is the relatively high incidence of false positives due to a subject's nervousness about being connected to the apparatus and then questioned. A less-obtrusive system could significantly mitigate this problem.
Also, it is well known that some subjects are able to suppress bodily response to stress (leading to false negatives), and others can generate voluntary variations and correlations (leading to a continuing stream of false positives) that mask response to stress. In effect, the subject is lying not only to the questioner, but to the machine as well.
The problem of unwitting false positives also is complicated by the problem of intentional false positives. These various effects degrade the reliability of all conventional polygraphic systems and techniques.
Not all polygraphy is related to criminal testimony.
Some is potentially useful instead in hiring applicants for sensitive jobs such as intelligence, police and other security work - or even simply positions calling for a high degree of personal stability and trustworthiness, as for instance, teachers, managers, pilots, bus drivers, medical and paramedical workers, and mass-transportation maintenance personnel.
In these areas, it is unseemly to subject applicants to the indignity or attaching leads and sensors to the skin. In common situations where only one polygrapher is available, an additional issue of sexual impropriety or at least offensiveness may arise when a subject and a polygrapher are of opposite gender.
Also, related to the characteristics of a polygrapher is the requirement for attention by a professional who is highly trained. A more highly automated system could reduce or eliminate the need for such advanced expertise - particularly if resulting primary data, without need for interpretation, could be used directly as evidence.
Results from conventional polygraphy do not appear to be sufficiently consistent for such use. This field accordingly would benefit from refinement of the technology to provide more reproducible results from test to test.
Finally, in most cases observation of a subject's body parameters is subject to considerations of civil liberties and personal privacy under the United States Constitution - and similar established policy worldwide; nevertheless, there are established circumstances under which such considerations are inapplicable or at least very severely attenuated. For example, it is understood that the law in much, if not all of the United States, accords to convicted felons while in prison a much lower degree of personal privacy than to citizens generally. Therefore it would be appropriate and desirable in such circumstances to have a means of monitoring vital signs without the subject's knowledge.
Also, it is well known that some subjects are able to suppress bodily response to stress (leading to false negatives), and others can generate voluntary variations and correlations (leading to a continuing stream of false positives) that mask response to stress. In effect, the subject is lying not only to the questioner, but to the machine as well.
The problem of unwitting false positives also is complicated by the problem of intentional false positives. These various effects degrade the reliability of all conventional polygraphic systems and techniques.
Not all polygraphy is related to criminal testimony.
Some is potentially useful instead in hiring applicants for sensitive jobs such as intelligence, police and other security work - or even simply positions calling for a high degree of personal stability and trustworthiness, as for instance, teachers, managers, pilots, bus drivers, medical and paramedical workers, and mass-transportation maintenance personnel.
In these areas, it is unseemly to subject applicants to the indignity or attaching leads and sensors to the skin. In common situations where only one polygrapher is available, an additional issue of sexual impropriety or at least offensiveness may arise when a subject and a polygrapher are of opposite gender.
Also, related to the characteristics of a polygrapher is the requirement for attention by a professional who is highly trained. A more highly automated system could reduce or eliminate the need for such advanced expertise - particularly if resulting primary data, without need for interpretation, could be used directly as evidence.
Results from conventional polygraphy do not appear to be sufficiently consistent for such use. This field accordingly would benefit from refinement of the technology to provide more reproducible results from test to test.
Finally, in most cases observation of a subject's body parameters is subject to considerations of civil liberties and personal privacy under the United States Constitution - and similar established policy worldwide; nevertheless, there are established circumstances under which such considerations are inapplicable or at least very severely attenuated. For example, it is understood that the law in much, if not all of the United States, accords to convicted felons while in prison a much lower degree of personal privacy than to citizens generally. Therefore it would be appropriate and desirable in such circumstances to have a means of monitoring vital signs without the subject's knowledge.
SIJMMP.RY OF THE INVENTION
Accordingly, it would be desirable to provide a form of polygraphic equipment and methodology requiring no such sensor attachment, and also amenable to a wider range of vital parameters through a single sensor module.
A heretofore-unrelated art is that of light detection and ranging - sometimes called "lidar" by analogy to radio detection and ranging, and its better-known acronym "radar".
More conspicuously, lidar has been used in large-scale aerial imaging, as in U.S. Patent 5,467,122 of Bowker et al directed to a streak-tube form of lidar for ocean-volume monitoring; but small- and even medical-scale applications are known as set forth in a related patent application of the same inventors, and to uses at a wide range of scales as disclosed in international application WO 97/18487 of Bowker et al.
The references just cited generally use a translating or scanning pulse source, with the receiver and transmitter substantially co-located. Through use of a streak-tube time resolver, they intrinsically map distance ("range"), between the transceiver and objects of interest, into position along one dimension (e. g., height) of a display screen - so that each pulse provides a sectional, two-dimensional image in a plane passing through the transceiver.
Due to the scanning or translation of the transceiver, successive pulses provide substantially parallel individual sectional images. These can then be integrated visually or otherwise into, effectively, a three-dimensional image.
Another well-known form of streak-tube lidar avoids the translation of the transceiver, substituting a different kind of remapping by use of a fiber-optic prism with rows of fiber-optic pixels physically rearranged - so that an entire two-dimensional image can be presented to a streak tube as a single line (i.e., one-dimensional) image. The streak tube is then able to time resolve motion within the entire image, based on a single laser pulse; but a computer reassembly of the image - with its motion -is required since the image would otherwise appear unintelligibly scrambled by the original action of the fiber remapper.
Accordingly, it would be desirable to provide a form of polygraphic equipment and methodology requiring no such sensor attachment, and also amenable to a wider range of vital parameters through a single sensor module.
A heretofore-unrelated art is that of light detection and ranging - sometimes called "lidar" by analogy to radio detection and ranging, and its better-known acronym "radar".
More conspicuously, lidar has been used in large-scale aerial imaging, as in U.S. Patent 5,467,122 of Bowker et al directed to a streak-tube form of lidar for ocean-volume monitoring; but small- and even medical-scale applications are known as set forth in a related patent application of the same inventors, and to uses at a wide range of scales as disclosed in international application WO 97/18487 of Bowker et al.
The references just cited generally use a translating or scanning pulse source, with the receiver and transmitter substantially co-located. Through use of a streak-tube time resolver, they intrinsically map distance ("range"), between the transceiver and objects of interest, into position along one dimension (e. g., height) of a display screen - so that each pulse provides a sectional, two-dimensional image in a plane passing through the transceiver.
Due to the scanning or translation of the transceiver, successive pulses provide substantially parallel individual sectional images. These can then be integrated visually or otherwise into, effectively, a three-dimensional image.
Another well-known form of streak-tube lidar avoids the translation of the transceiver, substituting a different kind of remapping by use of a fiber-optic prism with rows of fiber-optic pixels physically rearranged - so that an entire two-dimensional image can be presented to a streak tube as a single line (i.e., one-dimensional) image. The streak tube is then able to time resolve motion within the entire image, based on a single laser pulse; but a computer reassembly of the image - with its motion -is required since the image would otherwise appear unintelligibly scrambled by the original action of the fiber remapper.
This technology is epitomized by well-known seminal patents of Knight and of Alfano. No fiber-optic remapper is needed in the scanning-transceiver systems; but the latter can acquire - with a single laser pulse - only a very small section of an entire three-dimensional image, whereas the remapping enables collection of an entire such image from each pulse.
In still another variant, sometimes called a "bistatic"
configuration, the lidar transmitter and receiver are not co-located but rather, are in quite different locations. Here the laser pulses reflected from a subject are distorted by the effectively ellipsoidal character of the wavefronts reaching the receiver.
Here too, a computer reconstruction of the image is needed if the application at hand calls for a natural-appearing picture. Bistatic streak-tube lidar configurations are analogous to the similarly separated source/receiver configuration of radar systems.
A streak tube, however, is only one example of devices suited for time-resolution in lidar systems. Other alternatives will be introduced later in this document.
These several forms of lidar have been used to measure the conformation of land, or other objects, either directly in view or through turbid media that obscure direct vision. To the best of our knowledge, no connection has ever been suggested between lidar and polygraphy.
The three patent documents mentioned above, and all references cited therein, are wholly incorporated by reference into the present document. In particular, this incorporation shall include, but not be limited to, pictorial illustrations in those documents, which accordingly shall be regarded as directly presented in the present document.
As can now be seen, the related polygraphic art remains subject to significant problems, and the efforts outlined above although praiseworthy - have left room for considerable refinement.
In still another variant, sometimes called a "bistatic"
configuration, the lidar transmitter and receiver are not co-located but rather, are in quite different locations. Here the laser pulses reflected from a subject are distorted by the effectively ellipsoidal character of the wavefronts reaching the receiver.
Here too, a computer reconstruction of the image is needed if the application at hand calls for a natural-appearing picture. Bistatic streak-tube lidar configurations are analogous to the similarly separated source/receiver configuration of radar systems.
A streak tube, however, is only one example of devices suited for time-resolution in lidar systems. Other alternatives will be introduced later in this document.
These several forms of lidar have been used to measure the conformation of land, or other objects, either directly in view or through turbid media that obscure direct vision. To the best of our knowledge, no connection has ever been suggested between lidar and polygraphy.
The three patent documents mentioned above, and all references cited therein, are wholly incorporated by reference into the present document. In particular, this incorporation shall include, but not be limited to, pictorial illustrations in those documents, which accordingly shall be regarded as directly presented in the present document.
As can now be seen, the related polygraphic art remains subject to significant problems, and the efforts outlined above although praiseworthy - have left room for considerable refinement.
BRIEF DESCRIPTION OF THE DRAWINGS
FIGURE 1 is a two-part conceptual illustration of a preferred embodiment of the invention;
FIGURE 2 is a transceiver diagram (subject to variant interpretations as explained below) representing more specifically the temporal/geometrical form of the pulses - and indicating spectral and temporal resolution of the return in the front end of a detector;
FIGURE 3 is a triplet of range waveforms at different pixels - the (A), (B) and (C) portions representing returns from portions of a subject's anatomical features that are successively more remote from the transceiver;
FIGURE 4 is a pair of information-flow diagrams showing at (A) data derivation from a single lidar pulse, and at (B) data derivation from automatic analyses and comparisons of plural pulses considered as a set;
FIGURE 5 is a comparative timing diagram showing plural graphs of vital-parameter excursion vs. time, as the basis of a simple time-series or coincidence analysis; and FIGURE 6 is a graph of another data-evaluation approach that utilized correlation as the basis of analysis.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Preferred embodiments of the invention provide a remote (i.e., noncontact) and if desired clandestine technique and apparatus for lie-detector tests, using analysis of three-dimensional lidar data. Such data are obtained by, for example, a range-gated electro-optical lidar camera system acquiring image-data frames at roughly 10 to 200 Hz (more preferably near the high end of this laser-pulse-rate range) over a relatively small area, in a generally continuous way with a pulsed laser source. Although this invention need not be so limited, the aforementioned relatively small area is an individual's face and its upper chest area.
Attention is directed to Figure lA which shows the system of the present invention. This figure shows lidar pulse interaction with a subject 10. A lidar transmitter 12 transmits a pulsed beam 18 directed at the subject 10. A scattered pulse beam or reflected pulse beam 20 is obtained from the subject and is received by a lidar receiver 14. The lidar receiver 14 is generally co-located with respect to the lidar transmitter 12 in the form of a transceiver. However, it is noted that the lidar transmitter 12 and the lidar receiver 14 need not be required to be co-located. The lidar receiver 14 is connected to a computer 16 via a wire, cable or similar device 22, or by a wireless connection. The computer 16 contains a display 24 which is shown in more detail in Figure 1B. The computer 24 is provided with the requisite hardware and software to interpret the data received by the lidar receiver 14 to produce the various outputs shown in Figure 1B. The displays shown in Figure 1B can then be interpreted by a human operator as well as being transmitted to other utilization devices.
The display 24 illustrated in Figure 1B contains various outputs based upon various physiological parameters.
These parameter include, but are not limited to, a subject's heartbeat, as shown by display 28, the subject's respiration rate, as shown by display 30 and the subject's body temperature, as shown by display 32. Display 34 illustrates an output created by automatically analyzing one or more of the aforementioned _g_ physiological parameters or other physical parameters. This output is produced by the appropriate software included in the computer 16 and is used to demonstrate visually whether the subject is under stress, as would be produced if the subject was not telling the truth.
Although not directly shown in Figure 1A, the computer 24 is also connected to, and controls, the lidar transmitter 12, allowing the transmitter 12 to be directed at various locations on the head and upper torso of the subject, as well as changing the frequency of the pulse based upon the type of parameter of interest. This control can be done manually, or would allow the lidar transmitter 12 to automatically scan the body of the subject as well as automatically change the frequency of the pulse.
The various parameters are analyzed based upon a change of distance from the transmitter and the subject's body as would be created from movement of the skin due to the subject's heart rate and respiration rate. Change in frequency of the received pulse from the transmitted pulse, as well as relative degree of scattering at the subject's skin surface would also be used to measure the various aforementioned parameters, as well as moisture on the subject's skin.
Figure lA illustrates a system in which a low-power, short-pulse, is directed at a subject multiple times a second, detecting changes in heart rate, breathing rate, perspiration rate and subject temperature. An eye-safe infrared lidar could be used as well as other pulses, such as lasers. The computer 16 displays these measurements in near-real-time to aid an interrogation in determining stress and thereby in assessing the truthfulness of the subject.
Figure 1B suggests how the display is advantageously made to present all the key data, both graphically and numerically, and with a multiparameter-integrated figure of merit as shown by display 34, as well. In some applications, most particularly, outside a direct-interrogation context, any of the parameters (but particularly the parameter shown in display 34) may be used to operate other utilization devices 26. These utilization devices may incorporate any of a very great variety _g_ of devices. These may include, but are not limited to, access controls for doors, vehicles, computers, financial information or money (e.g., ATM machines) and so on.
As will be seen, however, the frame rate may depend very strongly on which of the above-outlined types of lidar system is in use. As mentioned earlier, a scanning system is simpler in terms of hardware, but also much slower in terms of overall three-dimensional frame rate.
This kind of apparatus is able to acquire a great range of vital signs - including, but not limited to, sweating (and, if so, the contents of the sweat), body temperature, heart rate, breathing rate, shivering or eye-blinking rate, and other parameters appropriate to monitoring of probable truthfulness in a subject.
In most-highly-preferred forms, the invention uses an active camera system, very finely range-gated with a very short-pulsed laser. The range-gate return is used to locate the surface of the subject's skin relative to the apparatus.
For this purpose, it is desirable to range-gate to millimeters. This objective calls for operation in the range of a few picoseconds to one nanosecond.
With skin position established, remaining variations of the signal provide the other parameters mentioned above. For instance, the relative degree of scattering at the surface, and particularly its variation over time, serves as an instantaneous indicator of moisture (i.e., sweat); and if desired, some limited amount of biochemistry in that moisture can be determined through analysis of spectral lines in the return.
Monitoring of minute periodic skin-range fluctuations, generally at frequencies of very approximately one per second (but between roughly 0.3 and 2.5 Hz) - and found at, for instance, the subject's temples - yield the heart rate. Like movements at the upper chest, throat, or nostrils, but slower (e.g., at frequencies in the range of 0.01 to 0.3 Hz) signify the respiratory rate; and at the eyes, the rate of blinking.
Small cyclical positional fluctuations in other areas, or even in the same areas (but characterized by substantially higher frequencies, e.g., 5 to 50 Hz), can reveal even a very slight trembling. In some of these operations, it is necessary to carefully discriminate beats (in the interfering-frequency sense) of the physiological activity against the pulse frequency of the laser.
Hence, a preferred embodiment of the apparatus filters the positional information into various frequency ranges, and separately monitors the amplitude and exact frequency of the data in each range. These signal channels can be read out on a display at the time of data acquisition - e.g., during an interrogation, which enables the equipment operator to dynamically control the course of questioning, as is the state of the art in conventional polygraphy - or can be saved for later, or preferably both.
Automatically derived correlations among the several parameters, and their time derivatives - i.e., acceleration, deceleration, or degree of abruptness in these changes - can also be characterized (i.e., "concern", "anxiety", "panic") and displayed or recorded. These, if preferred, can be treated as only advisory to the operator, whose professional interpretation is generally accorded greater reliability.
Preferred embodiments of the present invention, however, are capable of a reasonable degree of objectivity in output readings and their interpretation - much more so than in conventional polygraphy, as will be understood from the overall presentation in this document. This is partly due to the superior ability of the invention to deal with the problems of false positives and negatives.
While most of the equipment operates in an active mode (i.e., by analysis of radiation reflected by the subject from a pulsed laser), operation in the infrared enables collection of passive data as well - particularly including the subject's body temperature, found from its own very slight thermal radiation.
An alternative (or confirming) measurement of temperature, however, can be found from very slight frequency changes in the laser return beam.
By analyzing such changes, the apparatus can deduce the speed of sound at the subject's near interior surface, using phonon-photon interactions; temperature in turn is then deduced from the determined speed of sound. Such operation is based upon reported work, but as a practical matter, this operation is simple: the return signal is monitored at frequencies very slightly offset from the main, laser frequency. Certain spectral lines close-in to the laser line are due to a vibrational mode of water molecules, which reveals the desired sound speed and thereby the temperature value.
Relative to many of the established uses of lidar (particularly monitoring of small objects within turbid media), the present application intrinsically enjoys an unusually favorable signal-to-noise ratio. Preferred embodiments therefore can be operated to extract accurate and useful bioparameters from a relatively loosely operating system.
If desired, this apparatus can be placed in a housing that has the general appearance of an ordinary video camera, or for that matter, a potted plant or anything else. The same housing, in fact, can also accommodate a conventional video camera - or, as preferred, the lidar device itself can be configured and operated to acquire substantially conventional appearing video images, as well as all the data discussed above.
To minimize subject awareness, the device can be operated in the infrared, with careful attention to eye-safety and sensitivity precautions. Satisfactory laser performance is now available at 1.04 to 1.07 microns, and for eye safety, the device is advantageously fitted with a conventional frequency doubler (e.g., from 1.07 um to 532 nm); the resulting light is then wavelength-tripled (the frequency is divided by three) to obtain eye-safe 1.5 ~m radiation. The invention also should be practiced with careful attention to invasion-of-privacy issues, generally as noted earlier.
The accompanying drawings show how preferred embodiments of the invention operate, and also illustrate several variants that are intended to emphasize the very great variety of alternative forms of both apparatus and method.
Figure 2 shall be understood to illustrate application of any one of several forms of lidar system in preferred embodiments of the present invention. These include the three previously discussed streak-tube lidar versions, and also certain alternatives that will be discussed below. The three streak-tube-based systems will be introduced first:
First, as understood to illustrate a scanning system, Figure 2 shows how it is possible to illuminate very shallow segments of the image - by a series of pulses a-g of the laser, directed in progressively shifted directions to scan over relevant parts of the subject's body 10 - particularly where skin is exposed. This shifting of direction is preferably provided by a scanning mirror or set of mirrors, suitable angular rotation being obtainable by any of a great variety of means (such as a spinning polygonal mirror); or by a translating device closely analogous to the translating system disclosed in the art.
In such a system, each pulse generates a two dimensional image as previously mentioned - that image plane passing through the transceiver position and being extended in one direction a-g of pulse propagation. As to the nearest image facet of the subject volume, each pulse generates essentially a single pixel row.
The successive pulses in the aggregate produce a three-dimensional image in which no remapping is needed - the interpretation of the image is far more natural, as seen in the cited work of Bowker et al - and the physical apparatus is somewhat simplified by absence of the fiber-optic remapper. To achieve adequately fast overall-frame rates (at least 10 Hz and preferably 200 Hz, as noted earlier) - for visualizing a subject's shivering, or blinking, or other relatively rapid bodily activity - the entire scanning operation must complete its cycle in a small fraction (1/200 to 1/10) of a second.
This leads to a high laser-pulse-rate requirement, for instance on the order of very roughly 10 kHz - which would enable a 160 Hz frame rate for a low-resolution 64-pixel-row frame.
Such rates are possible, but somewhat drive up the cost of the apparatus; and a 64x64 frame is relatively unsatisfactory in terms of studying the subject's features and behavior visually.
At current-day technology, however, a medium-high resolution system is not readily attainable in a pure scanning system. Laser pulse rates of about 80 kHz would be required for 100 Hz frame rate and a medium-high-resolution 800-pixel-row frame; as will be seen, these frame and resolution objectives can be achieved, but using a preferred embodiment that is a variant system described below.
In a pure scanning system, the transmitter and receiver are most preferably co-located. For purposes of such a system, Figure 2 shows them separated only for convenience or practicality of illustration.
Second, as understood to illustrate a remapper system, Figure 2 shows how each laser pulse incorporates an array of pixel rows a-g. Here, unlike the interpretation just presented, the entire subject is illuminated in each laser pulse.
The entire returning two-dimensional subject image is then remapped into a single line, and that line preferably scanned in a streak tube to develop a three-dimensional image which as mentioned earlier is scrambled. The remapping is readily unfolded, however, by simple computer operations.
A major advantage of this type of system is that the overall frame rate is the same as the laser pulse rate, rather than being slower by two to nearly three orders of magnitude.
In a pure remapper system, as in the scanning system, the transmitter and receiver are co-located - and Figure 2 is to be understood as illustrating such co-location.
This arrangement does have drawbacks. Image resolution is limited by the preestablished number of pixels in the fiber optic remapper, and arrays exceeding 64x64 pixels are progressively more costly or awkward - and the energy in the laser light is divided among the entire complement of pixels.
Thus, although high frame rates are feasible, a medium-resolution image is not readily available in a pure-remapping system.
Third, as understood to illustrate a bistatic system, Figure 2 shows how the transmitter and receiver are not co-located, but rather, separated by some sizable angle. As mentioned earlier, this kind of geometry produces a relatively more complicated image; but once again, the image can be reconstructed by a computer. A bistatic system can be operated either with a scanning transmitter and scanning receiver, or with a remapper, as preferred.
Hybrids of the scanning and remapping system are also possible and within the scope of the invention. As will now be understood, these different systems simply represent different ways of dividing up space and time for convenient and effective imaging.
Thus, for example, a remapper can be provided, but rather than remapping an entire image, the device can be formed to remap only some segment of intermediate shallowness. The laser pulse is angularly stepped or scanned, as in the case of the pure scanning system, but not as many steps are required.
Here computer reconstruction is required, but a smaller amount of data is handled per laser pulse. The number of pulses per full image frame, and the number of pixel rows in the remapper, are traded off against one another to optimize the overall system.
This hybrid system enables provision of an intermediate-resolution image at high pulse rates. For example, 800 pixel rows in 200 Hz frames would require 160 kHz laser pulses in a pure scanning systems - and would be mechanically impractical in a pure remapping system.
Such a frame-rate/resolution specification, however, is implemented straightforwardly with a hybrid. In one preferred embodiment, the remapper has 1100 pixel columns and two pixel rows (remapped to a single line of 2200 pixels total, which is just over half the pixel complement of a more-traditional 64x64 remapper), with the laser pulsing at only 200 to 400 Hz and the scan system stepping the beam by two pixels between pulses. This system has a very creditable near-photographic 1100x800-pixel image, and a frame rate in the range of 100 to 200 Hz.
As already mentioned, streak tubes are not the only suitable time-resolution systems for use with lidar imaging in the practice of the present invention. Other exemplary systems use instead, an array of small photomultiplier tubes (PMTS), or avalanche diodes, or a microchannel plate with a charge-coupled detector (CCD) array.
These are all amenable to independent time-gating of individual pixels, which is desirable in preferred embodiments of the invention. Also, they are all effective at eye-safe wavelengths, which present-day streak tubes do not handle optimally.
In such an array, either the individual PMTS, diodes or CCD elements are tiny or an additional optical-coupling stage is used to spread the return laser beam, and essentially match it to the dimensions of the detector array. The array itself may be, merely by way of example, 64x64 elements.
The distance to the subject is ideally under about 10 m, and depending upon the several variants and the other parameters discussed above this may lead to pixel resolution on the subject of, for example, about 3 mm. Depth resolution should approach 0.3 mm. Although in principle data can be cached for later manipulation, this would preclude real-time preliminary assessment by an operator; therefore each pulse preferably is returned, sensed and analyzed before, or substantially at the same time as, the next pulse.
The scattered pulses are spectrally dispersed as by a diffraction grating, so as to enable the simple spectrometry mentioned earlier; and also range-gated. This means that the distance to impingement of each pulse on the nearest part (for that pulse) of the subject's body surface is used to start the time-resolution processes of the receiver. More-complicated gating is possible - as for example, setting the gate for each pixel by the previous image for that pixel, respectively.
One way in which such processes can provide extremely fine time resolution is by a streak-tube sweep such as discussed in the documents mentioned earlier. Those documents explain how the time interval of return of each pulse is essentially mapped to position along one dimension (e. g., height) of a streak-tube screen, as illustrated in the drawings of the patent documents and therein-cited art incorporated by references.
Such mapping causes that dimension on the screen to represent distance from the lidar transceiver, or in other words depth into the subject's body, as shown and explained at length in those earlier documents. As also mentioned in certain of the cited art, time resolution can be obtained through use of extremely fast electronics, without resort to a streak tube.
Meanwhile a transverse direction (perpendicular to the scan-sequence direction) is preserved as a spatial image direction, so that in the scanning-lidar form of the invention the streak-tube screen represents a tomographic visual section partway through the patient's body. As a patient's skin and flesh are not opaque, but rather turbid media, the analyses made by the automatic equipment extend slightly into the patient's body - to depths that are readily determined by simple systematic measurement.
Thus, the graph in Figure 3A represents pulse return from the air and the immediate interior of the patient's body, for a relatively near-in region of the anatomy - e.g., a hand held just in front of the body, or the subject's nose or chin projecting forwardly of other parts of the body. Those in Figure 3B and C represent similar air and immediate-interior returns, but from progressively more-remote regions of the anatomy such as the throat.
Merely by way of example, in a scanning system, these three returns might happen to the obtained in correspondence with the pulses a, b and c of Figure 2, and therefore could represent different bodily features sighted at different vertical positions; or instead might instead happen to be sighted at different horizontal position (pixels) along a common vertical position (pixel row).
In any event, the interior regions (flesh behind skin, bone behind hair, etc.) depicted in the drawing, are not merely distinguishable positionally, but also have respectively different characteristics. These different characteristics interact differently with a subject's stress.
Therefore, they offer opportunities to normalize the readings, or to partially calibrate the apparatus on-the-fly, etc. - for further refinement of the resulting polygraphic data.
For instance, the laser-pulse reflectance of bone at a fixed, shallow depth within the body (e.g., at the forehead) is not likely to vary as a function of stress; therefore, in suitable subj ects ( i . a . , where a clear bone return is found) , the software can form ratios of the nearer-in, skin reflectance signals with the bone reflectance, thereby enabling stabilization of those net signal components which represent conditions at the skin.
Such stabilization or normalization is not strictly necessary, using a well-calibrated active system. It might, however, be employed in such a way as to enable a less-stable operation, or a less finely calibrated or adjusted apparatus, or a slower computational regime, or combinations of these relaxations of operating demands - and thereby to reduce the system cost or complexity.
The invention is readily practiced by straightforward modification of an existing laboratory lidar system for scanning.
Calibration for the various parameters of interest is also straightforwardly obtained from breadboarding of optically fast detectors to measure amplitude and frequency shift in the scattered signal from a representative subject.
A journeyman programmer should have no difficulty preparing simple data-acquisition control software to record the measurements. Analysis software is more extensive but well within the state of the art; it should plot and assess in near-real-time:
~ Changes in amplitude, vs. time, of the reflected signal to determine changes in perspiration -such information being displayed after derivation from processing and comparison of individual pulses as detailed in Figure 4A, but the time-series (Figure 5) or correlation (Figure 6) analysis as well;
~ Changes in carrier frequency - and subtended angle for the scattered signal, to establish small changes in body temperature - these variations too being developed from tracking of single pulses as in Figure 4A; and ~ Fast Fourier transform of ongoing multipulse measurements to extract breathing and heart rates (and preferably some other periodic parameters, of interest, as mentioned earlier) - as represented in Figure 4B.
As previously mentioned, and as illustrated here, the Figure 4 outputs are not limited to display, but are also readily thresholded and directed to drive utilization means. The mathematics of Fourier analysis, as well as the statistical methodologies of time series (Figure 5) or correlation (Figure 6), are now found commercially in software modules that can be plugged into the analysis software to be developed here.
Hence, these relatively sophisticated methods are available on an off-the-shelf basis for incorporation into practice of the present invention. As noted in Figure 6, a zero correlation (or if preferred a resting-correlation) value can be automatically developed from the same subject and applied to set thresholds for the thresholding operations mentioned earlier.
In a preferred embodiment, temperature resolution and update rate are 0.1 °C and 0.1 Hz respectively. Heart-rate resolution and update rate are roughly one beat/minute and 0.1 Hz respectively.
Although the principles of the invention should now be clear, any newly assembled prototype apparatus should be carefully validated by controlled tests on a series of subjects, and overall operation subjected to a carefully crafted, statistically valid blind test demonstration. In this regard, it must be borne in mind that - given reliable bioparameter data, whether obtained from the present invention or conventionally -polygraphy itself is not an exact science.
As mentioned earlier, some subjects inadvertently generate false positives, while others can deliberately generate false negatives or positives (or both) at will, degrading the reliability of all direct polygraphic systems and techniques.
Conventional polygraphy provides little or no way to look behind the measurements, to determine whether observed reading patterns are arising in large part only from a subject's intentional, voluntarily screening of normal bodily responses - or are instead what they actually appear to be.
The present invention, however, does provide a way to look behind the superficial or apparent characteristics of the readings. It thereby offers several lie-detection advantages over conventional systems - particularly in that:
(a) A subject's responses can be assessed when the subject does not know the invention is in use;
and furthermore;
(b) A subject's responses when the subject knows the invention is in use, can now be compared with responses when the subject does not know;
(c) Such comparisons thereby enable detection of an open or truthful subject's fear of the apparatus itself, and also to quantification of such a subject's unintended disruption of the polygraphic process;
(d) Such comparisons also enable detection of a guarded or deceptive subject's ability to intentionally, voluntarily generate false positives or negatives, and also to quantification of that ability; and finally (e) Such detection and quantification can lead in turn to some degree of cancellation of, or compensation for, the consequences of both (i) such unintended disruptions by a merely nervous subject, and (ii) such deceptive abilities on the part of a guarded subject.
In these several distinct ways, the present invention can make very definite advances in the ability to deal with the problem of false positives and negatives in conventional polygraphy. Nevertheless, for a very conservative test, operation of the invention can be compared with that of conventional polygraphy as distinguished from any absolute measure of truthfulness in a wary or skillful subject.
By adapting and developing current IR lidar and detection technology, and standard fast Fourier transform algorithms, it is possible to measure changes in a subject's breathing, perspiration, heartbeat, blinking, shivering and temperature several times a second without physical contact - and if desired, without alerting the subject, whether during detention or during structured interviews. This capability must be tempered with due regard for applicable privacy rights and other applicable civil rights of the subject.
It will be understood that the foregoing disclosure is intended to be merely exemplary, and not to limit the scope of the invention.
FIGURE 1 is a two-part conceptual illustration of a preferred embodiment of the invention;
FIGURE 2 is a transceiver diagram (subject to variant interpretations as explained below) representing more specifically the temporal/geometrical form of the pulses - and indicating spectral and temporal resolution of the return in the front end of a detector;
FIGURE 3 is a triplet of range waveforms at different pixels - the (A), (B) and (C) portions representing returns from portions of a subject's anatomical features that are successively more remote from the transceiver;
FIGURE 4 is a pair of information-flow diagrams showing at (A) data derivation from a single lidar pulse, and at (B) data derivation from automatic analyses and comparisons of plural pulses considered as a set;
FIGURE 5 is a comparative timing diagram showing plural graphs of vital-parameter excursion vs. time, as the basis of a simple time-series or coincidence analysis; and FIGURE 6 is a graph of another data-evaluation approach that utilized correlation as the basis of analysis.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
Preferred embodiments of the invention provide a remote (i.e., noncontact) and if desired clandestine technique and apparatus for lie-detector tests, using analysis of three-dimensional lidar data. Such data are obtained by, for example, a range-gated electro-optical lidar camera system acquiring image-data frames at roughly 10 to 200 Hz (more preferably near the high end of this laser-pulse-rate range) over a relatively small area, in a generally continuous way with a pulsed laser source. Although this invention need not be so limited, the aforementioned relatively small area is an individual's face and its upper chest area.
Attention is directed to Figure lA which shows the system of the present invention. This figure shows lidar pulse interaction with a subject 10. A lidar transmitter 12 transmits a pulsed beam 18 directed at the subject 10. A scattered pulse beam or reflected pulse beam 20 is obtained from the subject and is received by a lidar receiver 14. The lidar receiver 14 is generally co-located with respect to the lidar transmitter 12 in the form of a transceiver. However, it is noted that the lidar transmitter 12 and the lidar receiver 14 need not be required to be co-located. The lidar receiver 14 is connected to a computer 16 via a wire, cable or similar device 22, or by a wireless connection. The computer 16 contains a display 24 which is shown in more detail in Figure 1B. The computer 24 is provided with the requisite hardware and software to interpret the data received by the lidar receiver 14 to produce the various outputs shown in Figure 1B. The displays shown in Figure 1B can then be interpreted by a human operator as well as being transmitted to other utilization devices.
The display 24 illustrated in Figure 1B contains various outputs based upon various physiological parameters.
These parameter include, but are not limited to, a subject's heartbeat, as shown by display 28, the subject's respiration rate, as shown by display 30 and the subject's body temperature, as shown by display 32. Display 34 illustrates an output created by automatically analyzing one or more of the aforementioned _g_ physiological parameters or other physical parameters. This output is produced by the appropriate software included in the computer 16 and is used to demonstrate visually whether the subject is under stress, as would be produced if the subject was not telling the truth.
Although not directly shown in Figure 1A, the computer 24 is also connected to, and controls, the lidar transmitter 12, allowing the transmitter 12 to be directed at various locations on the head and upper torso of the subject, as well as changing the frequency of the pulse based upon the type of parameter of interest. This control can be done manually, or would allow the lidar transmitter 12 to automatically scan the body of the subject as well as automatically change the frequency of the pulse.
The various parameters are analyzed based upon a change of distance from the transmitter and the subject's body as would be created from movement of the skin due to the subject's heart rate and respiration rate. Change in frequency of the received pulse from the transmitted pulse, as well as relative degree of scattering at the subject's skin surface would also be used to measure the various aforementioned parameters, as well as moisture on the subject's skin.
Figure lA illustrates a system in which a low-power, short-pulse, is directed at a subject multiple times a second, detecting changes in heart rate, breathing rate, perspiration rate and subject temperature. An eye-safe infrared lidar could be used as well as other pulses, such as lasers. The computer 16 displays these measurements in near-real-time to aid an interrogation in determining stress and thereby in assessing the truthfulness of the subject.
Figure 1B suggests how the display is advantageously made to present all the key data, both graphically and numerically, and with a multiparameter-integrated figure of merit as shown by display 34, as well. In some applications, most particularly, outside a direct-interrogation context, any of the parameters (but particularly the parameter shown in display 34) may be used to operate other utilization devices 26. These utilization devices may incorporate any of a very great variety _g_ of devices. These may include, but are not limited to, access controls for doors, vehicles, computers, financial information or money (e.g., ATM machines) and so on.
As will be seen, however, the frame rate may depend very strongly on which of the above-outlined types of lidar system is in use. As mentioned earlier, a scanning system is simpler in terms of hardware, but also much slower in terms of overall three-dimensional frame rate.
This kind of apparatus is able to acquire a great range of vital signs - including, but not limited to, sweating (and, if so, the contents of the sweat), body temperature, heart rate, breathing rate, shivering or eye-blinking rate, and other parameters appropriate to monitoring of probable truthfulness in a subject.
In most-highly-preferred forms, the invention uses an active camera system, very finely range-gated with a very short-pulsed laser. The range-gate return is used to locate the surface of the subject's skin relative to the apparatus.
For this purpose, it is desirable to range-gate to millimeters. This objective calls for operation in the range of a few picoseconds to one nanosecond.
With skin position established, remaining variations of the signal provide the other parameters mentioned above. For instance, the relative degree of scattering at the surface, and particularly its variation over time, serves as an instantaneous indicator of moisture (i.e., sweat); and if desired, some limited amount of biochemistry in that moisture can be determined through analysis of spectral lines in the return.
Monitoring of minute periodic skin-range fluctuations, generally at frequencies of very approximately one per second (but between roughly 0.3 and 2.5 Hz) - and found at, for instance, the subject's temples - yield the heart rate. Like movements at the upper chest, throat, or nostrils, but slower (e.g., at frequencies in the range of 0.01 to 0.3 Hz) signify the respiratory rate; and at the eyes, the rate of blinking.
Small cyclical positional fluctuations in other areas, or even in the same areas (but characterized by substantially higher frequencies, e.g., 5 to 50 Hz), can reveal even a very slight trembling. In some of these operations, it is necessary to carefully discriminate beats (in the interfering-frequency sense) of the physiological activity against the pulse frequency of the laser.
Hence, a preferred embodiment of the apparatus filters the positional information into various frequency ranges, and separately monitors the amplitude and exact frequency of the data in each range. These signal channels can be read out on a display at the time of data acquisition - e.g., during an interrogation, which enables the equipment operator to dynamically control the course of questioning, as is the state of the art in conventional polygraphy - or can be saved for later, or preferably both.
Automatically derived correlations among the several parameters, and their time derivatives - i.e., acceleration, deceleration, or degree of abruptness in these changes - can also be characterized (i.e., "concern", "anxiety", "panic") and displayed or recorded. These, if preferred, can be treated as only advisory to the operator, whose professional interpretation is generally accorded greater reliability.
Preferred embodiments of the present invention, however, are capable of a reasonable degree of objectivity in output readings and their interpretation - much more so than in conventional polygraphy, as will be understood from the overall presentation in this document. This is partly due to the superior ability of the invention to deal with the problems of false positives and negatives.
While most of the equipment operates in an active mode (i.e., by analysis of radiation reflected by the subject from a pulsed laser), operation in the infrared enables collection of passive data as well - particularly including the subject's body temperature, found from its own very slight thermal radiation.
An alternative (or confirming) measurement of temperature, however, can be found from very slight frequency changes in the laser return beam.
By analyzing such changes, the apparatus can deduce the speed of sound at the subject's near interior surface, using phonon-photon interactions; temperature in turn is then deduced from the determined speed of sound. Such operation is based upon reported work, but as a practical matter, this operation is simple: the return signal is monitored at frequencies very slightly offset from the main, laser frequency. Certain spectral lines close-in to the laser line are due to a vibrational mode of water molecules, which reveals the desired sound speed and thereby the temperature value.
Relative to many of the established uses of lidar (particularly monitoring of small objects within turbid media), the present application intrinsically enjoys an unusually favorable signal-to-noise ratio. Preferred embodiments therefore can be operated to extract accurate and useful bioparameters from a relatively loosely operating system.
If desired, this apparatus can be placed in a housing that has the general appearance of an ordinary video camera, or for that matter, a potted plant or anything else. The same housing, in fact, can also accommodate a conventional video camera - or, as preferred, the lidar device itself can be configured and operated to acquire substantially conventional appearing video images, as well as all the data discussed above.
To minimize subject awareness, the device can be operated in the infrared, with careful attention to eye-safety and sensitivity precautions. Satisfactory laser performance is now available at 1.04 to 1.07 microns, and for eye safety, the device is advantageously fitted with a conventional frequency doubler (e.g., from 1.07 um to 532 nm); the resulting light is then wavelength-tripled (the frequency is divided by three) to obtain eye-safe 1.5 ~m radiation. The invention also should be practiced with careful attention to invasion-of-privacy issues, generally as noted earlier.
The accompanying drawings show how preferred embodiments of the invention operate, and also illustrate several variants that are intended to emphasize the very great variety of alternative forms of both apparatus and method.
Figure 2 shall be understood to illustrate application of any one of several forms of lidar system in preferred embodiments of the present invention. These include the three previously discussed streak-tube lidar versions, and also certain alternatives that will be discussed below. The three streak-tube-based systems will be introduced first:
First, as understood to illustrate a scanning system, Figure 2 shows how it is possible to illuminate very shallow segments of the image - by a series of pulses a-g of the laser, directed in progressively shifted directions to scan over relevant parts of the subject's body 10 - particularly where skin is exposed. This shifting of direction is preferably provided by a scanning mirror or set of mirrors, suitable angular rotation being obtainable by any of a great variety of means (such as a spinning polygonal mirror); or by a translating device closely analogous to the translating system disclosed in the art.
In such a system, each pulse generates a two dimensional image as previously mentioned - that image plane passing through the transceiver position and being extended in one direction a-g of pulse propagation. As to the nearest image facet of the subject volume, each pulse generates essentially a single pixel row.
The successive pulses in the aggregate produce a three-dimensional image in which no remapping is needed - the interpretation of the image is far more natural, as seen in the cited work of Bowker et al - and the physical apparatus is somewhat simplified by absence of the fiber-optic remapper. To achieve adequately fast overall-frame rates (at least 10 Hz and preferably 200 Hz, as noted earlier) - for visualizing a subject's shivering, or blinking, or other relatively rapid bodily activity - the entire scanning operation must complete its cycle in a small fraction (1/200 to 1/10) of a second.
This leads to a high laser-pulse-rate requirement, for instance on the order of very roughly 10 kHz - which would enable a 160 Hz frame rate for a low-resolution 64-pixel-row frame.
Such rates are possible, but somewhat drive up the cost of the apparatus; and a 64x64 frame is relatively unsatisfactory in terms of studying the subject's features and behavior visually.
At current-day technology, however, a medium-high resolution system is not readily attainable in a pure scanning system. Laser pulse rates of about 80 kHz would be required for 100 Hz frame rate and a medium-high-resolution 800-pixel-row frame; as will be seen, these frame and resolution objectives can be achieved, but using a preferred embodiment that is a variant system described below.
In a pure scanning system, the transmitter and receiver are most preferably co-located. For purposes of such a system, Figure 2 shows them separated only for convenience or practicality of illustration.
Second, as understood to illustrate a remapper system, Figure 2 shows how each laser pulse incorporates an array of pixel rows a-g. Here, unlike the interpretation just presented, the entire subject is illuminated in each laser pulse.
The entire returning two-dimensional subject image is then remapped into a single line, and that line preferably scanned in a streak tube to develop a three-dimensional image which as mentioned earlier is scrambled. The remapping is readily unfolded, however, by simple computer operations.
A major advantage of this type of system is that the overall frame rate is the same as the laser pulse rate, rather than being slower by two to nearly three orders of magnitude.
In a pure remapper system, as in the scanning system, the transmitter and receiver are co-located - and Figure 2 is to be understood as illustrating such co-location.
This arrangement does have drawbacks. Image resolution is limited by the preestablished number of pixels in the fiber optic remapper, and arrays exceeding 64x64 pixels are progressively more costly or awkward - and the energy in the laser light is divided among the entire complement of pixels.
Thus, although high frame rates are feasible, a medium-resolution image is not readily available in a pure-remapping system.
Third, as understood to illustrate a bistatic system, Figure 2 shows how the transmitter and receiver are not co-located, but rather, separated by some sizable angle. As mentioned earlier, this kind of geometry produces a relatively more complicated image; but once again, the image can be reconstructed by a computer. A bistatic system can be operated either with a scanning transmitter and scanning receiver, or with a remapper, as preferred.
Hybrids of the scanning and remapping system are also possible and within the scope of the invention. As will now be understood, these different systems simply represent different ways of dividing up space and time for convenient and effective imaging.
Thus, for example, a remapper can be provided, but rather than remapping an entire image, the device can be formed to remap only some segment of intermediate shallowness. The laser pulse is angularly stepped or scanned, as in the case of the pure scanning system, but not as many steps are required.
Here computer reconstruction is required, but a smaller amount of data is handled per laser pulse. The number of pulses per full image frame, and the number of pixel rows in the remapper, are traded off against one another to optimize the overall system.
This hybrid system enables provision of an intermediate-resolution image at high pulse rates. For example, 800 pixel rows in 200 Hz frames would require 160 kHz laser pulses in a pure scanning systems - and would be mechanically impractical in a pure remapping system.
Such a frame-rate/resolution specification, however, is implemented straightforwardly with a hybrid. In one preferred embodiment, the remapper has 1100 pixel columns and two pixel rows (remapped to a single line of 2200 pixels total, which is just over half the pixel complement of a more-traditional 64x64 remapper), with the laser pulsing at only 200 to 400 Hz and the scan system stepping the beam by two pixels between pulses. This system has a very creditable near-photographic 1100x800-pixel image, and a frame rate in the range of 100 to 200 Hz.
As already mentioned, streak tubes are not the only suitable time-resolution systems for use with lidar imaging in the practice of the present invention. Other exemplary systems use instead, an array of small photomultiplier tubes (PMTS), or avalanche diodes, or a microchannel plate with a charge-coupled detector (CCD) array.
These are all amenable to independent time-gating of individual pixels, which is desirable in preferred embodiments of the invention. Also, they are all effective at eye-safe wavelengths, which present-day streak tubes do not handle optimally.
In such an array, either the individual PMTS, diodes or CCD elements are tiny or an additional optical-coupling stage is used to spread the return laser beam, and essentially match it to the dimensions of the detector array. The array itself may be, merely by way of example, 64x64 elements.
The distance to the subject is ideally under about 10 m, and depending upon the several variants and the other parameters discussed above this may lead to pixel resolution on the subject of, for example, about 3 mm. Depth resolution should approach 0.3 mm. Although in principle data can be cached for later manipulation, this would preclude real-time preliminary assessment by an operator; therefore each pulse preferably is returned, sensed and analyzed before, or substantially at the same time as, the next pulse.
The scattered pulses are spectrally dispersed as by a diffraction grating, so as to enable the simple spectrometry mentioned earlier; and also range-gated. This means that the distance to impingement of each pulse on the nearest part (for that pulse) of the subject's body surface is used to start the time-resolution processes of the receiver. More-complicated gating is possible - as for example, setting the gate for each pixel by the previous image for that pixel, respectively.
One way in which such processes can provide extremely fine time resolution is by a streak-tube sweep such as discussed in the documents mentioned earlier. Those documents explain how the time interval of return of each pulse is essentially mapped to position along one dimension (e. g., height) of a streak-tube screen, as illustrated in the drawings of the patent documents and therein-cited art incorporated by references.
Such mapping causes that dimension on the screen to represent distance from the lidar transceiver, or in other words depth into the subject's body, as shown and explained at length in those earlier documents. As also mentioned in certain of the cited art, time resolution can be obtained through use of extremely fast electronics, without resort to a streak tube.
Meanwhile a transverse direction (perpendicular to the scan-sequence direction) is preserved as a spatial image direction, so that in the scanning-lidar form of the invention the streak-tube screen represents a tomographic visual section partway through the patient's body. As a patient's skin and flesh are not opaque, but rather turbid media, the analyses made by the automatic equipment extend slightly into the patient's body - to depths that are readily determined by simple systematic measurement.
Thus, the graph in Figure 3A represents pulse return from the air and the immediate interior of the patient's body, for a relatively near-in region of the anatomy - e.g., a hand held just in front of the body, or the subject's nose or chin projecting forwardly of other parts of the body. Those in Figure 3B and C represent similar air and immediate-interior returns, but from progressively more-remote regions of the anatomy such as the throat.
Merely by way of example, in a scanning system, these three returns might happen to the obtained in correspondence with the pulses a, b and c of Figure 2, and therefore could represent different bodily features sighted at different vertical positions; or instead might instead happen to be sighted at different horizontal position (pixels) along a common vertical position (pixel row).
In any event, the interior regions (flesh behind skin, bone behind hair, etc.) depicted in the drawing, are not merely distinguishable positionally, but also have respectively different characteristics. These different characteristics interact differently with a subject's stress.
Therefore, they offer opportunities to normalize the readings, or to partially calibrate the apparatus on-the-fly, etc. - for further refinement of the resulting polygraphic data.
For instance, the laser-pulse reflectance of bone at a fixed, shallow depth within the body (e.g., at the forehead) is not likely to vary as a function of stress; therefore, in suitable subj ects ( i . a . , where a clear bone return is found) , the software can form ratios of the nearer-in, skin reflectance signals with the bone reflectance, thereby enabling stabilization of those net signal components which represent conditions at the skin.
Such stabilization or normalization is not strictly necessary, using a well-calibrated active system. It might, however, be employed in such a way as to enable a less-stable operation, or a less finely calibrated or adjusted apparatus, or a slower computational regime, or combinations of these relaxations of operating demands - and thereby to reduce the system cost or complexity.
The invention is readily practiced by straightforward modification of an existing laboratory lidar system for scanning.
Calibration for the various parameters of interest is also straightforwardly obtained from breadboarding of optically fast detectors to measure amplitude and frequency shift in the scattered signal from a representative subject.
A journeyman programmer should have no difficulty preparing simple data-acquisition control software to record the measurements. Analysis software is more extensive but well within the state of the art; it should plot and assess in near-real-time:
~ Changes in amplitude, vs. time, of the reflected signal to determine changes in perspiration -such information being displayed after derivation from processing and comparison of individual pulses as detailed in Figure 4A, but the time-series (Figure 5) or correlation (Figure 6) analysis as well;
~ Changes in carrier frequency - and subtended angle for the scattered signal, to establish small changes in body temperature - these variations too being developed from tracking of single pulses as in Figure 4A; and ~ Fast Fourier transform of ongoing multipulse measurements to extract breathing and heart rates (and preferably some other periodic parameters, of interest, as mentioned earlier) - as represented in Figure 4B.
As previously mentioned, and as illustrated here, the Figure 4 outputs are not limited to display, but are also readily thresholded and directed to drive utilization means. The mathematics of Fourier analysis, as well as the statistical methodologies of time series (Figure 5) or correlation (Figure 6), are now found commercially in software modules that can be plugged into the analysis software to be developed here.
Hence, these relatively sophisticated methods are available on an off-the-shelf basis for incorporation into practice of the present invention. As noted in Figure 6, a zero correlation (or if preferred a resting-correlation) value can be automatically developed from the same subject and applied to set thresholds for the thresholding operations mentioned earlier.
In a preferred embodiment, temperature resolution and update rate are 0.1 °C and 0.1 Hz respectively. Heart-rate resolution and update rate are roughly one beat/minute and 0.1 Hz respectively.
Although the principles of the invention should now be clear, any newly assembled prototype apparatus should be carefully validated by controlled tests on a series of subjects, and overall operation subjected to a carefully crafted, statistically valid blind test demonstration. In this regard, it must be borne in mind that - given reliable bioparameter data, whether obtained from the present invention or conventionally -polygraphy itself is not an exact science.
As mentioned earlier, some subjects inadvertently generate false positives, while others can deliberately generate false negatives or positives (or both) at will, degrading the reliability of all direct polygraphic systems and techniques.
Conventional polygraphy provides little or no way to look behind the measurements, to determine whether observed reading patterns are arising in large part only from a subject's intentional, voluntarily screening of normal bodily responses - or are instead what they actually appear to be.
The present invention, however, does provide a way to look behind the superficial or apparent characteristics of the readings. It thereby offers several lie-detection advantages over conventional systems - particularly in that:
(a) A subject's responses can be assessed when the subject does not know the invention is in use;
and furthermore;
(b) A subject's responses when the subject knows the invention is in use, can now be compared with responses when the subject does not know;
(c) Such comparisons thereby enable detection of an open or truthful subject's fear of the apparatus itself, and also to quantification of such a subject's unintended disruption of the polygraphic process;
(d) Such comparisons also enable detection of a guarded or deceptive subject's ability to intentionally, voluntarily generate false positives or negatives, and also to quantification of that ability; and finally (e) Such detection and quantification can lead in turn to some degree of cancellation of, or compensation for, the consequences of both (i) such unintended disruptions by a merely nervous subject, and (ii) such deceptive abilities on the part of a guarded subject.
In these several distinct ways, the present invention can make very definite advances in the ability to deal with the problem of false positives and negatives in conventional polygraphy. Nevertheless, for a very conservative test, operation of the invention can be compared with that of conventional polygraphy as distinguished from any absolute measure of truthfulness in a wary or skillful subject.
By adapting and developing current IR lidar and detection technology, and standard fast Fourier transform algorithms, it is possible to measure changes in a subject's breathing, perspiration, heartbeat, blinking, shivering and temperature several times a second without physical contact - and if desired, without alerting the subject, whether during detention or during structured interviews. This capability must be tempered with due regard for applicable privacy rights and other applicable civil rights of the subject.
It will be understood that the foregoing disclosure is intended to be merely exemplary, and not to limit the scope of the invention.
Claims
251. A system for non-invasively conducting polygraphic tests for determining the existence of stress on a human subject, comprising:
a transmitter provided at a distance from the human subject for producing a plurality of coherent radiation pulses directed at the human subject;
a receiver provided at a distance from the human subject for receiving reflected or scattered radiation pulses from the body or face of the human subject, said reflected radiation pulses including a measurable frequency shift between said coherent radiation pulses and said reflected radiation pulses, said measurable frequency shift and said scattered radiation pulses containing information relating to a plurality of physiological characteristic indicative of stress or the truthfulness of the human subject; and an information processing device in communication with said receiver for processing said measurable frequency shifts and said scattered radiation pulses.
2. The system in accordance with claim 1, further including a display device for displaying an output of said plurality of physiological characteristics.
3. The system in accordance with claim 2, wherein said plurality of physiological characteristics displayed by said display device includes at least one of the human subject's respiration rate, heart rate and temperature.
4. The system in accordance with claim 2, wherein said plurality of physiological characteristics includes the human subject's perspiration and said information processing device includes a spectral analyzation device for determining the existence of perspiration on the human subject's body.
5. The system in accordance with claim 2, wherein said information processing device utilizes said plurality of physiological characteristics to produce a single output displayed on said display device indicative of the truthfulness of the human subject.
14. The system in accordance with claim 1, wherein said transmitter produces a plurality of infrared pulses.
15. The system in accordance with claim 1, wherein said transmitter and said receiver are co-located.
16. A method for non-invasively conducting polygraphic tests for determining the existence of stress on a human subject, comprising the steps of:
producing a series of coherent radiation pulses from a transmitter;
directing said series of coherent radiation pulses toward a human subject provided at a distance from said transmitter;
receiving reflected or scattered radiation pulses from the human subject by a receiver provided at a distance from the human subject, said reflected radiation pulses including a measurable frequency shift between said coherent radiation pulses and said reflected radiation pulses; and analyzing said measurable frequency shift and scattered radiation pulses to determine various physiological characteristics of the human subject which are indicative of the stress of the human subject and the truthfulness of the human subject.
17. The method of claim 16, including the step of establishing the distance between the human subject and said transmitter and said receiver.
18. The method of claim 17, including the step of establishing said transmitter and said receiver at the same location.
19. The method in accordance with claim 17, including the step of interrogating the human subject with questions during said producing and said directing steps.
20. The method in accordance with claim 16, further including the step of visually displaying each of said various physiological characteristics developed by said analyzing step.
a transmitter provided at a distance from the human subject for producing a plurality of coherent radiation pulses directed at the human subject;
a receiver provided at a distance from the human subject for receiving reflected or scattered radiation pulses from the body or face of the human subject, said reflected radiation pulses including a measurable frequency shift between said coherent radiation pulses and said reflected radiation pulses, said measurable frequency shift and said scattered radiation pulses containing information relating to a plurality of physiological characteristic indicative of stress or the truthfulness of the human subject; and an information processing device in communication with said receiver for processing said measurable frequency shifts and said scattered radiation pulses.
2. The system in accordance with claim 1, further including a display device for displaying an output of said plurality of physiological characteristics.
3. The system in accordance with claim 2, wherein said plurality of physiological characteristics displayed by said display device includes at least one of the human subject's respiration rate, heart rate and temperature.
4. The system in accordance with claim 2, wherein said plurality of physiological characteristics includes the human subject's perspiration and said information processing device includes a spectral analyzation device for determining the existence of perspiration on the human subject's body.
5. The system in accordance with claim 2, wherein said information processing device utilizes said plurality of physiological characteristics to produce a single output displayed on said display device indicative of the truthfulness of the human subject.
14. The system in accordance with claim 1, wherein said transmitter produces a plurality of infrared pulses.
15. The system in accordance with claim 1, wherein said transmitter and said receiver are co-located.
16. A method for non-invasively conducting polygraphic tests for determining the existence of stress on a human subject, comprising the steps of:
producing a series of coherent radiation pulses from a transmitter;
directing said series of coherent radiation pulses toward a human subject provided at a distance from said transmitter;
receiving reflected or scattered radiation pulses from the human subject by a receiver provided at a distance from the human subject, said reflected radiation pulses including a measurable frequency shift between said coherent radiation pulses and said reflected radiation pulses; and analyzing said measurable frequency shift and scattered radiation pulses to determine various physiological characteristics of the human subject which are indicative of the stress of the human subject and the truthfulness of the human subject.
17. The method of claim 16, including the step of establishing the distance between the human subject and said transmitter and said receiver.
18. The method of claim 17, including the step of establishing said transmitter and said receiver at the same location.
19. The method in accordance with claim 17, including the step of interrogating the human subject with questions during said producing and said directing steps.
20. The method in accordance with claim 16, further including the step of visually displaying each of said various physiological characteristics developed by said analyzing step.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US34470301P | 2001-12-24 | 2001-12-24 | |
US60/344,703 | 2001-12-24 | ||
PCT/US2002/037622 WO2003057003A2 (en) | 2001-12-24 | 2002-12-20 | Non-invasive polygraph technology based on optical analysis |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2471372A1 true CA2471372A1 (en) | 2003-07-17 |
Family
ID=23351640
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002471372A Abandoned CA2471372A1 (en) | 2001-12-24 | 2002-12-20 | Non-invasive polygraph technology based on optical analysis |
Country Status (4)
Country | Link |
---|---|
AU (1) | AU2002367285A1 (en) |
CA (1) | CA2471372A1 (en) |
GB (1) | GB2404016B (en) |
WO (1) | WO2003057003A2 (en) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050054935A1 (en) * | 2003-09-08 | 2005-03-10 | Rice Robert R. | Hyper-spectral means and method for detection of stress and emotion |
JP5227023B2 (en) * | 2004-09-21 | 2013-07-03 | ディジタル シグナル コーポレイション | System and method for remotely monitoring physiological functions |
US8081670B2 (en) | 2006-02-14 | 2011-12-20 | Digital Signal Corporation | System and method for providing chirped electromagnetic radiation |
US20100113893A1 (en) * | 2006-10-12 | 2010-05-06 | Massachusetts Institute Of Technology | Method for measuring physiological stress |
US8812367B2 (en) | 2011-03-29 | 2014-08-19 | Toshiba Global Commerce Solutions Holdings Corporation | Adjustment of a security level of a transaction system based on a biometric characteristic of a customer |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US2944542A (en) * | 1955-10-03 | 1960-07-12 | Research Corp | Detecting and recording physiological changes accompanying emotion stresses |
US3230951A (en) * | 1962-06-01 | 1966-01-25 | Bulova Watch Co Inc | Method of examining the hemodynamic system of a human body |
US4085740A (en) * | 1966-03-28 | 1978-04-25 | Lockheed Corporation | Method for measuring physiological parameter |
US4289142A (en) * | 1978-11-24 | 1981-09-15 | Kearns Kenneth L | Physiological occurrence, such as apnea, monitor and X-ray triggering device |
US5792049A (en) * | 1996-01-17 | 1998-08-11 | Spectrx, Inc. | Spectroscopic system with disposable calibration device |
US5892575A (en) * | 1996-05-10 | 1999-04-06 | Massachusetts Institute Of Technology | Method and apparatus for imaging a scene using a light detector operating in non-linear geiger-mode |
-
2002
- 2002-12-20 WO PCT/US2002/037622 patent/WO2003057003A2/en not_active Application Discontinuation
- 2002-12-20 CA CA002471372A patent/CA2471372A1/en not_active Abandoned
- 2002-12-20 AU AU2002367285A patent/AU2002367285A1/en not_active Abandoned
- 2002-12-20 GB GB0414258A patent/GB2404016B/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
GB0414258D0 (en) | 2004-07-28 |
GB2404016A (en) | 2005-01-19 |
WO2003057003A3 (en) | 2003-10-16 |
WO2003057003B1 (en) | 2003-12-18 |
AU2002367285A1 (en) | 2003-07-24 |
AU2002367285A8 (en) | 2003-07-24 |
WO2003057003A2 (en) | 2003-07-17 |
GB2404016B (en) | 2005-07-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN101784227B (en) | Laser speckle imaging systems and methods | |
US7388971B2 (en) | Robust and low cost optical system for sensing stress, emotion and deception in human subjects | |
US7831061B1 (en) | Noninvasive polygraph technology based on optical analysis | |
EP2077753B1 (en) | Apparatus, probe and method for providing depth assessment in an anatomical structure | |
US6652458B2 (en) | ADHD detection by eye saccades | |
CN112423650B (en) | Performing transabdominal fetal oximetry using optical tomography | |
KR100900901B1 (en) | Personal identification method by subcutaneous bloodstream measurement and personal identification device | |
US20090082642A1 (en) | System and method for measurement of biological parameters of a subject | |
GB2429130A (en) | Imaging subcutaneous tissue | |
US20220039679A1 (en) | System and method for remote monitoring of biomedical parameters | |
US20150157224A1 (en) | System and Method for Remotely Identifying and Characterizing Life Physiological Signs | |
Paquit et al. | Combining near-infrared illuminants to optimize venous imaging | |
CA2471372A1 (en) | Non-invasive polygraph technology based on optical analysis | |
Wang et al. | Camera-based respiration monitoring: Motion and PPG-based measurement | |
US20120078114A1 (en) | System and method for real-time perfusion imaging | |
Bedoya-Echeverry et al. | Detection of lies by facial thermal imagery analysis | |
Xu et al. | Vertically polarized laser speckle contrast imaging to monitor blood flow in pulp | |
CN108121981A (en) | Finger print detection device | |
Sumriddetchkajorn et al. | Thermal analyzer enables improved lie detection in criminal-suspect interrogations | |
CN105769163B (en) | A kind of Bei Ershi facial paralysis state of an illness diagnostic method and device | |
CN113100823A (en) | Noninvasive cerebral blood flow detection system | |
Sumriddetchkajorn et al. | Simultaneous analysis of far infrared signals from periorbital and nostril areas for nonintrusive lie detection: Performance from real case study | |
US20240252045A1 (en) | Methods and systems for detecting deep tissue injuries | |
DE19838606A1 (en) | Method for non=invasive measurement of localised cerebral blood flow | |
US6577886B1 (en) | Living body function measurement method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
FZDE | Discontinued |