CA2290765C - Covert camera viewfinder or display having appearance of ordinary eyeglasses - Google Patents
Covert camera viewfinder or display having appearance of ordinary eyeglasses Download PDFInfo
- Publication number
- CA2290765C CA2290765C CA002290765A CA2290765A CA2290765C CA 2290765 C CA2290765 C CA 2290765C CA 002290765 A CA002290765 A CA 002290765A CA 2290765 A CA2290765 A CA 2290765A CA 2290765 C CA2290765 C CA 2290765C
- Authority
- CA
- Canada
- Prior art keywords
- display
- camera
- viewscreen
- eyeglasses
- beamsplitter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 239000000463 material Substances 0.000 claims description 12
- 230000000007 visual effect Effects 0.000 claims description 8
- 230000003068 static effect Effects 0.000 claims 2
- 239000000203 mixture Substances 0.000 abstract description 12
- 238000000034 method Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 abstract description 3
- 230000000750 progressive effect Effects 0.000 abstract description 2
- 239000011521 glass Substances 0.000 description 49
- 210000001508 eye Anatomy 0.000 description 40
- 210000001525 retina Anatomy 0.000 description 8
- 239000000428 dust Substances 0.000 description 5
- 230000004438 eyesight Effects 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 210000003128 head Anatomy 0.000 description 5
- 239000004033 plastic Substances 0.000 description 5
- 230000010287 polarization Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 241001270131 Agaricus moelleri Species 0.000 description 3
- 238000003491 array Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000003203 everyday effect Effects 0.000 description 3
- 229910052751 metal Inorganic materials 0.000 description 3
- 239000002184 metal Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 239000002245 particle Substances 0.000 description 3
- 230000008447 perception Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000011248 coating agent Substances 0.000 description 2
- 238000000576 coating method Methods 0.000 description 2
- 230000007812 deficiency Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 239000010437 gem Substances 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000003860 storage Methods 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 235000005156 Brassica carinata Nutrition 0.000 description 1
- 244000257790 Brassica carinata Species 0.000 description 1
- 239000004429 Calibre Substances 0.000 description 1
- 208000001613 Gambling Diseases 0.000 description 1
- 241000282412 Homo Species 0.000 description 1
- 206010047571 Visual impairment Diseases 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 230000009194 climbing Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000000887 face Anatomy 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 229910001751 gemstone Inorganic materials 0.000 description 1
- 210000004209 hair Anatomy 0.000 description 1
- 230000004886 head movement Effects 0.000 description 1
- 230000004409 healthy vision Effects 0.000 description 1
- 230000001771 impaired effect Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 238000010417 needlework Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000011017 operating method Methods 0.000 description 1
- 210000001328 optic nerve Anatomy 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000011514 reflex Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 229910052709 silver Inorganic materials 0.000 description 1
- 239000004332 silver Substances 0.000 description 1
- 238000005476 soldering Methods 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 229910001220 stainless steel Inorganic materials 0.000 description 1
- 239000010935 stainless steel Substances 0.000 description 1
- 230000002459 sustained effect Effects 0.000 description 1
- 238000011282 treatment Methods 0.000 description 1
- 230000016776 visual perception Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C7/00—Optical parts
- G02C7/02—Lenses; Lens systems ; Methods of designing lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C9/00—Attaching auxiliary optical parts
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B13/02—Viewfinders
- G03B13/04—Viewfinders of direct vision type, e.g. frame, sighting mark
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B29/00—Combinations of cameras, projectors or photographic printing apparatus with non-photographic non-optical apparatus, e.g. clocks or weapons; Cameras having the shape of other objects
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/22—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources
- G09G3/30—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels
- G09G3/32—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters using controlled light sources using electroluminescent panels semiconductive, e.g. using light-emitting diodes [LED]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Ophthalmology & Optometry (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Computer Hardware Design (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Indication In Cameras, And Counting Of Exposures (AREA)
- Studio Devices (AREA)
Abstract
A wearable viewfinder or display apparatus is described. The wearable viewfinder may be used by itself to give the wearer a feeling that the world is seen through a camera, or may be used with a wearable camera to actually take pictures. The wearable viewfinder is constructed so that it appears to others as ordinary eyeglasses. Some embodiments look just like ordinary unifocal eyeglasses, while others have the appearance of bifocal eyeglasses, trifocal eyeglasses, or progressive eyeglasses. Because of the wearer's ability to constantly see the world through the apparatus, the apparatus behaves as a true extension of the wearer's mind and body, giving rise to a new awareness of photographic composition at all times, whether shooting or simply imagining the process of shooting.
Description
Patent Application of Steve Mann for COVERT CAMERA VIEWFINDER OR DISPLAY HAVING
APPEARANCI~ OF ORDINARY BIFOCAL OR TRIFOCAL
EYEGLASSES
of which the following is a specification:
E'IELD OF THE INVENTION
The present invention pertains generally to a wearable apparatus that provides the wearer with an electronic display device, graticule, reticule, or crosshairs, similar to or suitable for a camera viewfinder screen, while at the same time appearing to others as ordinary bifocal eyeglasses.
BACKGROUND OF THE INVENTION
In photography (and in movie and video production), it is desirable to capture events in a natural manner with minimal intervention and disturbance. Current state-of-the-art photographic or video apparatus, even in its most simple "point and click" form, creates a visual disturbance to others and attracts considerable attention on account of the gesture of bringing the camera up to the eye. Even if the size of the camera could be reduced to the point of being negligible (e.g. no bigger than the eyecup of a typical camera viewfinder, for example), the very gesture of holding a device up to, or bringing a device up to the eye is unnatural and attracts considerable attention, especially in establishments such as gambling casinos or department stores where photography is often prohibited. Although there exist a variety of covert cameras such as a camera concealed beneath the jewel of a necktie clip, cameras concealed in baseball caps>, and cameras concealed in eyeglasses, these cameras tend to
APPEARANCI~ OF ORDINARY BIFOCAL OR TRIFOCAL
EYEGLASSES
of which the following is a specification:
E'IELD OF THE INVENTION
The present invention pertains generally to a wearable apparatus that provides the wearer with an electronic display device, graticule, reticule, or crosshairs, similar to or suitable for a camera viewfinder screen, while at the same time appearing to others as ordinary bifocal eyeglasses.
BACKGROUND OF THE INVENTION
In photography (and in movie and video production), it is desirable to capture events in a natural manner with minimal intervention and disturbance. Current state-of-the-art photographic or video apparatus, even in its most simple "point and click" form, creates a visual disturbance to others and attracts considerable attention on account of the gesture of bringing the camera up to the eye. Even if the size of the camera could be reduced to the point of being negligible (e.g. no bigger than the eyecup of a typical camera viewfinder, for example), the very gesture of holding a device up to, or bringing a device up to the eye is unnatural and attracts considerable attention, especially in establishments such as gambling casinos or department stores where photography is often prohibited. Although there exist a variety of covert cameras such as a camera concealed beneath the jewel of a necktie clip, cameras concealed in baseball caps>, and cameras concealed in eyeglasses, these cameras tend to
2 produce inferior images, not just because of the technical limitations imposed by their small size, but, more importantly because they lack a means of accurately determining which objects in the scene are within the field of view of the camera to aim the camera for obtaining a picture having good photographic or videographic composition.
Because of the lack of a. viewfinder, investigative video and photojournalism made with such cameras suffers from poor composition. Accordingly, such covert cameras are often fitted with very wide angle lenses so that the poor aim will not result in missing important subject matter. As a result of these wide angle lenses, details in the scene are typically much more poorly rendered than they would be if a normal or tele lens were used.
It is desired that a camera viewfinder provide a very clearly defined rectangular or oval shaped outline showing clearly what is included in the field of view of the camera and what is not. It is desired that the rectangular outline be in sharp focus along with the subject matter, even though the rectangular outline marking is typically much closer to the eye (s:ince it is located inside the camera) than the subject matter in the scene.
Alternatively, or in addition to this rectangular outline, it may be desired to have crosshairs, or a small ci~°cular outline, brackets, or the like, to indicate where the center of the camera's field of view is located. Brackets, or a small circular outline, may also indicate field of view of a special portion of the image, such as the portion over which automatic gain control (AGC) or automatic focus (AF) is determined.
Traditional camera viewfinders often include the ability to overlay virtual objects, such as camera shutter speed, or the like, on top of reality, as described in U.S.
Pat. No. 5664244 which describes a viewfinder with additional information display capability. In this case, it is desired that both the virtual objects that exist within the viewfinder and the real objects that exist beyond the viewfinder appear in sharp focus.
Open-air viewfinders are often used on extremely low cost cameras, as well as on
Because of the lack of a. viewfinder, investigative video and photojournalism made with such cameras suffers from poor composition. Accordingly, such covert cameras are often fitted with very wide angle lenses so that the poor aim will not result in missing important subject matter. As a result of these wide angle lenses, details in the scene are typically much more poorly rendered than they would be if a normal or tele lens were used.
It is desired that a camera viewfinder provide a very clearly defined rectangular or oval shaped outline showing clearly what is included in the field of view of the camera and what is not. It is desired that the rectangular outline be in sharp focus along with the subject matter, even though the rectangular outline marking is typically much closer to the eye (s:ince it is located inside the camera) than the subject matter in the scene.
Alternatively, or in addition to this rectangular outline, it may be desired to have crosshairs, or a small ci~°cular outline, brackets, or the like, to indicate where the center of the camera's field of view is located. Brackets, or a small circular outline, may also indicate field of view of a special portion of the image, such as the portion over which automatic gain control (AGC) or automatic focus (AF) is determined.
Traditional camera viewfinders often include the ability to overlay virtual objects, such as camera shutter speed, or the like, on top of reality, as described in U.S.
Pat. No. 5664244 which describes a viewfinder with additional information display capability. In this case, it is desired that both the virtual objects that exist within the viewfinder and the real objects that exist beyond the viewfinder appear in sharp focus.
Open-air viewfinders are often used on extremely low cost cameras, as well as on
3 some professional cameras for use at night when the light levels would be too low to tolerate any optical loss in the viewfinder. Examples of open-air viewfinders used on professional cameras, in addition to regular viewfinders, include those used on the Grafflex press cameras of the 1940s (which had three different kinds of viewfinders), as well as those used on some twin--lens reflex cameras. However, such open air viewfinders do not generally provide a sharply defined boundary. The rectangular boundary defined by such viewfinders is in poor focus, making it dif~lcult for the user of such a camera to determine the exact extent of coverage of the camera.
SUMMARY OF THE INVENTION
It is possible with this invention to provide a covert wearable viewfinder that may be used without a camer;~, of any kind, so that the wearer can simply imagine what it is like to be shooting, and can hone his or her compositional skills by having a reticle, graticule, crosshairs, or the like, in front of his or her vision at all times while wearing an embodiment of the invention.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view data, such as from the screen of a wearable computer (wearcomp) system but where the device appears to others to be simply a pair of ordinary bifocal eyeglasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view data, such as from the screen of a wearable computer (wearcomp) system but where the device appears to others to be simply a pair of ordinary reading glasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view electronically stored pictures but where the device appears to others to be simply a pair of ordinary bifocal eyeglasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view electronically stored pictures but where the device appears to others to be simply a pair of ordinary reading glasses.
SUMMARY OF THE INVENTION
It is possible with this invention to provide a covert wearable viewfinder that may be used without a camer;~, of any kind, so that the wearer can simply imagine what it is like to be shooting, and can hone his or her compositional skills by having a reticle, graticule, crosshairs, or the like, in front of his or her vision at all times while wearing an embodiment of the invention.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view data, such as from the screen of a wearable computer (wearcomp) system but where the device appears to others to be simply a pair of ordinary bifocal eyeglasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view data, such as from the screen of a wearable computer (wearcomp) system but where the device appears to others to be simply a pair of ordinary reading glasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view electronically stored pictures but where the device appears to others to be simply a pair of ordinary bifocal eyeglasses.
It is possible with this invention to provide a wearable eyeglass based device allowing the wearer to covertly view electronically stored pictures but where the device appears to others to be simply a pair of ordinary reading glasses.
4 It is possible with this invention to provide a method of covertly positioning a camera in which both hands may be left free, and in which the direction in which the camera is facing is clearly indicated to the wearer of the apparatus of the invention by means of some marking that appears as if it were superimposed on the real objects in the scene.
It is a further possible with this invention to provide a means of covertly exposing a film or acquiring a picoure electronically where the spatial extent (field of view) of the image may be ascertained without having to hold any device up to the eye.
What is described is a wearable camera and viewfinder for capturing video of exceptionally high compositional and artistic calibre. In addition to the fact that covert versions of the apparatus can be used to create investigative documentary videos having very good composition, for everyday usage the device need not neces-sarily be covert. In fact, it may be manufactured as a fashionable device that serves as both a visible crime deterrent, as well as a self-explanatory (through its overt obviousness) tool for documentary videomakers and photojournalists.
Another feature of thc~ invention is that the wearable camera ha,s a viewfinder such that the image may be presented in a natural manner suitable for long-term usage patterns.
There are several reasons why it might be desired to wear the camera over a sustained period of time:
1. There is the notion of a personal visual diary of sorts.
2. There is the idea of being always ready. By constantly recording into a circular buffer, a retroactive record function, such as a button that instructs the device to "begin recording from five minutes ago" may be useful in personal safety (crime reduction) as well a,s in ordinary everyday usage, such as capturing a baby's first steps o:n video. With the prior art in photography and video, we spend so much time preparing the camera and searching for film, batteries, etc., or at the very least;, just getting the camera out of its carrying case, that we often miss important moments like a baby's first steps, or a spontaneous facial expression during i;he opening of a gift.
3. There is the fact that the wearable camera system, after being worn for a long period of time, begins to behave as a true extension of the wearer's mind and body. As a result, the composition of video shot with the device is often impeccable withouv~ even the need for conscious thought or effort on the part of the user. Also, one can engage in other activities, and one is able to record the experience without the need to be encumbered by a camera, or even the need to remain aware, at a conscious level, of the camera's existence. This lack of the need for conscious thought or effort suggests a new genre of documentary video characterized by long-term psychophysical adaptation to the device. The result is a very natural first-person perspective documentary, whose artistic style is very much as if a recording could be made from a video tap of the optic nerve of the eye itself. Events that may be so recorded include involvement in activities such as horseback riding, climbing up a rope, or the like, that cannot normally be well recorded from a first-person perspective using cameras of the prior art.
Moreover, a very natural first-person perspective genre of video results. For example, while wearing an embodiment of the invention, it is possible to look through the eyepiece of a telescope or microscope and record this experience, including the approach toward the eyepiece. The experience is recorded, from the perspective of the participant.
4. A computational system, either built into the wearable camera, or worn on the body elsewhere and connected to the camera system, may be used to enhance images. This may be of v<~,lue to the visually impaired. The computer may also perform other casks such as object recognition. Because the device is worn constantly, it may also function as a photographic/videographic memory aid, e.g. to help in way-finding through the recall and display of previously captured imagery. For example, the wearable camera system may recognize the face of someone within the camera's field of view and superimpose the name of the person it recognized into the viewfinder. This is presented to the wearer in the form of a virtual name tag..
An important aspect of the proposed invention is the capability of the apparatus to mediate (augment, and to a limited extent diminish, or otherwise alter) the visual perception of reality.
The proposed camera viewfinder is related to the displays that are used in the field of Virtual Reality (VR) :in the sense that both are wearable. However, an important difference is that the proposed invention allows the wearer to continue to see the real world, while VR displays block out the ability to see the real world.
It is possible with this invention to provide a method of exposing a film or ac-quiring a picture electronically where the tonal characteristics of the picture may be ascertained without having to hold any device up to the eye.
It is possible with this invention to provide a method of exposing a film or acquiring a picture electronically where no apparent difference in body movement or gesture between when a picture is being taken and when no picture is being taken is detectable by others.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that only the user can see the display device, and so that the user can ascertain the composition of a picture or take a picture or video and transmit images) to one or more remote locations without the knowledge of others in the immediate environment.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that only the user can see the display device, as well as an optional additional display device that the user can show to others if and when the user desires to do so.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that both the user as well as others can see it, if the user should so desire.
It is possible with this invention to provide a means for a user to experience additional information overlaid on top of his or her visual field of view such that the information is relevant to the imagery being viewed.
It is possible with this invention to provide a means and apparatus for a user to capture a plurality of images of the same scene or objects, in a natural process of simply looking around, and then have these images combined together into a single image of increased spatial extent, spatial resolution, dynamic range, or tonal fidelity.
It is possible with this invention to provide a stereo viewfinder means in which there are two viewfinders, one concealed in each eyeglass lens of what appears to others to be ordinary bifocal eyel;lasses, or above each lens of what appears to others to be ordinary reading glasses.
The proposed invention facilitates a new form of visual art, in which the artist may capture, with relatively little effort, a visual experience as viewed from his or her own perspective. With some practice, it is possible to develop a very steady body posture and mode of movement that best produces video of the genre pertaining to this invention. Because the apparatus may be made lightweight and situated close to the head, there is not the protrusion associated with carrying a hand-held camera. Also because components of the apparatus of the invention are mounted very close to the head, in a manner that balances the weight distribution, the apparatus does not restrict the wearer's head movement or encumber the wearer appreciably.
Mounting close to the head minimizes the moment of inertia about the rotational axis of the neck, so that the head can be turned quickly while wearing the apparatus.
This arrangement allows one to easily record the experiences of ordinary day-to-day activities from a first-person perspective. Moreover, because both hands are free, much better balance and posture is possible while using the apparatus.
Anyone skilled in the arts of body movement control as is learned in the martial arts such as karate, as well as in dance, most notably ballet, will have little difficulty capturing exceptionally high quality video using the apparatus of this invention.
With known video or movie cameras, the best operators tend to be very large peo-ple who have trained for many years in the art of smooth control of the cumbersome video or motion picture :film cameras used. In addition to requiring a very large per-son to optimally operate such cameras, various stabilization devices are often used, which make the apparatus even more cumbersome. The apparatus of the invention may be optimally operated by people of any size. Even young children can become quite proficient in the use of the wearable camera system.
A typical embodiment of the invention comprises one or two spatial light modu-lators or other display means built into a pair of bifocal eyeglasses or reading glasses, together with one or more sensor arrays. Typically one or more CCD (charge coupled device) image sensor arrays and appropriate optical elements comprise the camera portion of the invention. In the bifocal embodiment of the invention, typically a beamsplitter or a mirror silvered on both sides is used to combine the image of the viewfinder with the apparent position of the camera, or to display the extent of cov-erage of the camera. The beamsplitter is typically imbedded into the eyeglass lens, and is made much wider than it needs to be, so that it appears to be a cut line in the eyeglass lens typical of bifocal eyeglasses. The viewfinder is simply a means of determining the extent of coverage of the camera in a natural manner, and may comprise either of:
~ A reticle, graticule, rectangle, or other marking that appears to float within a portion of the field of view.
~ A display device that shows a video image, or some other dynamic information perhaps related to the video image coming from the camera.
One aspect of the invention allows a photographer or videographer to wear the apparatus continuously .and they°efore always end up with the ability to produce a picture from something that was seen a couple of minutes ago. This may be useful to everyone in the sense that we may not want to miss a great photo opportunity, and often great photo opportunities only become known to us after we have had time to think about something we previously saw.
Such an apparatus might also be of use in personal safety. Although there are a growing number of video surveillance cameras installed in the environment allegedly for "public safety", there have been recent questions as to the true benefit of such centralized surveillance i:nfrastrucaures. Most notably there have been several exam-ples in which such centralized infrastructure has been abused by the owners of it (as in roundups, detainment. and execution of peaceful demonstrators). Moreover, "pub-lic safety" systems may :fail to protect individuals against crimes committed by the organizations that install'.ed the systems. The apparatus of this invention allows the storage and retrieval of images by transmitting and recording images at one or more remote locations. Images may be transmitted and recorded in different countries, so that they would be difficult to destroy, in the event that the perpetrator of a crime might wish to do so through the political machinery of a single country.
The apparatus of the invention allows images to be captured in a natural manner, without giving an unusual appearance to others (such as a potential assailant or human rights violator).
Accordingly, the present invention in one aspect comprises eyeglasses with an LED
imbedded inside the glass or plastic material from which the eyeglasses are made, and wires to connect the LEL> to the outside world. The LED is so close to the eye that one cannot focus on it, but it does provide a blurry circular disk with which the wearer can orient the glasses in a particular direction with respect to a particular object. Preferably there is also a small crosshairs scratched onto the inside surface of the eyeglass lens, so that thesE~ will appear sharp within the blurry circular disk, and will appear at all depths of focus, e.g. no matter what the wearer is looking at, the crosshairs will appear sharp <~,nd in focus, as if they formed an image with infinite field of view. The cros~~hairs will appear in the image of the wearer's eye lens, so that particles of dust or dirt in the eye will also be visible within the blurry circle of confusion of the LED. Such eyeglasses may be useful for their amusement value, e.g.
to give the wearer the feeling that he or she is shooting at something or aiming at something. Even without any form of camera in the eyeglasses, such eyeglasses could be marketed as a toy or personal amusement device, because of the unique appearance the wearer has, and the imagined sense of personal empowerment involved in sighting an "enemy" in the crosshairs etched onto the inside glass.
According to another aspect of the invention, there is provided a plurality of LEDs, with wires running inside the lens material. Preferably, either two LEDs are used to mark the left and right edges of a rectangular boundary, or four are used, one for each corner of the rectangular boundary.
According to another aspect of the invention, there is provided a wearable camera concealed in the eyeglasses, in which the above mentioned crosshairs are used to aim the camera.
According to another aspect of the invention, there is provided a similar wearable camera system in which the above rectangular boundary is used to aim the camera.
According to another aspect of the invention, there is provided a wearable cam era system in which four L-shaped corners are used to define the four corners of a rectangular boundary is 'used to aim the camera.
According to another aspect of the invention, there is provided an elongated beam-splitter imbedded within an eyeglass lens. The beamsplitter is made much longer than necessary, in order that it have the appearance of a normal cut line in a normal pair of flat top bifocal eyeglasses. Preferably this beamsplitter is oriented at a 45 degree angle, so that it can show the output of an electronic display that might, for example, be connected to the output of a wearable processor or wearable computer system that is processing images from a camera also concealed inside the eyeglass frames.
According to another aspect of the invention, there is provided eyeglasses in which a viewscreen in the eyeglasses provides an electronic viewfinder connected to the output of the camera also concealed in the eyeglass frames. Preferably this viewfinder allows the wearer to examine not just composition, but also exposure, contrast, and details of the image, as well as meta information such as that determined by an object recognition program that might, for example, recognize faces of people in the picture and remind the wearer who it is that the wearer wanted to photograph, or remind the wearer of people in the picture who are not satisfied with their picture portraits, or who need to be re-photographed in better lighting or the like, or the wearable face recognizer might recogni;~e people and construct a family tree in the viewfinder so for example, a wedding photographer could orient himself for best shot of the group by understanding and arranging individuals in a meaningful order.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described in more detail, by way of examples which in no way are meant to limit the scope of the invention, but, rather, these examples will serve to illustrate the invention with reference to the accompanying drawings, in which:
FIG. 1 illustrates the principle and components of typical flat-top bifocal eye-glasses.
FIG. 2 illustrates an older style of bifocal eyeglasses in which the cut line runs along the entire width of the lens.
FIG. 3 illustrates the concealment of an LED inside an eyeglass lens.
FIG. 4 illustrates how the concealed LED can be used to center the subject matter in the field of view of a camera also concealed within the eyeglasses.
FIG. 5 shows an embodiment of the invention in which there are two LEDs con-cealed within an eyeglass lens, so that the left and right edges of a rectangular bound-ary may be defined.
FIG. 5a shows a top view, while FIG. 5b shows an inside view and FIG. 5c shows the view seen by the wearer when the apparatus is in operation.
FIG. 6 shows an embodiment of the wearable viewfinder invention in which the viewfinder contains four LEDs concealed in what appears to others like an ordinary eyeglass lens of ordinary trifocal construction.
FIG. 6a shows the inside view, and FIG. 6b shows the view as seen by the wearer, when the device is in operation.
FIG. 7 shows an embodiment of the wearable camera invention where there is a beamsplitter concealed i:n an eyeglass lens such that it looks like the cut line across the top of a flat top bifocal eyeglass lens.
FIG. 8 shows an improvement of the wearable camera invention where there is a bifocal inset lens that magnifies the screen but not the objects seen through the glasses, and where there is also ambient light amplification so that the screen is backlit in proportion to the amount of light in the environment, but in such a way that it is more brightly lit than with passive ambient backlighting.
FIG. 9 shows an alternate embodiment of the wearable camera system where the display magnification is done through reflection rather than refraction, and where the camera and display do not function along collinear rays directly, but, instead, a WearComp (wearable computer) is used to correct for this noncollinearity.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
While the invention ;>hall now be described with reference to the preferred em-bodiments shown in the drawings, it should be understood that the intention is not to limit the invention only to the particular embodiments shown but rather to cover all alterations, modifications and equivalent arrangements possible within the scope of appended claims.
In all aspects of the present invention, references to "camera" mean any device or collection of devices capable of simultaneously determining a quantity of light arriving from a plurality of directions and or at a plurality of locations, or determining some other attribute of light .arriving from a plurality of directions and or at a plurality of locations. Similarly references to "viewscreen" shall not be limited to just minia-turized television monitors or computer monitors, but shall also include computer data display means, as well as fixed display means, where such fixed display means include crosshairs, graticules, reticles, brackets, etc., and other video display devices, still picture display devices, ASCII text display devices, terminals, and systems that directly scan light. onto the retina of the eye to form the perception of an image.
References to "processor", or "computer" shall include sequential instruction, par-allel instruction, and special purpose architectures such as digital signal processing hardware, Field Programmable Gate Arrays (FPGAs), programmable logic devices, as well as analog signal processing devices.
When it is said that object "A" is "borne" by object "B", this shall include the possibilities that A is attached to B, that A is part of B, that A is built into B, or that A is B.
FIG. 1 is a diagram depicting a pair of bifocal eyeglasses, and will serve to define the terminology pertaining to various parts of the bifocal eyeglasses, as this terminol-ogy will be used in this disclosure. Eyeglasses are normally held upon the head of the wearer by way of temple side pieces 110. These temple side pieces 110 support, by way of a hinge held on with rivets 120, a frame 130. Within frame 130 are two lenses 140. Lenses 140 contain inset lenses 150 which may have different prescriptions than lenses 140 in which they are set. There is typically a cut line 160 between lens 140 and lens 150.
Typically lens 140 will provide a prescription for distant objects while inset lens 150 will provide a prescription for nearby objects. Lens 150 is commonly used for reading. Accordingly, lens 140 may, in some cases, have infinite focal length (zero power) and simply serve <~,s a support for lens 150, which is typically a lens of positive focal length (e.g. a magnifying glass).
In some cases, lens 140 may be non existent, as in typical reading glasses, in which lens 150 is mounted directly to frame 130, and the wearer looks over frame 130 to see distant objects and looks through lens 150 to see nearby objects.
In many modern multifocal eyeglasses, there is no visible cut line 160, and instead there is a gradual transition from the prescription of lens 140 to that of lens 150. Such multifocal lenses are known as progressive. The purpose of such gradual transition is to accomodate a variety of distances, in situations where the wearer normally has an inability to focus over any appreciable range of distances, as well as for improved appearance. Since the need for rrmltifocal lenses shows a deficiency on the part of the user, there has been a trend toward hiding this deficiency, just as there has been a trend toward contact lenses and laser eye treatments to eliminate the need for eyewear altogether. However, amid the desire among some to hide the fact that they need bifocals or even just ordinary glasses, there are others who like to wear eyeglasses.
Even some people who do not need eyeglasses often wear so-called pseudo-intellectual glasses, which are glasses in which lens 140 has infinite focal length.
Moreover, bifocal eyeglasses and reading glasses are often associated with intellectuals, and thus there is a portion of society that would readily wear glasses having the general appearance of those depicted in FIG. 1, even if they did not require a prescription of any kind.
The eyeglass lenses 140 may also contain markings 170 made directly on the glass.
Such markings, for example, may be the manufacturer's name or an abbreviation (such as the letters "GA" engraved on the left lens of Giorgio Armani (trade-mark) glasses). For illustration in this disclosure, the markings "L" and "R" denote left and right lenses, as labeled from the perspective of the wearer. Such markings will help make it clearer which lens and which side of the lens is being shown.
FIG. 2 depicts the left lens of an older style of bifocal eyeglasses. The cut line extends all the way across. Older styles of bifocal eyeglasses such as that depicted in FIG. 2 are becoming popular among some individuals, so that a eyeglasses with lenses like those depicted in FIG. 2 would not look particularly out of place.
Lens 240 is suitable for looking at distant objects, while lens 250 is suitable for looking at near objects. Lens 240 rnay have infinite focal length (zero power) if the glasses are intended to be worn by a person who has normal vision (e.g. does not need corrective eyewear). Such a person may wear these glasses simply to facilitate in doing fine soldering, needlework, or the like, by virtue of lenses 250 which may simply serve the same purpose as ordinary magnifying glasses.
Alternatively, lenses 250 and 240 may both be of infinite focal length, and the cut line 260 therebetween may be simply for cosmetic purposes, e.g. to provide the wearer with the appearance of a traditional intellectual who might wear old-style bifocal eyeglasses.
Thus eyewear as depicted in li IG. 2 may be constructed to meet the prescription of one who requires bifoc;~,l glasses, or one who requires only ordinary unifocal glasses, or one who requires no glasses at all.
Accordingly, the eyewear as depicted in FIG. 2 may be constructed for nearly anyone, and may also be used as a basis in which to conceal additional apparatus.
FIG. 3 shows how an LED (light emitting diode) may be concealed within the lens material (such as glass or plastic) of an eyeglass lens 340. Lens 340 may comprise two separate prescriptions, one prescription, or no prescription at all, depending on the wearer's needs or lath thereof. A thin wire 310, preferably made of stainless steel or other material that is silver in colour, is imbedded on or within the lens material 340. Wire 310 carries electrical current to the anode terminal of an LED 320 also imbedded in the lens material. Wire 330 carries electrical current from the cathode terminal of the LED. (For purposes of this disclosure conventional current, in which electricity flows from plus to minus, is used rather than electron current in which electrons flow from minus to plus.) LEDs normally come in clear plastic housings, which are quite large (e.g. on the order of three millimeters in diameter). However, the internals of an LED
may be imbedded into the lens material 340, so that the lens material itself forms the protective housing around these internals. In this way, the LED 320 is too small to be easily seen by the unaided eye of someone who might be looking at the wearer's eyeglasses. Thus, so long as the LED 320 is not illuminated, it will remain essentially invisible to others.
A miniature shroud 321 is typically placed over LED 320 so that people other than the wearer of the glasses cannot easily see the light from LED 320. This shroud is typically made in an irregular shape, so that it has the appearance of a spec of dust or small particle of dirt. The side facing the wearer (and behind the LED from the wearer's perspective) is preferably black, while the side facing away from the wearer is preferably dust or dirt-coloured, and may comprise dirt or dust particles or other imperfections imbedded into the glass.
As an alternative to an LED, a scintillating fiber optic or other light source imbed-ded in the glass may be 'used.
Moreover, a cut line on the inside of the glass, such as crosshairs scratched into the glass, may be used to project this image directly onto the retina of the wearer, so that it is in focus for all focal distances of the wearer's own eye lens.
FIG. 4 depicts subject matter being captured using an embodiment of the in-vention. In this example, subject matter may, for example, comprise a department store manager or clerk who has i.Llegally chained his fire exits shut, but also (despite the use of video surveillance in his department store) has a store policy prohibiting photography by customers in the department store in order that his criminal activity is not documented.
An arbitrary point 410 on the subject matter of interest radiates light in all directions, and some of this light may be collected by a customer wearing eyeglasses in which a video camera has been concealed.
Light from 410 passes through the customer's eyeglasses, in particular, through a lens 340 of the customer's eyeglasses, and then through lens 420 of customer's eye 430. This light converges to a point 440 on the customer's retina. To the left of eye 430 is shown the image of the department store manager upon the customer's retina, and point 450 of this image corresponds to point 410 of the subject matter.
LED 320 is located in eyeglass lens 340 which is very close to the wearer's eye.
Humans with normal healthy vision can focus on objects that are between about inches (approximately l0cm) and infinity, away from the lens 420 in the eye 430.
Thus objects such as LED 320 which are closer than 4 inches must appear out of focus. LED 320 is so close to the eye, in fact, that it will appear extremely out of focus. The customer will not be able to see the LED in his eyeglasses, and in fact the customer will see a very large ci~°cular-shaped blob which is the out-of-focus image of the point source LED 320.
The circular disk that one sees from a point source of light that is out of focus is known as the circle of confusion.
Rays of light from LE;D 320 are denoted by dashed lines which eye lens 420 is too weak to focus, so that they spread out and strike the retina at 460, defining a circular disk of light 470. LED 320 is typically red or green, so that disk 470 appears as a large circle of red or green light.
The exact shape of this disk 470 is determined by the shape of the opening in the eye, and disk 470 will also show imperfections in the eye lens 420, such as dust on eye lens 420, or any irregularities in the eye iris of lens 420.
However, despite these irregularities, the circular blob 470 will indicate to the wearer the direction in which a video camera that has been hidden inside the eyeglass frames is pointing.
Thus the customer may make use of LED 320 imbedded in eyeglass lens 340 to orient his wearable camera in the direction of the subject matter, and to know that the subject matter is centered in the camera's field of view.
Moreover, the colour and state of the LED (e.g. whether the LED is flashing, and at what rate, and in. the case of a multicolour LED whether it is red or green or whichever other colours it may assume) may convey additional information to the wearer of the apparatus.
Typically LED 320 turns red to indicate that a recording device is active, or a transmitter is active. Typically the LED begins flashing when hard disk space on the recording device is almost full. 'The rate of flashing is typically used to indicate to the wearer how much disk space remains.
In order that light from the I,ED that might be reflected off the inside surface of the glass 340, or off the wearer's eye 430, is not seen by others (such as the depart-ment store manager or the like), LED 320 is automatically adjusted in brightness in accordance with ambient; light levels. Typically the camera is capable of measuring the quantity of light received, and also estimating the scene contrast, and from this information, provides a <;ontrol voltage to LED 320 so that it becomes bright when necessary (such as outdoors on a sunny day) and darker when it does not need to be so bright (such as in a dimly lit corridor or stairwell of a department store).
One drawback of the invention described in FIG. 4 is that the circular disk varies in size depending on the opening and closing of the iris of eye lens 420. Thus although it may be used. to center the subject matter in the viewfinder, it cannot easily be used as an indicator of the extent of coverage of the camera, as with a traditional viewfinder in which the user can see whether or not the subject matter is wholly contained within the field of view of the camera.
FIG. 5 therefore depicts an improved viewfinder in which two LEDs are concealed with wiring along the cut line of (or where the cut line would be in) a bifocal eyeglass lens 340. LEDs 520 and 521 may be of similar construction to LED 320 and may be similarly shrouded so that others facing the wearer do not readily see the light from LEDs 520 and 521.
Wire 510 carries electric current to LED 520, which is connected in series with LED 521 by wire 511, followed by wire 512 which completes the circuit. It is preferable that the LEDs be wired in series, so that a single current limiting resistor or drive circuit can drive both of them at equal brightness. (Wiring LEDs in parallel is known to provide unreliable and sometimes unpredictable results.) FIG. 5a is a top view of FI(~. 5, looking at the eyeglass lens 340 on edge.
The surface of the glass 340 that faces away from the wearer is designated 341, while that facing toward the wearer is designated as 342. LEDs 520 and 521 are imbedded inside the glass but located near surface 341. On the other surface 342 are scratch marks 550 and 551 which are c:onstruct;ed to look like part of the optical cut lines around normal bifocal insets.
These cut lines are made in a,n inside-out bracket shape.
FIG. 5b is an inside view of F'IG. 5, looking at the eyeglass lens from the wearer's side.
FIG. 5c is an inside view of FIG. 5, looking at the eyeglass lens from the wearer's side, but showing how it appears when the LEDs 520 and 521 are turned on, and the glass is too close to a wearer's eye to focus on. Instead, light from LED 520 projects an image of scratch marls 550 dig°ectly onto the retina of the wearer's eye. Since the image of scratch mark 550 is not inverted (e.g. since it is projected directly onto the retina), it will appear to the wearer as if it is inverted. This is because upright objects are normally presented inverted (upside down) on the retina, and this is what we are used to. (See for example, George M. Stratton's 1896 article in the journal "Psychological Review" , entitled "Some Preliminary Experiments on Vision" . ) It is for this reason that the two halves of the brackets are each backwards.
What the wearer sees is inward-facing brackets as shown in FIG 5c. These are seen as dark lines within. the circles of confusion 570 and 571. Circles of confusion 570 and 571 arise from LEDs 520 and 521 respectively, since each is a point source that is too close to the eye for the eye lens to focus on.
Brackets 550 and 551 are sufficient to indicate to the wearer what subject matter will be within the camera's field of view and what will not. Most notably, brackets 550 and 551 are made to match exactly the horizontal field of view of the camera, and some fraction of the vertical field of coverage of the camera. Typically this fraction of vertical coverage is 1/3, so that t;he wearer can easily imagine a grid 580 where there are 12 squares of size equal to that defined by each bracket. Grid 580 is shown as a dashed line because the wearer does not in fact see grid 580 but merely imagines it, given the visual cues 550 and 551.
Moroever, since braclcets 550 and 551 define the central 1/3 horizontal strip along what will be the final picture, the wearer can concentrate on this portion of the frame, and compose a picture using the well-known "rule of thirds" in which it is suggested that the most artistically pleasing images usually result by placing important subject matter on a 1/3 boundary.
Thus the viewfinder of FIG 5 provides the wearer with a practical wearable camera system in which there is an awareness of picture composition.
FIG. 6 shows an embodiment of the wearable camera system in which the viewfinder means is concealed in eyeglass lens 340 configured to appear as if it were an ordinary trifocal eyeglass lens.
The same series configuration of LEDs as that depicted in FIG 5 is used, but a second row higher up, in which wire 610 carries electricity to the anode terminal of LED 620 which is connected in series with LED 621 by way of wire 611, and in which wire 612 completes the circuit.
Each pair of LEDs ha:. its own current limiting resistor or the like which is typically mounted in the eyeglass frames so that a single set of wires concealed within the frames can power the LEDs. These wires are typically connected to a waist-worn power supply and the wiring from the glasses to the power supply is typically concealed within an eyeglass safety strap. A satisfactory eyeglass safety strap for concealment of wiring is one sold under the trade name "Croakies" .
FIG. 6a shows the inside surface 342 of lens 340 after it has been marked for use with the four LEDs depicted in F'IG 6. Four "L"-shaped scratches or similar marks are made on the inside surface 342 of eyeglass lens 340. L 650 will be seen in the upper left hand corner, L 651 will be seen in the upper right corner, L 652 will be seen in the lower left coy°ner, and L 653 will be seen in the lower right corner of the camera's field of view.
FIG. 6b shows the inside surface 342 of lens 340 after it has been marked for use with the four LEDs depicted in FIG 6, and when it is placed too close to the eye to focus on, and when further, all four LEDs are turned on.
Although each L appears in its proper place (e.g. the upper left L appears to the wearer to be situated at the upper left corner of the frame), each of them is inverted within its corresponding circle of confusion. LED 620 defines a circle of confusion 670. LED 621 defines a circle of confusion 671. LED 520 defines a circle of confusion 672. LED 521 defines a <:ircle of confusion 673.
Note that it is acceptable if these circles of confusion overlap. For example may overlap with 672, as may circle of confusion 671 overlap with 673.
However, so long as the overlap does not extend into the "L"-shaped marking the apparatus will work fine. For example, as long as circle of confusion 670 does not extend into L 652, then L 652 will continue to be clearly defined. (Otherwise, L 652 will be seen as a double image. ) With the embodiments depicted so far, the camera is typically concealed in the nosebridge of the eyeglasses, or behind one or both of the fasteners 120. In stereo systems (e.g. where there are two cameras) one camera is concealed behind fastener 120 on each side, and the camera extends back into the temple side piece, with the wire extending back down a hollow eyeglass safety strap.
In stereo embodiments of the invention, the lenses are typically made to look like decorative jewels typically found on eyeglasses, where fastener 120 is located.
Alternatively, a thin metal plated plastic where the metal coating is thin enough to see through, is placed over each lens, and is made to have the appearance of a fastener 120.
In some embodiments, a narrow angle camera (also called tele camera) is mounted behind each of the fasteners 120, and a wide angle camera (also called simply wide camera) is also concealed within the nose bridge of the eyeglass frames 130.
However, the difference in location between these cameras and the eye location where the viewfinders are located, introduces some error in the viewfinder and camera alignment at close distance. For example, if the wearer wishes to look into an eyepiece of a telescope or microscope, the camera will not likely see into the eyepiece, and the glasses will therefore have failed to record this experience as the wearer had actually experienced it (e.g. video recorded from the apparatus will fail to show the view through the telescope or microscope).
Accordingly, an improvement to the invention may be made by making the camera collect rays of light that are collinear with the rays of light entering the eye from the viewfinder.
FIG. 7 shows both front and side views of an eyeglass lens 140 in which such an improved design has been implemented. The inset bifocal lens 750 is constructed such that it extends all the way through the glass 140 and so that the cut line 760 on the outside of the glass is at a much different height than the cut line 761 on the inside of the glass. Cut lines i'60 and 761 in fact define a flat surface that extends from inside to outside surfaces of the glass, and is angled at a 45 degree angle.
This surface is typically coated with a thin coating of a reflective material such as metal, or the like, so that it is partially transparent and partially reflective. This surface acts as a beamsplitter to reflect some light that enters the glasses along the cut line, and to reflect some of this light down through lens 720 into CCD sensor array 710. At the top of the eyeglass lens 140 there is a graticule, reticle, crosshairs, cropping "L" pattern, brackets, or spatial light modulator 770. Whether 770 is a fixed pattern such as a graticle, reticle, crosshairs, cropping "L" pattern, or brackets, or a moving pattern defined by an electronic display rrledium such as a spatial light modulator, 770 will be hereafter referred to as a "viewscreen" . Viewscreen 770 may display a combination of fixed and variable information, such as an electronic image from camera sensor array 710 together with a grid and other markings and annotations such as shutter speed, light levels, or the like.
Viewscreen 770 may also display meta information derived from the image formed on sensor array 710. This meta information may, for example, include a virtual name tag superimposed on a person's body, and derived from a wearable face recognizes system attached to the output of sensor array 710. In this manner, the wearable camera system may assist the wearer in recognizing people who the wearer might wish to photograph.
When sensor array 710 is connected to viewscreen 770, sensor array 710 may incor-porate a polarizes and so may viewscreen 770, so as to prevent video feedback.
Video feedback may be prevented by making the surface between cut lines 760 and 761 into a beamsplitter with appropriate polarization characteristics, or by placing polarizers on one or both of array 710 and viewscreen 770 or a combination of both.
Beamsplitters that are imbedded in glass and have polarization characteristics are well known, and are referred to as dichroic beamsplitters, and as polarizing cube beamsplitters, when the polarization characteristics are deliberately optimized.
Viewscreen 770 is typically mounted on the top of the eyeglass lens, so that a small opening in the frames 130 allows light from natural sources like the sun 780, or artificial electric lighting typically found in indoor settings, to enter.
Typical bifocal eyeglass inset lenses 150 are mounted on the outside surface of eyeglass lens 140, but there is no reason why they could not be mounted instead on the inside surface. Accordingly, 790 depicts a bifocal inset lens mounted on the inside surface of lens 140. This lens is like a very powerful reading glass, that allows the wearer to see viewscreen 770 in sharp focus, and to read any text that might be displayed on viewscreen 770 in addition to picture compositional aids displayed thereon.
Three major drawbacks of the embodiment depicted in FIG. 7 are that objects beyond lens 790 appear out of focus, it relies on a bright light source 780 directly over the glasses, and the path between the camera lens 720 and the sensor array 710 is open so that the image is washed out by light leaking in.
FIG. 8 shows a side view of an alternative embodiment of the invention in which lens 790 is replaced with. simply having an inward curving portion of the eyeglasses defined between 810 and. 790. In the same way that sunglass lenses may be curved without providing any magnification or other prescription, this curvature between 790 and 810 provides no magnification of objects seen through the glasses.
However, light from viewscreen 770 passes within the glass 140 and therefore is not affected by curvature 810. Thus a magnified well focused view of viewscreen 770 is seen.
Camera lens 720 is now located at the edge of eyeglass lens 140, so that the path between camera lens 720 and sensor array 710 is now wholly contained inside eyeglasses frame 130. Eyeglass frame 130 is typically made of black plastic so that it forms a good housing for the one or more cameras contained therein.
The output of sensor array 710 goes into WearComp ( "wearable computer" ) 830, where it is digitized and analyzed in terms of brightness, contrast, etc..
The WearComp has a display output, typically in the form of a VGA signal 840, which is connected to viewscreen 770. Viewscreen 770 is typically a spatial light modulator. Preferably viewscreen 770 is a full color high resolution VGA
screen, but the spatial light modulator from a display known by the trade name "Cyberdisplay"
or "Smart Slide", manufactured by Kopin Corporation, is a satisfactory viewscreen 770. This item produces polarized light, owing to the fact that it is a liquid crystal between crossed polarizers. The desired polarization is selected by choosing which side of viewscreen 770 will face downwards. While viewing through lens 790, one can try both orientations, and select the one with greatest brightness. If the beamsplitter defined by cut lines 760 and 761 does not provide sufficient polarization to prevent video feedback, and additional polarizer is used on sensor array 710.
The WearComp 830 will typically display the digitized video from sensor 710 along with annotation, such as a menu of commands for the wearable camera system.
WearComp 830 may also do additional processing, such as face recognition, and other forms of photographic/vi.deographic memory aids, so that the unit will function as a visual memory prosthetic (VMP;I as defined in http://wearcam.org/vmp.htm In the embodiment pictured here in FIG 8, an external backlight 870 is used to backlight viewscreen 770, so that it can be seen clearly and brightly.
However, this backlight is controlled by an amplifier drive circuit 880 which amplifies the ambient light sensor 890.
Light sensor 890 determines how bright the environment is, and drives the back-light 870 appropriately. In this way, the display appears bright in bright sunny conditions, and dark when indoors in low light. Thus, for example, when walking down a dark street late a,t night, a potential assailant is unlikely to see the backscat-tered light from the apparatus because light sensor 890 has controlled backlight 870 in such a manner that there is just sufficient light to see the viewscreen 770 in this dark setting.
Additionally, the estimated ambient light quantity reported by light sensor may be overridden or replaced by a light control signal 850 from WearComp 830, which is calculated by analyzing the input 820 from the sensor array 710. In this way, the quantity of light entering the eye from viewscreen 770 can be precisely controlled in nearly exact correspondence with the actual quantity of light entering the eye from the scene itself. Thus noi; only are rays of light from the scene collinear with rays of light from corresponding points in viewscreen 770, but they are also in tonal register.
Recording is typically retroactive, in the sense that the wearable camera system, by default, typically records into <~, 5-minute circular buffer, so that pressing "record"
begins recording starting from 5 minutes ago, e.g. starting from 5 minutes before "record" is pressed. This means that if the wearer presses "record" within a couple of minutes of, for example, witnessing a police brutality or human rights violation, the event will have been sucessfully recorded.
Typically the recording is also transmitted by way of a wireless Internet connection to wearcomp 830, so that. corrupt officials such as a corrupt department store security guards who might be a close personal friends of the manager who might, for example have the fire exits illegally chained shut, cannot seize and destroy the storage medium upon which the recording was made.
FIG. 9 shows an alternate embodiment of the wearable camera system in which the collinearity error is corrected computationally. Such a wearable camera system is suit-able for augmented reality and mediated reality (as described http://wearcam.org/mr.htm), as well as for more traditional forms of photography and videography. A camera 910, concealed within the nosebridge of the eyeglass frames 130, or a pair of cameras 910 concealed within the temple side pieces 110 of eyeglass frames 130, is connected to a vision processor 931 within a WearComp 830. The WearComp is typically worn around the waist, in a shirt pocket, or comprises components spread throughout an undershirt, as described :in http://wearcam.org/procieee.html The output of vision processor 931 is a scene description, which is supplied to a coordinate transformer 932. The coordinate transformer maps from camera coordi-nates of camera 910, or camera pair 910 to eye coordinates. These eye coordinates are passed on to a graphics rendering system 933, and rendered in eye coordinates, onto viewscreen 770.
A complete machine vision analysis of the scene, followed by a complete graphics rendering of the entire scene is typically too formidable a task for a small battery powered wearcomp 830.
Accordingly, in typical use of the invention, only a small fraction of the scene details are rendered. For example, in the wearable face recognizes, only a virtual name tag is rendered. Because of the coordinate transformer, this name tag appears to the wearer as if it were attached to the subject, even though there is a discrepancy between camera location 910 and the eyeball location of the wearer. In the stereo version, two views are rendered, one for each eye, so that the name tag appears to hover in the same depth plane as the subject matter.
Light from viewscreen 770 is projected down through the glass to beamsplitter 960.
Some will pass through beamsplitter 960, and unfortunately some will be reflected outward where people might be able to see it. Because of the desire that the apparatus be covert, beamsplitter 960 must be a polarizing beamsplitter and the viewscreen 770 must be polarizing, and oriented appropriately, to minimize light reflecting off the beamsplitter 960.
A curved concave mirrorlike surface 961 reflects some light back up to the beam-splitter 960 and into the eye, while providing magnification as concave mirrorlike surfaces do. This mirrorlike surface is disguised as part of a bulge 950 in the eyeglass lens. This bulge may be the actual prescription of the wearer, or may be simply a magnifying region useful to anyone who does not normally wear glasses but wishes to be able to do fine work. Alternatively, the bulge may be made so that it does not provide magnification, but simply looks like the inset lens of bifocal eyeglasses.
Mirrors 960 and 961 are partially silvered, and imbedded in the glass in such a way as to appear as cut lines for inset bifocal lens 950. Although mirrors 960 and only need to be about as wide as they are deep, they may be extended across much further than necessary, so that they will look like normal bifocal cut lines.
The apparatus of this invention allows the wearer to experience the camera over a long period of time. F'or example, after wearing the apparatus sixteen hours per day for several weeks, it; begins to function as a true extension of the mind and body. In this way, photoi;raphic composition is much more optimal, because the act of taking pictures or shooting video no longer requires conscious thought or effort.
Moreover, the intentionality of the picture-taking process is not evident to others, because picture-taking is not proceeded by a gesture such as holding a viewfinder object up to the eye. The wearable viewfinder is an important element of the wearable camera invention allowing the wearer to experience everyday life through a screen, and therefore be always ready to capture anything that might happen, or even anything that might have happened previously by virtue of a retroactive record capability of the invention. Moreover, additional information beyond just exposure and shutter speed may be displayed in the camera viewfinder. For example, the camera allows the wearer to augment, partially diminish, or otherwise partially alter his or her perception of visual reality. This mediated-reality experience may be shared. The wearer may allow others to partially alter :his or her perception of reality. In this way the invention is useful as a new communications medium, in the context of collaborative photography, collaborative videography, and telepresence. Moreover, the invention may perform other useful tasks such a;~ functioning as a personal safety device and crime deterrent by virtue of its ability to maintain a video diary transmitted and recorded at multiple remote locations. As a tool for photojournalists and reporters, the invention has clear advantages over other competing technologies.
From the foregoing description, it will thus be evident that the present invention provides a design for a wearable camera with a viewfinder. As various changes can be made in the above embodiments and operating methods without departing from the spirit or scope of the invention, it is intended that all matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense.
Variations or modifications to the design and construction of this invention, within the scope of the invention, may occur to those skilled in the art upon reviewing the disclosure herein. Such variations or modifications, if within the spirit of this invention, are intended to be encompassed within the scope of any claims to patent protection issuing upon this invention.
It is a further possible with this invention to provide a means of covertly exposing a film or acquiring a picoure electronically where the spatial extent (field of view) of the image may be ascertained without having to hold any device up to the eye.
What is described is a wearable camera and viewfinder for capturing video of exceptionally high compositional and artistic calibre. In addition to the fact that covert versions of the apparatus can be used to create investigative documentary videos having very good composition, for everyday usage the device need not neces-sarily be covert. In fact, it may be manufactured as a fashionable device that serves as both a visible crime deterrent, as well as a self-explanatory (through its overt obviousness) tool for documentary videomakers and photojournalists.
Another feature of thc~ invention is that the wearable camera ha,s a viewfinder such that the image may be presented in a natural manner suitable for long-term usage patterns.
There are several reasons why it might be desired to wear the camera over a sustained period of time:
1. There is the notion of a personal visual diary of sorts.
2. There is the idea of being always ready. By constantly recording into a circular buffer, a retroactive record function, such as a button that instructs the device to "begin recording from five minutes ago" may be useful in personal safety (crime reduction) as well a,s in ordinary everyday usage, such as capturing a baby's first steps o:n video. With the prior art in photography and video, we spend so much time preparing the camera and searching for film, batteries, etc., or at the very least;, just getting the camera out of its carrying case, that we often miss important moments like a baby's first steps, or a spontaneous facial expression during i;he opening of a gift.
3. There is the fact that the wearable camera system, after being worn for a long period of time, begins to behave as a true extension of the wearer's mind and body. As a result, the composition of video shot with the device is often impeccable withouv~ even the need for conscious thought or effort on the part of the user. Also, one can engage in other activities, and one is able to record the experience without the need to be encumbered by a camera, or even the need to remain aware, at a conscious level, of the camera's existence. This lack of the need for conscious thought or effort suggests a new genre of documentary video characterized by long-term psychophysical adaptation to the device. The result is a very natural first-person perspective documentary, whose artistic style is very much as if a recording could be made from a video tap of the optic nerve of the eye itself. Events that may be so recorded include involvement in activities such as horseback riding, climbing up a rope, or the like, that cannot normally be well recorded from a first-person perspective using cameras of the prior art.
Moreover, a very natural first-person perspective genre of video results. For example, while wearing an embodiment of the invention, it is possible to look through the eyepiece of a telescope or microscope and record this experience, including the approach toward the eyepiece. The experience is recorded, from the perspective of the participant.
4. A computational system, either built into the wearable camera, or worn on the body elsewhere and connected to the camera system, may be used to enhance images. This may be of v<~,lue to the visually impaired. The computer may also perform other casks such as object recognition. Because the device is worn constantly, it may also function as a photographic/videographic memory aid, e.g. to help in way-finding through the recall and display of previously captured imagery. For example, the wearable camera system may recognize the face of someone within the camera's field of view and superimpose the name of the person it recognized into the viewfinder. This is presented to the wearer in the form of a virtual name tag..
An important aspect of the proposed invention is the capability of the apparatus to mediate (augment, and to a limited extent diminish, or otherwise alter) the visual perception of reality.
The proposed camera viewfinder is related to the displays that are used in the field of Virtual Reality (VR) :in the sense that both are wearable. However, an important difference is that the proposed invention allows the wearer to continue to see the real world, while VR displays block out the ability to see the real world.
It is possible with this invention to provide a method of exposing a film or ac-quiring a picture electronically where the tonal characteristics of the picture may be ascertained without having to hold any device up to the eye.
It is possible with this invention to provide a method of exposing a film or acquiring a picture electronically where no apparent difference in body movement or gesture between when a picture is being taken and when no picture is being taken is detectable by others.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that only the user can see the display device, and so that the user can ascertain the composition of a picture or take a picture or video and transmit images) to one or more remote locations without the knowledge of others in the immediate environment.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that only the user can see the display device, as well as an optional additional display device that the user can show to others if and when the user desires to do so.
It is possible with this invention to provide the user with a means of determining the composition of the picture from a display device that is located such that both the user as well as others can see it, if the user should so desire.
It is possible with this invention to provide a means for a user to experience additional information overlaid on top of his or her visual field of view such that the information is relevant to the imagery being viewed.
It is possible with this invention to provide a means and apparatus for a user to capture a plurality of images of the same scene or objects, in a natural process of simply looking around, and then have these images combined together into a single image of increased spatial extent, spatial resolution, dynamic range, or tonal fidelity.
It is possible with this invention to provide a stereo viewfinder means in which there are two viewfinders, one concealed in each eyeglass lens of what appears to others to be ordinary bifocal eyel;lasses, or above each lens of what appears to others to be ordinary reading glasses.
The proposed invention facilitates a new form of visual art, in which the artist may capture, with relatively little effort, a visual experience as viewed from his or her own perspective. With some practice, it is possible to develop a very steady body posture and mode of movement that best produces video of the genre pertaining to this invention. Because the apparatus may be made lightweight and situated close to the head, there is not the protrusion associated with carrying a hand-held camera. Also because components of the apparatus of the invention are mounted very close to the head, in a manner that balances the weight distribution, the apparatus does not restrict the wearer's head movement or encumber the wearer appreciably.
Mounting close to the head minimizes the moment of inertia about the rotational axis of the neck, so that the head can be turned quickly while wearing the apparatus.
This arrangement allows one to easily record the experiences of ordinary day-to-day activities from a first-person perspective. Moreover, because both hands are free, much better balance and posture is possible while using the apparatus.
Anyone skilled in the arts of body movement control as is learned in the martial arts such as karate, as well as in dance, most notably ballet, will have little difficulty capturing exceptionally high quality video using the apparatus of this invention.
With known video or movie cameras, the best operators tend to be very large peo-ple who have trained for many years in the art of smooth control of the cumbersome video or motion picture :film cameras used. In addition to requiring a very large per-son to optimally operate such cameras, various stabilization devices are often used, which make the apparatus even more cumbersome. The apparatus of the invention may be optimally operated by people of any size. Even young children can become quite proficient in the use of the wearable camera system.
A typical embodiment of the invention comprises one or two spatial light modu-lators or other display means built into a pair of bifocal eyeglasses or reading glasses, together with one or more sensor arrays. Typically one or more CCD (charge coupled device) image sensor arrays and appropriate optical elements comprise the camera portion of the invention. In the bifocal embodiment of the invention, typically a beamsplitter or a mirror silvered on both sides is used to combine the image of the viewfinder with the apparent position of the camera, or to display the extent of cov-erage of the camera. The beamsplitter is typically imbedded into the eyeglass lens, and is made much wider than it needs to be, so that it appears to be a cut line in the eyeglass lens typical of bifocal eyeglasses. The viewfinder is simply a means of determining the extent of coverage of the camera in a natural manner, and may comprise either of:
~ A reticle, graticule, rectangle, or other marking that appears to float within a portion of the field of view.
~ A display device that shows a video image, or some other dynamic information perhaps related to the video image coming from the camera.
One aspect of the invention allows a photographer or videographer to wear the apparatus continuously .and they°efore always end up with the ability to produce a picture from something that was seen a couple of minutes ago. This may be useful to everyone in the sense that we may not want to miss a great photo opportunity, and often great photo opportunities only become known to us after we have had time to think about something we previously saw.
Such an apparatus might also be of use in personal safety. Although there are a growing number of video surveillance cameras installed in the environment allegedly for "public safety", there have been recent questions as to the true benefit of such centralized surveillance i:nfrastrucaures. Most notably there have been several exam-ples in which such centralized infrastructure has been abused by the owners of it (as in roundups, detainment. and execution of peaceful demonstrators). Moreover, "pub-lic safety" systems may :fail to protect individuals against crimes committed by the organizations that install'.ed the systems. The apparatus of this invention allows the storage and retrieval of images by transmitting and recording images at one or more remote locations. Images may be transmitted and recorded in different countries, so that they would be difficult to destroy, in the event that the perpetrator of a crime might wish to do so through the political machinery of a single country.
The apparatus of the invention allows images to be captured in a natural manner, without giving an unusual appearance to others (such as a potential assailant or human rights violator).
Accordingly, the present invention in one aspect comprises eyeglasses with an LED
imbedded inside the glass or plastic material from which the eyeglasses are made, and wires to connect the LEL> to the outside world. The LED is so close to the eye that one cannot focus on it, but it does provide a blurry circular disk with which the wearer can orient the glasses in a particular direction with respect to a particular object. Preferably there is also a small crosshairs scratched onto the inside surface of the eyeglass lens, so that thesE~ will appear sharp within the blurry circular disk, and will appear at all depths of focus, e.g. no matter what the wearer is looking at, the crosshairs will appear sharp <~,nd in focus, as if they formed an image with infinite field of view. The cros~~hairs will appear in the image of the wearer's eye lens, so that particles of dust or dirt in the eye will also be visible within the blurry circle of confusion of the LED. Such eyeglasses may be useful for their amusement value, e.g.
to give the wearer the feeling that he or she is shooting at something or aiming at something. Even without any form of camera in the eyeglasses, such eyeglasses could be marketed as a toy or personal amusement device, because of the unique appearance the wearer has, and the imagined sense of personal empowerment involved in sighting an "enemy" in the crosshairs etched onto the inside glass.
According to another aspect of the invention, there is provided a plurality of LEDs, with wires running inside the lens material. Preferably, either two LEDs are used to mark the left and right edges of a rectangular boundary, or four are used, one for each corner of the rectangular boundary.
According to another aspect of the invention, there is provided a wearable camera concealed in the eyeglasses, in which the above mentioned crosshairs are used to aim the camera.
According to another aspect of the invention, there is provided a similar wearable camera system in which the above rectangular boundary is used to aim the camera.
According to another aspect of the invention, there is provided a wearable cam era system in which four L-shaped corners are used to define the four corners of a rectangular boundary is 'used to aim the camera.
According to another aspect of the invention, there is provided an elongated beam-splitter imbedded within an eyeglass lens. The beamsplitter is made much longer than necessary, in order that it have the appearance of a normal cut line in a normal pair of flat top bifocal eyeglasses. Preferably this beamsplitter is oriented at a 45 degree angle, so that it can show the output of an electronic display that might, for example, be connected to the output of a wearable processor or wearable computer system that is processing images from a camera also concealed inside the eyeglass frames.
According to another aspect of the invention, there is provided eyeglasses in which a viewscreen in the eyeglasses provides an electronic viewfinder connected to the output of the camera also concealed in the eyeglass frames. Preferably this viewfinder allows the wearer to examine not just composition, but also exposure, contrast, and details of the image, as well as meta information such as that determined by an object recognition program that might, for example, recognize faces of people in the picture and remind the wearer who it is that the wearer wanted to photograph, or remind the wearer of people in the picture who are not satisfied with their picture portraits, or who need to be re-photographed in better lighting or the like, or the wearable face recognizer might recogni;~e people and construct a family tree in the viewfinder so for example, a wedding photographer could orient himself for best shot of the group by understanding and arranging individuals in a meaningful order.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described in more detail, by way of examples which in no way are meant to limit the scope of the invention, but, rather, these examples will serve to illustrate the invention with reference to the accompanying drawings, in which:
FIG. 1 illustrates the principle and components of typical flat-top bifocal eye-glasses.
FIG. 2 illustrates an older style of bifocal eyeglasses in which the cut line runs along the entire width of the lens.
FIG. 3 illustrates the concealment of an LED inside an eyeglass lens.
FIG. 4 illustrates how the concealed LED can be used to center the subject matter in the field of view of a camera also concealed within the eyeglasses.
FIG. 5 shows an embodiment of the invention in which there are two LEDs con-cealed within an eyeglass lens, so that the left and right edges of a rectangular bound-ary may be defined.
FIG. 5a shows a top view, while FIG. 5b shows an inside view and FIG. 5c shows the view seen by the wearer when the apparatus is in operation.
FIG. 6 shows an embodiment of the wearable viewfinder invention in which the viewfinder contains four LEDs concealed in what appears to others like an ordinary eyeglass lens of ordinary trifocal construction.
FIG. 6a shows the inside view, and FIG. 6b shows the view as seen by the wearer, when the device is in operation.
FIG. 7 shows an embodiment of the wearable camera invention where there is a beamsplitter concealed i:n an eyeglass lens such that it looks like the cut line across the top of a flat top bifocal eyeglass lens.
FIG. 8 shows an improvement of the wearable camera invention where there is a bifocal inset lens that magnifies the screen but not the objects seen through the glasses, and where there is also ambient light amplification so that the screen is backlit in proportion to the amount of light in the environment, but in such a way that it is more brightly lit than with passive ambient backlighting.
FIG. 9 shows an alternate embodiment of the wearable camera system where the display magnification is done through reflection rather than refraction, and where the camera and display do not function along collinear rays directly, but, instead, a WearComp (wearable computer) is used to correct for this noncollinearity.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
While the invention ;>hall now be described with reference to the preferred em-bodiments shown in the drawings, it should be understood that the intention is not to limit the invention only to the particular embodiments shown but rather to cover all alterations, modifications and equivalent arrangements possible within the scope of appended claims.
In all aspects of the present invention, references to "camera" mean any device or collection of devices capable of simultaneously determining a quantity of light arriving from a plurality of directions and or at a plurality of locations, or determining some other attribute of light .arriving from a plurality of directions and or at a plurality of locations. Similarly references to "viewscreen" shall not be limited to just minia-turized television monitors or computer monitors, but shall also include computer data display means, as well as fixed display means, where such fixed display means include crosshairs, graticules, reticles, brackets, etc., and other video display devices, still picture display devices, ASCII text display devices, terminals, and systems that directly scan light. onto the retina of the eye to form the perception of an image.
References to "processor", or "computer" shall include sequential instruction, par-allel instruction, and special purpose architectures such as digital signal processing hardware, Field Programmable Gate Arrays (FPGAs), programmable logic devices, as well as analog signal processing devices.
When it is said that object "A" is "borne" by object "B", this shall include the possibilities that A is attached to B, that A is part of B, that A is built into B, or that A is B.
FIG. 1 is a diagram depicting a pair of bifocal eyeglasses, and will serve to define the terminology pertaining to various parts of the bifocal eyeglasses, as this terminol-ogy will be used in this disclosure. Eyeglasses are normally held upon the head of the wearer by way of temple side pieces 110. These temple side pieces 110 support, by way of a hinge held on with rivets 120, a frame 130. Within frame 130 are two lenses 140. Lenses 140 contain inset lenses 150 which may have different prescriptions than lenses 140 in which they are set. There is typically a cut line 160 between lens 140 and lens 150.
Typically lens 140 will provide a prescription for distant objects while inset lens 150 will provide a prescription for nearby objects. Lens 150 is commonly used for reading. Accordingly, lens 140 may, in some cases, have infinite focal length (zero power) and simply serve <~,s a support for lens 150, which is typically a lens of positive focal length (e.g. a magnifying glass).
In some cases, lens 140 may be non existent, as in typical reading glasses, in which lens 150 is mounted directly to frame 130, and the wearer looks over frame 130 to see distant objects and looks through lens 150 to see nearby objects.
In many modern multifocal eyeglasses, there is no visible cut line 160, and instead there is a gradual transition from the prescription of lens 140 to that of lens 150. Such multifocal lenses are known as progressive. The purpose of such gradual transition is to accomodate a variety of distances, in situations where the wearer normally has an inability to focus over any appreciable range of distances, as well as for improved appearance. Since the need for rrmltifocal lenses shows a deficiency on the part of the user, there has been a trend toward hiding this deficiency, just as there has been a trend toward contact lenses and laser eye treatments to eliminate the need for eyewear altogether. However, amid the desire among some to hide the fact that they need bifocals or even just ordinary glasses, there are others who like to wear eyeglasses.
Even some people who do not need eyeglasses often wear so-called pseudo-intellectual glasses, which are glasses in which lens 140 has infinite focal length.
Moreover, bifocal eyeglasses and reading glasses are often associated with intellectuals, and thus there is a portion of society that would readily wear glasses having the general appearance of those depicted in FIG. 1, even if they did not require a prescription of any kind.
The eyeglass lenses 140 may also contain markings 170 made directly on the glass.
Such markings, for example, may be the manufacturer's name or an abbreviation (such as the letters "GA" engraved on the left lens of Giorgio Armani (trade-mark) glasses). For illustration in this disclosure, the markings "L" and "R" denote left and right lenses, as labeled from the perspective of the wearer. Such markings will help make it clearer which lens and which side of the lens is being shown.
FIG. 2 depicts the left lens of an older style of bifocal eyeglasses. The cut line extends all the way across. Older styles of bifocal eyeglasses such as that depicted in FIG. 2 are becoming popular among some individuals, so that a eyeglasses with lenses like those depicted in FIG. 2 would not look particularly out of place.
Lens 240 is suitable for looking at distant objects, while lens 250 is suitable for looking at near objects. Lens 240 rnay have infinite focal length (zero power) if the glasses are intended to be worn by a person who has normal vision (e.g. does not need corrective eyewear). Such a person may wear these glasses simply to facilitate in doing fine soldering, needlework, or the like, by virtue of lenses 250 which may simply serve the same purpose as ordinary magnifying glasses.
Alternatively, lenses 250 and 240 may both be of infinite focal length, and the cut line 260 therebetween may be simply for cosmetic purposes, e.g. to provide the wearer with the appearance of a traditional intellectual who might wear old-style bifocal eyeglasses.
Thus eyewear as depicted in li IG. 2 may be constructed to meet the prescription of one who requires bifoc;~,l glasses, or one who requires only ordinary unifocal glasses, or one who requires no glasses at all.
Accordingly, the eyewear as depicted in FIG. 2 may be constructed for nearly anyone, and may also be used as a basis in which to conceal additional apparatus.
FIG. 3 shows how an LED (light emitting diode) may be concealed within the lens material (such as glass or plastic) of an eyeglass lens 340. Lens 340 may comprise two separate prescriptions, one prescription, or no prescription at all, depending on the wearer's needs or lath thereof. A thin wire 310, preferably made of stainless steel or other material that is silver in colour, is imbedded on or within the lens material 340. Wire 310 carries electrical current to the anode terminal of an LED 320 also imbedded in the lens material. Wire 330 carries electrical current from the cathode terminal of the LED. (For purposes of this disclosure conventional current, in which electricity flows from plus to minus, is used rather than electron current in which electrons flow from minus to plus.) LEDs normally come in clear plastic housings, which are quite large (e.g. on the order of three millimeters in diameter). However, the internals of an LED
may be imbedded into the lens material 340, so that the lens material itself forms the protective housing around these internals. In this way, the LED 320 is too small to be easily seen by the unaided eye of someone who might be looking at the wearer's eyeglasses. Thus, so long as the LED 320 is not illuminated, it will remain essentially invisible to others.
A miniature shroud 321 is typically placed over LED 320 so that people other than the wearer of the glasses cannot easily see the light from LED 320. This shroud is typically made in an irregular shape, so that it has the appearance of a spec of dust or small particle of dirt. The side facing the wearer (and behind the LED from the wearer's perspective) is preferably black, while the side facing away from the wearer is preferably dust or dirt-coloured, and may comprise dirt or dust particles or other imperfections imbedded into the glass.
As an alternative to an LED, a scintillating fiber optic or other light source imbed-ded in the glass may be 'used.
Moreover, a cut line on the inside of the glass, such as crosshairs scratched into the glass, may be used to project this image directly onto the retina of the wearer, so that it is in focus for all focal distances of the wearer's own eye lens.
FIG. 4 depicts subject matter being captured using an embodiment of the in-vention. In this example, subject matter may, for example, comprise a department store manager or clerk who has i.Llegally chained his fire exits shut, but also (despite the use of video surveillance in his department store) has a store policy prohibiting photography by customers in the department store in order that his criminal activity is not documented.
An arbitrary point 410 on the subject matter of interest radiates light in all directions, and some of this light may be collected by a customer wearing eyeglasses in which a video camera has been concealed.
Light from 410 passes through the customer's eyeglasses, in particular, through a lens 340 of the customer's eyeglasses, and then through lens 420 of customer's eye 430. This light converges to a point 440 on the customer's retina. To the left of eye 430 is shown the image of the department store manager upon the customer's retina, and point 450 of this image corresponds to point 410 of the subject matter.
LED 320 is located in eyeglass lens 340 which is very close to the wearer's eye.
Humans with normal healthy vision can focus on objects that are between about inches (approximately l0cm) and infinity, away from the lens 420 in the eye 430.
Thus objects such as LED 320 which are closer than 4 inches must appear out of focus. LED 320 is so close to the eye, in fact, that it will appear extremely out of focus. The customer will not be able to see the LED in his eyeglasses, and in fact the customer will see a very large ci~°cular-shaped blob which is the out-of-focus image of the point source LED 320.
The circular disk that one sees from a point source of light that is out of focus is known as the circle of confusion.
Rays of light from LE;D 320 are denoted by dashed lines which eye lens 420 is too weak to focus, so that they spread out and strike the retina at 460, defining a circular disk of light 470. LED 320 is typically red or green, so that disk 470 appears as a large circle of red or green light.
The exact shape of this disk 470 is determined by the shape of the opening in the eye, and disk 470 will also show imperfections in the eye lens 420, such as dust on eye lens 420, or any irregularities in the eye iris of lens 420.
However, despite these irregularities, the circular blob 470 will indicate to the wearer the direction in which a video camera that has been hidden inside the eyeglass frames is pointing.
Thus the customer may make use of LED 320 imbedded in eyeglass lens 340 to orient his wearable camera in the direction of the subject matter, and to know that the subject matter is centered in the camera's field of view.
Moreover, the colour and state of the LED (e.g. whether the LED is flashing, and at what rate, and in. the case of a multicolour LED whether it is red or green or whichever other colours it may assume) may convey additional information to the wearer of the apparatus.
Typically LED 320 turns red to indicate that a recording device is active, or a transmitter is active. Typically the LED begins flashing when hard disk space on the recording device is almost full. 'The rate of flashing is typically used to indicate to the wearer how much disk space remains.
In order that light from the I,ED that might be reflected off the inside surface of the glass 340, or off the wearer's eye 430, is not seen by others (such as the depart-ment store manager or the like), LED 320 is automatically adjusted in brightness in accordance with ambient; light levels. Typically the camera is capable of measuring the quantity of light received, and also estimating the scene contrast, and from this information, provides a <;ontrol voltage to LED 320 so that it becomes bright when necessary (such as outdoors on a sunny day) and darker when it does not need to be so bright (such as in a dimly lit corridor or stairwell of a department store).
One drawback of the invention described in FIG. 4 is that the circular disk varies in size depending on the opening and closing of the iris of eye lens 420. Thus although it may be used. to center the subject matter in the viewfinder, it cannot easily be used as an indicator of the extent of coverage of the camera, as with a traditional viewfinder in which the user can see whether or not the subject matter is wholly contained within the field of view of the camera.
FIG. 5 therefore depicts an improved viewfinder in which two LEDs are concealed with wiring along the cut line of (or where the cut line would be in) a bifocal eyeglass lens 340. LEDs 520 and 521 may be of similar construction to LED 320 and may be similarly shrouded so that others facing the wearer do not readily see the light from LEDs 520 and 521.
Wire 510 carries electric current to LED 520, which is connected in series with LED 521 by wire 511, followed by wire 512 which completes the circuit. It is preferable that the LEDs be wired in series, so that a single current limiting resistor or drive circuit can drive both of them at equal brightness. (Wiring LEDs in parallel is known to provide unreliable and sometimes unpredictable results.) FIG. 5a is a top view of FI(~. 5, looking at the eyeglass lens 340 on edge.
The surface of the glass 340 that faces away from the wearer is designated 341, while that facing toward the wearer is designated as 342. LEDs 520 and 521 are imbedded inside the glass but located near surface 341. On the other surface 342 are scratch marks 550 and 551 which are c:onstruct;ed to look like part of the optical cut lines around normal bifocal insets.
These cut lines are made in a,n inside-out bracket shape.
FIG. 5b is an inside view of F'IG. 5, looking at the eyeglass lens from the wearer's side.
FIG. 5c is an inside view of FIG. 5, looking at the eyeglass lens from the wearer's side, but showing how it appears when the LEDs 520 and 521 are turned on, and the glass is too close to a wearer's eye to focus on. Instead, light from LED 520 projects an image of scratch marls 550 dig°ectly onto the retina of the wearer's eye. Since the image of scratch mark 550 is not inverted (e.g. since it is projected directly onto the retina), it will appear to the wearer as if it is inverted. This is because upright objects are normally presented inverted (upside down) on the retina, and this is what we are used to. (See for example, George M. Stratton's 1896 article in the journal "Psychological Review" , entitled "Some Preliminary Experiments on Vision" . ) It is for this reason that the two halves of the brackets are each backwards.
What the wearer sees is inward-facing brackets as shown in FIG 5c. These are seen as dark lines within. the circles of confusion 570 and 571. Circles of confusion 570 and 571 arise from LEDs 520 and 521 respectively, since each is a point source that is too close to the eye for the eye lens to focus on.
Brackets 550 and 551 are sufficient to indicate to the wearer what subject matter will be within the camera's field of view and what will not. Most notably, brackets 550 and 551 are made to match exactly the horizontal field of view of the camera, and some fraction of the vertical field of coverage of the camera. Typically this fraction of vertical coverage is 1/3, so that t;he wearer can easily imagine a grid 580 where there are 12 squares of size equal to that defined by each bracket. Grid 580 is shown as a dashed line because the wearer does not in fact see grid 580 but merely imagines it, given the visual cues 550 and 551.
Moroever, since braclcets 550 and 551 define the central 1/3 horizontal strip along what will be the final picture, the wearer can concentrate on this portion of the frame, and compose a picture using the well-known "rule of thirds" in which it is suggested that the most artistically pleasing images usually result by placing important subject matter on a 1/3 boundary.
Thus the viewfinder of FIG 5 provides the wearer with a practical wearable camera system in which there is an awareness of picture composition.
FIG. 6 shows an embodiment of the wearable camera system in which the viewfinder means is concealed in eyeglass lens 340 configured to appear as if it were an ordinary trifocal eyeglass lens.
The same series configuration of LEDs as that depicted in FIG 5 is used, but a second row higher up, in which wire 610 carries electricity to the anode terminal of LED 620 which is connected in series with LED 621 by way of wire 611, and in which wire 612 completes the circuit.
Each pair of LEDs ha:. its own current limiting resistor or the like which is typically mounted in the eyeglass frames so that a single set of wires concealed within the frames can power the LEDs. These wires are typically connected to a waist-worn power supply and the wiring from the glasses to the power supply is typically concealed within an eyeglass safety strap. A satisfactory eyeglass safety strap for concealment of wiring is one sold under the trade name "Croakies" .
FIG. 6a shows the inside surface 342 of lens 340 after it has been marked for use with the four LEDs depicted in F'IG 6. Four "L"-shaped scratches or similar marks are made on the inside surface 342 of eyeglass lens 340. L 650 will be seen in the upper left hand corner, L 651 will be seen in the upper right corner, L 652 will be seen in the lower left coy°ner, and L 653 will be seen in the lower right corner of the camera's field of view.
FIG. 6b shows the inside surface 342 of lens 340 after it has been marked for use with the four LEDs depicted in FIG 6, and when it is placed too close to the eye to focus on, and when further, all four LEDs are turned on.
Although each L appears in its proper place (e.g. the upper left L appears to the wearer to be situated at the upper left corner of the frame), each of them is inverted within its corresponding circle of confusion. LED 620 defines a circle of confusion 670. LED 621 defines a circle of confusion 671. LED 520 defines a circle of confusion 672. LED 521 defines a <:ircle of confusion 673.
Note that it is acceptable if these circles of confusion overlap. For example may overlap with 672, as may circle of confusion 671 overlap with 673.
However, so long as the overlap does not extend into the "L"-shaped marking the apparatus will work fine. For example, as long as circle of confusion 670 does not extend into L 652, then L 652 will continue to be clearly defined. (Otherwise, L 652 will be seen as a double image. ) With the embodiments depicted so far, the camera is typically concealed in the nosebridge of the eyeglasses, or behind one or both of the fasteners 120. In stereo systems (e.g. where there are two cameras) one camera is concealed behind fastener 120 on each side, and the camera extends back into the temple side piece, with the wire extending back down a hollow eyeglass safety strap.
In stereo embodiments of the invention, the lenses are typically made to look like decorative jewels typically found on eyeglasses, where fastener 120 is located.
Alternatively, a thin metal plated plastic where the metal coating is thin enough to see through, is placed over each lens, and is made to have the appearance of a fastener 120.
In some embodiments, a narrow angle camera (also called tele camera) is mounted behind each of the fasteners 120, and a wide angle camera (also called simply wide camera) is also concealed within the nose bridge of the eyeglass frames 130.
However, the difference in location between these cameras and the eye location where the viewfinders are located, introduces some error in the viewfinder and camera alignment at close distance. For example, if the wearer wishes to look into an eyepiece of a telescope or microscope, the camera will not likely see into the eyepiece, and the glasses will therefore have failed to record this experience as the wearer had actually experienced it (e.g. video recorded from the apparatus will fail to show the view through the telescope or microscope).
Accordingly, an improvement to the invention may be made by making the camera collect rays of light that are collinear with the rays of light entering the eye from the viewfinder.
FIG. 7 shows both front and side views of an eyeglass lens 140 in which such an improved design has been implemented. The inset bifocal lens 750 is constructed such that it extends all the way through the glass 140 and so that the cut line 760 on the outside of the glass is at a much different height than the cut line 761 on the inside of the glass. Cut lines i'60 and 761 in fact define a flat surface that extends from inside to outside surfaces of the glass, and is angled at a 45 degree angle.
This surface is typically coated with a thin coating of a reflective material such as metal, or the like, so that it is partially transparent and partially reflective. This surface acts as a beamsplitter to reflect some light that enters the glasses along the cut line, and to reflect some of this light down through lens 720 into CCD sensor array 710. At the top of the eyeglass lens 140 there is a graticule, reticle, crosshairs, cropping "L" pattern, brackets, or spatial light modulator 770. Whether 770 is a fixed pattern such as a graticle, reticle, crosshairs, cropping "L" pattern, or brackets, or a moving pattern defined by an electronic display rrledium such as a spatial light modulator, 770 will be hereafter referred to as a "viewscreen" . Viewscreen 770 may display a combination of fixed and variable information, such as an electronic image from camera sensor array 710 together with a grid and other markings and annotations such as shutter speed, light levels, or the like.
Viewscreen 770 may also display meta information derived from the image formed on sensor array 710. This meta information may, for example, include a virtual name tag superimposed on a person's body, and derived from a wearable face recognizes system attached to the output of sensor array 710. In this manner, the wearable camera system may assist the wearer in recognizing people who the wearer might wish to photograph.
When sensor array 710 is connected to viewscreen 770, sensor array 710 may incor-porate a polarizes and so may viewscreen 770, so as to prevent video feedback.
Video feedback may be prevented by making the surface between cut lines 760 and 761 into a beamsplitter with appropriate polarization characteristics, or by placing polarizers on one or both of array 710 and viewscreen 770 or a combination of both.
Beamsplitters that are imbedded in glass and have polarization characteristics are well known, and are referred to as dichroic beamsplitters, and as polarizing cube beamsplitters, when the polarization characteristics are deliberately optimized.
Viewscreen 770 is typically mounted on the top of the eyeglass lens, so that a small opening in the frames 130 allows light from natural sources like the sun 780, or artificial electric lighting typically found in indoor settings, to enter.
Typical bifocal eyeglass inset lenses 150 are mounted on the outside surface of eyeglass lens 140, but there is no reason why they could not be mounted instead on the inside surface. Accordingly, 790 depicts a bifocal inset lens mounted on the inside surface of lens 140. This lens is like a very powerful reading glass, that allows the wearer to see viewscreen 770 in sharp focus, and to read any text that might be displayed on viewscreen 770 in addition to picture compositional aids displayed thereon.
Three major drawbacks of the embodiment depicted in FIG. 7 are that objects beyond lens 790 appear out of focus, it relies on a bright light source 780 directly over the glasses, and the path between the camera lens 720 and the sensor array 710 is open so that the image is washed out by light leaking in.
FIG. 8 shows a side view of an alternative embodiment of the invention in which lens 790 is replaced with. simply having an inward curving portion of the eyeglasses defined between 810 and. 790. In the same way that sunglass lenses may be curved without providing any magnification or other prescription, this curvature between 790 and 810 provides no magnification of objects seen through the glasses.
However, light from viewscreen 770 passes within the glass 140 and therefore is not affected by curvature 810. Thus a magnified well focused view of viewscreen 770 is seen.
Camera lens 720 is now located at the edge of eyeglass lens 140, so that the path between camera lens 720 and sensor array 710 is now wholly contained inside eyeglasses frame 130. Eyeglass frame 130 is typically made of black plastic so that it forms a good housing for the one or more cameras contained therein.
The output of sensor array 710 goes into WearComp ( "wearable computer" ) 830, where it is digitized and analyzed in terms of brightness, contrast, etc..
The WearComp has a display output, typically in the form of a VGA signal 840, which is connected to viewscreen 770. Viewscreen 770 is typically a spatial light modulator. Preferably viewscreen 770 is a full color high resolution VGA
screen, but the spatial light modulator from a display known by the trade name "Cyberdisplay"
or "Smart Slide", manufactured by Kopin Corporation, is a satisfactory viewscreen 770. This item produces polarized light, owing to the fact that it is a liquid crystal between crossed polarizers. The desired polarization is selected by choosing which side of viewscreen 770 will face downwards. While viewing through lens 790, one can try both orientations, and select the one with greatest brightness. If the beamsplitter defined by cut lines 760 and 761 does not provide sufficient polarization to prevent video feedback, and additional polarizer is used on sensor array 710.
The WearComp 830 will typically display the digitized video from sensor 710 along with annotation, such as a menu of commands for the wearable camera system.
WearComp 830 may also do additional processing, such as face recognition, and other forms of photographic/vi.deographic memory aids, so that the unit will function as a visual memory prosthetic (VMP;I as defined in http://wearcam.org/vmp.htm In the embodiment pictured here in FIG 8, an external backlight 870 is used to backlight viewscreen 770, so that it can be seen clearly and brightly.
However, this backlight is controlled by an amplifier drive circuit 880 which amplifies the ambient light sensor 890.
Light sensor 890 determines how bright the environment is, and drives the back-light 870 appropriately. In this way, the display appears bright in bright sunny conditions, and dark when indoors in low light. Thus, for example, when walking down a dark street late a,t night, a potential assailant is unlikely to see the backscat-tered light from the apparatus because light sensor 890 has controlled backlight 870 in such a manner that there is just sufficient light to see the viewscreen 770 in this dark setting.
Additionally, the estimated ambient light quantity reported by light sensor may be overridden or replaced by a light control signal 850 from WearComp 830, which is calculated by analyzing the input 820 from the sensor array 710. In this way, the quantity of light entering the eye from viewscreen 770 can be precisely controlled in nearly exact correspondence with the actual quantity of light entering the eye from the scene itself. Thus noi; only are rays of light from the scene collinear with rays of light from corresponding points in viewscreen 770, but they are also in tonal register.
Recording is typically retroactive, in the sense that the wearable camera system, by default, typically records into <~, 5-minute circular buffer, so that pressing "record"
begins recording starting from 5 minutes ago, e.g. starting from 5 minutes before "record" is pressed. This means that if the wearer presses "record" within a couple of minutes of, for example, witnessing a police brutality or human rights violation, the event will have been sucessfully recorded.
Typically the recording is also transmitted by way of a wireless Internet connection to wearcomp 830, so that. corrupt officials such as a corrupt department store security guards who might be a close personal friends of the manager who might, for example have the fire exits illegally chained shut, cannot seize and destroy the storage medium upon which the recording was made.
FIG. 9 shows an alternate embodiment of the wearable camera system in which the collinearity error is corrected computationally. Such a wearable camera system is suit-able for augmented reality and mediated reality (as described http://wearcam.org/mr.htm), as well as for more traditional forms of photography and videography. A camera 910, concealed within the nosebridge of the eyeglass frames 130, or a pair of cameras 910 concealed within the temple side pieces 110 of eyeglass frames 130, is connected to a vision processor 931 within a WearComp 830. The WearComp is typically worn around the waist, in a shirt pocket, or comprises components spread throughout an undershirt, as described :in http://wearcam.org/procieee.html The output of vision processor 931 is a scene description, which is supplied to a coordinate transformer 932. The coordinate transformer maps from camera coordi-nates of camera 910, or camera pair 910 to eye coordinates. These eye coordinates are passed on to a graphics rendering system 933, and rendered in eye coordinates, onto viewscreen 770.
A complete machine vision analysis of the scene, followed by a complete graphics rendering of the entire scene is typically too formidable a task for a small battery powered wearcomp 830.
Accordingly, in typical use of the invention, only a small fraction of the scene details are rendered. For example, in the wearable face recognizes, only a virtual name tag is rendered. Because of the coordinate transformer, this name tag appears to the wearer as if it were attached to the subject, even though there is a discrepancy between camera location 910 and the eyeball location of the wearer. In the stereo version, two views are rendered, one for each eye, so that the name tag appears to hover in the same depth plane as the subject matter.
Light from viewscreen 770 is projected down through the glass to beamsplitter 960.
Some will pass through beamsplitter 960, and unfortunately some will be reflected outward where people might be able to see it. Because of the desire that the apparatus be covert, beamsplitter 960 must be a polarizing beamsplitter and the viewscreen 770 must be polarizing, and oriented appropriately, to minimize light reflecting off the beamsplitter 960.
A curved concave mirrorlike surface 961 reflects some light back up to the beam-splitter 960 and into the eye, while providing magnification as concave mirrorlike surfaces do. This mirrorlike surface is disguised as part of a bulge 950 in the eyeglass lens. This bulge may be the actual prescription of the wearer, or may be simply a magnifying region useful to anyone who does not normally wear glasses but wishes to be able to do fine work. Alternatively, the bulge may be made so that it does not provide magnification, but simply looks like the inset lens of bifocal eyeglasses.
Mirrors 960 and 961 are partially silvered, and imbedded in the glass in such a way as to appear as cut lines for inset bifocal lens 950. Although mirrors 960 and only need to be about as wide as they are deep, they may be extended across much further than necessary, so that they will look like normal bifocal cut lines.
The apparatus of this invention allows the wearer to experience the camera over a long period of time. F'or example, after wearing the apparatus sixteen hours per day for several weeks, it; begins to function as a true extension of the mind and body. In this way, photoi;raphic composition is much more optimal, because the act of taking pictures or shooting video no longer requires conscious thought or effort.
Moreover, the intentionality of the picture-taking process is not evident to others, because picture-taking is not proceeded by a gesture such as holding a viewfinder object up to the eye. The wearable viewfinder is an important element of the wearable camera invention allowing the wearer to experience everyday life through a screen, and therefore be always ready to capture anything that might happen, or even anything that might have happened previously by virtue of a retroactive record capability of the invention. Moreover, additional information beyond just exposure and shutter speed may be displayed in the camera viewfinder. For example, the camera allows the wearer to augment, partially diminish, or otherwise partially alter his or her perception of visual reality. This mediated-reality experience may be shared. The wearer may allow others to partially alter :his or her perception of reality. In this way the invention is useful as a new communications medium, in the context of collaborative photography, collaborative videography, and telepresence. Moreover, the invention may perform other useful tasks such a;~ functioning as a personal safety device and crime deterrent by virtue of its ability to maintain a video diary transmitted and recorded at multiple remote locations. As a tool for photojournalists and reporters, the invention has clear advantages over other competing technologies.
From the foregoing description, it will thus be evident that the present invention provides a design for a wearable camera with a viewfinder. As various changes can be made in the above embodiments and operating methods without departing from the spirit or scope of the invention, it is intended that all matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a limiting sense.
Variations or modifications to the design and construction of this invention, within the scope of the invention, may occur to those skilled in the art upon reviewing the disclosure herein. Such variations or modifications, if within the spirit of this invention, are intended to be encompassed within the scope of any claims to patent protection issuing upon this invention.
Claims (29)
1. A display for use as a viewfinder or for viewing a static pattern or variable information for use within eyeglasses having an appearance of ordinary bifocal eyeglasses, said display comprising an eyeglass lens with an elongated beamsplitter imbedded within lens material of said lens, and in which said elongated beamsplitter runs across inside said lens at approximately the same height, and has approximately the same width as the cut line of commonly manufactured flat top bifocal lenses, where said beamsplitter has depth extending most of the way from the inner surface to the outer surface of said transparent lens material.
2. The display of Claim 1, further including a viewscreen.
3. The display of Claim 1 in which said eyeglass lens further includes a curved mirrorlike surface imbedded in said eyeglass lens.
4. The display of Claim 2, said eyeglass lens further including a curved mirrorlike surface imbedded in said eyeglass lens, said curved mirrorlike surface and said viewscreen being on opposite sides of said beamsplitter, said curved mirrorlike surface having a concave surface facing toward said viewscreen.
5. The display of Claim 2, said viewscreen located above said beamsplitter.
6. The display of Claim 5, said viewscreen located at the top of said eyeglass lens.
7. The display of Claim 5, said viewscreen located at least partially in a top portion of eyeglass frames, said eyeglass frames holding said lens.
8. The display of Claim 2, said viewscreen visible through reflection off a portion of said elongated beamsplitter, said portion of said elongated beamsplitter being less than a substantial portion.
9. The display of Claim 2, said viewscreen visible through reflection off less than one third of the width of said elongated beamsplitter.
10. The display of Claim 2, borne by eyeglasses, each ray of light emerging from said display to a point close to the center of projection of an eye of a wearer of said display, such that said each ray of light is approximately collinear with a ray of light to which a portion of a sensor array of a camera also borne by said eyeglasses.
11. The display of Claim 2, in which said viewscreen is an electronic display.
12. The display of Claim 2, in which said viewscreen includes a spatial light modulator.
13. The display of Claim 2, said viewscreen providing a visual field of view corresponding approximately with that of a camera also borne by eyeglasses also bearing said eyeglass lens.
14. The display of Claim 13 in which said viewscreen is responsive to an output of said camera.
15. The display of Claim 13 in which said viewscreen is responsive to an output of said camera, and in which said beamsplitter is a polarizing beamsplitter, and in which said viewscreen produces polarized light.
16. The display of Claim 13 in which said viewscreen is responsive to an output of said camera, and in which said beamsplitter is a polarizing beamsplitter, and in which said camera includes a polarizer between said beamsplitter and a sensor array of said camera.
17. The display of Claim 11, where said electronic display is responsive to an output of a processor wearable by a wearer of said display.
18. The display of Claim 17, said display further including a light sensor, where the brightness of said electronic display is responsive to an output of said light sensor.
19. The display of Claim 17, said display borne by eyeglasses further including a camera concealed within said eyeglasses, said electronic display responsive to an output of said camera.
20. A display for viewing static or variable information within eyeglasses having an appearance of ordinary multifocal eyeglasses, said display comprising:
~ an eyeglass lens with beamsplitter running horizontally, said beamsplitter imbedded within lens material of said eyeglass lens;
~ eyeglass framea in which to support said eyeglass lens;
~ a viewscreen, also borne by said eyeglass frames, said viewscreen and said beamsplitter located one above the other.
~ an eyeglass lens with beamsplitter running horizontally, said beamsplitter imbedded within lens material of said eyeglass lens;
~ eyeglass framea in which to support said eyeglass lens;
~ a viewscreen, also borne by said eyeglass frames, said viewscreen and said beamsplitter located one above the other.
21. The display of Claim 20, said viewscreen located above said beamsplitter.
22. The display of Claim 20, further including a camera borne by said eyeglasses.
23. The display of Claim 22, said display showing a wearer of said eyeglasses an approximate field of view of said camera.
24. The display of Claim 22, said display responsive to an output of said camera.
25. The display of Claim 22, said display responsive to an output of a processor worn by a wearer of said eyeglasses.
26. The display of Claim 22 further including a wearable processor in the signal path between said camera and said viewscreen.
27. The display of Claim 26 where said wearable processor further includes a machine vision system.
28. The display of Claim 26 where said wearable processor further includes a computer graphics system.
29. The display of Claim 26, said display showing the name of a person corresponding to a face in field of view of said camera, recognized by said processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA002290765A CA2290765C (en) | 1998-02-02 | 1998-10-13 | Covert camera viewfinder or display having appearance of ordinary eyeglasses |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CA002228403A CA2228403A1 (en) | 1998-02-02 | 1998-02-02 | Means and apparatus for aquiring, processing, and combining multiple exposures of the same scene or objects to different illuminations |
CA2,228,403 | 1998-02-02 | ||
CA2,233,047 | 1998-03-15 | ||
CA002233047A CA2233047C (en) | 1998-02-02 | 1998-03-25 | Wearable camera system with viewfinder means |
CA002290765A CA2290765C (en) | 1998-02-02 | 1998-10-13 | Covert camera viewfinder or display having appearance of ordinary eyeglasses |
CA002248473A CA2248473C (en) | 1998-02-02 | 1998-10-29 | Eyetap camera or partial reality mediator having appearance of ordinary eyeglasses |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002247649A Division CA2247649C (en) | 1998-02-02 | 1998-10-13 | Covert camera viewfinder or display having appearance of ordinary eyeglasses |
Publications (2)
Publication Number | Publication Date |
---|---|
CA2290765A1 CA2290765A1 (en) | 1998-11-27 |
CA2290765C true CA2290765C (en) | 2000-07-25 |
Family
ID=29740332
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002290765A Expired - Fee Related CA2290765C (en) | 1998-02-02 | 1998-10-13 | Covert camera viewfinder or display having appearance of ordinary eyeglasses |
CA002248473A Expired - Fee Related CA2248473C (en) | 1998-02-02 | 1998-10-29 | Eyetap camera or partial reality mediator having appearance of ordinary eyeglasses |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002248473A Expired - Fee Related CA2248473C (en) | 1998-02-02 | 1998-10-29 | Eyetap camera or partial reality mediator having appearance of ordinary eyeglasses |
Country Status (1)
Country | Link |
---|---|
CA (2) | CA2290765C (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6554499B1 (en) | 2000-07-17 | 2003-04-29 | Marcus Egon Gumpenberger | Apparatus for supplying consistent, properly exposed and high resolution video images for the purpose of physical identification and process for making same |
AU2018355441B2 (en) * | 2017-10-27 | 2023-11-09 | Magic Leap, Inc. | Virtual reticle for augmented reality systems |
-
1998
- 1998-10-13 CA CA002290765A patent/CA2290765C/en not_active Expired - Fee Related
- 1998-10-29 CA CA002248473A patent/CA2248473C/en not_active Expired - Fee Related
Also Published As
Publication number | Publication date |
---|---|
CA2248473C (en) | 2000-07-25 |
CA2290765A1 (en) | 1998-11-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2233047C (en) | Wearable camera system with viewfinder means | |
Mann | 'WearCam'(The wearable camera): personal imaging systems for long-term use in wearable tetherless computer-mediated reality and personal photo/videographic memory prosthesis | |
CA2316473A1 (en) | Covert headworn information display or data display or viewfinder | |
US6614408B1 (en) | Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety | |
EP1064783B1 (en) | Wearable camera system with viewfinder means | |
US20020085843A1 (en) | Wearable camera system with viewfinder means | |
CN104903818B (en) | Eyes track Worn type Apparatus and operation method | |
CN103501406B (en) | Image collecting system and image collecting method | |
US20020030637A1 (en) | Aremac-based means and apparatus for interaction with computer, or one or more other people, through a camera | |
CA2362895A1 (en) | Smart sunglasses or computer information display built into eyewear having ordinary appearance, possibly with sight license | |
US20050195277A1 (en) | Image capturing apparatus | |
CA2388766A1 (en) | Eyeglass frames based computer display or eyeglasses with operationally, actually, or computationally, transparent frames | |
CN101542584A (en) | Display device and display method | |
CA2399698A1 (en) | Optical beam-splitter unit and binocular display device containing such a unit | |
CA2290765C (en) | Covert camera viewfinder or display having appearance of ordinary eyeglasses | |
CA2247649C (en) | Covert camera viewfinder or display having appearance of ordinary eyeglasses | |
EP1066717B1 (en) | Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety | |
CA2297344A1 (en) | Look direction microphone system with visual aiming aid | |
CA2256920A1 (en) | Lenstop camera viewfinder or computer data display having appearance of ordinary reading glasses or half glasses | |
CA2249976C (en) | Wearable camera system with viewfinder means | |
JP2011109276A (en) | Camera finder, photographing apparatus, and remote operation support system | |
JP2000020703A (en) | Photographing device for fitting glasses | |
JPH11353353A (en) | Selection supporting system for glasses | |
CA2235030A1 (en) | System for electronic newsgathering, documentary video, and photojournalism | |
CA2246697A1 (en) | Reality mediator with viewfinder means |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
MKLA | Lapsed |
Effective date: 20181015 |