CA2233047C - Wearable camera system with viewfinder means - Google Patents

Wearable camera system with viewfinder means

Info

Publication number
CA2233047C
CA2233047C CA 2233047 CA2233047A CA2233047C CA 2233047 C CA2233047 C CA 2233047C CA 2233047 CA2233047 CA 2233047 CA 2233047 A CA2233047 A CA 2233047A CA 2233047 C CA2233047 C CA 2233047C
Authority
CA
Grant status
Grant
Patent type
Prior art keywords
camera
system
viewfinder
personal
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA 2233047
Other languages
French (fr)
Inventor
Steve Mann
Original Assignee
Steve Mann
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/232Devices for controlling television cameras, e.g. remote control; Control of cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in, e.g. mobile phones, computers or vehicles
    • H04N5/23293Electronic Viewfinder, e.g. displaying the image signal provided by an electronic image sensor and optionally additional information related to control or operation of the camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/225Television cameras ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/2251Constructional details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed circuit television systems, i.e. systems in which the signal is not broadcast
    • H04N7/183Closed circuit television systems, i.e. systems in which the signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed circuit television systems, i.e. systems in which the signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/30Polarising elements

Abstract

A novel means and apparatus for a new kind of photography and videography is described. In particular, a wearable camera with viewfinder means is introduced. The system, in effect, absorbs and quantifies rays of light that are processed on a small wearable computer system and re-constituted to emerge to reconstruct the virtual image of objects at nearly the same position in space, or at a coordinate transformed position, as viewed by the wearer of the apparatus. The wearer of the apparatus becomes, after adaptation, an entity that seeks, without conscious thought or effort, an optimal point of vantage and camera orientation. Because of the wearer's ability to constantly see the world through the invention, which may also function as an image enhancement device, the apparatus behaves as a true extension of the wearer's mind and body, giving rise to a new genre of documentary video.

Description

Patent Application of Steve Mann for ~rEARABLE CAMERA SYSTEM WITH VIEWFINDER MEANS
of which the following is a specification:
FIELD OF THE INVENTION
The present invention pertains generally to a new photographic or video means and app~~ratus comprising a body-worn portable electronic camera system with wearable viewfinder means.
BACKGROUND OF THE INVENTION
In photography (and in movie and video production), it is desirable to capture events in a natural manner with minimal intervention and disturbance. Current state-of-the-art photographic or video apparatus, even in its most simple "point and click:" form, creates a visual disturbance to others and attracts considerable attention on account of the gesture of bringing the camera up to the eye. Even if the size of the camera could be reduced to the point of being negligible (e.g. no bigger than the ~°yecup of a typical camera viewfinder, for example), the very gesture of bringing a device up to the eye is unnatural and attracts considerable attention, especially in e:~tablishments such as gambling casinos or department stores where photography is often prohibited. Although there exist a variety of covert cameras such a camera concealed beneath the jewel of a necktie clip, cameras concealed in baseball caps, and cameras concealed in eyeglasses, these cameras tend to produce inferior images, not just because of the technical limitations imposed by their small size, but, more importantly because they lack a means of viewing the image. Because of the lack of viewfinder means, investigative video and photojournalism made with such cameras suffers from poor composition.
Accordingly, what is proposed is a wearable camera and viewfinder means for capturing video of exceptionally high compositional and artistic calibre. In vddition to the fact that covert versions of the apparatus can tie used to create investigative documentary videos having very good composition, for everyday usage. the device need not necessarily be covert. a:nd may. in fact, be a fashionable device that serves as both a visible crime deterrent, as well as a tool for documentary videomakers and photo journalists.
Moreover, the fact that the apparatus can be worn comfortably for many hours suggests a new genre of documentary video characterized by long-term ps,y-chophvsical adaptation to the device. The result is a very natural first-person perspective genre of documentary, whose artistic style is very much as if a recording could be made from a video tap of the optic nerve of the eye itself.
Although one could imagine mounting a video camera with viewfinder onto a hel-met. the apparatus would be cumbersome owing to the unbalance and high moment of inertia due to having weight out far from the center of rotation of the neck. The protrusion of the camera would also present a problem, making tha apparatus cmn-bersome. Moreover, the resulting mismatch between viewfin<:ler image and the real world would create an unnatural mapping. Indeed. anyone who has walked around holding a small camcorder up to his or her eye for several hours a day will obtain an understanding of the ill psych.ophysical effects that result. Eventually.
such ad-verse effects as nausea, and flashbacks, may persist even after the camera is removed.
There is also the question as to whether or not such a so-called Mediated Reality might, over a long period of time. cause brain damage, Such as damage to the visual cortex, in the sense that learning (including the learning of new spatial mappings) permanently alters the brain.
Accordingly, the invention proposes an embodiment with view finder means such theft the lllltlge 111aV be yI'e5E'IlteCl 111 '<1 Ilatlll'al I11<lllIlel' S111table fu l' lOllg-teI'II1 Usage patterns.
There are several re~lsons wly it. alight be desired to wear the camera aver a sustained period of time:
1. There is the notion. of a personal visual diary of sorts.

2. There is tile idea of being always ready. By constantly recording into ~
circular buffer, a retroactive record function. such as a button that in structs the device to "begin recordirlz; from five minutes ago' play be useful in personal safety (crime reduction) as well a.s in ordinary every-day usage, such as capturing a baby's first steps on video. 'Vith the prior art in photography anti video. we spend so much time preparing tile camera and searching for film, batteries.
etc..
or at the very least, just getting the camera out of its carrying case. that we often miss important moments like a baby's first steps, or a spontaneous facial expression during t.!~e opening of a gift.

3. There is the fact tluat the proposed invention, after worn for a long period of time, begins to beh<lve as a true extension of the wearer's mind and hotly.
.as a result, the composition of video shot with the device is often impeccable without even the need for conscious thought or effort on the part of the user.
Moreover, a very natural first-person perspective genre of video results. For example.
while wearing an embodiment of the proposed invention, it is possible to Look through the viewfinder of a telescope or microscope and record this experience.
including the approach toward the eyepiece. This experience is recorded. from the perspective of the participant ill the experience. The act of nlakin g the recording is also done without appreciable conscious thought or effort.
~. :~ computional system, either built into the wearable camera, or worn un the body elsewhere and connected to the camera system, may be used to enhance images. This may :~e of value to the visually impaired. The con lputer n lay also perform other tasks such as object recognition. Because the device is worn constantly, it may also function as a memory aid, e.g. to help in way-finding through the recall and display of previously captured imagery.
BACKGROUND OF THE INVENTION WITH RESPECT TO PRIOR
AR'.r: It appears that apart from large view cameras upon which the image is observed on a. ground glass, that most viewfinders present an erect image. See, for example, U.S. Pat. No.5095326 entitled "Keppler-type erect image viewfinder and erecting prism" . In contrast to this fact, it is well-known that one can become accustomed, through long-term psychophysical adaptation (as reported by George M.
Stratton, in Psychology Review, in 1896 and 1897) to eyeglasses that present an upside-down image. After wearing upside-down glasses constantly, for eight days (keeping himself blindfolded when removing the glasses .for bathing or sleeping) Stratton found that he could see normally through the glasses. More recent experiments, as conducted by and reported by Mann, in an MIT technical report Mediated Reality, medialab visrnod TR260, (1994), (the report is available in http://wearcam.org/mediated-reality/index.html) suggest that slight transformations such as rotation by a few degrees or small image displacements give rise to a reversed aftereffect that is more rapidly assimilated by the wearer, and that such effects can often have a more detri-mental effect on performing other tasks through the camera as well as detrimental flashbacks upon removal of the camera. These findings suggest that merely mounting a conventional camera such as a small 35mm rangefinder camera or a small video camcorder to a helmet, so that one can look through the viewfinder and use it it hands-free while performing other tasks, will result in poor performance at doing those tasks while looking through the camera viewfinder.
Moreover, these findings suggest that doing tasks while looking through the viewfinder of a conventional camera, over a long period of time, may give rise to detrimental flashback effects that may persist even after the camera is removed. This is especially true when the tasks involve a great deal of hand-eye coordination, such as when

4 one might, for example. wish to photograph. film, ur make video recordings of the experience of eating or playing volleyball or the like. by doing the task while concen-trating primarily on the eye that is looking through the camera viewfinder.
Indeed.
since cameras of the prior art were never intended to be used this way. to record events from a first-person-perspective while looking through the viewfinder.
it is not surprising that performance is poor in this usage.
Part of the reason for poor performance associated with simply attaching a con-ventional camera to a helmet is the induced parallax and the failure to provide an orthoscopic view. Even viewfinders which correct for parallax, as described in U.S.
Pat. Vo.5G92227 in which a rang~efinder is coupled to a parallax error compensating mechanism, only correct for parallax between the viewfinder and the cmuerv lens that is taking the picture. but do not correct for parallax between the view-fincler and the image that would be observed with the naked eve while not looking through the camera.
The invention may provide a viewfinder means that is suitable for long-term usage.
such as when one may- be wearing the camera for 16 hours per day, looking through it all the while. Accordingly, since traditional viewfinders are only viewed through on a shorter term basis. there will be some important differences between the propo>ecl wearable camera system and traditional cameras. For example, when the proposed wearable camera system comprises a zoom lens for the camera, it will be necessary that the viewfinder also comprises a zoom lens, so that when zooming into a scene, the image in the viewfinder will subtend a lesser visual angle (appear to get smaller) to negate the usual effect in which zooming in produces increased magnification.
In this manner the proposed wearable camera system will provide the wearer with absolutely no nragnifcation regardless of the zoom adjustment.
Some viewfinders are equipped with a zoom capability. as, for example, is de-scribed in U.S. Pat. No.5323264, so that their field of coverage varies with the varying of a zoom lens. The reader will need to be careful not to confuse zoom viewfinders of the prior art with the zoom viewfinder of the proposed invention in which view-ing takes place through an electronic viewfinder where the decrease in visual angle subtended by the image of the viewfinder screen is coupled to the increase in focal lengi;h of the camera within the proposed invention. This coupling negates any in-crease in magnification that would otherwise result from zooming in on the scene. At first this may seem counter-intuitive, in the sense that we normally expect zooming in to produce magnification. This expectation is owing to the cameras of the prior art. However, after using the proposed invention for an extended period of time, one quickly grows accustomed to the unique characteristics of its viewfinder, and the much more seamless integration of the viewfinder with everyday life. This seamless-ness is such that after time, the wearer will begin to operate the proposed wearable camera invention without appreciable conscious thought or effort.
tin important aspect of the proposed invention is the capability of the apparatus to mediate (augment, diminish, or otherwise alter) the visual perception of reality.
Traditional camera viewfinders often include the ability to overlay virtual objects, such as camera shutter speed, or the like, on top of reality, as described in U.S.
Pat. No.5664244 which describes a viewfinder with additional information display capability.
The proposed camera viewfinder is related to the displays that are used in the field of ''irtual Reality (VR) in the sense that both are wearable. However, an important difference is that the proposed invention allows the wearer to continue to see the real world, while VR displays block out the ability to see the real world.
Displays for helmet mounted aircraft weapons aiming applications have been de-veloped, as described in U.S. Pat. No.369'7154, U.S. Pat. No.3833300, LT.S.
Pat.
No.4081209, U.S. Pat. No.4220400. Such displays do not directly incorporate a cam-era. Although they could be used to display the output image from an electronic camera (hand-held or perhaps mounted to the same helmet), the above-mentioned problems will still exist. U.S. Pat. No.4806011 describes an eyeglass-based display of a clock or the like. While the clock could, in principle, be replaced with a small tele-vision, and a camera could be attached to the glasses and the output of the television connected to it, the above-mentioned problems would still exist.
C)pen-air viewfinders are often used on extremely low cost cameras, as well as on some professional cameras for use at night when the light levels would be too low to tolerate any optical loss in the viewfinder. Examples of open-air viewfinders used on ~~rofessional cameras, in addition to regular viewfinders, include those used on the ~:~rafHex press cameras of the 1940s (which had three different kinds of viewfind-ing :means), as well as those used on some twin-lens reflex cameras. While such viewfinders could be used in the context of the proposed invention, and would have the advantage of not inducing the problems such as flashback effects described above, they also fail to provide an electronically mediated reality. It is an object of the in-vention to allow visual reality to be mediated in order to make certain that exposure is correct as well as to keep the wearer of the apparatus in the feedback loop of the photo compositional process by constantly providing the wearer with a video stream.
Moreover, it is desired that the apparatus will allow the wearer to experience a com-putationally mediated visual reality, and for that experience to be shared through wireless communications networks so that the wearer may receive additional visual information, as well as be aware of modifications to visual reality that might arise, for example, as part of a communications process in a shared virtual environment.
For such compositional and interactional capabilities, a simple air-based viewfinder is inadequate.
'Wearable display devices have been described, such as in U.S. Pat.
No.5546099, U.S. Pat. No.S'708449, U.S. Pat. No.5331333, U.S. Pat. No.4636866, and may be used as a. starting point for implementing the proposed invention, through the addition of the appropriate light sensing apparatus. U.S. Pat. No.5640221 also proposes an eye---tracking device which may be used in the context of the proposed invention.
A means of using a plurality of pictures of the same scene or object, in which the pictures were taken using a camera with automatic exposure control, uutomuti<
gain control. or the like lay been proposed in 'PEVCIC.'R.=1PH~'' C-67TH.-1C.'C'. .IOINT
P_fIR.~I:IIETER ESTI:'tlfl TION ITV BOTH DO:~.L-II~V .-1~VD R.-1~VCE OF
FL~:VC'TIO,V.S' IN 5.~1:'lIE ORBIT OF THE PF,'OJECTIV'E-6G'y'C'h~OFF C'ROL%P. imf>lishecl f>v S.
Mann, in VI.I.T. medialab visrnod tech report TR38-I. December, 1~-J9=l, ami later pub-lished also in Proceedings of the IEEE International Conference on Image Processing (ICIP-96), Lausanne, Switzerland, September 16-1J. 1J96, pages 1J3-1J6. The re-port is also available on a world wide web site:
http://wearcam.org/icipJ6/inclex.html as a hypertext document. This report relates to the proposed invention in the formu-lation of a means for camera self-calibration in which the unknown nonlinear response function of the camera is determined up to a single unknown scalar constant.
There-fore. once the camera is so understood, it may be used, within the context of the method, as a light measuring instrument. As each pixel of the camera then becomes a light measuring instrun:.ent, successive pictures in a video sequence become maltil>le estimates of the same quantity once the nmltiple images are registered anc:1 appropri-ately interpolated. The measwen.ient from a plurality of such estimates gives rise to knowledge about the scene sufficient to render pictures of increased dynamic range and tonal fidelity, as well as increased spatial resolution and extent. In this wav a miniature video camera as may be concealed inside a pair of eyeglasses may be used to generate images of very high quality. sufficient for fine-arts work or other uses where good image quality is needed.
DESCRIPTION OF THE INVENTION
The proposed invention facilitates a new form of visual art, in which the artist may capture, with relatively little effort, a visual experience as viewed from his or her own perspective. With some practice, it i5 possible to develop a very steady body posture and mode of movement that best produces video of the genre pertaining to this invention. Because the apparatus may be lightweight and close to the lead.
there is not the protrusion associated with carrying a hand-held camera. .also because components of the proposed invention may be mounted very close to the beach.
in n manner that balances the weight distribution as well as minimizes the moment of inertia abocct the rotational axis of the neck. the head can be turned quickly While weaving the apparatus. This allows one to record the experiences of orclinarv <lav-to-day activities from a first-person perspective. Moreover. because both hands are free, much better balance and posture is possible while using the apparatus.
Anyone skilled in the arts of bod~r movement control as is learned in the inertial arts wcl as karate, as well as in daxu~e, most notably lallet. will leave little clifficalt,v cmptmiy exceptionally high qualit;v video using the proposed invention.
V-ith the prior art. the hest video or movie camera operators tend to he very large people who have trained for many years in the art of smooth control of the cumbersome video or motion picture film cameras used. In addition to requiring a very large person to optimally operate such cameras. various stabilization devices are often used, which make the apparatus even more cumbersome. The propcosed wearable camera invention may be optimally operated by people of any size.
Even young children can become quite proficient in the use of the proposed invention.
A typical embodiment of the invention comprises one or two spatial light modula-tors or other display means blzilt into a pair of eyeglasses together with one or more sensor arrays. Typically one or more CCD (charge coupled device) image sensor ar-rays and appropriate optical elements comprise the camera portion of the invention.
Typically a beamsplitter or a mirror silvered on both Sides is used to combine the image of the viewfinder with the apparent position of the camera. The viewfinder is simply a means of determining the extent of coverage of the camera in a natural manner, and may compri'e either of:
~ A reticle, graticule, rectangle, or other marking that appears to float within a portion of the field of view.
~ A display device that shows a video image, or some other dynamic information perhaps related to the video image coming from the camera.

SUMMARY OF THE INVENTION: OBJECTS AND ADVANTAGES
It is an object of this invention to provide a method of positioning a camelvl in which both hands are left, free.
It is a further object of this i~,nvention to provide a means of exposing a film or acquiring a picture electronically where the spatial extent (field of view) of the image may be ascertained without havi~ig to hold ayy device up to the eye.
This invention may provide such a method of e~cposing a film or uc<~uirip a picture electronically where the tonal characteristics of the picture myv be ascertained without having to hold a:ay device up to the eve.
This invention may provide such a method of e:cposing a film or a<:duirin g a picture electronically where no apparent difference in body movement or gesture between when a picture is being l;aken and when no picture is being taken is detectable by of hers.
This invention may provide the user with a means of determining the composition of the picture from a display device that is located such that only the user can see the display device, and so that the user can ascertain the composition of a picture or take a picture or video and transmit images) to one or more remote locations without the knowledge of others in the immecl.iate environment.
This invention may provide the user with a means of determining the composition of the picture from a display device that is located such that only- the user can gee the display device, as well. as a secondary additional display device that the user can show to others if and when the user desires to do so.
This invention may provide the user with a means of determining the composition of the picture from a display device that is located such that both the user as well as others can see it.
This invention may provide a wearable camera viewfinder means in which video is displayed on a viewfinder in such ~~ way that all rays of light from the viewfinder that enter the eye appear to emenate from essentially the same direction as they wocdd 1() have had the apparatus not been worn.
This invention may provide a means for a user to experience additional information overlaid on top of his or her visual field of view such that the information is relevant to the imagery being vie~,ved.
This invention may provide a means and apparatus for a user to capture a plm~.llitv of images of the same scene or objects. in a natural pro<:ess of simply looking around.
and then have these images combined together into a single image of increased spatial extent, spatial resolution. dynam:~c range. or tonal fidelity.
This invention may provide a viewfinder means in which the viewfinder has a focusing mechanism that is couplec-i to a focusing mechanism of a camera system, so that when the camera is focused on a particular object the viewfinder also presents that object in a manner such that when the apparatus moves relative to the user's eye, that the object appears to neither move with or against the movement of the eye, so that the rays of light entering the eye are approximately the same in direction as if the apparatus were not present.
This invention may provide a~ viewfinder means in which the viewfinder has a focusing mechanism that is coupled to a focusing mechanism of a camera system.
so that when the camera is focused on a particular object the viewfinder also presents that object in the same focal depth plane as the object would appear to the user with the apparatus removed.
This invention may provide a viewfinder means in which the viewfinder has a fo-cusing mechanism that is controlled by an automatic focusing mechanism of a camera system.
This invention may provide a stereo viewfinder means in which the viewfinder has focusing and vergence control mechanisms that are controlled by an automatic focusing mechanism of a camera system.
This invention may p:.°ovide a viewfimler means in which the viewfinder has a focusing mechanism that is controlled by an automatic focusing mechanism of a cam-era system, and in which the apparatus comprises an eye-tracking mechanism that causes the focus of the camera to be based on where the. user is looking, and therefore the focus of the viewfinder mechanism to be also focused in such a manner that the convergence of light rays from whatever object happens to be within the foveal region of the eye's view also pro~~luces rays of light that have the same focal distance as they would have had with the apparatus removed from the uzser.
This invention may p~°ovide a wearable camera with viewfinder means for collab-oration between the user of the apparatus and one or more other persons at remote locations through the manipulation of virtual objects such as cursors, or computer graphics renderings displayed upon the camera viewfinder.
This invention may allow multiple users of the invention. whether at remote loca-dons or side-by-side, or i:n the same room within each other's field of view, to intract with one another through the collaborative capabilities of the apparatus.
This invention may allow muloiple users of the invention, at remote locations.
to collaborate in such a way that a virtual environment is shared in which camera-based head-tracking of each user results in acquisition of video and subsequent generation of virtual information bei.zg made available to the other(s).
This invention may allow multiple users of the invention, at the same location, to collaborate in such a way that multiple camera viewpoints may be shared among the users so that they can advise each other on matters such as composition, or so that one or more viewers at remote locations can advise one or more of the users on matters such as composition or camera angle.
This invention may al.~ow m~.iltiple ~.isers of the invention, at different locations.
to collaborate on a project or endeavour that may not pertain to photography-or videography directly; but a project or endeavour nevertheless that is enhanced by the ability for each person to experience the viewpoint of another.
This invention may allow one or more remote participants at conventional desktop computers or the like to interact with one or more users of the invention. at one or more other locations, to collaborate on a project or endeavour that may not pertain to photography or video~;raphy directly, but a project or endeavour nevertheless that is enhanced by the ability for one or more users of the invention to either provide or obtain advice from or to another individual at a remote location.
SUMMARY OF THE INVENTION: Informal review of what the new invention does One aspect of the invention allows a photographer or videographer to wear the apparatus continuously and therefore always end up with the ability to produce a picture from something that was seen ~, couple of minutes ago. This may be useful to everyone in the sense that we may not want to miss a, great photo opportunity, and often great photo opport-unities only become known to us after we have had time to think about something we previously saw.
Such an apparatus might also be of use in personal safety. Although there are a growing number of video surveillance cameras installed in the environment allegedly for ''public safety", there have been recent questions as to the true benefit of such centralized surveillance infrastructnrres. Most notably there brave been several e~am-ples in which such centralized infrastructure has been abused by the owners of it (as in roundups and detainment of peaceful demonstrators). ~-Ioreover, wpublic safetv~' systems may fail to protect individuals against crimes committed by the organiza-tions that installed the systems. Accordingly, embodiments of the invention often implement the storage and retrieval of images by transmitting and recording images at one or more remote locations. In one embodiment of the invention, images were transmitted and recorded in different countries, so that they would be dif~rcult to destroy, in the event that the perpretrator of a crime might wish to do so.
The invention allows images to be captured in a natural manner. without giving an unusual appearance to others (,such as a potential assailant).

Moreover, as an artistic tool of personal expression, the apparatus allows the user to record, from a first-person-perspective, experiences that have been difficult to so record in the past. For example, a user might be able to record the experience of looking through binoculars while riding horseback, or the experience of waterskiing, rope climbing, or the like. Such experiences captured from a first-person perspective provide a new genre of video by way of a wearable camera system with viewfinder means that goes beyond current state-of-the-art point of view sports videos (such as created by cameras mounted in sports helmets which have no viewfinder means).
A typical embodiment of the invention comprises a wearable viewfinder system which is fitted with a motorized focusing mechanism. A camera also fitted with a motorized focusing mechanism is positioned upon one side of a mirror that is silvered on both sides, so that the viewfinder can be positioned on the other side and provide a view that is focused to whatever the camera is focused on. Such an apparatus allows the user to record a portion of his or her eye's visual field of view. With the correct design, the device will tend to cause the wearer to want to place the recording zone over top of whatever is most interesting in the scene. This tendency arises from the enhancement of the imagery in this zone. In much the same way that people tend to look at a TV set in a darkened room, regardless of what is playing (even if the TV is tuned to a blank station and just playing "snow"), there is a tendency when wearing the invention to look at the recording~displaywiewfinder zone. Therefore, there is a tendency to try to put the recording zone on top that which is of most interest.
Therefore using the apparatus, after time, does not require conscious thought or effort. In was once said that television is more real than real life, and in much the same way, the wearer of the apparatus becomes a cybernetic organism (cyborg) in a true synergy of human and camera. This is particularly true with a low vision system in which one can actually see better through the viewfinder than in real life (e.g. at night when an image intensifier provides enhanced vision). In this case, the tendency of the wearer to want to become an organism that seeks best picture is very pronounced.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will now be described in more detail, by way of examples which in no way are meant to limit the scope of the invention, but, rather, these examples will serve to illustrate the invention with reference to the accompanying drawings, in which:
FIG. 1 is a diagram of a simple embodiment of the invention in which there are two cameras, a wide-angle camera concealed in the nose bridge of a pair of sunglasses, a tele-camera concealed in the top part of the frame of the sunglasses, and combined by way of a beamsplitter with the wide-camera, as well as a viewfinder means concealed in the left temple side-piece of the glasses with optics concealed in or behind the glass of the left lens.
FIG. 2 is a diagram of the wearable camera system with an improvement in which the viewfinder is constructed so that when other people look at the wearer of the apparatus they can see both of the wearer's eyes in such a way that they do not notice any unusual magnification of the wearer's left eye which might otherwise look unusual or become a problem in making normal eye contact with the wearer.
FIG. 3 illustrates the principle of a camera viewfinder which replaces a portion of the visual field of view with the view from a camera, yet allows the wearer to see through the apparatus without experiencing any psychophysical adaptation or coordinate transformation.
FIG. 4 illustrates a version of the apparatus similar to that in FIG. 1, except where a portion of the visual field of view is only partially replaced, owing to the use of polarizers to prevent video feedback, as well as a beamsplitter rather than a double-sided mirror.
FIG. 5 shows an embodiment of the invention in which there are two televisions of different sizes which are each superimposed upon exactly the field of view that corresponds to each of two cameras, one being wide-angle and the other being tele.

FIG. 6 shows an embodiment of the wearable camera invention in which the viewfinder contains considerable magnification, yet allows other people to see both of the wearer's eyes except for a slight amount of blocked vision which may be concealed by making the glasses look like bifocal glasses.
While the invention shall now be described with reference to the preferred em-bodiments shown in the drawings, it should be understood that the intention is not to limit the invention only to the particular embodiments shown but rather to cover all alterations, modifications and equivalent arrangements possible within the scope of appended claims.
In all aspects of the present invention, references to "camera" mean any device or collection of devices capable of simultaneously determining a quantity of light arriving from a plurality of directions and or at a plurality of locations, or determining some other attribute of light arriving from a plurality of directions and or at a plurality of locations. Similarly references to "television" shall not be limited to just television monitors or traditional televisions used for the display of video from a camera near or distant, but shall also include computer data display means, computer data monitors, other video display devices, still picture display devices, ASCII text display devices, terminals, and the like.
With respect to both the cameras and televisions, as broadly defined above, the term "zoom" shall be used in a broad sense to mean any lens of variable focal length, any apparatus of adjustable magnification, or any digital, computational, or electronic means of achieving a change in apparent magnification. Thus, for example, a zoom viewfinder or zoom television shall be taken to include the ability to display a picture upon a computer monitor in various sizes through a process of image interpolation as may be implemented on a body-worn computer system.
DETAILED DESCRIPTION OF THE INVENTION WITH
REFERENCE TO DRAWINGS
Fig 1 shows an early embodiment of the wearable camera invention built into eye-glass frames 100, typically containing two eyeglass lenses 105. A wide-angle camera 110 is typically concealed within the nose bridge of the eyeglass frames 100.
In what follows, the wide-angle camera 110 will be simply referred to as the "wide-camera".
In this embodiment of the wearable camera invention, a second camera, 120, is also concealed in the eyeglass frames 100. This second camera is one which has been fitted with a lens of longer focal length, and will be referred to as a "tele-camera"
in what follows. The wide-camera 110 faces forward looking through a beamsplit-ter 130 so that the tele-camera 120 may have exactly the same field of view as the wide-camera 110. The beamsplitter 130 is typically mounted at a 45 degree angle, and the optical axes of the two cameras are typically at 90 degree angles to each other. The optical axes of the two cameras should intersect and thus share a common viewpoint. Typically eyeglasses with black frames are selected, and a CCD
sensor array for wide-camera 110 is concealed in a cavity which is also used as a nose bridge support, so that the eyeglasses have a normal appearance. The wide-camera is typi-cally fitted with a lens having a diameter of approximately 132 inch (less than one millimeter) - small enough that it cannot be easily seen by someone at close con-versational distance to the person wearing the eyeglasses. The tele-camera 120 is typically concealed in the upper portion of the eyeglass frames. In some prototypes, an Elmo G~N42H camera was used owing to its long and very slender (7mm diame-ter) construction. In actual manufacture, a custom-made tele-camera could be built directly into the eyeglass frames. Since the tele-camera 120 is typically built into the top of the eyeglass frames, the wide-camera 110 should also be mounted near the top of the frames. In most prototypes of the invention, a complete camera system provid-ing NTSC video was not installed directly in the eyeglasses. Instead, wires 125 from the camera sensor arrays were concealed inside the eyeglass frames and run inside a hollow eyeglass safety strap such as the safety strap that is sold under the trade name "Croakies". Wires 125 are run down to a belt pack or to a body-worn computer, recording, transmitting device, or the like. In some embodiments, a minimal amount of circuitry was concealed in the eyeglass frames so that the wires 125 could be driven with a buffered signal in order to reduce signal loss. In or behind one or both of the eyeglass lenses 105, there is typically an optical system 150 for the camera viewfinder.
This optical system provides a magnified view of a miniature television screen 160 in which the viewing area is typically less than one inch (or less than 25 millimeters) on the diagonal. For example, in one recent embodiment, the viewfinder comprised a 1~4 inch (approx. 6mm) television screen comprising an LCD spatial light modulator with a field-sequenced LED backlight. In some embodiments of the invention, the television screen was driven by a coaxial cable carrying a video signal similar to an NTSC RS-170 signal. In this case the coaxial cable and additional wires to power it are concealed inside the eyeglass safety-strap and run down to a belt pack or other body-worn equipment by connection 190.
In some embodiments television 160 contains a television tuner so that a single coaxial cable may provide both signal and power. In other embodiments the majority of the electronic components needed to construct the video signal are worn on the body, and the eyeglasses contain only a minimal amount of circuits, perhaps only a spatial light modulator, LCD flat panel, or the like, with termination resistors and backlight. In this case, there are a greater number of wires 170. In some embodiments of the invention the television screen 160 is a VGA computer display, or another form of computer monitor display, connected to a computer system worn on the body of the wearer of the eyeglasses. In typical operation of the invention, light enters the eyeglasses and is absorbed and quantified by one or more cameras. By virtue of the connection 190, information about the light entering the eyeglasses is available to a body-worn computer system. The computer system may calculate the actual quantity of light, up to a single unknown scalar constant, arriving at the glasses from each of a plurality of directions corresponding to the location of each pixel of the camera with respect to the camera's center of projection. This calculation may be done using the PENCIGI~APHY method described above. In some embodiments of the invention a second tele-camera 120 provides a more dense array of such photoquanta estimates.
This increase in density toward the center of the visual field of view matches the characteristics of the human visual system in which there is a central foveal region of increased visual acuity. Video from one or both cameras is possibly processed by the body-worn computer and recorded or transmitted to one or more remote locations by body-worn video transmission means or body-worn Internet connection, such as a standard WA4DSY 56 kbps RF link with a KISS 56 eprom running TCP/IP over an AX25 connection to the serial port of the body-worn computer. The possibly processed video signal is sent back up into the eyeglasses through connection 190 and appears on viewfinder screen 160, viewed through optical elements 150. If desired, the wide-angle camera may be used for motion tracking to serve the role of a head-tracker by determining the location of the head using optical flow methods, and the foveal camera may then be used as a high-resolution index into that image.
Thus even though television screen 160 may only have 240 lines of resolution, a virtual television screen of extremely high resolution may be implemented by virtue of the head-tracker, so that the wearer may view very high resolution pictures through what appears to be a small window that pans back and forth across the picture by the head-movements of the wearer. This act of panning the head back-and forth also may cause a high-resolution picture to be acquired through appropriate processing of a plurality of low-resolution pictures captured on tele-camera 120. This action mimicks the function of the human eye, where saccades are replaced with head movements to sweep out the scene using the camera's light-measurement ability as is typical of PENCIGRAPHIC imaging.
A major shortcoming of the apparatus depicted in Fig 1 is that the optical elements 150 block the eyes) of the wearer. The wearer may be able to adapt to this condition, or at least compensate for it through the display of video from the wearable camera to create an illusion of transparency, in the same way that a hand-held camcorder creates an illusion of transparency when it is on and running even though it would function as a vision-blocking eye patch when turned off. However, the fact that the eye of the wearer is blocked means that others cannot make eye-contact with the wearer. In social situations this creates an unnatural form of interaction.
Although the lenses of the glasses may be made sufficiently dark that the viewfinder optics are concealed, it is preferable that the viewfinder optics may be concealed in eyeglasses that allow others to see both of the wearer's eyes. Accordingly, a viewfinder system is depicted in Fig 2 in which an optical path 200 brings light from a viewfinder screen 210, through a first relay mirror 220, along a cavity inside the left temple-side piece of the glasses formed by an opaque side shield 230, or simply by hollowing out a temple side-shield. Light travels to a second relay mirror 240 and is combined with light from the outside environment as seen through diverging lens 250. The light from the outside and from the viewfinder is combined by way of beamsplitter 260. The rest of the eyeglass lenses 261 are typically tinted slightly to match the beamsplitter 260 so that other people looking at the wearer's eyes do not see a dark patch where the beamsplitter is. Converging lens 270 magnifies the image from the viewfinder screen 210, while canceling the effect of the diverging lens 250. The result is that others can look into the wearer's eyes and see both eyes at normal magnification, while at the same time, the wearer can see the camera viewfinder at increased magnification.
The embodiments of the wearable camera depicted in Fig 1 and Fig 2 give rise to a small displacement between the actual location of the camera, and the location of the virtual image of the viewfinder. Therefore, when performing tasks at close range, such as looking into a microscope while wearing the glasses, there is a discrepancy that must be learned. Initially when wearing the glasses, the tendency is to put the microscope up to the eye, rather than the camera. As a result, the apparatus fails to record exactly the wearer's experience. It is desired that the apparatus will record exactly the wearer's experience. Thus if the wearer looks into a microscope, the glasses should record that experience for others to observe vicariously through the wearer's eye. Although the wearer can learn the difference between the camera position and the eye position, it is preferable that this not be required, for otherwise, as previously described, long-term usage may lead to undesirable flashback effects.
Accordingly, Fig 3 illustrates a system whereby rays of light spanning a visual angle from ray 310 to ray 320 enter the apparatus and are intercepted by a two-sided mirror 315, typically mounted at a 45 degree angle with respect to the optical axis of a camera 330.
These rays of light enter camera 330. 'rhe video output of the camera 330 is displayed upon television screen 340 possibly after having been processed on a body-worn computer system or the like. A reflection of television screen 340 is seen in the other side of mirror 315, so that the television image of ray 310 appears as virtual ray 360 and the television image of ray 320 appears as ray 370. Since the camera 330 records an image image that is backwards, a backwards image is displayed on the television screen 340.
Since the television 340 is observed in a mirror, the image is reversed again so that the view seen at eye location 390 is not backwards. In this way a portion of the wearer's visual field of view is replaced by the exact same subject matter, in perfect spatial register with the real world. The image could, in principle also be registered in tonal range, using the PENCIGRAPHY framework for estimating the unknown nonlinear response of the camera, and also estimating the response of the display, and compensating for both. So far focus has been ignored, and infinite depth-of-field has been assumed. In practice, a viewfinder with a focus adjustment is used, and the focus adjustment is driven by a servo mechanism controlled by an autofocus camera.
Thus camera 330 automatically focuses on the subject matter of interest, and controls the focus of viewfinder 330 so that the apparent distance to the object is the same while looking through the apparatus as with the apparatus removed.
It is desirable that embodiments of the wearable camera invention comprising man-ual focus cameras have the focus of the camera linked to the focus of the viewfinder so that both may be adjusted together with a single knob. Moreover, a camera with zoom lens may be used together with a viewfinder having zoom lens. The zoom mech-anisms are linked in such a way that the viewfinder image magnification is reduced as the camera magnification is increased. Through this appropriate linkage, any increase in magnification by the camera is negated exactly by decreasing the apparent size of the viewfinder image.
The calibration of the autofocus zoom camera and the zoom viewfinder may be done by temporarily removing the mirror 315 and adjusting the focus and zoom of the viewfinder to maximize video feedback. This must be done for each zoom setting, so that the zoom of the viewfinder will properly track the zoom of the camera.
By using video feedback as a calibration tool, a computer system may monitor the video output of the camera while adjusting the viewfinder and generating a lookup table for the viewfinder settings corresponding to each camera setting. In this way, calibration may be automated during manufacture of the wearable camera system.
Some similar embodiments of the wearable camera invention use two cameras and two viewfinders. In some embodiments, the vergence of the viewfinders is linked to the focus mechanism of the viewfinders and the focus setting of cameras, so that there is a single automatic or manual focus adjustment for viewfinder vergence, camera vergence, viewfinder focus, and camera focus.
The apparatus of Fig 3 does not permit others to make full eye-contact with the wearer. Accordingly, Fig 4 depicts a similar apparatus in which only a portion of the rays of the leftmost ray of light 410 is deflected by beamsplitter 415. A
visual angle subtended by light ray 410 to light ray 420 is deflected by way of beamsplitter 415 into camera 430. Output from this camera is displayed on television 470, possibly after processing on a body-worn computer or processing at one or more remote sites, or a combination of local and remote image processing or the like. A partial reflection of television 440 is visible to the eye of the wearer by way of beamsplitter 415. The leftmost ray of light 460 of the partial television 440 is aligned with the direct view of the leftmost ray of light 410 from the original scene. Thus the wearer sees a superposition of whatever real object is located in front of ray 410 and the television picture of the same real object at the same location. The rightmost ray of light 420 is similarly visible through the beamsplitter 415 in register with the rightmost virtual ray reflected off the beamsplitter 415. In order to prevent video feedback, in which light from the television screen would shine into the camera, a polarizes 480 is positioned in front of the camera. The polarization axis of the polarizes is aligned at right angles to the polarization axis of the polarizes inside the television, assuming the television already has a built-in polarizes as is typical of small battery powered LCD televisions, LCD camcorder viewfinders, and LCD computer monitors.
If the television does not have a built in polarizes, a polarizes is added in front of the television. Thus video feedback is prevented by virtue of the two crossed polarizers in the path between the television 440 and the camera 430. If the television displays the exact same rays of light that come from the real world, the view at eye location 490 is essentially the same as it might otherwise be. However, in order that the viewfinder provide a distinct view of the world, it may be desirable that the virtual light from the television be made different in color or the like from the real light from the scene. For example, simply using a black and white television, or a black and red television, or the like, or placing a colored filter over the television, will give rise to a unique appearance of the region of the wearer's visual field of view by virtue of a difference in color between the television image and the real world upon which it is exactly superimposed. Even with such chromatic mediation of the television view of the world, it may still be difficult for the wearer to discern whether or not video is correctly exposed. Accordingly, a pseudocolor image may be displayed, or unique patterns may be used to indicate areas of over exposure or under exposure.
Television 440 may also be fitted with a focusing lens so that it may be focused to the same apparent depth as the real objects in front of the apparatus. A
single manual focus adjustment may be used for both camera 430 and television 440 to adjust them both together. Alternatively, an autofocus camera 430 may control the focus of television 440. Similarly, if a varifocal or zoom camera is used, a varifocal lens in front of television 440 should be used, and should be linked to the camera lens, so that a single knob may be used to adjust the zoom setting for both.
The apparatus of Fig 4 may be calibrated by temporarily removing the polarizes, and then adjusting the focal length of the lens in front of television 440 to maximize video feedback for each zoom setting of camera 430. This process may be automated if desired, for example, using video feedback to generate a lookup table used in the calibration of a servo mechanism controlling the zoom and focus of television 440.
The entire apparatus is typically concealed in eyeglass frames in which the beam-sputter is either embedded in one or both glass lenses of the eyeglasses, or behind one or both lenses. In the case in which a monocular version of the apparatus is being used, the apparatus is built into one lens, and a dummy version of the beamsplit-ter portion of apparatus may be positioned in the other lens for visual symmetry.
These beamsplitters may be integrated into the lenses in such a manner to have the appearance of ordinary the lenses in ordinary bifocal eyeglasses. Moreover, magni-fication may be unobtrusively introduced by virtue of the bifocal characteristics of such eyeglasses. Typically the entire eyeglass lens is tinted to match the density of the beamsplitter portion of the lens, so there is no visual discontinuity introduced by the beamsplitter.
Fig 5 depicts a foveated embodiment of the invention in which incoming light is intercepted from the direct visual path through the eyeglasses and directed instead, by double-sided mirror 510 to beamsplitter 520. A portion of this light passes through beamsplitter 520 and is absorbed and quantified by wide-camera 530. A portion of this incoming light is also reflected by beamsplitter 520 and directed to tele-camera 540. The image from the wide-camera 530 is displayed on a large screen television 550, typically of size 0.7 inches (approx. l8mm) on the diagonal, forming a wide-field-of-view image of virtual light 551 from the wide-camera. The image from the tele-camera 540 is displayed on a small screen television 560, typically of screen size 1~4 inch (approx. 6mm) on the diagonal, forming a virtual image of the tele-camera as virtual light 561. A smaller television screen is used to display the image from the tele-camera in order to negate the increased magnification that the tele-camera would otherwise provide. In this manner, there is no magnification, and both images appear as if the rays of light were passing through the apparatus, so that the virtual light rays align with the real light rays were they not intercepted by the double-sided mirror 510. Television 550 is viewed as a reflection in mirror 510, while television 560 is viewed as a reflection in beamsplitter 570. Note also that the distance between the two televisions 550 and 560 should equal the distance between double-sided mirror 510 and beamsplitter 570 as measured in a direction perpendicular to the optical axes of the cameras. In this way, the apparent distance to both televisions will be the same, so that the wearer experiences a view of the two televisions superimposed upon one-another in the same depth plane. Alternatively, the televisions may be equipped with lenses to adjust their magnifications so that the television displaying the image from the tele camera 540 subtends a smaller visual angle than the television displaying the image from wide camera 530, and so that these visual angles match the visual angles of the incoming rays of light 500. In this way, two television screens of equal size may be used, which simplifies manufacture of the apparatus.
Typically, the entire apparatus is built within the frames 590 of a pair of eyeglasses, where cameras 530 and 540, as well as televisions 550 and 560 are concealed within the frames 590 of the glasses, while double-sided mirror 510 and beamsplitter 570 are mounted in, behind, or in front of the lens of the eyeglasses. In some embodiments, mirror 510 is mounted to the front of the eyeglass lens, while beamsplitter 5'70 is mounted behind the lens. In other embodiments, one or both of mirror 510 and beamsplitter 570 are actually embedded in the glass of the eyeglass lens.
Fig 6 depicts an alternate embodiment of the wearable camera invention depicted in Fig 4 in which both the camera and television are concealed within the left temple side-piece of the eyeglass frames. A first beamsplitter 610 intercepts a portion of the incoming light and directs it to a second beamsplitter 620 where some of the incoming light is directed to camera 630 and some is wasted illuminating the television screen 640. However, the screen 640, when presented with a video signal from camera (possibly after being processed by a body-worn computer, or remotely by way of wireless communications, or the like) directs light back through beamsplitter 620, where some is wasted but is absorbed by the eyeglass frame to ensure concealment of the apparatus, and some is directed to beamsplitter 610. Some of this light is directed away from the glasses and would be visible by others, and some is directed to the curved mirror 650 where it is magnified and directed back toward beamsplitter 610.
The portion that is reflected off of beamsplitter 610 is viewed by the wearer, while the portion that continues back toward beamsplitter 620 must be blocked by a polarizes 660 to prevent video feedback. Implicit in the use of polarizes 660 is the notion that the television produces a polarized output. This is true of LCD televisions which comprise a liquid crystal display between crossed polaroids. If the television is of a type that does not already produce a polarized output, an additional polarizes should be inserted in front of television 640. Finally, if it is desired that the apparatus be unobtrusive, an additional polarizes or polarizing beamsplitter should be used so that the television 640 is not visible to others by way of its reflection in beamsplitter 610.
Alternatively, in certain situations it may actually be desirable to make the display visible to others. For example when the system is used for conducting interviews, it might be desirable that the person being interviewed see himself or herself upon the screen. This may be facilitated by exposing beamsplitter 620 to view, or allowing the reflection of the television to be seen in beamsplitter 610.
Alternatively, another television may be mounted to the glasses, facing outwards. Therefore, just. as the wearer of the proposed invention may see the image captured by the camera, along with additional information such as text of a teleprompter, the interviewees) may also be presented with an image of themselves so that they appear to be looking into an electronic mirror, or may be teleprompted by this outward-facing display, or both. In some embodiments of the invention, the use of two separate screens was useful for facilitation of an interview, in which the same image was presented to both the inward-facing television and the outward-facing television, but the images were mixed with different text. In this way the wearer was teleprompted with one stream of text, while the interviewee was prompted with a different stream of text.
BENEFITS OF THE INVENTION
The wearable camera invention allows the wearer to experience the camera over a long period of time. For example, after wearing the apparatus 16 hours per day for several weeks, it begins to function as a true extension of the mind and body. In this way, photographic composition is much more optimal, because the act of taking pictures or shooting video no longer requires conscious thought or effort.
More-over, the intentionality of the picture-taking process is not evident to others, because picture-taking is not preceeded by a gesture such as holding a viewfinder object up to the eye. The wearable viewfinder is an important element of the wearable cam-era invention allowing the wearer to experience everyday life through a screen, and therefore be always ready to capture anything that might happen, or even anything that might have happened previously by virtue of the retroactive record capability of the invention. Moreover, additional information beyond just exposure and shutter speed may be displayed in the camera viewfinder. For example, the camera allows the wearer to augment, diminish, or otherwise alter his or her perception of visual reality. This mediated-reality experience may be shared. The wearer may allow oth-ers to alter his or her perception of reality. In this way the invention is useful as a new communications medium, in the context of collaborative photography, collab-orative videography, and telepresence. Moreover, the invention may perform other useful tasks such as functioning as a personal safety device and crime deterrent by virtue of its ability to maintain a video diary transmitted and recorded at multiple remote locations. As a tool for photojournalists and reporters, the invention has clear advantages over other competing technologies.
OTHER EMBODIMENTS

From the foregoing desc.~iption. it will thus be evident that the present invention provides a design for a wearable camera with a viewfinder. As various changes can be made in the above embodiments and operating methods without departing from the spirit or scope of the invention, it is intended that all matter contained in the above description or shown in the accompanying drawings should be interpreted as illustrative and not in a .limiting sense.
Variations or modifications to the design and construction of this invention, within the scope of the invention, may occur to those skilled in the art upon reviewing the disclosure herein. Such variations or modifications, if within the spirit of this invention, are intended to be encompassed within the scope of any claims to patent protection issuing upon this invention.
EMBODIMENTS FEATURING BODY-WORN COMPUTER
A typical embodimer,.t of the invention may be based on a wearable computer system and may include a body-worn electronic display means capable of display of a picture, video, or graphic information, where the display means is affixed to the body in such a manner as to leave both of the wearer's hands free. and where the display means is capable of the display of information from the body worn computer system, and where the computer system is capable of receiving input from a body-worn electronic camera.
This embodiment nee~~ not necessarily be eyeglass-based, as shown in the draw-ings, but may, for example, take the form of other headwear such as a helmet.
For example. a separate camera and camera viewfinder are mounted to a helmet. and the camera is connected to a body-worn computer System in such a way that the computer system may capture images from the camera, and where the viewfinder comprises a computer monitor connected to the computer system.
Some of the preferred embodiments comprise a wearable computer based personal imaging system where some of the rays of light that would enter the eye in the absence of the system are diverted to the camera by the system and displayed in such a manner that each ray of light frc>m the display device enters the eye in such a wav that it is essentiallv collinear to th.e corresponding ray of light that initially entered the system (e.g. each ray of processed light can emerge collinearly with the corresponding rays of incoming light that gave rise to it).
This personal imaging system may operate by rays of light being diverted by a mirror which is reflective on both sides, one side being used to divert rays of light to one or more cameras, and the other side of the mirror being used to view a video image from the camera, ~~ossibly after the video image has been processed or altered by a body worn computer system or by virtue of a wireless communications means.
In other words, the wearer can allow other people (wirelessly linked) to alter his or her visual perception of reality.
The personal imaging system may also direct only a portion of each ray of light that would otherwise enter the eye in the absence of the system, so that the portion of light is diverted to the camera and displayed in such a manner that the portion of each ray of light from the display device enters the eye in such a way that when the signal from the camera is displayed upon the display device, the rays of light entering the eye each correspond to subject matter that is essentially equivalent to that which would have been observed in the absence of the personal imaging system.
In this personal imaging system, the camera and the screen of may be concealed within the frame of eyegl~~sses, and means of diverting rays of light toward the camera may be concealed within one or both lenses of the eyeglasses.
With the partial reality mediator personal imaging system; a portion of each ray of light that enters the e;ye may be diverted to the camera and displayed in such a manner that this portion of each ray of light from the display device enters the eye in such a way that when the signal from the camera is displayed upon the display device, the rays of light entering the eye each correspond to subject matter that is in approximate spatial alignment with the undiverted portion of each of said rays of light, when the wearable cornput~~r ,just copies input (camera) to ozztput (display).
Of course it is not necessary to maintain the above collinearitv criterion.
and there are in fact some lesser preferred embodiments of the invention that don~t maintain this spatial alignment between the display, especially when it does not completely block the wearer's vision. In this case, it is preferable that the video image from the camera appears upside-down, rotated 90 degrees, or is otherwise presented in the display means in a rnann~~r that makes it sufficiently distinct from the portion of the wearer's field of view that is not mediated ly the display means.
In many embodiments of the wearable computer personal imaging system, the display means is a see-through display in the sense that it blocks essentially none of the wearer's visual field of view. and where a continuously updated image from the camera may be presented upon the display in a sufficiently different color than it would otherwise appear in the absence of the personal imaging system, so that the continuously updated image remains distinctly visible from the unmediated portion of the visual field of view.
In some of the personal imaging system embodiments, especially those with see through displays, an indication of over exposure or under exposure is given as an overlay on the subject maoter that is over or under exposed. Thus, for example, where the display means is a see-through display in the sense that it blocks essentially none of the wearer's visual field of view, a continuously updated image from the camera is presented upon the display means in a sufficient manner as to indicate clearly areas of over exposure or areas of underexposure as uniquely textured or colored patches superimposed on the scene.
The above exposure indicator may take the form of graphic information, e.g.
graphics superimposed on reality. Thus a continuously updated image from said cam-era is presented upon the display means together with additional graphic information pertaining to image exposure or pixel value statistics calculated from the camera, by way of the wearable computer system.

In some eyeglass embodiments of the invention, optical elements are embedded within a lens of the eyeglasses in such a way as to provide a magnified view of said display means, and where the c.~ptical elements are arranged and located to give the eyeglasses the appearance of ordinary bifocal eyeglasses. For aesthetic.
svmcnetrv an el improved covertness. a mirrored (left-right reversed) replica of the optical elements is installed in the other lens of the eyeglasses even if this mirrored replica is non-functional. Thus a stereo or twcr-eye System would have two sets of optics, but so would a monocular system, where the second set of optics is a dummy set of optics not actually used other tluan for the aesthetic benefit (visual symmetry) of others who look at the wearer of the apparatus.
Some embodiments work just like the old gun sights and weapons sights commonly used during the war years, where the beamsplitter (diverter) is installed backwards and a concave mirror is used so that the user sees a double reflection magnified by the concave mirror. In this case the display optics includes a beamsplitter mounted at an approximate 45 degree angle with respect to the optical axis of the w°earer's eve looking through it, and a, curved mirror with optical axis perpendicular to the that c>f the wearer's eye is mounted to provide a magnified inuage of the display means.
This means and apparatus may be embedded within the lenses of eyeglasses, to direct light from the display ~:neans into one or both eyes of the wearer of the eyeglasses.
Using the miniaturized weapon-sight principle embedded in eyeglasses, the beam-splitter unfortunately is not entirely covert. Therefore, it is preferable that the eye-glasses be lightly tinted. Prefera,b~ly the eyeglass lens is tinted everywhere other tluan where the beamsplitter is located, so that the eyeglass lens matches exactly the degree of transmissivity of the portion where the beamsplitter is embedded in. That makes the apparatus almost completely covert.
This tinting can preferably be implemented by a metallization, so that the beam-splitter itself' is just part of the Same metallization (the same thin metal coating deposited on the eyeglass lens). Therefore the beamsplitter is implemented through a partial nretalization w;.thin the eyeglass lenses, extending sufficiently drat most of the rays of light passing through each of the lenses must also pass through the partial metalization, and where the partial metalization is located at varying depth from the front surface of each of the eyeglass lenses, so that the partial rnetalization curves around to form a beamsplitter chat directs light from one or more of the display means into one or both eves of the wearer.
In extreme cases, e.g. where a nice wide field of view is needed, it is hard to conceal the discontinuity of the beanrsplitter portion. In some embodiments of the invention, rather than tr~ring to conceal the 1>eamsplitter, the partial rnetalization of the entire eyeglass lens is done in such a way that there will be a discontinuity in the partial metalization such that the partial metalization gives the eyeglass lenses the appearance of ordinary bifocal lenses commonly used in eyeglasses.
Embodiments of the :invention using the weapons sight principle for the display will typically have a beamsplitter and concave mirror positioned such that light from the subject matter being photographed or observed through the eyeglasses may pass through the beamsplitter once to reach the wearer's eye, while light being observed from the display means must pass through the beamsplitter, be reflected off the concave mirror, and then be reflected off the beamsplitter to reach the wearer's eye.
Again, these items, li~eamsplitter a,nd concave mirror are preferably embedded within the lens of the eyeglasses.
Even with this embodiment, it is preferable that the eyeglass lens is tinted every-where except where said heamsplitter i5 located so that, the entire eyeglass lens is of the same transmissivity.
Typically the display means comprises a computer monitor and the wearable com-puter system is capable of acquiring a digital representation of pictures from the cam-era at a rate of more than one picture per second, and displaying these pictures upon the display means, so than a viewfinder effect rewzlts.

These wearable computer peripherals {computer monitor and camera) are prefer-ably mounted in eyeglasses for the preferred embodiment, but may be mounted on other headwear for other useful embodiments.
In many eyeglass based embodiments, a television screen or spatial light modula-tor, or other active image display surface of the computer monitor and the camera are mounted in the frames of eyeglasses, and means of providing magnification a.nd re-direction of light rays to view the monitor is embedded within the glass of one or both lenses of said eyeglasses.
There will often be a means of providing magnification and re-direction of light rays to view the monitor, where th.e magnification and re-direction means is embedded within the lens material of one or lboth lenses of the eyeglasses, below the main optical axis of the eye in its normal position, so that the means of providing magnification and re-direction of light rays to view said monitor is embedded in a position within said eyeglass lenses that is typical of bifocal eyeglass lenses. Thus the preferred embodiment will have the appearance of ordinary bifocal eyeglasses, to people other than the wearer (e.g. the wearer will be the only one who need know that the eyeglasses are different from ordinary bifocal eyeglasses).
In many embodiments the wearable computer system is connected wirelessly to a remote base-station by way of radio communications, so that images from the camera can be processed or altered on the remote base-station.
EMBODIMENTS FEATURING WEARABLE DISPLAYS
Some embodiments of the invention may feature multiple video display devices.
This may facilitate monitoring more than one camera. One or more electronic cameras and one or more video display devices are fixed together in a wearable device such that one or more of the video di~~play devices is visible to one or both eyes and is capable of displaying a pi~aure or video signal from one or more of the cameras.
Some embodiments have displyys that are responsive to an input from a camera, while others have displays that are not responsive to an inpi.it from a camera. In the former case, rays of light that would enter the eye in the absence of the apparatus are diverted to one or more cameras, and displayed in such a manner that rays of light from the one or more of said display devices enter the eye in such a way that when the signal from one or more of said cameras is connected to one or more of said displays, In the former case, rags of light entering the eye each correspond to subject matter that is essentially equivalent to that which would have been observed in the absence of said apparatus.
In a preferred embodiment (preferred for its simplicity of design and manufacture), rays of light are diverted by a mirror which is reflective on both sides, one side being used to divert rays of light to one or more cameras, and the other side of the mirror being used to view a video image of the output from said camera, possibly after the video image has been pr~~cessed or altered by a body worn computer system or by virtue of a wireless communications means.
This same apparatus with one or more cameras and one or more display means may also be mounted in eyeglasses.
Again, the means of providing magnification and re-direction of light rays to view said monitor may be embedded within the glass of one or both lenses of said eyeglasses, below the main optical axis of the eye in its normal position, so that the means of providing magnification a:nd re-direction of light rays to view the monitor is embedded in a position within the eyeglass lenses that is typical of bifocal eyeglass lenses.
One or more of said cameras and one or more of said display devices may be affixed in eyeglasses.
In some embodiments, light may be split, by way of a beamsplitter, to two cameras of differing fields of view.
Similarly, in some embodiments of the invention, there rnay be two (or more) display devices, one displaying output from each of two cameras.
EMBODIMENTS lE'EATURING FIELD OF VIEW INDICATORS
3~l Some embodiments of the invention have a display that is in now wav responsive to any input from the c<~,mera. Other embodiments of the invention have a display that i5 responsive to an input from the camera part of the time. and some have a display that is only partially responsive to the camera (perhaps only part of the time).
In one embodiment, a body-worn electronic camera is affixed to the body of a wearer in such a manner as to leave both of the wearer's hands free. and where, also affixed to the wearer is a means of displaying a static pattern of a rectangle, graticule. or other indication of the field of view of the camera.
This embodiment may of coin°se be mounted within eyeglasses.
In some eyeglass base~~ embodiments, a camera mounted in eyeglasses is mounted within eyeglasses that also include means of displaying a static pattern of a rectangle, graticule, or other indication of the field of view of the camera, where the means comprises reflective and refractive elements embedded within the lens material of one or both lenses of the eye~;lasses. Again, the static pattern is, in many embodiments of the invention. not responsive to any input frorrr the camera.
In a preferred embodiment, the=_ optics for generating the static pattern of a rectan-gle, graticule, or other indication of the field of view of the camera comprise reflective and refractive elements embedded within the lower portion of the glass of both lenses of said eyeglasses.

Claims (83)

The embodiments of the invention in which I claim an exclusive property or privilege are defined as follows:
1. a personal imaging system for personal image capture and processing comprising:

~ a wearable computer:
~ a camera for supplying a picture signal to said wearable computer, said camera for being borne by headwear:
~ a viewfinder for being borne by said headwear, said viewfinder for providing at least a visible image boundary, said visible image boundary in focus to a wearer of said headwear.
2. A personal imaging system for personal image capture and processing, comprising:

~ a wearable computer;
~ a camera for supplying a picture signal to said wearable computer said camera for being borne by headwear:
~ a viewfinder for being borne by said headwear, said viewfinder for providing a visible image boundary, said visible image boundary for appearing in focus to a wearer of said headwear, rays of light from said visible image boundary being collinear with rays of light defining a field of view of said camera.
3. A personal imaging system for personal image capture and processing, comprising:

~ a camera, said camera for being borne by headwear:

~ an image processing computer for processing an output of said camera:
~ a viewfinder for being borne by said headwear, said viewfinder for providing a visible image boundary, said visible image boundary for appearing in focus to a wearer of said headwear, at least some rays of light from said visible image boundary being collinear with at least come rays of light defining a field of view of said camera.
4. A personal imaging system for personal image capture and prucessing, comprising:

~ a camera said camera for being borne by headwear:
~ a wearable picture processing computer for processing an output of said camera;
~ a viewfinder for being borne by said headwear, said viewfinder for providing a visible image boundary, said visible image boundary for appearing in focus to a wearer of said headwear, the center of the field of view of said viewfinder, as viewed by a wearer of said personal imaging system, being collinear with an incoming ray of light to which the center of a picture from said camera is most responsive, when said personal imaging system is in use by said wearer.
5. a personal imaging system for personal image capture and processing, comprising:

~ a camera, said camera for being borne by headwear:
~ a wearable picture processing computer for processing an output of said camera:
~ a viewfinder for being borne by said headwear, said viewfinder for providing a rectangular visible image boundary, said visible image bourndary for appearing in focus to a wearer of said headwear, rays of light from the corners of said visible image boundary as viewed by a wearer of said personal imaging system, being collinear with incoming ray of light to which the corners of a picture from said camera are most responsive, when said personal imaging system is in use by said wearer.
6. A personal imaging system for personal image capture and processing, comprising:
~ a camera. said camera for being borne by headwear:
~ a wearable picture processing computer for processing an output of said camera;
~ a viewfinder for being borne by said headwear, said viewfinder for providing a visible image boundary, said visible image boundary for appearing in focus to a wearer of said headwear.
the field of view of said camera being equal to the field of view of said visible image boundary as viewed by a wearer of said personal imaging system.
7. A wearable personal imaging system for picture capture and processing.
comprising:
~ a camera;
~ optics, at least a portion of said optics for being borne by headwear. said optics for directing rays of light into said camera, the effective center of projection of said camera when operating together with said optics, being located approximately at the center of a lens of an eye of a wearer of said personal imaging system, when said wearer is looking in an approximate forward direction;
~ a wearable picture processing computer for processing an output of said camera;

~ a viewfinder for being borne by said headwear. said viewfinder for providing a visible image boundary. said visible image boundary for appearing in focus to said wearer, the center of the field of view of said camera together with said optics.
being approximately collinear with the center of the field of view of said visible image boundary as viewed by said wearer.
8. The personal imaging system of Claim 1. 2. 3. 4. 5, 6. or. 7. including a diverter for diverting at least a portion of some rays of eyeward bound light into said camera.
9. The personal imaging system of Claim 8. where said diverter has one mirrorred surface.
10. The personal imaging system of Claim 8, where said diverter is located diagonally with respect to said camera's optical axis, and an optical axis defined by an eye of a wearer of said personal imaging system, when said wearer is looking straight ahead.
11. The personal imaging system of Claim 8. where said diverter is a two-sided mirror.
12. The personal imaging system of Claim 8, where said diverter is a beamsplitter.
13. The personal imaging system of Claim 12 further including at least one polarizer in the optical path between said camera and said viewfinder.
14. The personal imaging system of Claim 12 further including at least one polarizes in the optical path between said camera and said diverter.
15. The personal imaging system of Claim 8, where the effective center of projection of said camera is the same distance from the effective optical center. facing said camera, of said diverter as the effective center of projection of all eye of a wearer of said personal imaging system is from the effective optical center, facing said eye, of said diverter.
16. The personal imaging system of Claim 8. where said diverter has at least one flat side.
17. The personal imaging system of Claim 1. 2. 3, 4, 5, 6, 7, 8, 9, 10 11, 12.
13, 14, or 15, said viewfinder including a camera aiming aid, said camera aiming aid including one of:
~ a reticle:
~ a graticule;
~ a rectangle:
~ a marking.
18. The personal imaging system of Claim 1, 2, 3, 4. 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, said viewfinder responsive to said computer, but said viewfinder not responsive to said camera, said viewfinder including a camera aiming aid. said camera aiming aid comprising visible information displayed on said viewfinder from said computer.
19. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, l4, or 15, where said camera is a wide camera, said personal imaging system further including a narrow camera.
20. The personal imaging systems of Claim 19, where said narrow camera and said wide camera share a common effective center of projection.
21. The personal imaging system of Claim 20 where said common effective center of projection co-incides with the center of projection of an eye of a wearer of said personal imaging system.
22. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15. where the center of projection of said camera co-incides with the center of projection of an eye of a wearer of said personal imaging system.
23. The personal imaging system of Claim 19, 20, or 21, where said viewfinder is a wide viewfinder, said personal imaging system further including a narrow viewfinder.
24. The personal imaging system of Claim 23, respective rays of light from said wide viewfinder being collinear with rays of light to which said wide camera is responsive, and respective rays of light from said narrow viewfinder being collinear with rays of light to which said narrow camera is responsive.
25. The personal imaging system of Claim 23, or 24, where said narrow viewfinder is an electronic viewfinder. said narrow viewfinder for being responsive to an input from said camera.
26. The personal imaging system of Claim 25, where said wide viewfinder is not responsive to an input from either of said cameras.
27. The personal imaging system of Claim 1. 2, 3, 4, 5, 6, 7, 8, 9. 10 11. 12.
13. 14.
or 15, further including a camera based headtracker.
28. The personal imaging system of Claim 23, or 24, further including a camera based headtracker.
29. The personal imaging system of Claim 1, 2. 3. 4, 5, 6, 7, 8, 9, 10 11, 12, 13. 14, or 15, further including an eyetracker.
30. The personal imaging system of Claim 23, or 24, further including an eyetracker.
31. The personal imaging system of Claim 1. 2. 3. 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, 27, or 29, further including means for overlaying additional information on said viewfinder, said additional information responsive to an input from said camera.
32. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, said camera responsive to rays of light collinear with lines extending outward from an eye of a wearer of said personal imaging system.
33. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, or 7, further including means for directing at least some rays of light from said viewfinder. such that said rays of light are collinear with at least some light rays to which said camera is responsive.
34. The personal imaging system of Claim 1. 2, 3, 4, 5, 6, or 7, further including means for directing all rays of light from said viewfinder, such that said rays of light are collinear with all light rays to which said camera is responsive.
35. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11. 12, 13, 14, or 15, said viewfinder being in focus to an eye of a wearer of said personal imaging system regardless of a focus of a lens of said eye.
36. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, focus of said viewfinder being responsive to an output of said computer.
37. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11. 12, 13, 14, or 15, focus of said viewfinder being responsive to focus of said camera.
38. A personal always ready picture capture device, including the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, together with means for retroactive recording of at least one picture, said means for retroactive recording including a circular buffer.
39. A visual memory prosthetic, including the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, said visual memory prosthetic including an object recognizes.
40. The personal imaging system of Claim 1, 2, 3. 4, 5, 6, 7, 8, 9, 10 11 12, 13, 14, or 15, further including means for directing a user of said personal imaging system to position subject matter of greatest relevance within the field of view of said camera, said means comprising the processing of images from said camera. and display of results of said processing on said viewfinder.
41. The personal imaging system of Claim 40, for inducing a hypnotic semi-trance state in said user, similar to that induced by viewing a television in a darkened room. such that said user will tend to rotate his or her head until subject matter said user wishes to see is within the field of view of said camera.
42. The personal imaging system of Claim 40, where said processing includes the addition of noise to said images.
43. The personal imaging system of Claim 40, where said processing includes enhancement of said images.
44. The personal imaging system of Claim 40, where said camera is a night vision camera, and said processing is the processing normally done in the course of displaying imagery from a night vision camera.
45. A night vision system using the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, further including means for directing a user of said personal imaging system to position subject matter of greatest relevance within the field of view of said camera, said means comprising means for brightening subject matter within the field of view from said camera. by way of display of results of processing of images from said camera on said viewfinder.
said brightening for enabling said user to see more clearly objects in said field of view.
46. The personal imaging system of Claim 1. 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, where said headwear comprises eyeglasses, and where said camera is concealed within the nose bridge of said eyeglasses.
47. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15. where said headwear includes eyeglasses, and where said camera is concealed within the upper portion of the frames of said eyeglasses.
48. The personal imaging system of Claim 19, 20, or 21, said wide camera being concealed within the nose bridge of eyeglasses. and where said narrow camera is concealed within the upper portion of the frames of said eyeglasses.
49. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9. 10 11. 12, 13, 14, or 15, a connection between said computer and said camera being made by way of wires concealed inside an eyeglass safety strap.
50. A quantigraphic personal imaging system, including the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, where said computer calculates the actual quantity of light, up to a single unknown scalar constant.
arriving at said camera from each of a plurality of directions.
51. The personal imaging system of Claim 19. 20, or 21, including headtracker.
said headtracker comprising processing an output of said wide camera by way of said computer.
52. The personal imaging system of Claim 1, 2. 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13.
14, or 15, including a virtual television screen of high resolution. and means for indexing a view into said virtual television screen, said means comprising headtracker for tracking head movements of a wearer of said personal imaging system, said means for tracking head movements including the processing of a plurality of pictures from said camera by way of said computer.
53. A non eye-blocking personal imaging system, for allowing other people to make eye contact and see both eyes of a wearer of said non eye-blocking personal imaging system, said non eye-blocking personal imaging system comprising the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, together with a magnifier for viewing said viewfinder. and a demagnifier for cancelling distortion of an eye of a wearer of said personal imaging system.
54. The system of Claim 53. where said demagnifier is a diverging lens.
55. The personal imaging system of Claim 1, 2, 3, 4, 5, 6, or, 7, where said headwear is eyeglasses, said personal. imaging system including a beamsplitter borne by a lens of said eyeglasses, said lens of said eyeglasses being tinted slightly to match said beamsplitter, for concealment of said beamsplitter.
56. The personal imaging system of Claim 8, where said headwear is eyeglasses.
said diverter comprising a beamsplitter borne by a lens of said eyeglasses, said lens of said eyeglasses being tinted slightly to match said beamsplitter, for concealment of said beamsplitter.
57. A method of electronic newsgathering using the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, and comprising the steps of:
~ wearing said personal imaging system for some time period before, as well as during a newsworthy event;
~ viewing objects through said viewfinder for some time before as well as during a newsworthy event;
~ capturing images into said computer.
58. The method of electronic newsgathering of Claim 57, where said step of capturing images into said computer includes a step of capturing at least some of said images into a circular buffer, and where said method of electronic newsgathering further includes a step of stopping the capturing of said at least some of said images into said circular buffer, after said newsworthy event.
59. A reality mediator for altering the visual perception of reality, said reality mediator including the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, said reality mediator further including means for processing images captured from said camera and means for displaying results of processing said images on said viewfinder.
60. The reality mediator of Claim 59. where said means for processing said images comprises a program running on said computer.
61. The reality mediator of Claim 69, further including a picture signal transmitter means and a picture signal receiver means, where said means for processing said images comprises transmission of said picture signal to at least one remote location for processing at said remote location, followed by reception of said picture signal by way of said picture signal receiver.
62. The reality mediator of Claim 59. where said means for processing said images includes the steps of capturing said images by way of said computer, followed by transmission of at least some of said images to at least one remote location, followed by at least some processing of said at least some of said images at paid at least one remote location. followed by reception of results of said at least come processing.
63. The reality mediator of Claim 59, or 60, where said computer is connected by a wireless communications link to a computer network comprised of said computer and at least one of her computer.
64. A collaborative reality mediator system for a community of photographic cybernetic users. said collaborative reality mediator comprising at least two personal imaging systems as described in Claim 59, 60, 61, or 62.
65. The personal imaging system of Claim 1, 3, 3. 41, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, further including means for combining multiple pictures of the same subject matter into a single image of increased resolution.
66. A collaborative reality mediator, for a community of photographic cybernetic users, said collaborative reality mediator comprising at least two personal imaging systems as described in Claim 65.
67. A reality augmenter. including the personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, where said viewfinder is an electronic viewfinder, said reality augmenter further including means for overlaying information on top of information displayed from said camera on said viewfinder.
68. A method of videography, including the reality augmenter of Claim 67, said method of videography including the steps of:
~ outfitting at least ones user with said reality augmenter, together with remote data communications means for remotely communicating with said computer;
~ using said means of overlaying information to remotely advise said at least one user with regard to matters of videographic composition or content.
69. The method of videography of Claim 68, wherein a plurality of users are each outfitted with said reality augmenter, and where said data communications means includes means for any of said users to remotely advise any other of said users.
70. A system for collaboration including at least two personal imaging systems of Claim 52, one of said personal imaging systems for a first user, and another of said personal imaging systems for a second user, said means for indexing a view into said virtual television screen being for said first user to index a view into a virtual television screen of said second user, and further including means for said second user to index a view into a virtual television screen of said first user.
71. A system for shared lookpainting, including the system for collaboration of Claim 70, further including means for combining multiple pictures of the same subject matter into a single image of increased resolution.
72. A method of manufacturing the apparatus of Claim 8, or Claim 56, said method comprising the steps of:
~ prior to installing said diverter;
~ aligning said camera with respect to said viewfinder, while monitoring an output of said camera, said alignment responsive to said output of said camera, said alignment for maximizing the degree to which said rays of light from said visible image boundary enter said camera closest to said boundary of a field of view of said camera:
~ installing said diverter after completing said aligning said camera with respect to said viewfinder.
73. A method of manufacturing an embodiment of the apparatus of Claim 8. or Claim 56, in which said viewfinder is an electronic viewfinder, said method comprising the steps of:
~ prior to installing said diverter;
~ presenting a feedback test signal to said viewfinder;
~ aligning said camera with respect to said viewfinder, while monitoring an output of said camera, said alignment responsive to said output of said camera, said alignment for maximizing the degree to which said output of said camera matches at least one aspect of said feedback test signal:

~ installing said diverter after completing said aligning said camera with respect to said viewfinder.
74. The personal imaging system of Claim 1, 2. 3, 4, 5. 6, 7, 8, 9, 10, 11, 12, 13, 14, or 15, said viewfinder responsive to an input from said computer.
75. The personal imaging system of Claim 74 for use by a wearer of said personal imaging system, light from said viewfinder being virtual light, said personal imaging system further including means for providing said virtual light with a unique appearance in a region of said wearer's field of view that corresponds to a region to which said camera is responsive to light.
76. The personal imaging system of Claim 75, where said means is by the elimination of colour information from said virtual light.
77. The personal imaging system of Claim 75, where said means is a colour filter for altering the colour of said virtual light.
78. The personal imaging system of Claim 75, where said means includes display of images from said computer in pseudocolour on said viewfinder.
79. The personal imaging system of Claim 75, where said means includes display of unique patterns on said viewfinder, said unique patterns also indicating areas of over exposure.
80. The personal imaging system of Claim 75, where said means includes display of unique patterns on said viewfinder, said unique patterns also indicating areas of under exposure.
81. Tile personal imaging system of Claim 1, 2, 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, for use by a wearer of said personal imaging system, further including means for making said display visible to other people standing in front of said wearer.
82. The personal imaging system of Claim 1, 2. 3, 4, 5, 6, 7, 8, 9, 10 11, 12, 13, 14, or 15, for use by a wearer of said personal imaging system, further including a second display visible to other people standing in front of said wearer.
83. A wearable personal imaging system for picture capture and processing, comprising:
~ an image sensor:
~ optics, at least a portion of said optics for being borne by headwear, said optics for directing rays of light into said sensor, the effective center of projection of said sensor together with said optics, being located approximately at the center of a lens of an eye of a wearer of said personal imaging system, when said wearer is looking in an approximate forward direction:
~ a wearable picture processing computer for processing an output of said sensor;
~ a viewfinder for being borne by said headwear, said viewfinder for providing a visible image boundary, said visible image boundary for appearing in focus to said wearer, the center of the field of view of said sensor when operating together with said optics, being approximately collinear with the center of the field of view of said visible image boundary as viewed by said wearer.
CA 2233047 1998-02-02 1998-03-25 Wearable camera system with viewfinder means Expired - Fee Related CA2233047C (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA2,228,403 1998-02-02
CA 2228403 CA2228403A1 (en) 1998-02-02 1998-02-02 Means and apparatus for aquiring, processing, and combining multiple exposures of the same scene or objects to different illuminations
CA 2233047 CA2233047C (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means

Applications Claiming Priority (22)

Application Number Priority Date Filing Date Title
CA 2310114 CA2310114A1 (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means
CA 2233047 CA2233047C (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means
CA 2235030 CA2235030A1 (en) 1998-02-02 1998-04-14 System for electronic newsgathering, documentary video, and photojournalism
CA 2247649 CA2247649C (en) 1998-02-02 1998-10-13 Covert camera viewfinder or display having appearance of ordinary eyeglasses
CA 2290765 CA2290765C (en) 1998-02-02 1998-10-13 Covert camera viewfinder or display having appearance of ordinary eyeglasses
US09172599 US6307526B1 (en) 1998-02-02 1998-10-15 Wearable camera system with viewfinder means
CA 2249976 CA2249976C (en) 1998-02-02 1998-10-15 Wearable camera system with viewfinder means
CA 2248473 CA2248473C (en) 1998-02-02 1998-10-29 Eyetap camera or partial reality mediator having appearance of ordinary eyeglasses
CA 2256918 CA2256918C (en) 1998-02-02 1998-12-24 Aremac--based means and apparatus for interaction with computer, or one or more other people, through a camera
CA 2256920 CA2256920A1 (en) 1998-02-02 1998-12-29 Lenstop camera viewfinder or computer data display having appearance of ordinary reading glasses or half glasses
CA 2256922 CA2256922C (en) 1998-02-02 1998-12-31 Aiming and compositional means for head--worn camera
CA 2261376 CA2261376A1 (en) 1998-02-02 1999-02-01 Means and apparatus for acquiring, processing, and combining multiple exposures of the same scene or objects to different illuminations
CA 2264973 CA2264973A1 (en) 1998-03-15 1999-03-15 Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
JP2000538503A JP2002508636A (en) 1998-03-25 1999-03-25 Wearable camera system with a view finder means
PCT/CA1999/000248 WO1999049655A1 (en) 1998-03-25 1999-03-25 Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
EP19990908727 EP1064783B1 (en) 1998-03-25 1999-03-25 Wearable camera system with viewfinder means
DE1999608108 DE69908108D1 (en) 1998-03-25 1999-03-25 Visor for electronic news gathering, documentary video, photo journalism and personal safety
US09275775 US6614408B1 (en) 1998-03-25 1999-03-25 Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
JP2000538502A JP2002508635A (en) 1998-03-25 1999-03-25 Electronic news gathering, production of documentary video, in photo journalism, and iTap camera to be used for the life and physical safety
EP19990910052 EP1066717B1 (en) 1998-03-25 1999-03-25 Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
DE1999608574 DE69908574D1 (en) 1998-03-25 1999-03-25 Portable camera system with visor medium
PCT/CA1999/000249 WO1999049656A1 (en) 1998-03-25 1999-03-25 Wearable camera system with viewfinder means

Publications (1)

Publication Number Publication Date
CA2233047C true CA2233047C (en) 2000-09-26

Family

ID=25680010

Family Applications (2)

Application Number Title Priority Date Filing Date
CA 2310114 Abandoned CA2310114A1 (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means
CA 2233047 Expired - Fee Related CA2233047C (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CA 2310114 Abandoned CA2310114A1 (en) 1998-02-02 1998-03-25 Wearable camera system with viewfinder means

Country Status (2)

Country Link
US (1) US6307526B1 (en)
CA (2) CA2310114A1 (en)

Families Citing this family (143)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7953824B2 (en) 1998-08-06 2011-05-31 Digimarc Corporation Image sensors worn or attached on humans for imagery identification
US6614408B1 (en) * 1998-03-25 2003-09-02 W. Stephen G. Mann Eye-tap for electronic newsgathering, documentary video, photojournalism, and personal safety
GB9823977D0 (en) * 1998-11-02 1998-12-30 Scient Generics Ltd Eye tracking method and apparatus
US7117157B1 (en) 1999-03-26 2006-10-03 Canon Kabushiki Kaisha Processing apparatus for determining which person in a group is speaking
GB9908545D0 (en) * 1999-04-14 1999-06-09 Canon Kk Image processing apparatus
US6710805B1 (en) * 2000-01-26 2004-03-23 Hewlett-Packard Development Company, L.P. Simplified user interface for digital camera
US20120105740A1 (en) 2000-06-02 2012-05-03 Oakley, Inc. Eyewear with detachable adjustable electronics module
DE10135626B4 (en) * 2000-07-21 2007-09-06 Fujinon Corp. Teleprompter and associated signal processing device
US20020071277A1 (en) * 2000-08-12 2002-06-13 Starner Thad E. System and method for capturing an image
US6956614B1 (en) * 2000-11-22 2005-10-18 Bath Iron Works Apparatus and method for using a wearable computer in collaborative applications
WO2002054147A8 (en) * 2000-12-28 2006-04-06 Adi Anani Method and device for interpretation of an observed object
US20030007079A1 (en) * 2001-06-08 2003-01-09 Sisselman Kerry Pauline Electronic personal viewing device
US7013009B2 (en) 2001-06-21 2006-03-14 Oakley, Inc. Eyeglasses with wireless communication features
US7539504B2 (en) * 2001-12-05 2009-05-26 Espre Solutions, Inc. Wireless telepresence collaboration system
US7805114B1 (en) 2002-07-17 2010-09-28 Bath Iron Works Corporation In situ re-configurable wireless communications system (IRCWCS)
US6753899B2 (en) 2002-09-03 2004-06-22 Audisoft Method and apparatus for telepresence
US7742013B2 (en) * 2002-09-26 2010-06-22 Hari Hara Kumar Venkatachalam Integrated spectacles and display unit for computers and video
GB2394852B (en) * 2002-10-31 2006-12-20 Hewlett Packard Co Image capture systems using motion detection
US7576800B2 (en) * 2002-12-02 2009-08-18 Mike Swain Extreme sports video system
US20040119816A1 (en) * 2002-12-02 2004-06-24 Michael Swain Extreme sports video system
JP2004222254A (en) * 2002-12-27 2004-08-05 Canon Inc Image processing system, method, and program
US6784833B1 (en) * 2003-02-21 2004-08-31 Lockheed Martin Corporation Personal surveillance system with locating capabilities
US7922321B2 (en) 2003-10-09 2011-04-12 Ipventure, Inc. Eyewear supporting after-market electrical components
US8109629B2 (en) 2003-10-09 2012-02-07 Ipventure, Inc. Eyewear supporting electrical components and apparatus therefor
US7677723B2 (en) 2003-10-09 2010-03-16 Ipventure, Inc. Eyeglasses with a heart rate monitor
US7438410B1 (en) 2003-10-09 2008-10-21 Ip Venture, Inc. Tethered electrical components for eyeglasses
US7792552B2 (en) 2003-04-15 2010-09-07 Ipventure, Inc. Eyeglasses for wireless communications
US7760898B2 (en) 2003-10-09 2010-07-20 Ip Venture, Inc. Eyeglasses with hearing enhanced and other audio signal-generating capabilities
US7500747B2 (en) 2003-10-09 2009-03-10 Ipventure, Inc. Eyeglasses with electrical components
US7192136B2 (en) * 2003-04-15 2007-03-20 Howell Thomas A Tethered electrical components for eyeglasses
US7255437B2 (en) 2003-10-09 2007-08-14 Howell Thomas A Eyeglasses with activity monitoring
US8465151B2 (en) 2003-04-15 2013-06-18 Ipventure, Inc. Eyewear with multi-part temple for supporting one or more electrical components
US7380936B2 (en) 2003-10-09 2008-06-03 Ipventure, Inc. Eyeglasses with a clock or other electrical component
US7806525B2 (en) 2003-10-09 2010-10-05 Ipventure, Inc. Eyeglasses having a camera
US7581833B2 (en) 2003-10-09 2009-09-01 Ipventure, Inc. Eyewear supporting after-market electrical components
US7872635B2 (en) 2003-05-15 2011-01-18 Optimetrics, Inc. Foveated display eye-tracking system and method
JP4623657B2 (en) * 2003-05-28 2011-02-02 富士機械製造株式会社 Capturing an image processing apparatus and an imaging image processing method of the electronic component mounting apparatus
US20050052119A1 (en) * 2003-09-08 2005-03-10 Gang Yu Organic electronic device having low background luminescence
US8337013B2 (en) 2004-07-28 2012-12-25 Ipventure, Inc. Eyeglasses with RFID tags or with a strap
US7755608B2 (en) * 2004-01-23 2010-07-13 Hewlett-Packard Development Company, L.P. Systems and methods of interfacing with a machine
US7500746B1 (en) 2004-04-15 2009-03-10 Ip Venture, Inc. Eyewear with radiation detection system
US7403337B2 (en) * 2004-05-11 2008-07-22 Universal Vision Biotechnology Co., Ltd. Focus adjustable head mounted display system and method and device for realizing the system
US20060017841A1 (en) * 2004-07-26 2006-01-26 Farrell Brian J Surveillance Camera Mount for Pegboard
US8388164B2 (en) * 2005-05-17 2013-03-05 Michael Waters Hands-Free lighting devices
US9526292B2 (en) 2005-05-17 2016-12-27 Michael Waters Power modules and headgear
WO2007007278A3 (en) * 2005-07-11 2007-03-29 Elmar Gallo Wearable device supporting a microcamera
US8956396B1 (en) * 2005-10-24 2015-02-17 Lockheed Martin Corporation Eye-tracking visual prosthetic and method
US20070081123A1 (en) * 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US9658473B2 (en) 2005-10-07 2017-05-23 Percept Technologies Inc Enhanced optical and perceptual digital eyewear
US8696113B2 (en) 2005-10-07 2014-04-15 Percept Technologies Inc. Enhanced optical and perceptual digital eyewear
US7499217B2 (en) * 2006-03-03 2009-03-03 University Of Central Florida Research Foundation, Inc. Imaging systems for eyeglass-based display devices
US7542210B2 (en) * 2006-06-29 2009-06-02 Chirieleison Sr Anthony Eye tracking head mounted display
US7593034B2 (en) * 2006-08-31 2009-09-22 Dekeyser Paul Loop recording with book marking
US7543934B2 (en) 2006-09-20 2009-06-09 Ipventures, Inc. Eyeglasses with activity monitoring and acoustic dampening
JP5017989B2 (en) * 2006-09-27 2012-09-05 ソニー株式会社 Imaging apparatus, an imaging method
US8130261B2 (en) * 2006-10-10 2012-03-06 Exelis, Inc. System and method for dynamically correcting parallax in head borne video systems
US8648897B2 (en) * 2006-10-10 2014-02-11 Exelis, Inc. System and method for dynamically enhancing depth perception in head borne video systems
EP2095178B1 (en) 2006-12-14 2015-08-12 Oakley, Inc. Wearable high resolution audio visual interface
WO2008109172A1 (en) * 2007-03-07 2008-09-12 Wiklof Christopher A Recorder with retrospective capture
WO2009049272A3 (en) * 2007-10-10 2009-06-18 Gerard Dirk Smits Image projector with reflected light tracking
US8550651B2 (en) 2007-12-18 2013-10-08 Waters Industries, Inc. Lighted hat
US8491145B2 (en) 2007-12-18 2013-07-23 Waters Industries, Inc. Illuminated headgear having switch devices and packaging therefor
US8757831B2 (en) 2007-12-18 2014-06-24 Michael Waters Headgear having an electrical device and power source mounted thereto
CN202975580U (en) 2010-04-30 2013-06-05 迈克尔·沃特斯 Head apparatus and camera arranged on hat
CA2709991A1 (en) 2007-12-18 2009-06-25 Michael Waters Hands free lighting devices
US7802883B2 (en) 2007-12-20 2010-09-28 Johnson & Johnson Vision Care, Inc. Cosmetic contact lenses having a sparkle effect
US8743223B2 (en) * 2008-02-21 2014-06-03 Microsoft Corporation Linking captured images using short range communications
US8151194B1 (en) * 2008-03-26 2012-04-03 Google Inc. Visual presentation of video usage statistics
US7544288B1 (en) 2008-05-16 2009-06-09 Michael Cook Gutter filtering device
US8526779B2 (en) 2008-11-07 2013-09-03 Looxcie, Inc. Creating and editing video recorded by a hands-free video recording device
US8593570B2 (en) * 2008-11-07 2013-11-26 Looxcie, Inc. Video recording camera headset
US8352046B1 (en) 2009-01-30 2013-01-08 Advanced Bionics, Llc Sound processing assembly for use in a cochlear implant system
US8872910B1 (en) * 2009-06-04 2014-10-28 Masoud Vaziri Method and apparatus for a compact and high resolution eye-view recorder
US9697746B2 (en) * 2009-09-30 2017-07-04 National Ict Australia Limited Object tracking for artificial vision
US8558154B2 (en) * 2009-10-29 2013-10-15 Applied Precision, Inc. System and method for continuous, asynchronous autofocus of optical instruments using multiple calibration curves
US8376548B2 (en) 2010-09-22 2013-02-19 Vuzix Corporation Near-eye display with on-axis symmetry
WO2012054231A3 (en) 2010-10-04 2012-12-06 Gerard Dirk Smits System and method for 3-d projection and enhancements for interactivity
EP2499960B1 (en) * 2011-03-18 2015-04-22 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Method for determining at least one parameter of two eyes by setting data rates and optical measuring device
US8510166B2 (en) 2011-05-11 2013-08-13 Google Inc. Gaze tracking system
US8860787B1 (en) 2011-05-11 2014-10-14 Google Inc. Method and apparatus for telepresence sharing
KR101824501B1 (en) * 2011-05-19 2018-02-01 삼성전자 주식회사 Device and method for controlling display of the image in the head mounted display
US8737803B2 (en) 2011-05-27 2014-05-27 Looxcie, Inc. Method and apparatus for storing and streaming audiovisual content
US9560314B2 (en) 2011-06-14 2017-01-31 Microsoft Technology Licensing, Llc Interactive and shared surfaces
US8928735B2 (en) 2011-06-14 2015-01-06 Microsoft Corporation Combined lighting, projection, and image capture without video feedback
US9288468B2 (en) * 2011-06-29 2016-03-15 Microsoft Technology Licensing, Llc Viewing windows for video streams
US9405135B2 (en) 2011-09-15 2016-08-02 Ipventure, Inc. Shutter eyewear
US20130088413A1 (en) 2011-10-05 2013-04-11 Google Inc. Method to Autofocus on Near-Eye Display
US8970452B2 (en) 2011-11-02 2015-03-03 Google Inc. Imaging method
US8681426B2 (en) 2011-11-04 2014-03-25 Honeywell International Inc. Steerable near-to-eye display and steerable near-to-eye display system
CA2794370A1 (en) 2011-11-04 2013-05-04 Michael Waters Hat with automated shut-off feature for electrical devices
US8611015B2 (en) 2011-11-22 2013-12-17 Google Inc. User interface
US8872853B2 (en) 2011-12-01 2014-10-28 Microsoft Corporation Virtual light in augmented reality
US9311751B2 (en) 2011-12-12 2016-04-12 Microsoft Technology Licensing, Llc Display of shadows via see-through display
US9568173B2 (en) 2011-12-23 2017-02-14 Michael Waters Lighted hat
US9609902B2 (en) 2011-12-23 2017-04-04 Michael Waters Headgear having a camera device
US9526287B2 (en) 2011-12-23 2016-12-27 Michael Waters Lighted hat
US9864211B2 (en) 2012-02-17 2018-01-09 Oakley, Inc. Systems and methods for removably coupling an electronic device to eyewear
US8862764B1 (en) 2012-03-16 2014-10-14 Google Inc. Method and Apparatus for providing Media Information to Mobile Devices
US8893164B1 (en) 2012-05-16 2014-11-18 Google Inc. Audio system
US9030505B2 (en) * 2012-05-17 2015-05-12 Nokia Technologies Oy Method and apparatus for attracting a user's gaze to information in a non-intrusive manner
US9002308B1 (en) * 2012-06-04 2015-04-07 Maxim Integrated Products, Inc. Receiver automatic gain control (AGC) and slicer
US8971568B1 (en) 2012-10-08 2015-03-03 Gerard Dirk Smits Method, apparatus, and manufacture for document writing and annotation with virtual ink
US9265458B2 (en) 2012-12-04 2016-02-23 Sync-Think, Inc. Application of smooth pursuit cognitive testing paradigms to clinical drug development
US20140160248A1 (en) * 2012-12-06 2014-06-12 Sandisk Technologies Inc. Head mountable camera system
WO2014093932A1 (en) 2012-12-14 2014-06-19 Biscotti Inc. Mobile presence detection
US9485459B2 (en) * 2012-12-14 2016-11-01 Biscotti Inc. Virtual window
US9654563B2 (en) 2012-12-14 2017-05-16 Biscotti Inc. Virtual remote functionality
US20140211320A1 (en) * 2013-01-31 2014-07-31 Kabushiki Kaisha Toshiba Visual line detection device
US9500865B2 (en) * 2013-03-04 2016-11-22 Alex C. Chen Method and apparatus for recognizing behavior and providing information
US9380976B2 (en) 2013-03-11 2016-07-05 Sync-Think, Inc. Optical neuroinformatics
CN205177388U (en) 2013-03-15 2016-04-20 奥克利有限公司 Eyepiece system
US9717633B2 (en) 2013-03-15 2017-08-01 Michael Waters Lighted headgear
US8922589B2 (en) 2013-04-07 2014-12-30 Laor Consulting Llc Augmented reality apparatus
GB201310359D0 (en) * 2013-06-11 2013-07-24 Sony Comp Entertainment Europe Head-Mountable apparatus and systems
US9710130B2 (en) 2013-06-12 2017-07-18 Microsoft Technology Licensing, Llc User focus controlled directional user input
CN205691887U (en) 2013-06-12 2016-11-16 奥克利有限公司 Modularization communication system and glasses communication system
US9658454B2 (en) 2013-09-06 2017-05-23 Omnivision Technologies, Inc. Eyewear display system providing vision enhancement
US9652892B2 (en) 2013-10-29 2017-05-16 Microsoft Technology Licensing, Llc Mixed reality spotlight
CN104639518A (en) * 2013-11-14 2015-05-20 中兴通讯股份有限公司 Session building method and device and session content delivering method and device
US9578307B2 (en) 2014-01-14 2017-02-21 Toyota Motor Engineering & Manufacturing North America, Inc. Smart necklace with stereo vision and onboard processing
US9915545B2 (en) 2014-01-14 2018-03-13 Toyota Motor Engineering & Manufacturing North America, Inc. Smart necklace with stereo vision and onboard processing
US9629774B2 (en) 2014-01-14 2017-04-25 Toyota Motor Engineering & Manufacturing North America, Inc. Smart necklace with stereo vision and onboard processing
US9237847B2 (en) 2014-02-11 2016-01-19 Welch Allyn, Inc. Ophthalmoscope device
US9211064B2 (en) 2014-02-11 2015-12-15 Welch Allyn, Inc. Fundus imaging system
WO2015149027A1 (en) 2014-03-28 2015-10-01 Gerard Dirk Smits Smart head-mounted projection system
USD770143S1 (en) 2014-05-23 2016-11-01 Michael Waters Beanie with means for illumination
US9922236B2 (en) 2014-09-17 2018-03-20 Toyota Motor Engineering & Manufacturing North America, Inc. Wearable eyeglasses for providing social and environmental awareness
USD768024S1 (en) 2014-09-22 2016-10-04 Toyota Motor Engineering & Manufacturing North America, Inc. Necklace with a built in guidance device
KR20160072364A (en) * 2014-12-12 2016-06-23 삼성디스플레이 주식회사 Electro-optical device and wearable electronic device
CN107111136A (en) * 2014-12-31 2017-08-29 埃西勒国际通用光学公司 Binocular device comprising a monocular display device
US9576460B2 (en) 2015-01-21 2017-02-21 Toyota Motor Engineering & Manufacturing North America, Inc. Wearable smart device for hazard detection and warning based on image and audio data
US9586318B2 (en) 2015-02-27 2017-03-07 Toyota Motor Engineering & Manufacturing North America, Inc. Modular robot with smart device
US9677901B2 (en) 2015-03-10 2017-06-13 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for providing navigation instructions at optimal times
US9811752B2 (en) 2015-03-10 2017-11-07 Toyota Motor Engineering & Manufacturing North America, Inc. Wearable smart device and method for redundant object identification
US9972216B2 (en) 2015-03-20 2018-05-15 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for storing and playback of information for blind users
US9898039B2 (en) 2015-08-03 2018-02-20 Toyota Motor Engineering & Manufacturing North America, Inc. Modular smart necklace
JP2017049670A (en) * 2015-08-31 2017-03-09 カシオ計算機株式会社 Display control device, display control method, and program
US20170108892A1 (en) * 2015-10-14 2017-04-20 Atomic Vr Inc Wearable computing system
US20170154464A1 (en) * 2015-11-30 2017-06-01 Microsoft Technology Licensing, Llc Multi-optical surface optical design
WO2017106875A1 (en) 2015-12-18 2017-06-22 Gerard Dirk Smits Real time position sensing of objects
US9813673B2 (en) 2016-01-20 2017-11-07 Gerard Dirk Smits Holographic video capture and telepresence system
US20170336609A1 (en) * 2016-05-18 2017-11-23 Carl Zeiss Ag Catadioptric eyepiece system, eyepiece system and optical system
US9958275B2 (en) 2016-05-31 2018-05-01 Toyota Motor Engineering & Manufacturing North America, Inc. System and method for wearable smart device communications

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3697154A (en) 1971-05-12 1972-10-10 Us Navy Optical viewing system
US3833300A (en) 1973-05-14 1974-09-03 Us Navy Three {37 d{38 {11 weapons sight
GB1533859A (en) 1975-04-29 1978-11-29 Elliott Bros Headgear incorporating optical display systems
US4220400A (en) 1977-02-22 1980-09-02 Honeywell Inc. Display apparatus with reflective separated structure
US4516157A (en) 1982-11-23 1985-05-07 Campbell Malcolm G Portable electronic camera
JPS59117876A (en) 1982-12-24 1984-07-07 Seiko Epson Corp Personal liquid crystal video display device
US4649434A (en) 1984-01-23 1987-03-10 Weinblatt Lee S Eyeglass-frame mountable view monitoring device
US4786966A (en) 1986-07-10 1988-11-22 Varo, Inc. Head mounted video display and remote camera system
US4806011A (en) 1987-07-06 1989-02-21 Bettinger David S Spectacle-mounted ocular display apparatus
US5095326A (en) 1988-10-28 1992-03-10 Asahi Kogaku Kogyo K.K. Kepler-type erect image viewfinder and erecting prism
US5331333A (en) 1988-12-08 1994-07-19 Sharp Kabushiki Kaisha Display apparatus
US5189512A (en) * 1991-07-01 1993-02-23 Camair Research, Inc. Helmet integrated display system
JP3365780B2 (en) 1991-08-23 2003-01-14 オリンパス光学工業株式会社 Real-image zoom finder optical system
US5570156A (en) 1991-08-26 1996-10-29 Canon Kabushiki Kaisha Camera utilizing detection of visual line
US5486701A (en) * 1992-06-16 1996-01-23 Prometrix Corporation Method and apparatus for measuring reflectance in two wavelength bands to enable determination of thin film thickness
US5422653A (en) 1993-01-07 1995-06-06 Maguire, Jr.; Francis J. Passive virtual reality
JP3260880B2 (en) 1993-01-26 2002-02-25 トウシバビデオプロダクツ プライベート リミテッド Luminance signal and color signal separating circuit
US5550585A (en) 1993-03-26 1996-08-27 Allan Cherri Video inter-view system
US5692227A (en) 1993-04-05 1997-11-25 Asahi Kogaku Kogyo Kabushiki Kaisha Viewfinder
WO1994026061A1 (en) 1993-04-29 1994-11-10 Michael Friedland Hands free video camera system
US5546099A (en) 1993-08-02 1996-08-13 Virtual Vision Head mounted display system with light blocking structure
EP0724758A4 (en) 1993-10-07 1998-03-04 Virtual Vision Inc Binocular head mounted display system
US5491510A (en) 1993-12-03 1996-02-13 Texas Instruments Incorporated System and method for simultaneously viewing a scene and an obscured object
JPH07199278A (en) 1993-12-28 1995-08-04 Canon Inc Imaging apparatus
US5610678A (en) 1993-12-30 1997-03-11 Canon Kabushiki Kaisha Camera including camera body and independent optical viewfinder
US5664244A (en) 1994-09-06 1997-09-02 Fuji Photo Film Co., Ltd. Viewfinder device
DE4436528C2 (en) 1994-10-13 1997-07-03 Lixfeld Wolf Dieter Optical magnifying device
WO1996014641A1 (en) 1994-11-04 1996-05-17 Kelly Shawn L Modular binocular electronic imaging system
KR0146142B1 (en) 1994-12-19 1998-09-15 이헌조 A detachable camcorder
JP3309615B2 (en) 1994-12-21 2002-07-29 キヤノン株式会社 Image observation apparatus and binocular image observation apparatus using the same
JPH08299275A (en) 1995-05-15 1996-11-19 Nippon Koden Corp Optical device for binocular image pickup and binocular image pickup apparatus
EP0825826B1 (en) 1995-05-15 2002-10-23 Leica Mikroskopie Systeme AG Process and device for the parallel capture of visual information
WO1997011386A1 (en) * 1995-09-21 1997-03-27 Omniplanar, Inc. Method and apparatus for determining position and orientation
US6005536A (en) * 1996-01-16 1999-12-21 National Captioning Institute Captioning glasses
DE69736039T2 (en) 1996-02-26 2007-01-11 Seiko Epson Corp. Portable information display device
EP0890259A4 (en) 1996-03-13 2003-01-29 Fraser Volpe Corp Real-time, multiple path video imaging system
US5828793A (en) 1996-05-06 1998-10-27 Massachusetts Institute Of Technology Method and apparatus for producing digital images having extended dynamic ranges
US6046712A (en) * 1996-07-23 2000-04-04 Telxon Corporation Head mounted communication system for providing interactive visual communications with a remote system
JP3338618B2 (en) * 1996-10-07 2002-10-28 ▲すすむ▼ ▲たち▼ Display method and display device in the real space image and virtual space image
US5777715A (en) * 1997-01-21 1998-07-07 Allen Vision Systems, Inc. Low vision rehabilitation system
US6057966A (en) * 1997-05-09 2000-05-02 Via, Inc. Body-carryable display devices and systems using E.G. coherent fiber optic conduit
US6043799A (en) * 1998-02-20 2000-03-28 University Of Washington Virtual retinal display with scanner array for generating multiple exit pupils

Also Published As

Publication number Publication date Type
CA2310114A1 (en) 1999-08-02 application
US6307526B1 (en) 2001-10-23 grant

Similar Documents

Publication Publication Date Title
US5883606A (en) Flat virtual displays for virtual reality
US7345277B2 (en) Image intensifier and LWIR fusion/combination system
US5696521A (en) Video headset
US6597346B1 (en) Hand held computer with see-through display
US5914810A (en) Stereoscopic imaging arrangement and viewing arrangement
US6222675B1 (en) Area of interest head-mounted display using low resolution, wide angle; high resolution, narrow angle; and see-through views
US6522474B2 (en) Head-mounted optical apparatus for stereoscopic display
US20050174470A1 (en) Head-mounted camera
US4744633A (en) Stereoscopic viewing system and glasses
US4805988A (en) Personal video viewing device
US4704000A (en) Vision enhancing system
US5861936A (en) Regulating focus in accordance with relationship of features of a person&#39;s eyes
US20050195277A1 (en) Image capturing apparatus
US5189512A (en) Helmet integrated display system
US8253760B2 (en) Imaging display apparatus and method
US6078427A (en) Smooth transition device for area of interest head-mounted display
US5963369A (en) Digital solid-state binoculars
US6487012B1 (en) Optically multiplexed hand-held digital binocular system
US6549231B1 (en) Image recording apparatus
EP0454443A2 (en) Spectacles incorporating display means for a stereoscopic viewing system
US5151722A (en) Video display on spectacle-like frame
US5129716A (en) Stereoscopic video image display appliance wearable on head like spectacles
US20040120035A1 (en) Binocular optical device, in particular electronic spectacles, comprising an electronic camera for automatically setting a focus that includes the correction of different vision defects
US5777715A (en) Low vision rehabilitation system
US20030020807A1 (en) Hand-held electronic stereoscopic imaging system with improved three-dimensional imaging capabilities

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed