KR100609421B1 - Video camera system - Google Patents

Abstract

The present invention relates to the use of a body worn movable computer having a video camera that allows image adjustment. Video camera users can't see the camera directly because of some obstacles quite often. In this case, a head mounted display worn by the user and connected to the computer can simplify this process to ensure that the camera points in the correct direction towards the object to be captured by the image. One example where such a system may be used is when the camera operator is located behind the crowd watching the parade. The camera operator can move the camera viewer in the desired direction by keeping the camera viewer above the crowd to view the image in his head mounted display. The visible image can then be displayed to the wearer (or user) at the same time and stored or recorded on the wearable computer or transmitted via the computer around the remote location.

Description

Image Display System and Image Adjustment System

The present invention relates to a video camera system, and more particularly to a system for transmitting a view from a video camera to a user. This application is a partial continuing application of US Patent Application No. 08 / 861,598, filed May 22, 1997.

Video capture devices similar to consumer video cameras have a viewfinder that provides the view information being captured to the video cameraman. This works well in an environment that allows the cameraman to hold the video camera close enough for the cameraman to look through the viewfinder. However, there are situations where the cameraman cannot see through the view feeder to confirm that what the camera is recording is what the cameraman planned at capture.

There are a number of situations where a cameraman or woman wants to capture a view on a video camera that the user cannot clearly see. For example, if the user is located behind the crowd watching the parade and wants to capture the parade on the video element, the user probably lifts the camera over his head and the view of the camera is in front of the user. Will try to avoid. When the user attempts as described above, the user cannot confirm whether the direction that the camera is actually facing is appropriate and whether his operation is correct or wrong. There are many opportunities for users to be in this situation where the parade view misses what was planned. In other situations where the user cannot easily observe the view being captured through the viewfinder, such as after an earthquake or building collapse, the viewing probe is typically inserted into the area between the debris. It would also be highly desirable if the user could adjust what the camera was viewing or could see if the camera was viewing the planned subject. Once this is accomplished, the user can change the angle or pointing direction of the video camera to ensure that the planned image is captured.

Nowadays there is no accommodation in which the user of the video cannot view the camera's view in order to view, view, adjust and adjust the view that the camera is recording. U.S. Patent No. 5,305,244 (granted to Newman et al.) Discloses a hands-free user-supported mobile computer. Newman et al. Systems provide a small, self-contained portable computing device that fully supports hands-free retrieval and display of information to a user. The computing device communicates with a processor to receive an audio command from a user, converts the received voice command into an electrical signal, recognizes the converted electrical signal, and transmits the recognized electrical signal to a processor for processing. A recognition module is included, which is supported by the user. The computing device further includes a display in communication with the processor to receive information from the processor and display the received information for the user, the display being supported by the user so that the user can view the information in a hands-free manner using only audio instructions. The computing device can be operated to display.

Remote viewing of video signals using a helmet integrated display system (HID) is known from US Pat. No. 5,189,512, which is worn on the head of a cameraman or on the head of a woman. Through a network of mirrors and convex lenses, the visible image is converted into a virtual image and provided to the cameraman's sighting eye. In addition, the occlusion device attached to the HID system partially blocks the view outside the non-sighting eye so that the image perceived from both eyes is combined into a predetermined image in the cerebral cortex of the cameraman. Such display systems are simple structures that are useful only for viewing video images remotely.

It was useful when the computer means were included in the middle of the system or in the same system with HID and video camera. For example, if a video was viewing a scene that was destroyed by a fire, earthquake, or other destructive force, it could be compared with an image generated by any computer before being immediately destroyed at that point. Another use of this type is for making mobile photographs, in which case the camera's holder cannot complete this operation while the cameraman's hand is holding the camera, thus requiring focusing or other manipulation of the camera. Voice or other hands free camera operation is very necessary. Another reason for hands-free computers in this type of system is that images and information communicate with systems such as other locations and the Internet. In addition, when a parade or other activity is being recorded on a video tape, an image or sound generated by the computer can be immediately generated by a voice or other hands free command formed on the video tape. In other cases, the processor can easily adjust the orientation of the camera that is recorded and played back every Nth frame of the image recorded on the videotape. User-Wearing or Wearable Mobile Hands-free computers are of great help to cameramen, especially when direct viewing via a video camera is not possible. The user wearable hands free computer device disclosed in US patent application Ser. No. 80 / 538,194 is very important in this type of system.

It is an object of the present invention to provide a system in which a video camera user views a subject when the video camera user does not use a camera viewfinder.

Another object of the present invention is to provide a system for a video camera user to adjust his or her camera direction when the video camera user does not see what is seen by the camera.

It is a further object of the present invention to provide a reliable method of capturing and / or transmitting vivid video information from a video camera when the user cannot easily observe the information captured through the viewfinder.

It is yet a further object of the present invention to provide a method and system for improving the accuracy of probes used to locate victims in collapsed buildings and the like.

This and other objects of the present invention are achieved by a system that can be used to view a camera while a mobile computer having a display screen or HMD does not use the camera viewfinder. Preferred mobile computers and drive means to be used in the present invention are of the type disclosed in Parent Application No. 08 / 538,194 to Mobile Assistant ^™ , but any suitable mobile computer having a viewing screen can be used. Mobile Assistant ^™ is a hands-free computer system that allows a user to hold a video or other camera in his hand, but any suitable mobile computer with a viewing screen can be used.

Computer No. 08 / 538,194 of "Mobile Assistant" ^TM , or "movable computer", hands-free with various driving means having the advantage provided by a hands-free driving computer even if it allows a user to carry a video camera. This is ideal for use in the present invention. In addition, the video camera can be easily coupled to the processor of the Mobile Assistant ^™ so that the camera view can be displayed on the head mounted display (HMD) of the Mobile Assistant ^™ . This method allows the video camera to be moved into an area that is not normally viewable while verifying that the intended subject to be recorded on the videotape has been captured correctly. This is accomplished by having a video capture device attached to the movable computer and viewing the image captured by the video camera. Once the image is viewed as described above, the portable video camera can be moved until the desired view is displayed in the HMD. The mobile computer then sends the video information to the storage communication port to send the information to the opposite location. While the information is being transmitted, the computer captures every Nth frame and displays it on the user's computer monitor or head mounted display. This method allows the cameraman to observe what is being captured and gives him the ability to adjust the camera's position if necessary.

There is also means for controlling the N-th frame exposure adjustment of the object being captured. The Nth frame represents a preselected number such as every fifth frame or every tenth frame.

The adaptation of the video camera for use in the present invention is relatively simple. A PMCCIA (PC) card can be used in the Mobile Assistant ^™ 's processor, which can be connected to a video camera using an RCA jack. The PC card used may be a suitable card, such as a Card Cam, available from Quadrant Corporation of Melbourne, Pennsylvania.

Although the system of the present invention continues to be described using a video camera, other types of cameras, such as still cameras, can equally be used. In addition, if desired, Mobile Assistant ^TM and other but movable in any suitable computer may be used, it is the Mobile Assistant ^TM more preferable because of flexibility. Mobile Assistant ^™ normally functions as follows.

Small, self-contained portable computing devices that are fully supported by the user are used for hands-free retrieval and display of information about the user. The computing device includes a housing having mounting means for removably mounting the housing to the user for support by the user. The housing further comprises storage means for storing pre-input information and processor means for communicating with storage means for receiving, retrieving and processing information and user instructions in accordance with the stored program. The computing device also communicates with the processor means to receive an audio command from the user, converts the received voice command into an electrical signal, recognizes the converted electrical signal and transmits the recognized electrical signal to the processor means. Audio transducers and converter means are included, which are also supported by the user. The computing device further comprises display means in communication with the processor means for receiving information from the processor means and for displaying the received information for the user, the display means being supported by the user so that the user can use hands-free only voice commands. The computing device can be operated to display information in a manner.

There are a number of situations where a person operating a wearable computer needs to have the video camera focus on items that are not directly visible to the operator of the wearable computer. The example involves using a camera with a portable rod provided for repair so that the camera is positioned around a visual obstruction, such as a device located in an enclosure in a narrow space. The image from the camera is delivered to the wearable computer and counted, processed and formatted for distribution in the wearable computer. The visual image is then displayed simultaneously on the wearable computer, stored and recorded on the wearable computer, and sent to a remote location for analysis.

The image / video acquisition system may be comprised of a video camera such as a Sony "XC-999" CCD made by Sony Corporation of Tokyo, Japan, or another camera capable of capturing and / or communicating still images or moving video. The camera can be connected via a multiple conductor cable to an image / video capture card such as "Cardcam Video-in" made by Quadrant Corporation of Melbourne, Pennsylvania, or via wireless means. Communicate with a host computer comprising a. The image / video capture card may be attached to a host computer attached to an actual camera or inserted into the host computer as a "PCMCIA" or "PC Card". The image / video capture card device described above plugs into a PCMCIA compatible slot housed inside a host computer, such as Mobile Assistant ^™ made by Governor Corporation, Fairfax, VA.

In this arrangement, the image / video capture card takes information from the video camera, converts the analog information into digital information, and performs one of the following steps. (1) storing the information on a hard drive or other medium for later transmission; (2) transmitting all information by means of communication connected to a host computer to transfer such information to a remote location; or (3 ) Simultaneously performing both storage and transmission steps. In any case, while simultaneously transmitting every Nth frame to the display device for camera adjustment, the stored program controls or transmits the information to the correct position. "Nth frame" means how many times it is required for the user to get the desired adjustment of the image being viewed. This desired adjustment is simply obtained as above by moving the video camera until the user sees what he wants to record by video (or other camera) means.

In another embodiment, the means for transferring the image from the camera to the host computer changes as the embodiment changes. For example, if the acquisition card is located in the camera, the user will probably exchange information through the serial or parallel port. This is somewhat important because some of the digital cameras (single short type cameras) have a direct interface to the serial port for transferring captured images to a computer. In this example, the camera is not the original video camera, but captures still images. Cameras used in this disclosure are clearly for "video cameras", but this includes still cameras, night vision cameras, thermography cameras, infrared cameras, or any other suitable camera.

1 shows a processor 2 of a computer having a control button 3 and a mouse lever 4 to be used when manual operation of the movable computer system is required. However, in the present invention, it is preferable to use voice driving, eye-tracking, electroencephalography or other hands free driving. See parent application no. 08 / 538,194 for suitable drive means. The processor 2 has a PCMCIA card housing 5 which houses a suitable PCMCIA (PC) card 10 useful for the present invention. The cable 6 extends from the electrical cord hole of the processor 2 to the video (or other) camera 1, while the cable 7 extends from the electrical cord hole of the processor 2 to the video (or other) camera 1. ) Or to a head-mounted display (HMD) or other monitor (see FIGS. 4 and 5). The recessed PC card housing 5 prevents the card from being damaged once the door 9 is closed. The slot 11 allows the cable 6 to be installed through the slot when the door is closed. Any suitable display such as the HMD shown in FIG. 3 can be used.

In FIG. 2, the head mounted display 8 comprises a narrow head band 12 with a rotating alternative lens or cell 13 attached to the head band. An alternative lens 13 is attached to the rotary arm 14. The head band 12 can be adjusted using the adjustment means 15. Computer connection means or processor connection means 7 attached to the alternative lens 13 is shown and extends to the processor 2 at the rear of the HMD 8. Details of suitable HMDs are described in pending patent application No. 08 / 745,013. The above description is part of this specification by reference. In addition, the ear cover or earphone 16 is connected to the head band 12, the microphone 17 is movably connected to the earphone 16. As mentioned above, voice driving is preferred, but other suitable means may be used in the present invention including other hands free driving means. Parent Application No. 08 / 538,194 discloses some suitable drive means and other embodiments useful in the present invention. The video image transmitted to the HMD is shown to the user in the alternative lens 13 and the video camera 1 is moved and redirected to record the desired image as shown in the alternative lens 13.

3 shows the user holding the camera 1 over the head 18 of the crowd. Using the user's hands-free computer system, which includes a display screen or objective lens 13, a processor 2 and a connection cable 6 and a cable 7, the user 19 can display the desired image on the display screen 13 The direction of the camera 7 can be easily reversed until it is viewed onto the image. Obviously, the user 19 cannot see the desired image from the viewfinder in the camera 1 from his position, but the desired image through the alternative lens 13 until the desired image is viewed through the display screen 123. You can watch or move the camera. The processor 2 has a PCMCIA card 10 programmed to record an Nth frame or a desired image. The Nth frame means how many times of the frame is necessary for the user to adjust the video camera 1 properly.

4 and 5, the processor 2 of the Mobile Assistant ^™ is connected to the video camera 1 via a PCMCIA card in the processor 2 or via an electrical cord hole connection 20. The HMD is connected to the processor 2 at the connecting means 21 and via a cable 7 which is attached to the processor. The processor 2 may include belt loops 22 and 23 used to attach the processor 2 to a user's wrist (or other portion). In addition, the belt loop 23 can be used as a movable stand when the processor 2 is converted from a body wearing unit to a stand alone as disclosed in pending patent application No. 08 / 698,319. The body-worn hands-free computer, as shown in FIG. 3, provides the computer means required for the present invention because the fixed computer or laptop computer impedes the mobility of the cameraman. As mentioned above, Mobile Assistant ^™ adds an important capability to the system of the invention that is not disclosed in the prior art, namely the ability to communicate with other remote computers or systems, such as the Internet, to display images being recorded at different locations. . This image can be analyzed as recorded by the cameraman. If the mobile computer is a preferred voice driven computer, the instructions may be provided at a different location by the cameraman or woman to question or require analysis of the image being displayed. Another advantage of having a computer managing a remote camera as opposed to having an HMD in communication with the remote camera is as follows.

(1) The computer may overlay other information while viewing the camera image.

(2) The computer can recall another captured image or remote image stored in the computer and compare it with the image being viewed.

(3) Computers can communicate with others using two-way voice, but this option requires a separate unit.

(4) The computer can process the image to better define what is being viewed.

(5) The computer has the ability to refer back to the image that was captured.

One of the advantages of having a computer with an HMD and a remote camera is that the user can recall information stored in the local or remote computer. This can be very useful if the user needs to evaluate whether the object currently being viewed has changed since the last time it was examined. The ability to recall a pre-captured image and display a stored image with relevant data about the captured image simultaneously with the image viewed by the remote camera is desirable as well as needs to determine if the object has changed over time. . Some examples are maintenance inspectors who need to periodically evaluate the internal integrity of the pipes located inside the boiler room. The pipe inspection procedure requires the pipe to be inspected using a camera inserted under the opening in the pipe. If a crack or problem is found, the inspector can call up the information, including the image from a pre-inspection of the pipe, from the wearable computer or a remote computer system (using the communication capabilities of the wearable computer). If the internal structure of the pipe deteriorates from the final inspection, appropriate maintenance should be carried out. In addition, other similar applications than inspection in the system of the present invention may be achieved using a mobile user wearable computer.

If the alternative lens 24 in the video camera 1 cannot be used for any reason and the remote means need to view the image, the system of the present invention provides a convenient and movable means to achieve this. If it is necessary to use Mobile Assistant ^™ as part of a remote viewing system, Mobile Assistant ^™ can be converted and used as disclosed in pending US application numbers 08 / 538,194 and 08 / 698,319. While the preferred and optimally preferred embodiments of the invention have been described herein to illustrate the basic principles of the invention and are shown in the accompanying drawings, numerous modifications and offsets may be made without departing from the spirit and scope of the invention. I can understand that.

The system of the present invention achieves the effect that can be used to view the camera when a mobile screen with a display screen or HMD cannot use the camera viewfinder.

1 is a perspective view illustrating the connection of a video camera to a processor of Mobile Assistant ^™ .

2 is a plan view of a head mounted display useful in the present invention.

3 is a perspective view of one method of use or one embodiment of the present invention illustrating a user video recording over the head of a crowd;

4 is a plan view of an embodiment of the invention in which a video camera is connected to a "Mobile Assistant" ^TM and head mounted display means.

5 is a perspective view of a processor of the Mobile Assistant " ^TM having electrical or optical connection means for both the video camera and the head mounted display in the system of the present invention.

Claims (13)

A system for displaying an image captured by a camera on a device separate from the camera, A movable computer electrically connected to the camera, The movable computer has a hands free drive means, a processor, a memory, and a user wear display screen, and is configured to transmit a signal representing the image from the camera to the display screen, The hands-free driving means is a driving means selected from the group consisting of voice driving means, eye-tracking driving means, EEG driving means, and a mixture thereof, And the movable computer is configured to transmit a signal representing the image to a computer network. The method of claim 1, And the movable computer comprises a PCMCIA card electrically connected with the processor and the camera. The method of claim 1, And the movable computer is a user-supported computer. The method of claim 1, And the display screen is a head-mounted display. According to the first, And the memory of the movable computer is configured to store image data from the camera. The method of claim 1, And the movable computer communicates with another location while the camera is recording data. The method of claim 1, And the camera and the movable computer are connected by optical fibers. In the system for image adjustment, A user wearable computer configured to operate in electrical connection with the camera, The user wearing computer comprises a hands free driving means, a processor, a memory, and a user wearing display screen, and is configured to transmit a signal representing an image from the camera to the display screen, The hands-free driving means is a driving means selected from the group consisting of voice driving means, eye-tracking driving means, EEG driving means, and a mixture thereof, And the user wearing computer is configured to transmit a signal representing the image to a computer network. The method of claim 8, And the user wearing computer comprises a PCMCIA card electrically connected with the processor and the camera. The method of claim 8, And the display screen is a head-mounted display. The method of claim 8, And memory of the user wearing computer is configured to store image data from the camera. The method of claim 8, And the user wearing computer communicates with another location while the camera is recording data. The method of claim 8, And the camera and the user wearing computer are connected by optical fibers.