CN1922544A - Method and apparatus for providing a combined image - Google Patents
Method and apparatus for providing a combined image Download PDFInfo
- Publication number
- CN1922544A CN1922544A CNA2005800053169A CN200580005316A CN1922544A CN 1922544 A CN1922544 A CN 1922544A CN A2005800053169 A CNA2005800053169 A CN A2005800053169A CN 200580005316 A CN200580005316 A CN 200580005316A CN 1922544 A CN1922544 A CN 1922544A
- Authority
- CN
- China
- Prior art keywords
- images
- image
- cameras
- combination image
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 66
- 239000002131 composite material Substances 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 description 9
- 230000004438 eyesight Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000010561 standard procedure Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 1
- 238000002601 radiography Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000004304 visual acuity Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
Disclosed is a method for providing a combined image from a plurality of images each produced by one of a plurality of cameras. Each camera has an image system for taking an image of the plurality of images. The method comprises generating the plurality of images in each of the plurality of cameras and stitching the plurality of images to form the combined image using a stitcher disguised as a virtual camera.
Description
Technical field
The present invention relates to be used to provide the method and apparatus of combination image, especially (but nonexcludability ground) relates to the method and apparatus that is used for providing from a plurality of images combination image.
Background technology
Run through this instructions, the use of term " combination " is counted as comprising establishment and the video post that relates to panoramic picture and stereo-picture, lenticular stereoscopic image/video, so that two or more video image streams are merged into single video flowing.
Panoramic picture is a wide angle picture.In conventional radiography, panoramic picture generally is to take like this, even a series of consecutive image is linked in sequence or is stitched together and forms combination image.When using a plurality of cameras to take a plurality of image simultaneously, the common separated demonstration of image.For video camera security, video conference and other similar application, this means that a plurality of cameras and a plurality of display must be used to continuous panoramic imagery.
Alternatively or additionally, one or more in the camera can be pan/tilt (can turn to up and down) cameras.The servo motor that this requires the pan/tilt camera to have to be used for the manipulater in the dollying head visual field or to be used for the dollying head.Servo motor can long-range and/or automatic operation.But when using such system, camera only covers the part of its absolute visual field at any time.The result is that another part of its absolute visual field at any time is uncovered.This is unsatisfactory.
Though wide-angle lens can be used to reduce to cover the influence of loss, the distortion of being introduced (especially under higher off-axis angle) also is unsatisfactory.Wide-angle lens also needs more high-resolution imageing sensor to keep identical resolution.
Summary of the invention
According to an aspect of the present invention, a kind of method that is used for providing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) utilize the splicer of the Softcam that disguises oneself as to splice described a plurality of image, to form described combination image.
According to a further aspect in the invention, a kind of method that is used for providing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) use Softcam that described a plurality of images are carried out concatenation to form described combination image.
According to a further aspect in the invention, a kind of method that is used for providing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) in described a plurality of images each is bent to middle coordinate; And
(c) utilize two-dimensional search that described a plurality of image mosaics are become described combination image, splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
According to a further aspect in the invention, a kind of method that is used for providing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) carry out overlapping calculation to determine the overlapping region of described a plurality of images;
(c) the described a plurality of images of splicing are to form described combination image, and splicing is to be carried out by the splicer of the Softcam that disguises oneself as; And
(d) result of step (b) is used for all follow-up a plurality of images from described a plurality of cameras.
According to a further aspect in the invention, a kind of method that is used for providing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) presentation mode of the described combination image of selection; And
(c) splice described a plurality of image to form described combination image with described presentation mode, splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
According to a further aspect in the invention, a kind of method that is used for producing from a plurality of images combination image is provided, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in described a plurality of video images each is bent to middle coordinate;
(b) determine the overlapping region of the described a plurality of video images that are bent;
(c) the described a plurality of video images that are bent of splicing are to form described composite video image, and splicing is to be carried out by the splicer of the Softcam that disguises oneself as, and
(d) handle described composite video image, with one or more application that are used for showing and storing.
Aspect second from the bottom of the present invention provides a kind of method that is used for providing from a plurality of images combination image, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) carry out overlapping calculation to determine the overlapping region of described a plurality of images;
(c) use described overlapping calculation in described a plurality of images, to carry out color correction; And
(d) all the follow-up a plurality of images from described a plurality of cameras are carried out essentially identical color correction.
Last aspect of the present invention provides a kind of device that is used to produce combination image, and this device comprises:
(a) a plurality of cameras, wherein each camera has a picture system;
(b) be used for a plurality of images are carried out concatenation to produce the splicer of described combination image, each in described a plurality of images is produced by one of described a plurality of cameras;
(c) the disguise oneself as described splicer of Softcam.
Each camera can have impact damper, and they can also can separate in common body.
Description of drawings
For complete understanding and enforcement the present invention easily, will utilize non-limiting example to describe the preferred embodiments of the present invention now, it is described with reference to the accompanying drawings, in the accompanying drawings:
Fig. 1 is the view of combination shot head preferred form;
Fig. 2 is the view of combination shot head second form;
Fig. 3 is the block diagram of the device of Fig. 1 and Fig. 2;
Fig. 4 is the process flow diagram of the Softcam of Fig. 2; And
Fig. 5 is the representative of various presentation modes.
Embodiment
As illustrated in fig. 1 and 2, a kind of method of creating real-time combined video stream is to use a plurality of cameras 10.Though show three, this just for convenience.Employed number can be the arbitrary number greater than 2.If used abundant camera, then the visual field can be in the plane 360 °.It can be spherical.
Imageing sensor 12 in the multi-cam can be independent entity (as shown in Figure 1), also can be combined into single camera body 14 (as shown in Figure 2).In arbitrary mode, each imageing sensor 12 of a plurality of cameras provides the partial view of object scene.Preferably, the visual field of the visual field of each camera 10 and adjacent camera 10 is overlapping, and utilizes splicer to be spliced together from the video flowing of each camera, thereby forms single composite video.If camera 10 is independent entities (as shown in Figure 1), then they can separate but be close mutually, just look like the same in a cluster, perhaps can be separated and away from each other.If away from, still preferably make their visual field overlapping.
Compare with the single camera with mechanical pan/tilt motor, the multi-cam configuration has the not advantage of Tape movement parts, and this makes it be difficult for taking place mechanical fault.In addition, it also have can both catch whole scene (promptly showing as the wide-angle shot head) if having time and can not occur related distortion and view data the loss benefit, especially under the situation of very big off-axis angle.Different with the camera of the single wide-angle lens with single image sensor, the multi-cam configuration is scalable, thereby can produce the wideer visual field, and it is owing to using a plurality of imageing sensors that more high resolving power is provided.
Multi-camera system can utilize existing camera and Video Applications (for example video conference and web propagate and use) to use on standard computer.A kind of its method of working with existing Video Applications that makes is with the splicer Softcam (Fig. 3) that disguises oneself as, and this Softcam can be handled individual images from camera 10 to form combination image and combination image is presented to general Video Applications.By this way, can avoid using special hardware and/or software.
Most computers operating system (OS) all provide the standard method that makes its application access attached camera.Usually, each camera has " device driver " of customization, and the common interface that provides OS to communicate by letter is provided.And then OS provides common interface to its application, to be used for sending inquiry and order to camera.Such layered architecture provides a kind of standard method that makes the application access camera.Using common driver interface is very important for making these application be independent of camera vendor work.It also makes these application can continue to operate following camera, as long as these cameras are followed this common driver interface.
Softcam 32 does not exist in the physical sense.This Softcam 32 does not provide video flowing (it does not have imageing sensor) from imageing sensor, but directly from the device driver 33 of other actual camera 30,31 or by using common driver interface to obtain the video flowing 34 of camera 30,31.Then, it is laid equal stress on the combination of these video flowings and is packaged into single video flowing, and provides this single video flowing by its oneself common driver interface 33.Combination shot head 32 is Softcams, and its video flowing 34 with input is spliced into combined video stream.Therefore, Softcam 32 is the video processors that can handle the video flowing of one or more inputs, and exports single video flowing.
From the angle of Video Applications 35, Softcam 32 shows as conventional camera, and it has a broad visual angle.By this way, can be handled by Softcam 32, thereby make the Video Applications 35 of computing machine that it is considered as single camera from view data more than a camera 30,31.The number of the camera that is comprised is not limited thereto, and can be two, three, four, five, six or the like.The panorama of being caught by the combined field of view of camera is not limited thereto, and can expand to 360 °, even expands to a sphere.
As shown in Figure 4, the Softcam 32 of combination is a splicer in essence.It takes superimposed images (each superimposed images is from a camera) in real time, and they are combined into a combination image.These images are from impact damper 41,42, the 43... of each camera 30,31....Each image is bent (44) and becomes middle coordinate (for example cylinder or spherical coordinate), thereby makes splicing can be reduced to the simple two-dimensional search.Determine the overlapping region (45) of these images then.Utilize the overlapping region, can carry out color correction (46) and guarantee colour consistency between image.Identical color correction or substantially the same color correction are used to all successive images.Final image mixed (47) is together to constitute final panorama.
In order to realize real-time performance, the Softcam of combination is only carried out an overlapping calculation (45), and the position of hypothesis camera remains unchanged during whole session.
Some Video Applications has format restriction.For example, only accept CIF and QCIF resolution based on video conference application H.261.The size of the image that is produced and aspect ratio may be different from the video format of standard.Can carry out also that to be used for image transformation be the additional phase of required form, this generally includes proportional zoom and pan-shot.
Fig. 5 illustrates multiple different presentation mode.Fig. 5 (a) is original combined image.The pan﹠amp of letterbox (mailbox) mode of (b) of Fig. 5 and (c) of Fig. 5; Scan (panorama and scanning) mode is similar to the method that digital versatile disc (DVD) form adopts respectively, to show 16: 9 image on 4: 3 display screens of standard.The horizontal compressed style of Fig. 5 (d) can be used to record composite video when catching whole scene, and it has some loss aspect image detail.
Can provide the user interface of separation to the user, to enable the selection of different presentation modes.For pan﹠amp; Scan (48), the user can pan to select interesting areas by interactively.Replacedly, can adopt switching between automatic pan-shot and the mode with the time interval that sets in advance.Also can create multiple mode simultaneously.For example, horizontal compressed style can be used to recording of video, and pan﹠amp; Scan can be used to show.
By a plurality of viewpoints are set, can obtain best splicing.But,, may cause image to repeat or lose in the overlapping region.This problem is more serious than long-range objectives for close-range target.For major part all is the surveillance application of long-range objectives, and this problem may alleviate to some extent.For close-up applications (for example video conference), can use three cameras, thereby make centre camera have the integral photograph of head part and shoulder.Each camera preferably per second sends 30 frames.
For real-time stereoscopic vision, Softcam is can be for example capable and pile up and be used for from top to bottom the image of stereoscopic vision and carry out the stereo-picture forming process by the staggered scanning odd and even number.For the aftertreatment of video, Softcam can be used to make up or merge video from different cameras, and it can be used to generate lenticular stereoscopic image/video.
Staggered scanning stereoscopic vision form carries out staggered scanning to solid to (stereo pair), and wherein odd-numbered line is represented left eye, and even number line is represented right eye.This can use demultiplexing equipment (for example " Stereographic ' s SimulEyes ") check and with the video standard signal compatibility.Softcam 32 is carried out staggered scanning, and staggered scanning relates to the copy pixel, also may relate to the size of adjusting every row:
Linel[--------Left?eye?Line?1-----------]
Line2[--------Right?eye?Line?2-----------]
Line3[--------Left?eye?Line?3-----------]
Line4[--------Right?eye?Line?4-----------]
The stereoscopic vision form needs vertical size and the conversion source image of adjusting source images up and down, and wherein upper needle is to left eye, and the bottom is at right eye.With the same manner, also can use parallel form.In these cases, Softcam 32 is carried out proportional zoom and conversion, so that two video flowings are combined into single stereo video streaming.At receiving end, it is three-dimensional right that the equipment of the selected form of can decoding can be used to utilize anaglyph spectacles to check.
Though in description before, described the preferred embodiments of the present invention, it will be understood by those skilled in the art that to change or revise one or more in design, structure and the operation without departing from the invention.
Claims (38)
1. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) utilize the splicer of the Softcam that disguises oneself as to splice described a plurality of image, to form described combination image.
2. the method for claim 1, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
3. the method for claim 1 also comprises and carries out overlapping calculation to determine the overlapping region of described a plurality of images, and described overlapping calculation is used to all the follow-up a plurality of images from described a plurality of cameras.
4. the method for claim 1 also comprises the presentation mode of selecting described combination image.
5. method as claimed in claim 3 also comprises the presentation mode of selecting described combination image.
6. method as claimed in claim 3, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
7. method as claimed in claim 4, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
8. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) use Softcam that described a plurality of images are carried out concatenation to form described combination image.
9. method as claimed in claim 8, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
10. method as claimed in claim 8 comprises also and carries out overlapping calculation to determine the overlapping region of described a plurality of images that described overlapping calculation is used to all the follow-up a plurality of images from described a plurality of cameras.
11. method as claimed in claim 10 also comprises:
(a) use described overlapping calculation in described a plurality of images, to carry out color correction; And
(b) keep color correction from all follow-up a plurality of images of described a plurality of cameras.
12. method as claimed in claim 10 also comprises the presentation mode of selecting described combination image.
13. method as claimed in claim 11 also comprises the presentation mode of selecting described combination image.
14. method as claimed in claim 11, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
15. method as claimed in claim 12, wherein splicing is that in described a plurality of image each bends to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
16. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) in described a plurality of images each is bent to middle coordinate; And
(c) utilize two-dimensional search that described a plurality of image mosaics are become described combination image, splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
17. method as claimed in claim 16 comprises also and carries out overlapping calculation to determine the overlapping region of described a plurality of images that described overlapping calculation is used to all the follow-up a plurality of images from described a plurality of cameras.
18. method as claimed in claim 16 also comprises the presentation mode of selecting described combination image.
19. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) carry out overlapping calculation to determine the overlapping region of described a plurality of images;
(c) the described a plurality of images of splicing are to form described combination image, and splicing is to be carried out by the splicer of the Softcam that disguises oneself as; And
(d) result of step (b) is used for all follow-up a plurality of images from described a plurality of cameras.
20. method as claimed in claim 19, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
21. method as claimed in claim 19 also comprises the presentation mode of selecting described combination image.
22. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) presentation mode of the described combination image of selection; And
(c) splice described a plurality of image to form described combination image with described presentation mode, splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
23. method as claimed in claim 22, wherein splicing is by in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
24. method as claimed in claim 22 comprises also and carries out overlapping calculation to determine the overlapping region of described a plurality of images that described overlapping calculation is used to all the follow-up a plurality of images from described a plurality of cameras.
25. method that is used for producing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in described a plurality of video images each is bent to middle coordinate;
(b) determine the overlapping region of the described a plurality of video images that are bent;
(c) the described a plurality of video images that are bent of splicing are to form described composite video image, and splicing is to be carried out by the splicer of the Softcam that disguises oneself as; And
(d) handle described composite video image, with one or more application that are used for showing and storing.
26. method as claimed in claim 25 comprises also and carries out overlapping calculation to determine the overlapping region of described a plurality of images that described overlapping calculation is used to all the follow-up a plurality of images from described a plurality of cameras.
27. method as claimed in claim 25 also comprises the presentation mode of selecting described combination image.
28. method that is used for providing combination image from a plurality of images, in described a plurality of image each is produced by one of a plurality of cameras, in described a plurality of camera each has the picture system of an image that is used for taking described a plurality of images, and this method comprises:
(a) in each camera of described a plurality of cameras, generate described a plurality of images;
(b) carry out overlapping calculation to determine the overlapping region of described a plurality of images;
(c) use described overlapping calculation in described a plurality of images, to carry out color correction; And
(d) all the follow-up a plurality of images from described a plurality of cameras are carried out essentially identical color correction.
29. method as claimed in claim 28, wherein splicing is that in described a plurality of images each is bent to middle coordinate, and utilizes two-dimensional search that described a plurality of image mosaics are become described combination image.
30. method as claimed in claim 28 also comprises the presentation mode of selecting described combination image.
31. method as claimed in claim 28, wherein splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
32. method as claimed in claim 29 also comprises the presentation mode of selecting described combination image.
33. method as claimed in claim 30 also comprises the presentation mode of selecting described combination image.
34. method as claimed in claim 29, wherein splicing is to be carried out by the splicer of the Softcam that disguises oneself as.
35. a device that is used to produce combination image, this device comprises:
(a) a plurality of cameras, wherein each camera has a picture system;
(b) be used for a plurality of images are carried out concatenation to produce the splicer of described combination image, each in described a plurality of images is produced by one of described a plurality of cameras;
(c) the disguise oneself as described splicer of Softcam.
36. device as claimed in claim 36, wherein each camera comprises an impact damper.
37. device as claimed in claim 36, wherein said a plurality of cameras are in common body.
38. device as claimed in claim 36, each in wherein said a plurality of cameras is in the independent main body.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/783,279 | 2004-02-19 | ||
| US10/783,279 US20050185047A1 (en) | 2004-02-19 | 2004-02-19 | Method and apparatus for providing a combined image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1922544A true CN1922544A (en) | 2007-02-28 |
Family
ID=34861191
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2005800053169A Pending CN1922544A (en) | 2004-02-19 | 2005-02-17 | Method and apparatus for providing a combined image |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20050185047A1 (en) |
| CN (1) | CN1922544A (en) |
| AU (1) | AU2005215585A1 (en) |
| GB (1) | GB2430104A (en) |
| TW (1) | TW200529098A (en) |
| WO (1) | WO2005081057A1 (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101527828A (en) * | 2009-04-14 | 2009-09-09 | 深圳华为通信技术有限公司 | Image acquisition equipment |
| CN101556758B (en) * | 2009-04-23 | 2010-12-01 | 杭州镭星科技有限公司 | Method for realizing displaying of high dynamic luminance range images by a plurality of projecting cameras |
| CN101930162A (en) * | 2009-06-22 | 2010-12-29 | 富士胶片株式会社 | Imaging device and control method thereof |
| CN101796815B (en) * | 2007-09-05 | 2012-08-29 | 创新科技有限公司 | Methods for processing a composite video image with feature indication |
| CN101771830B (en) * | 2008-12-30 | 2012-09-19 | 华为终端有限公司 | Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment |
| US8717405B2 (en) | 2008-12-30 | 2014-05-06 | Huawei Device Co., Ltd. | Method and device for generating 3D panoramic video streams, and videoconference method and device |
| US8773495B2 (en) | 2007-10-12 | 2014-07-08 | Polycom, Inc. | Integrated system for telepresence videoconferencing |
| CN103916699A (en) * | 2012-12-31 | 2014-07-09 | 德州仪器公司 | System and method for generating 360 degree video recording using MVC |
| CN104360488A (en) * | 2014-11-14 | 2015-02-18 | 山东理工大学 | Compact three-dimensional display system and display method thereof |
| CN104516482A (en) * | 2013-09-26 | 2015-04-15 | 北京天盛世纪科技发展有限公司 | Shadowless projection system and method |
| CN104615917A (en) * | 2015-01-20 | 2015-05-13 | 中兴通讯股份有限公司 | Picture camouflaging method, picture viewing method, system and terminal |
| CN104680078A (en) * | 2015-01-20 | 2015-06-03 | 中兴通讯股份有限公司 | Method and system for taking photos and checking images and terminal |
| CN104680077A (en) * | 2015-01-20 | 2015-06-03 | 中兴通讯股份有限公司 | Picture encryption method and picture checking method, system and terminal |
| CN105657290A (en) * | 2016-01-29 | 2016-06-08 | 宇龙计算机通信科技(深圳)有限公司 | Dual-camera based scanning method and device |
| CN107959844A (en) * | 2016-10-14 | 2018-04-24 | 安华高科技通用Ip(新加坡)公司 | 360 degree of video captures and playback |
| CN109300145A (en) * | 2018-08-20 | 2019-02-01 | 彭楷文 | NEW ADAPTIVE intelligence dazzle system |
| US11019257B2 (en) | 2016-05-19 | 2021-05-25 | Avago Technologies International Sales Pte. Limited | 360 degree video capture and playback |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7868847B2 (en) * | 2005-05-24 | 2011-01-11 | Mark W Miles | Immersive environments with multiple points of view |
| US8509563B2 (en) * | 2006-02-02 | 2013-08-13 | Microsoft Corporation | Generation of documents from images |
| CN101479767A (en) * | 2006-06-30 | 2009-07-08 | Nxp股份有限公司 | A method and device for video stitching |
| US8139026B2 (en) * | 2006-08-02 | 2012-03-20 | Research In Motion Limited | System and method for adjusting presentation of text and images on an electronic device according to an orientation of the device |
| EP2259163A3 (en) * | 2006-08-02 | 2011-03-16 | Research In Motion Limited | System and method for adjusting presentation of moving images on an electronic device according to an orientation of the device |
| US8493323B2 (en) | 2006-08-02 | 2013-07-23 | Research In Motion Limited | System and method for adjusting presentation of moving images on an electronic device according to an orientation of the device |
| US7843487B2 (en) * | 2006-08-28 | 2010-11-30 | Panasonic Corporation | System of linkable cameras, each receiving, contributing to the encoding of, and transmitting an image |
| US8607281B2 (en) * | 2006-09-07 | 2013-12-10 | Porto Vinci Ltd. Limited Liability Company | Control of data presentation in multiple zones using a wireless home entertainment hub |
| US9319741B2 (en) | 2006-09-07 | 2016-04-19 | Rateze Remote Mgmt Llc | Finding devices in an entertainment system |
| JP2008219428A (en) * | 2007-03-02 | 2008-09-18 | Fujifilm Corp | Imaging apparatus |
| FR2913779B1 (en) * | 2007-03-13 | 2009-11-13 | Gint | DEVICE FOR THE ACQUISITION OF CUSTOMIZATION IMAGE. |
| US8009200B2 (en) | 2007-06-15 | 2011-08-30 | Microsoft Corporation | Multiple sensor input data synthesis |
| US8300083B2 (en) * | 2007-07-20 | 2012-10-30 | Hewlett-Packard Development Company, L.P. | Position relationships associated with image capturing devices |
| TW200907557A (en) * | 2007-08-08 | 2009-02-16 | Behavior Tech Computer Corp | Camera array apparatus and the method for capturing wide-angle video over a network |
| BRPI0815023A2 (en) * | 2007-08-09 | 2015-03-10 | Koninkl Philips Electronics Nv | METHOD AND DEVICE FOR CREATING A MODIFIED VIDEO FROM AN INPUT VIDEO, AND, CAMCORDER. |
| KR101204888B1 (en) * | 2007-08-31 | 2012-11-26 | 삼성테크윈 주식회사 | Digital photographing apparatus, method for controlling the same, and recording medium storing program to implement the method |
| US20100033570A1 (en) * | 2008-08-05 | 2010-02-11 | Morgan Plaster | Driver observation and security system and method therefor |
| US8767081B2 (en) * | 2009-02-23 | 2014-07-01 | Microsoft Corporation | Sharing video data associated with the same event |
| TWI532009B (en) | 2010-10-14 | 2016-05-01 | 華晶科技股份有限公司 | Method and apparatus for generating image with shallow depth of field |
| US9055189B2 (en) | 2010-12-16 | 2015-06-09 | Microsoft Technology Licensing, Llc | Virtual circular conferencing experience using unified communication technology |
| US8908054B1 (en) * | 2011-04-28 | 2014-12-09 | Rockwell Collins, Inc. | Optics apparatus for hands-free focus |
| US8698874B2 (en) * | 2011-06-10 | 2014-04-15 | Microsoft Corporation | Techniques for multiple video source stitching in a conference room |
| CA2856896A1 (en) * | 2013-07-18 | 2015-01-18 | Spo Systems Inc. Limited | Virtual video patrol system and components therefor |
| US20150124120A1 (en) * | 2013-11-05 | 2015-05-07 | Microscan Systems, Inc. | Machine vision system with device-independent camera interface |
| ES2654598T3 (en) * | 2013-12-23 | 2018-02-14 | Coherent Synchro, S.L. | System to generate a composite video image and procedure to obtain a composite video image |
| US20150271400A1 (en) * | 2014-03-19 | 2015-09-24 | Htc Corporation | Handheld electronic device, panoramic image forming method and non-transitory machine readable medium thereof |
| CN104243920B (en) * | 2014-09-04 | 2017-09-26 | 浙江宇视科技有限公司 | A kind of image split-joint method and device encapsulated based on basic flow video data |
| TWI548281B (en) * | 2014-11-21 | 2016-09-01 | 財團法人工業技術研究院 | Wide view monitoring system and method thereof |
| US9769419B2 (en) | 2015-09-30 | 2017-09-19 | Cisco Technology, Inc. | Camera system for video conference endpoints |
| CN105530473A (en) * | 2015-12-09 | 2016-04-27 | 北京永泰安达科技有限公司 | Fast evidence collection system for panoramic eye criminal investigation |
| US10297059B2 (en) | 2016-12-21 | 2019-05-21 | Motorola Solutions, Inc. | Method and image processor for sending a combined image to human versus machine consumers |
| KR20220025600A (en) * | 2020-08-24 | 2022-03-03 | 삼성전자주식회사 | Method and apparatus for generating image |
Family Cites Families (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5023725A (en) * | 1989-10-23 | 1991-06-11 | Mccutchen David | Method and apparatus for dodecahedral imaging system |
| EP0605045B1 (en) * | 1992-12-29 | 1999-03-31 | Laboratoires D'electronique Philips S.A.S. | Image processing method and apparatus for generating one image from adjacent images |
| US5495576A (en) * | 1993-01-11 | 1996-02-27 | Ritchey; Kurtis J. | Panoramic image based virtual reality/telepresence audio-visual system and method |
| EP0650299B1 (en) * | 1993-10-20 | 1998-07-22 | Laboratoires D'electronique Philips S.A.S. | Method of processing luminance levels in a composite image and image processing system applying this method |
| US5850352A (en) * | 1995-03-31 | 1998-12-15 | The Regents Of The University Of California | Immersive video, including video hypermosaicing to generate from multiple video views of a scene a three-dimensional video mosaic from which diverse virtual video scene images are synthesized, including panoramic, scene interactive and stereoscopic images |
| US5657073A (en) * | 1995-06-01 | 1997-08-12 | Panoramic Viewing Systems, Inc. | Seamless multi-camera panoramic imaging with distortion correction and selectable field of view |
| US6549650B1 (en) * | 1996-09-11 | 2003-04-15 | Canon Kabushiki Kaisha | Processing of image obtained by multi-eye camera |
| AU6515798A (en) * | 1997-04-16 | 1998-11-11 | Isight Ltd. | Video teleconferencing |
| JPH10336705A (en) * | 1997-06-02 | 1998-12-18 | Canon Inc | Compound eye camera |
| US6078701A (en) * | 1997-08-01 | 2000-06-20 | Sarnoff Corporation | Method and apparatus for performing local to global multiframe alignment to construct mosaic images |
| US6545702B1 (en) * | 1998-09-08 | 2003-04-08 | Sri International | Method and apparatus for panoramic imaging |
| US6778207B1 (en) * | 2000-08-07 | 2004-08-17 | Koninklijke Philips Electronics N.V. | Fast digital pan tilt zoom video |
-
2004
- 2004-02-19 US US10/783,279 patent/US20050185047A1/en not_active Abandoned
-
2005
- 2005-02-17 AU AU2005215585A patent/AU2005215585A1/en not_active Abandoned
- 2005-02-17 GB GB0616491A patent/GB2430104A/en not_active Withdrawn
- 2005-02-17 CN CNA2005800053169A patent/CN1922544A/en active Pending
- 2005-02-17 WO PCT/SG2005/000044 patent/WO2005081057A1/en active Application Filing
- 2005-02-18 TW TW094104782A patent/TW200529098A/en unknown
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101796815B (en) * | 2007-09-05 | 2012-08-29 | 创新科技有限公司 | Methods for processing a composite video image with feature indication |
| US8773495B2 (en) | 2007-10-12 | 2014-07-08 | Polycom, Inc. | Integrated system for telepresence videoconferencing |
| CN101771830B (en) * | 2008-12-30 | 2012-09-19 | 华为终端有限公司 | Three-dimensional panoramic video stream generating method and equipment and video conference method and equipment |
| US8717405B2 (en) | 2008-12-30 | 2014-05-06 | Huawei Device Co., Ltd. | Method and device for generating 3D panoramic video streams, and videoconference method and device |
| WO2010118674A1 (en) * | 2009-04-14 | 2010-10-21 | 华为终端有限公司 | Image acquisition equipment |
| CN101527828B (en) * | 2009-04-14 | 2011-08-10 | 华为终端有限公司 | Image acquisition equipment |
| CN101527828A (en) * | 2009-04-14 | 2009-09-09 | 深圳华为通信技术有限公司 | Image acquisition equipment |
| CN101556758B (en) * | 2009-04-23 | 2010-12-01 | 杭州镭星科技有限公司 | Method for realizing displaying of high dynamic luminance range images by a plurality of projecting cameras |
| CN101930162A (en) * | 2009-06-22 | 2010-12-29 | 富士胶片株式会社 | Imaging device and control method thereof |
| CN103916699A (en) * | 2012-12-31 | 2014-07-09 | 德州仪器公司 | System and method for generating 360 degree video recording using MVC |
| CN104516482A (en) * | 2013-09-26 | 2015-04-15 | 北京天盛世纪科技发展有限公司 | Shadowless projection system and method |
| CN104360488A (en) * | 2014-11-14 | 2015-02-18 | 山东理工大学 | Compact three-dimensional display system and display method thereof |
| CN104360488B (en) * | 2014-11-14 | 2017-05-24 | 山东理工大学 | Display method for compact three-dimensional display system |
| CN104615917A (en) * | 2015-01-20 | 2015-05-13 | 中兴通讯股份有限公司 | Picture camouflaging method, picture viewing method, system and terminal |
| CN104680078A (en) * | 2015-01-20 | 2015-06-03 | 中兴通讯股份有限公司 | Method and system for taking photos and checking images and terminal |
| CN104680077A (en) * | 2015-01-20 | 2015-06-03 | 中兴通讯股份有限公司 | Picture encryption method and picture checking method, system and terminal |
| US10922435B2 (en) | 2015-01-20 | 2021-02-16 | Zte Corporation | Image encryption method, image viewing method, system, and terminal |
| CN104680078B (en) * | 2015-01-20 | 2021-09-03 | 中兴通讯股份有限公司 | Method for shooting picture, method, system and terminal for viewing picture |
| CN105657290A (en) * | 2016-01-29 | 2016-06-08 | 宇龙计算机通信科技(深圳)有限公司 | Dual-camera based scanning method and device |
| US11019257B2 (en) | 2016-05-19 | 2021-05-25 | Avago Technologies International Sales Pte. Limited | 360 degree video capture and playback |
| CN107959844A (en) * | 2016-10-14 | 2018-04-24 | 安华高科技通用Ip(新加坡)公司 | 360 degree of video captures and playback |
| CN107959844B (en) * | 2016-10-14 | 2021-09-17 | 安华高科技股份有限公司 | 360degree video capture and playback |
| CN109300145A (en) * | 2018-08-20 | 2019-02-01 | 彭楷文 | NEW ADAPTIVE intelligence dazzle system |
Also Published As
| Publication number | Publication date |
|---|---|
| US20050185047A1 (en) | 2005-08-25 |
| TW200529098A (en) | 2005-09-01 |
| AU2005215585A1 (en) | 2005-09-01 |
| WO2005081057A1 (en) | 2005-09-01 |
| GB2430104A (en) | 2007-03-14 |
| GB0616491D0 (en) | 2006-09-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1922544A (en) | Method and apparatus for providing a combined image | |
| KR101003277B1 (en) | Method and system for producing seamless composite images having non-uniform resolution from a multi-imager | |
| JP6021541B2 (en) | Image processing apparatus and method | |
| JP6273163B2 (en) | Stereoscopic panorama | |
| JP2883265B2 (en) | Image processing device | |
| AU2008215908B2 (en) | Banana codec | |
| CN102595168B (en) | Seamless left/right views for 360-degree stereoscopic video | |
| US8928729B2 (en) | Systems and methods for converting video | |
| CN201523430U (en) | Panoramic video monitoring system | |
| CN104685860A (en) | Generating images from light fields utilizing virtual viewpoints | |
| JP2010078768A (en) | Stereoscopic image capturing apparatus and stereoscopic image capturing system | |
| CN1727991A (en) | Foveated panoramic camera system | |
| CN1771740A (en) | Steroscopic panoramic image capture device | |
| EP1702475A2 (en) | Multi-dimensional imaging apparatus, systems, and methods | |
| KR20200064998A (en) | Playback apparatus and method, and generating apparatus and method | |
| US20080101724A1 (en) | Constructing arbitrary-plane and multi-arbitrary-plane mosaic composite images from a multi-imager | |
| JP2013223008A (en) | Image processing device and method | |
| WO2020179473A1 (en) | Image processing device, image generation method, and image processing method | |
| JP5747679B2 (en) | Presentation method of 3D image | |
| JP4660463B2 (en) | Stereo image encoding device | |
| CN1238818C (en) | Imaging method and system for 2D 360 deg panorama based on color linear CCD | |
| JP4293945B2 (en) | Image generation method | |
| KR100551107B1 (en) | method for merging photographic images to implement virtual realty | |
| JP2005321987A (en) | Image formation method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |