CN103813154A - Method and device for multi-viewpoint image acquisition and three-dimensional camera - Google Patents

Method and device for multi-viewpoint image acquisition and three-dimensional camera Download PDF

Info

Publication number
CN103813154A
CN103813154A CN201210458151.2A CN201210458151A CN103813154A CN 103813154 A CN103813154 A CN 103813154A CN 201210458151 A CN201210458151 A CN 201210458151A CN 103813154 A CN103813154 A CN 103813154A
Authority
CN
China
Prior art keywords
viewpoint
treatment
optical lens
imageing sensor
idle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210458151.2A
Other languages
Chinese (zh)
Other versions
CN103813154B (en
Inventor
徐晶明
林福辉
韦虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Spreadtrum Communications Shanghai Co Ltd
Original Assignee
Spreadtrum Communications Shanghai Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Spreadtrum Communications Shanghai Co Ltd filed Critical Spreadtrum Communications Shanghai Co Ltd
Priority to CN201210458151.2A priority Critical patent/CN103813154B/en
Publication of CN103813154A publication Critical patent/CN103813154A/en
Application granted granted Critical
Publication of CN103813154B publication Critical patent/CN103813154B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a method and device for multi-viewpoint image acquisition and a three-dimensional camera. The device comprises M optical lenses, N image sensors, a viewpoint selection unit and a lens control unit. The number M of the optical lenses is smaller than the number L of multiple viewpoints. More than one viewpoint is selected from the M viewpoints through the viewpoint selection unit to serve as current processing viewpoints, no optical lens is arranged at the lens positions corresponding to the current processing viewpoints, and the lens control unit moves the idle optical lenses to the lens positions of the current processing viewpoints correspondingly without the optical lenses so as to obtain digital images of the current processing viewpoints. On the basis of the technical scheme, on the conditions that digital image quality is not reduced, the fewer optical lenses are utilized to obtain the multi-viewpoint digital images.

Description

Multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera
Technical field
The present invention relates to image processing field, particularly a kind of multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera.
Background technology
In recent years, three-dimensional (Three Dimensions, 3D) camera and 3D video camera receive increasing concern, by the picture of 3D camera or the output of 3D video camera, spectators can, in the situation that not using professional 3D glasses, with the naked eye directly appreciate three-dimensional image effect.Compare with video camera with 2D camera, 3D camera and video camera adopt two images and video acquisition device conventionally, to obtain image and the video data of two viewpoints, and be treated to image and the video of 3D, obviously, increase the increase that image and video acquisition device have caused 3D camera and video camera cost.
At present, a popular class 3D camera, video camera on market, the FinePixW3 camera of for example Fuji, the Lumix DMC-3D1 camera of Panasonic, the HDR-TD10E video camera of Sony and the GS-TD1 video camera of JVC etc., be all to have two to overlap independently image or video acquisition device, wherein every covering device comprises an optical lens and an imageing sensor.Extraneous light, by after each optical lens, completes opto-electronic conversion, and obtains two-way data image signal or vision signal on the corresponding imageing sensor of each optical lens, then realizes the synthetic of 3D rendering or video by other processing unit.As can be seen here, in this class 3D camera, video camera, optical lens and imageing sensor one by one corresponding, number equate, and for realizing 3D effect, optical lens and imageing sensor respectively have respectively 2.
Also has a class 3D video camera, as the HDC-TM900 of Panasonic, HDC-SD800, with video cameras such as HDC-SD90, this class video camera adopts VW-CLT1 3D convertible lens group, and the light of the two-way different visual angles from two optical lens is spliced on an imageing sensor, simultaneously simultaneously, reduce the resolution of each road light, the half that the resolution that makes each road light is image sensor resolutions.Complete after opto-electronic conversion at imageing sensor, digital picture or vision signal are sent to other processing unit and realize the synthetic of 3D rendering or video.In this class camera, video camera, by two-way light is spliced on same imageing sensor, than preceding method, reduce the number of imageing sensor, but, when this method is spliced the light of different visual angles, reduce the resolution of each road light, caused reducing the image quality of the 3D digital picture obtaining.
Summary of the invention
According to the embodiment of the present invention aspect, a technical problem to be solved is: a kind of multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera are provided, in the situation that not reducing digital picture image quality, utilize less optical lens to obtain the digital picture of many viewpoints.
According to a first aspect of the invention, a kind of acquisition device of multi-view image is provided, comprise M optical lens, a N imageing sensor, viewpoint selected cell and lens control unit, wherein, the number M of optical lens is less than the number of views L of many viewpoints, L is greater than 1 integer, and N is greater than zero integer;
Described viewpoint selected cell for according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint; Whether the described lens location when pre-treatment viewpoint of identification has optical lens; There is no optical lens in response to the lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, send the first indication to lens control unit, to indicate described lens control unit that the idle optical lens of selecting is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens;
Described lens control unit, for indicating according to described first, selected viewpoint selected cell idle optical lens is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, so that described optical lens is gathered and optical treatment the light when pre-treatment viewpoint of position, obtain when pre-treatment light path;
Described optical lens, is respectively used to the light when pre-treatment viewpoint of position to gather and optical treatment, obtains when pre-treatment light path;
Described imageing sensor, is respectively used to the light signal when pre-treatment light path of position to be converted to the described data image signal when pre-treatment viewpoint, obtains the described digital picture when pre-treatment viewpoint.
Preferably, the number M of described optical lens equals 1; Described viewpoint selected cell specifically for according to default selection strategy, is chosen a viewpoint successively as working as pre-treatment viewpoint from L viewpoint;
Described viewpoint selected cell, also for identifying the digital picture of each viewpoint of whether obtaining a described L viewpoint; In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint;
Or
The number M of described optical lens is greater than 1; Described viewpoint selected cell, also for identifying the digital picture of each viewpoint of whether obtaining a described L viewpoint; In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.
Preferably, the initial state of optical lens is idle state;
Described lens control unit by selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state, or have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state; And
Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of this optical lens of described lens control unit is set to idle state.
Preferably, described viewpoint selected cell, also, in response to there is no idle optical lens, waits for predetermined time interval, is implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
Preferably, the number N of imageing sensor is less than the number of views L of many viewpoints;
Whether described viewpoint selected cell, also have imageing sensor for identifying the described sensing station when pre-treatment viewpoint; There is no imageing sensor in response to the described sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, send the second indication to sensor control unit, to indicate described sensor control unit that the idle imageing sensor of selecting is moved to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor;
Described device also comprises:
Sensor control unit, for indicating according to described second, the idle imageing sensor that institute's viewpoint selected cell is selected moves to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint.
Preferably, the initial state of imageing sensor is idle state;
Described sensor control unit by selected idle imageing sensor move to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state, or have imageing sensor in response to the sensing station when pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state; And
Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of described this imageing sensor of sensor control unit is set to idle state.
Preferably, described viewpoint selected cell, also, in response to there is no idle imageing sensor, waits for predetermined time interval, is implemented as the operation when an idle imageing sensor of pre-treatment viewpoint selection that there is no imageing sensor.
Preferably, described device also comprises:
3-D view processing unit, for the digital picture of each viewpoint in response to obtaining a described L viewpoint, carries out the processing operation of 3-D view to the digital picture of described L obtained viewpoint, obtain three-dimensional digital image.
Preferably, described device also comprises:
Buffer unit, for the digital picture when pre-treatment viewpoint described in buffer memory;
Described 3-D view processing unit obtains the digital picture of each viewpoint a described L viewpoint from described buffer unit.
Preferably, described viewpoint selected cell specifically for according to the spatial relation between a described L viewpoint, according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint.
According to a second aspect of the invention, provide a kind of three-dimensional camera, the acquisition device of the multi-view image that comprises any one that first aspect provides according to the present invention.
According to a third aspect of the present invention, provide a kind of three-dimensional camera, the acquisition device of the multi-view image that comprises any one that first aspect provides according to the present invention.
According to a fourth aspect of the present invention, provide a kind of acquisition methods of multi-view image, described method comprises:
According to default selection strategy, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint, wherein, and the number of views that L is many viewpoints, and L is greater than 1 integer;
Whether the described lens location when pre-treatment viewpoint of identification has optical lens;
There is no optical lens in response to the described lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, mobile selected idle optical lens moves to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, the light when pre-treatment viewpoint to position gathers and optical treatment, obtain when pre-treatment light path, wherein, the number M of optical lens is less than the number of views L of many viewpoints;
Utilize N imageing sensor that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint, obtain the described digital picture when pre-treatment viewpoint, wherein, N is greater than zero integer.
Preferably, the number M of described optical lens equals 1, describedly from L viewpoint, chooses more than one viewpoint as when pre-treatment viewpoint, specifically comprises: from L viewpoint, choose a viewpoint as working as pre-treatment viewpoint;
Described method also comprises:
Whether identification has obtained the digital picture of each viewpoint in a described L viewpoint;
In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint.
Or
The number M of described optical lens is greater than 1; Described method also comprises:
Whether identification has obtained the digital picture of each viewpoint in a described L viewpoint;
In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.
Preferably, described method also comprises: it is idle state that the initial state of optical lens is set;
By selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state, or have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state; And
Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of this optical lens is set to idle state.
Preferably, described method also comprises:
In response to there is no idle optical lens, wait for predetermined time interval, be implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
Preferably, the number N of imageing sensor is less than the number of views L of many viewpoints, and described method also comprises:
Whether the described sensing station when pre-treatment viewpoint of identification has imageing sensor; There is no imageing sensor in response to the described sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, mobile selected idle imageing sensor moves to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint.
Preferably, described method also comprises: it is idle state that the initial state of imageing sensor is set;
Selected idle imageing sensor is moved to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state, or have imageing sensor in response to the sensing station when pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state; And
Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of this imageing sensor is set to idle state.
Preferably, described method also comprises:
In response to there is no idle imageing sensor, wait for predetermined time interval, be implemented as the operation when an idle imageing sensor of pre-treatment viewpoint selection that there is no imageing sensor.
Preferably, it is characterized in that, described method also comprises:
In response to the digital picture of obtaining each viewpoint in a described L viewpoint, the digital picture of described L obtained viewpoint is carried out to the processing operation of 3-D view, obtain three-dimensional digital image.
Preferably, described according to default selection strategy, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint, specifically comprise:
According to the spatial relation between a described L viewpoint, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint.
The multi-view image acquisition methods providing based on the above embodiment of the present invention, device and three-dimensional camera, three-dimensional camera, the number of optical lens is less than the number of views of many viewpoints, by choosing successively viewpoint as working as pre-treatment viewpoint from multiple viewpoints, whether the lens location that pre-treatment viewpoint is worked as in identification has optical lens, there is no optical lens in response to the lens location when pre-treatment viewpoint, select idle optical lens to move to when pre-treatment viewpoint, to obtain the digital picture when pre-treatment viewpoint, thereby can obtain with the optical lens of number still less the digital picture of more viewpoints, and then synthetic higher-quality 3D rendering or 3D video.
Conventionally for the acquisition device of digital picture, optical lens is the parts of core, is also one of key factor of decision device cost, in the situation that increasing viewpoint with acquisition high-quality multi-view image, reduce the number of optical lens, effectively controlled the cost of equipment.
In addition, in technical scheme provided by the present invention, work as pre-treatment viewpoint by selection, imageing sensor is for carrying out light signal conversion when pre-treatment viewpoint, avoid in prior art, the light of different points of view being spliced and reducing the operation of resolution, also keep the resolution of Liao Ge road light, thereby make the image quality of obtained digital picture uninfluenced.
By the detailed description to exemplary embodiment of the present invention referring to accompanying drawing, it is clear that further feature of the present invention and advantage thereof will become.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, to the accompanying drawing of required use in embodiment or description of the Prior Art be briefly described below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, do not paying under the prerequisite of creative work, can also obtain according to these accompanying drawings other accompanying drawing.
, it should be understood that for convenience of description, the size of the various piece shown in accompanying drawing is not to draw according to actual proportionate relationship meanwhile.In similar label and letter accompanying drawing below, represent similar terms, therefore, once be defined in an a certain Xiang Yi accompanying drawing, in accompanying drawing subsequently, do not need it to be further discussed.
The accompanying drawing that forms a part for specification has been described embodiments of the invention, and together with the description for explaining principle of the present invention.
With reference to accompanying drawing, according to detailed description below, can more be expressly understood the present invention, wherein:
Fig. 1 illustrates the structural representation of a kind of embodiment of acquisition device of multi-view image provided by the present invention;
Fig. 2 illustrates the structural representation of the another kind of embodiment of acquisition device of multi-view image provided by the present invention;
Fig. 3 illustrates the structural representation of another embodiment of acquisition device of multi-view image provided by the present invention;
Fig. 4 illustrates the also structural representation of a kind of embodiment of acquisition device of multi-view image provided by the present invention;
Fig. 5 illustrates the structural representation of another embodiment of acquisition device of multi-view image provided by the present invention;
Fig. 6 illustrates the structural representation of a kind of embodiment of three-dimensional camera provided by the present invention;
Fig. 7 illustrates the structural representation of a kind of embodiment of three-dimensional camera provided by the present invention;
Fig. 8 illustrates the schematic flow sheet of a kind of embodiment of acquisition methods of multi-view image provided by the present invention;
Fig. 9 illustrates the schematic flow sheet of the another kind of embodiment of acquisition methods of multi-view image provided by the present invention;
Figure 10 illustrates the schematic flow sheet of another embodiment of acquisition methods of multi-view image provided by the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is clearly and completely described, obviously, described embodiment is only the present invention's part embodiment, rather than whole embodiment.It should be noted that: unless illustrate in addition, the parts of setting forth in these embodiments and the positioned opposite of step do not limit the scope of the invention.
Illustrative to the description only actually of at least one exemplary embodiment below, never as any restriction to the present invention and application or use.Based on the embodiment in the present invention, those of ordinary skills, not making the every other embodiment obtaining under creative work prerequisite, belong to the scope of protection of the invention.
May not discuss in detail for the known technology of person of ordinary skill in the relevant, method and apparatus, but in suitable situation, technology, method and apparatus should be regarded as authorizing a part for specification.
In all examples with discussing shown here, it is exemplary that any occurrence should be construed as merely, rather than as restriction.Therefore, other example of exemplary embodiment can have different values.
Shown in Figure 1, Fig. 1 illustrates the structural representation of a kind of embodiment of acquisition device of multi-view image provided by the present invention.The acquisition device of this embodiment multi-view image comprises M optical lens 101 and N imageing sensor 102, viewpoint selected cell 103 and lens control unit 104, wherein, the number M of optical lens is less than the number of views L of many viewpoints, i.e. M<L, and L is greater than 1 integer.N is greater than zero integer.
Viewpoint selected cell 103, for according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint; Whether the lens location that pre-treatment viewpoint is worked as in identification has optical lens; There is no optical lens in response to the lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, send the first indication to lens control unit 104, to indicate camera lens control unit 104 that the idle optical lens of selecting is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens.Viewpoint selected cell 103 is worked as in the operation of pre-treatment viewpoint in selection, specifically can be according to the spatial relation between multiple viewpoints, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint.
Lens control unit 104, for the first indication sending according to viewpoint selected cell 103, selected idle optical lens is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, so that optical lens is gathered and optical treatment the light when pre-treatment viewpoint of position, obtain when pre-treatment light path.
Optical lens 101 is respectively used to the light when pre-treatment viewpoint of position to gather and optical treatment, obtains when pre-treatment light path.In optical lens, can comprise convex lens and concavees lens, utilize convex lens and concavees lens to focus on or zoom processing the light when pre-treatment viewpoint position.In optical lens, also can comprise reflective mirror, optical lens specifically utilizes reflective mirror to reflect processing to the light when pre-treatment viewpoint position.
Imageing sensor 102 is respectively used to the light signal when pre-treatment light path of position to be converted to the data image signal when pre-treatment viewpoint, obtains the digital picture when pre-treatment viewpoint.
The multi-view image acquisition device providing based on the above embodiment of the present invention, the number M of optical lens 101 is less than the number of views L of many viewpoints, from multiple viewpoints, choose successively viewpoint by viewpoint selected cell 103 as working as pre-treatment viewpoint, whether the lens location that pre-treatment viewpoint is worked as in identification has optical lens, there is no optical lens in response to the lens location when pre-treatment viewpoint, select idle optical lens and move to when pre-treatment viewpoint by lens control unit 104, to obtain the digital picture when pre-treatment viewpoint, thereby can obtain with the optical lens of number still less the digital picture of more viewpoints, and then synthetic high-quality 3D rendering or 3D video, also avoided in prior art, the light of different points of view being spliced and reducing the operation of resolution simultaneously, also keep the resolution of Liao Ge road light, keep making the image quality of obtained digital picture.
Shown in Figure 2, Fig. 2 illustrates the structural representation of the another kind of embodiment of acquisition device of multi-view image provided by the present invention.This embodiment is a concrete example of the acquisition device of multi-view image provided by the present invention, the acquisition device of the multi-view image of this embodiment comprises 1 optical lens 101, be that M equals 1, under the control of lens control unit 104, optical lens is displaced between viewpoint 1 and viewpoint 2.
In the embodiment shown in Figure 2, viewpoint selected cell 103, specifically for according to default selection strategy, is chosen a viewpoint successively as working as pre-treatment viewpoint from L viewpoint.Viewpoint selected cell 103 can also be used for identifying the digital picture of whether obtaining each viewpoint of L viewpoint; In response to the digital picture of not obtaining L each viewpoint in viewpoint, according to default selection strategy, carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint.
According to a concrete example of the acquisition device embodiment of multi-view image provided by the present invention, the number M of optical lens also can be greater than 1.Viewpoint selected cell 103 is also for identifying the digital picture of whether obtaining each viewpoint of L viewpoint; In response to the digital picture of not obtaining L each viewpoint in viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.Because the number M of optical lens is greater than 1, therefore, can select multiple when pre-treatment viewpoint.
Exemplarily, can there is diverse ways to identify the different conditions of optical lens, comprise idle state or non-idle state.For example, can mode bit be set for optical lens, identify respectively idle state or non-idle state.Particularly, the initial state of optical lens is idle state, lens control unit 104 by selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state.
Another kind of situation is, viewpoint selected cell 103 from M optical lens, be respectively do not have optical lens in the time that pre-treatment viewpoint is selected an idle optical lens, have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state.
Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of lens control unit 104 these optical lens is set to idle state.
There is no optical lens in response to the lens location when pre-treatment viewpoint, viewpoint selected cell 103 is respectively from M optical lens does not have the pre-treatment viewpoint of working as of optical lens to select in the process of an idle optical lens, if there is no idle optical lens, viewpoint selected cell 103 can be waited for predetermined time interval, is again implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
The various embodiments described above have realized the digital picture that uses number optical lens still less to obtain more viewpoints, also keep the image quality of the digital picture that obtains simultaneously.In the following embodiments, not only can reduce the number of optical lens, further, can also use number imageing sensor still less to obtain the digital picture of more viewpoints, and keep the image quality of the digital picture that obtains.
In the time that execution is selected when pre-treatment viewpoint again, can be combined into image quality, the time interval T that selects different points of view is set.For example, in conjunction with concrete scene, under static scene, the value of T can be greater than the value of T under dynamic scene.
Shown in Figure 3, Fig. 3 illustrates the structural representation of another embodiment of acquisition device of multi-view image provided by the present invention.According to the acquisition device of the multi-view image shown in Fig. 3, the number N of imageing sensor is also less than the number of views L of many viewpoints.
Compare in Fig. 1 embodiment, in Fig. 3, the device of embodiment also comprises sensor control unit 305, for the second indication sending according to viewpoint selected cell 103, selected idle imageing sensor is moved to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the data image signal when pre-treatment viewpoint.
Whether viewpoint selected cell 103 also has imageing sensor for identifying when the sensing station of pre-treatment viewpoint.Viewpoint selected cell 103 does not have imageing sensor in response to the sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, send the second indication to sensor control unit 305, with indication sensor control unit, the idle imageing sensor of selecting is moved to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor.
For example, as shown in Figure 3, the number of optical lens is 1, and the number N of imageing sensor is 1, is all less than the number of views 2 of many viewpoints.Viewpoint selected cell 103 selects viewpoint 2 for working as pre-treatment viewpoint, whether the lens location that viewpoint selected cell 103 is identified viewpoint 2 has optical lens, lens location in response to viewpoint 2 does not have optical lens, select the optical lens 1 of idle state for there is no the viewpoint 2 of optical lens, send the first indication to lens control unit 104, there is no the lens location when pre-treatment viewpoint 2 of optical lens to indicate camera lens control unit 104 that the idle optical lens 1 of selecting is moved to response.Whether the sensing station that viewpoint selected cell 103 is also identified viewpoint 2 has imageing sensor, sensing station in response to viewpoint 2 does not have imageing sensor, select the imageing sensor 1 of idle state for there is no the viewpoint 2 of imageing sensor, send the second indication to sensor control unit 305, with indication sensor control Unit 305, the idle imageing sensor 1 of selecting is moved to the corresponding sensing station when pre-treatment viewpoint 2 that there is no imageing sensor.
Similarly, the initial state of imageing sensor can be also idle state.Sensor control unit 305 by selected idle imageing sensor move to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state.
Another kind of situation is, viewpoint selected cell 103 from N imageing sensor, be respectively do not have imageing sensor in the time that pre-treatment viewpoint is selected an idle imageing sensor, sensor control unit 305 has imageing sensor in response to the sensing station when pre-treatment viewpoint, and the state of this imageing sensor is set to non-idle state.
Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of sensor control unit 305 these imageing sensors is set to idle state.
Viewpoint selected cell 103 from N imageing sensor, be respectively do not have imageing sensor in the time that pre-treatment viewpoint is selected an idle imageing sensor, in response to there is no idle imageing sensor, can wait for predetermined time interval, again be implemented as the operation when an idle imageing sensor of pre-treatment viewpoint selection that there is no imageing sensor.
Shown in Figure 4, Fig. 4 illustrates the also structural representation of a kind of embodiment of acquisition device of multi-view image provided by the present invention.In the acquisition device embodiment of above each multi-view image, further, can also comprise 3-D view processing unit 406.
3-D view processing unit 406, in response to the digital picture of obtaining L each viewpoint in viewpoint, carries out the processing operation of 3-D view to the digital picture of obtained a L viewpoint, obtain three-dimensional digital image.
3-D view processing unit 406 specifically for mate multiple viewpoints digital picture pixel, unified multiple viewpoints digital picture brightness and/or contrast, the digital picture of multiple viewpoints is carried out to image and/or Video coding.3-D view processing unit 406 can be processed operation according to 3-D view well-known to those skilled in the art, digital picture to each viewpoint in M viewpoint is processed, to obtain the frame three-dimensional digital image in three-dimensional digital image or 3 D video.
Shown in Figure 5, Fig. 5 illustrates the structural representation of another embodiment of acquisition device of multi-view image provided by the present invention.Compared with Fig. 4 embodiment, the acquisition device of the multi-view image in Fig. 5 can also comprise the digital picture of buffer unit 507 buffer memorys when pre-treatment viewpoint.Before not obtaining the digital picture of L each viewpoint in viewpoint, utilize buffer unit 507 to store the digital picture of the viewpoint of having finished dealing with.3-D view processing unit 406 is in response to the digital picture of obtaining L each viewpoint in viewpoint, obtains the digital picture of L each viewpoint viewpoint from buffer unit 507.
Shown in Figure 6, Fig. 6 illustrates the structural representation of a kind of embodiment of three-dimensional camera provided by the present invention.The acquisition device that three-dimensional camera comprises the multi-view image in above-mentioned any one embodiment.In Fig. 6, only exemplarily illustrate that the structural representation of the acquisition device of the multi-view image that provides of aforementioned each embodiment is provided three-dimensional camera, for realizing needed other unit of three-dimensional camera, can specifically implement according to implementation well-known to those skilled in the art, repeat no more here.
Shown in Figure 7, Fig. 7 illustrates the structural representation of a kind of embodiment of three-dimensional camera provided by the present invention.The acquisition device that three-dimensional camera comprises the multi-view image in above-mentioned any one embodiment.In Fig. 7, only exemplarily illustrate that the structural representation of the acquisition device of the multi-view image that provides of aforementioned each embodiment is provided three-dimensional camera, for realizing needed other unit of three-dimensional camera, can specifically implement according to implementation well-known to those skilled in the art, repeat no more here.
The three-dimensional camera, the three-dimensional camera that provide based on the above embodiment of the present invention, the number of optical lens can be equal to, or greater than 2, to obtain more viewpoints, and then synthetic higher-quality 3D rendering or 3D video, by reducing optical lens number, effectively control the cost of three-dimensional camera, three-dimensional camera, also kept the image quality of digital picture simultaneously.
Shown in Figure 8, Fig. 8 illustrates the schematic flow sheet of a kind of embodiment of acquisition methods of multi-view image provided by the present invention.The acquisition methods of the multi-view image shown in Fig. 8 comprises following operation:
Step 801 according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint, wherein, the number of views that L is many viewpoints, and L is greater than 1 integer;
Step 802, whether the lens location that pre-treatment viewpoint is worked as in identification has optical lens;
Step 803, there is no optical lens in response to the lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, mobile selected idle optical lens moves to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, wherein, the number M of optical lens is less than the number of views L of many viewpoints;
Step 804, utilize respectively the optical lens being positioned at when the lens location of pre-treatment viewpoint to gather and optical treatment the light when pre-treatment viewpoint of position, obtain the light signal when pre-treatment light path, utilize imageing sensor that the light signal when pre-treatment light path of position is converted to the data image signal when pre-treatment viewpoint, obtain the digital picture when pre-treatment viewpoint.
The multi-view image acquisition methods providing based on the above embodiment of the present invention, by choosing successively viewpoint as working as pre-treatment viewpoint from multiple viewpoints, whether the lens location that pre-treatment viewpoint is worked as in identification has optical lens, there is no optical lens in response to the lens location when pre-treatment viewpoint, select idle optical lens to move to when pre-treatment viewpoint, to obtain the digital picture when pre-treatment viewpoint, thereby can obtain with the optical lens of number still less the digital picture of more viewpoints, and then synthetic higher-quality 3D rendering or 3D video, also avoided in prior art, the light of different points of view being spliced and reducing the operation of resolution simultaneously, also keep the resolution of Liao Ge road light, thereby make the image quality of obtained digital picture uninfluenced.
According to the inventive method embodiment concrete example, the number M of optical lens can equal 1, in the operation of step 801, particularly, chooses a viewpoint as working as pre-treatment viewpoint from L viewpoint.After the operation of execution step 804, the method for this specific embodiment can also comprise: whether identification has obtained the digital picture of L each viewpoint in viewpoint; In response to the digital picture of not obtaining L each viewpoint in viewpoint, according to default selection strategy, again carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint.
According to the inventive method embodiment concrete example, the number M of optical lens can be greater than 1, and after the operation of execution step 804, particularly, the method also comprises: whether identification has obtained the digital picture of L each viewpoint in viewpoint; In response to the digital picture of not obtaining L each viewpoint in viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.
Exemplarily, the method can also comprise: it is idle state that the initial state of optical lens is set, and by selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state, or have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state.Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of this optical lens is set to idle state.
Wherein, in step 803, there is no optical lens in response to the lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select in the operation of an idle optical lens, in the time there is no idle optical lens, can wait for predetermined time interval, again be implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
The various embodiments described above have realized the digital picture that uses the optical lens of number still less to obtain more viewpoints, also keep the image quality of the digital picture that obtains simultaneously.Further, not only reduce the number of optical lens, can also use the still less imageing sensor of number to obtain the digital picture of more viewpoints, and keep the image quality of the digital picture that obtains.
Shown in Figure 9, Fig. 9 illustrates the schematic flow sheet of the another kind of embodiment of acquisition methods of multi-view image provided by the present invention.Be less than the number of views L of many viewpoints for the number N of imageing sensor, the acquisition methods of the multi-view image shown in Fig. 9 also comprises following operation:
Step 901, whether the sensing station that pre-treatment viewpoint is worked as in identification has imageing sensor;
Step 902, there is no imageing sensor in response to the sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, mobile selected idle imageing sensor moves to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the data image signal when pre-treatment viewpoint.
Be understandable that, in Fig. 9, step 802,803 operation can prior to, after in or carry out with step 901,902 operation simultaneously.
Similarly, the initial state of imageing sensor can be set is idle state.Selected idle imageing sensor is moved to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state, or have imageing sensor in response to the sensing station when pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state.Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of this imageing sensor is set to idle state.
Be respectively from N imageing sensor in above-mentioned steps 902 and do not have the pre-treatment viewpoint of working as of imageing sensor to select in the operation of an idle imageing sensor, in response to there is no idle imageing sensor, can wait for predetermined time interval, again for there is no the operation when an idle imageing sensor of pre-treatment viewpoint selection of imageing sensor.
In above-mentioned each embodiment of the method, in response to the digital picture of obtaining L each viewpoint in viewpoint, can also carry out to the digital picture of obtained a L viewpoint processing operation of 3-D view, obtain three-dimensional digital image.
In above-mentioned each embodiment of the method, according to default selection strategy, from L viewpoint, choose more than one viewpoint as the operation when pre-treatment viewpoint, specifically can be according to the spatial relation between L viewpoint, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint.
Identify and carry out the various embodiments of the imageing sensor of mobile idle state in order clearly to describe above-mentioned employing, embodiment shown in Figure 10, in this embodiment, schematically comprise the operation for each specific embodiment, but those skilled in the art benefit from the above-mentioned thought of the present invention, should be understood that the not completely essential operation of carrying out of the operating procedure shown in Figure 10, those skilled in the art can optionally carry out part operation wherein, and it does not affect the realization of the object of the invention.
Shown in Figure 10, Figure 10 illustrates the schematic flow sheet of another embodiment of acquisition methods of multi-view image provided by the present invention.In this embodiment, the number that M is optical lens, the number that N is imageing sensor, the number of views that L is many viewpoints, L is more than or equal to 2, M and N is all less than L.In Figure 10, the acquisition methods of the multi-view image of embodiment comprises:
Step 1001, arranges all optical lens, the initial state of imageing sensor is idle state;
Step 1002 according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint, wherein, can be according to the spatial relation between L viewpoint, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint;
Step 1003, identification, when whether the lens location of pre-treatment viewpoint has optical lens transducer, does not have optical lens in response to the lens location when pre-treatment viewpoint, the operation of execution step 1004, there is optical lens in response to the lens location when pre-treatment viewpoint, the operation of execution step 1007;
Step 1004, whether identification has idle optical lens, if there is idle optical lens, carries out 1006 operation, if there is no idle optical lens, the operation of execution step 1005;
Step 1005, waits for behind predetermined time interval, again performs step 1004 operation, i.e. whether identification has the operation of idle optical lens;
Step 1006 is respectively and does not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens from M optical lens, and the idle optical lens of selecting is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens;
Step 1007, the state of working as the optical lens of pre-treatment viewpoint lens location is set to non-idle state;
Step 1008, whether the sensing station that pre-treatment viewpoint is worked as in identification has imageing sensor, there is no imageing sensor in response to the sensing station when pre-treatment viewpoint, the operation of execution step 1009, there is imageing sensor in response to the sensing station when pre-treatment viewpoint, the operation of execution step 1012;
Step 1009, whether identification has the imageing sensor of idle state, if there is idle imageing sensor, carries out 1011 operation, if there is no idle imageing sensor, the operation of execution step 1010;
Step 1010, waits for predetermined time interval, re-executes the operation of step 1009, i.e. whether identification has idle imageing sensor;
Step 1011, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, selected idle imageing sensor is moved to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor;
Step 1012, the state of working as the imageing sensor of pre-treatment viewpoint sensing station is set to non-idle state;
Step 1013, when the optical lens of pre-treatment viewpoint gathers and optical treatment the light when pre-treatment viewpoint, obtains the light signal of current light path; When the light signal when pre-treatment light path is converted to the data image signal when pre-treatment viewpoint by the imageing sensor of pre-treatment viewpoint, obtain the digital picture when pre-treatment viewpoint;
Step 1014, whether identification obtains the digital picture when pre-treatment viewpoint, in response to not obtaining the digital picture when pre-treatment viewpoint, the operation of execution step 1015, in response to the digital picture obtaining when pre-treatment viewpoint, execution step 1016 operation, wherein, identification whether obtain when the operation of pre-treatment viewpoint digital picture can be also whether the operation being converted to when the light signal of pre-treatment light path when the data image signal of pre-treatment viewpoint to be realized by identification;
Step 1015, waits for that optical lens and imageing sensor continue to process the signal that deserves pre-treatment viewpoint, waits for behind predetermined time interval, and again carry out 1014 operation, i.e. whether identification obtains the digital picture when pre-treatment viewpoint;
Step 1016 is idle state by the optical lens of this current view point, the initial state of imageing sensor;
Step 1017, whether identification has obtained the digital picture of L each viewpoint in viewpoint, in response to the digital picture of not obtaining L each viewpoint in viewpoint, return to step 1002, to re-execute according to default selection strategy, from L viewpoint, choose a viewpoint of not choosing above as the operation when pre-treatment viewpoint, in response to the digital picture of obtaining L each viewpoint in viewpoint, process ends.
According to the inventive method embodiment concrete example, in above-mentioned steps 1017, whether identification has obtained the digital picture of L each viewpoint in viewpoint, when the digital picture in response to obtaining L each viewpoint in viewpoint, can also carry out to the digital picture of obtained a L viewpoint processing operation of 3-D view, obtain three-dimensional digital image.The processing operation of 3-D view can be specifically the digital picture of the pixel of the digital picture of the multiple viewpoints of coupling, unified multiple viewpoints brightness and/or contrast, the digital picture of multiple viewpoints is carried out to image and/or Video coding.
So far, described in detail according to a kind of multi-view image acquisition methods of the present invention, device and three-dimensional camera, three-dimensional camera.For fear of covering design of the present invention, details more known in the field are not described.Those skilled in the art, according to description above, can understand how to implement technical scheme disclosed herein completely.
In this specification, each embodiment all adopts the mode of going forward one by one to describe, and what each embodiment stressed is and the difference of other embodiment, same or analogous part cross-references between each embodiment.For three-dimensional camera, three-dimensional camera, embodiment of the method, because it is substantially corresponding with device embodiment, so description is fairly simple, relevant part is referring to the part explanation of embodiment of the method.
May realize in many ways multi-view image acquisition methods of the present invention, device and three-dimensional camera, three-dimensional camera.For example, can realize multi-view image acquisition methods of the present invention, device and three-dimensional camera, three-dimensional camera by any combination of software, hardware, firmware or software, hardware, firmware.The said sequence that is used for the step of described method is only in order to describe, and the step of method of the present invention is not limited to above specifically described order, unless otherwise specified.In addition, in certain embodiments, can be also the program being recorded in recording medium by the invention process, these programs comprise the machine readable instructions for realizing the method according to this invention.Thereby the present invention also covers the recording medium of storing the program for carrying out the method according to this invention.
Although specific embodiments more of the present invention are had been described in detail by example, it should be appreciated by those skilled in the art, above example is only in order to describe, rather than in order to limit the scope of the invention.It should be appreciated by those skilled in the art, can without departing from the scope and spirit of the present invention, above embodiment be modified.Scope of the present invention is limited by claims.

Claims (21)

1. an acquisition device for multi-view image, is characterized in that, described device comprises:
M optical lens, a N imageing sensor, viewpoint selected cell and lens control unit, wherein, the number M of optical lens is less than the number of views L of many viewpoints, and L is greater than 1 integer, and N is greater than zero integer;
Described viewpoint selected cell for according to default selection strategy, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint; Whether the described lens location when pre-treatment viewpoint of identification has optical lens; There is no optical lens in response to the lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, send the first indication to lens control unit, to indicate described lens control unit that the idle optical lens of selecting is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens;
Described lens control unit, for indicating according to described first, selected viewpoint selected cell idle optical lens is moved to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, so that described optical lens is gathered and optical treatment the light when pre-treatment viewpoint of position, obtain when pre-treatment light path;
Described optical lens, is respectively used to the light when pre-treatment viewpoint of position to gather and optical treatment, obtains when pre-treatment light path;
Described imageing sensor, is respectively used to the light signal when pre-treatment light path of position to be converted to the described data image signal when pre-treatment viewpoint, obtains the described digital picture when pre-treatment viewpoint.
2. device according to claim 1, is characterized in that, the number M of described optical lens equals 1; Described viewpoint selected cell specifically for according to default selection strategy, is chosen a viewpoint successively as working as pre-treatment viewpoint from L viewpoint;
Described viewpoint selected cell, also for identifying the digital picture of each viewpoint of whether obtaining a described L viewpoint; In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint;
Or
The number M of described optical lens is greater than 1; Described viewpoint selected cell, also for identifying the digital picture of each viewpoint of whether obtaining a described L viewpoint; In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.
3. device according to claim 2, is characterized in that, the initial state of optical lens is idle state;
Described lens control unit by selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state, or have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state; And
Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of this optical lens of described lens control unit is set to idle state.
4. device according to claim 3, it is characterized in that, described viewpoint selected cell, also in response to there is no idle optical lens, wait for predetermined time interval, be implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
5. device according to claim 4, is characterized in that, the number N of imageing sensor is less than the number of views L of many viewpoints;
Whether described viewpoint selected cell, also have imageing sensor for identifying the described sensing station when pre-treatment viewpoint; There is no imageing sensor in response to the described sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, send the second indication to sensor control unit, to indicate described sensor control unit that the idle imageing sensor of selecting is moved to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor;
Described device also comprises:
Sensor control unit, for indicating according to described second, the idle imageing sensor that institute's viewpoint selected cell is selected moves to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint.
6. device according to claim 5, is characterized in that, the initial state of imageing sensor is idle state;
Described sensor control unit by selected idle imageing sensor move to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state, or have imageing sensor in response to the sensing station when pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state; And
Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of described this imageing sensor of sensor control unit is set to idle state.
7. device according to claim 6, it is characterized in that, described viewpoint selected cell, also in response to there is no idle imageing sensor, wait for predetermined time interval, be implemented as the operation when an idle imageing sensor of pre-treatment viewpoint selection that there is no imageing sensor.
8. according to the device described in claim 2 to 7, it is characterized in that, described device also comprises:
3-D view processing unit, for the digital picture of each viewpoint in response to obtaining a described L viewpoint, carries out the processing operation of 3-D view to the digital picture of described L obtained viewpoint, obtain three-dimensional digital image.
9. device according to claim 8, is characterized in that, described device also comprises:
Buffer unit, for the digital picture when pre-treatment viewpoint described in buffer memory;
Described 3-D view processing unit obtains the digital picture of each viewpoint a described L viewpoint from described buffer unit.
10. device according to claim 1, is characterized in that, described viewpoint selected cell, specifically for according to the spatial relation between a described L viewpoint, is chosen more than one viewpoint as working as pre-treatment viewpoint from L viewpoint.
11. 1 kinds of three-dimensional cameras, is characterized in that, comprise according to the acquisition device of the multi-view image described in claim 1 to 10 any one.
12. 1 kinds of three-dimensional cameras, is characterized in that, comprise according to the acquisition device of the multi-view image described in claim 1 to 10 any one.
The acquisition methods of 13. 1 kinds of multi-view images, is characterized in that, described method comprises:
According to default selection strategy, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint, wherein, and the number of views that L is many viewpoints, and L is greater than 1 integer;
Whether the described lens location when pre-treatment viewpoint of identification has optical lens;
There is no optical lens in response to the described lens location when pre-treatment viewpoint, from M optical lens, be respectively and do not have the pre-treatment viewpoint of working as of optical lens to select an idle optical lens, mobile selected idle optical lens moves to the corresponding lens location when pre-treatment viewpoint that there is no optical lens, the light when pre-treatment viewpoint to position gathers and optical treatment, obtain when pre-treatment light path, wherein, the number M of optical lens is less than the number of views L of many viewpoints;
Utilize imageing sensor that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint, obtain the described digital picture when pre-treatment viewpoint.
14. methods according to claim 13, it is characterized in that, the number M of described optical lens equals 1, describedly from L viewpoint, chooses more than one viewpoint as when pre-treatment viewpoint, specifically comprises: from L viewpoint, choose successively a viewpoint as working as pre-treatment viewpoint; Described method also comprises:
Whether identification has obtained the digital picture of each viewpoint in a described L viewpoint;
In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose successively a viewpoint of not choosing as the operation when pre-treatment viewpoint.
Or
The number M of described optical lens is greater than 1; Described method also comprises:
Whether identification has obtained the digital picture of each viewpoint in a described L viewpoint;
In response to the digital picture of not obtaining each viewpoint in a described L viewpoint, according to default selection strategy, carry out and from L viewpoint, choose multiple viewpoints of not choosing as the operation when pre-treatment viewpoint.
15. methods according to claim 14, is characterized in that, described method also comprises: it is idle state that the initial state of optical lens is set;
By selected idle optical lens move to corresponding do not have optical lens when after the lens location of pre-treatment viewpoint, the state of this optical lens is set to non-idle state, or have optical lens in response to the sensing station when pre-treatment viewpoint, the state of this optical lens is set to non-idle state; And
Optical lens gathers and optical treatment the light when pre-treatment viewpoint of position, obtains after pre-treatment light path, and the state of this optical lens is set to idle state.
16. methods according to claim 15, is characterized in that, described method also comprises:
In response to there is no idle optical lens, wait for predetermined time interval, be implemented as the operation when an idle optical lens of pre-treatment viewpoint selection that there is no optical lens.
17. methods according to claim 16, is characterized in that, the number N of imageing sensor is less than the number of views L of many viewpoints, and described method also comprises:
Whether the described sensing station when pre-treatment viewpoint of identification has imageing sensor; There is no imageing sensor in response to the described sensing station when pre-treatment viewpoint, from N imageing sensor, be respectively and do not have the pre-treatment viewpoint of working as of imageing sensor to select an idle imageing sensor, mobile selected idle imageing sensor moves to the corresponding sensing station when pre-treatment viewpoint that there is no imageing sensor, so that the light signal when pre-treatment light path of position is converted to the described data image signal when pre-treatment viewpoint.
18. methods according to claim 17, is characterized in that, described method also comprises: it is idle state that the initial state of imageing sensor is set;
Selected idle imageing sensor is moved to corresponding do not have imageing sensor when after the sensing station of pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state, or have imageing sensor in response to the sensing station when pre-treatment viewpoint, the state of this imageing sensor is set to non-idle state; And
Imageing sensor is converted to the light signal when pre-treatment viewpoint of position after the data image signal of pre-treatment viewpoint, and the state of this imageing sensor is set to idle state.
19. methods according to claim 18, is characterized in that, described method also comprises:
In response to there is no idle imageing sensor, wait for predetermined time interval, be implemented as the operation when an idle imageing sensor of pre-treatment viewpoint selection that there is no imageing sensor.
20. according to claim 14 to the method described in 19 any one, it is characterized in that, described method also comprises:
In response to the digital picture of obtaining each viewpoint in a described L viewpoint, the digital picture of described L obtained viewpoint is carried out to the processing operation of 3-D view, obtain three-dimensional digital image.
21. methods according to claim 20, is characterized in that, described according to default selection strategy, choose more than one viewpoint as working as pre-treatment viewpoint from L viewpoint, specifically comprise:
According to the spatial relation between a described L viewpoint, from L viewpoint, choose more than one viewpoint as working as pre-treatment viewpoint.
CN201210458151.2A 2012-11-15 2012-11-15 Multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera Active CN103813154B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210458151.2A CN103813154B (en) 2012-11-15 2012-11-15 Multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210458151.2A CN103813154B (en) 2012-11-15 2012-11-15 Multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera

Publications (2)

Publication Number Publication Date
CN103813154A true CN103813154A (en) 2014-05-21
CN103813154B CN103813154B (en) 2016-12-21

Family

ID=50709289

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210458151.2A Active CN103813154B (en) 2012-11-15 2012-11-15 Multi-view image acquisition methods, device and three-dimensional camera, three-dimensional camera

Country Status (1)

Country Link
CN (1) CN103813154B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113546869A (en) * 2020-04-24 2021-10-26 合肥美亚光电技术股份有限公司 Material sorting device, method and storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5063441A (en) * 1990-10-11 1991-11-05 Stereographics Corporation Stereoscopic video cameras with image sensors having variable effective position
JP2004236156A (en) * 2003-01-31 2004-08-19 Sharp Corp Stereo image photography auxiliary device and stereo image photographic method
CN102215337A (en) * 2010-04-09 2011-10-12 索尼公司 Imaging device, display control method and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5063441A (en) * 1990-10-11 1991-11-05 Stereographics Corporation Stereoscopic video cameras with image sensors having variable effective position
JP2004236156A (en) * 2003-01-31 2004-08-19 Sharp Corp Stereo image photography auxiliary device and stereo image photographic method
CN102215337A (en) * 2010-04-09 2011-10-12 索尼公司 Imaging device, display control method and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113546869A (en) * 2020-04-24 2021-10-26 合肥美亚光电技术股份有限公司 Material sorting device, method and storage medium

Also Published As

Publication number Publication date
CN103813154B (en) 2016-12-21

Similar Documents

Publication Publication Date Title
CN103813155A (en) Method and device for multi-viewpoint image acquisition and three-dimensional camera
CN201523430U (en) Panoramic video monitoring system
CN102342116B (en) Three-dimensional image capture device
CN102172031B (en) Three-dimensional display device and three-dimensional display method
EP1836859B1 (en) Automatic conversion from monoscopic video to stereoscopic video
CN103392342B (en) The method and apparatus of vision area adjustment, the equipment of three-dimensional video signal can be realized
KR101609486B1 (en) Using motion parallax to create 3d perception from 2d images
CN108028915A (en) For producing the system and method around view
CN102135722B (en) Camera structure, camera system and method of producing the same
EP2659680B1 (en) Method and apparatus for providing mono-vision in multi-view system
CN103852243B (en) Method for detecting optical center of wide-angle lens and optical center detecting device
CN101673395A (en) Image mosaic method and image mosaic device
CN102883176A (en) Image processing apparatus, image processing method, and program
CN108616742B (en) 3D panoramic shooting system and method
CN102884802A (en) Three-dimensional imaging device, and disparity image restoration method
CN104735350B (en) A kind of information processing method and electronic equipment
WO2013080697A1 (en) Image processing device, image processing method and program
CN104871058A (en) Image processing device, imaging device, image processing method, and image processing program
CN105530503A (en) Depth map creating method and multi-lens camera system
CN103370943A (en) Imaging device and imaging method
JP2014501086A (en) Stereo image acquisition system and method
JP5614268B2 (en) Image processing apparatus, image processing method, and program
CN103634588A (en) Image composition method and electronic apparatus
CN105051600A (en) Image processing device, imaging device, image processing method and image processing program
CN104853080A (en) Image processing device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20180417

Address after: 300456 Tianjin Binhai New Area free trade pilot area (Dongjiang Bonded Port Area), Asia Road 6865 financial and Trade Center North District 1 Building 1 door 1802 room -7

Patentee after: Xinji Lease (Tianjin) Co.,Ltd.

Address before: 201203 Shanghai city Zuchongzhi road Pudong New Area Zhangjiang hi tech park, Spreadtrum Center Building 1, Lane 2288

Patentee before: SPREADTRUM COMMUNICATIONS (SHANGHAI) Co.,Ltd.

TR01 Transfer of patent right
EE01 Entry into force of recordation of patent licensing contract

Application publication date: 20140521

Assignee: SPREADTRUM COMMUNICATIONS (SHANGHAI) Co.,Ltd.

Assignor: Xinji Lease (Tianjin) Co.,Ltd.

Contract record no.: 2018990000196

Denomination of invention: Method and device for multi-viewpoint image acquisition and three-dimensional camera

Granted publication date: 20161221

License type: Exclusive License

Record date: 20180801

EE01 Entry into force of recordation of patent licensing contract
TR01 Transfer of patent right

Effective date of registration: 20221025

Address after: 201203 Shanghai city Zuchongzhi road Pudong New Area Zhangjiang hi tech park, Spreadtrum Center Building 1, Lane 2288

Patentee after: SPREADTRUM COMMUNICATIONS (SHANGHAI) Co.,Ltd.

Address before: 300456 Tianjin Binhai New Area free trade pilot area (Dongjiang Bonded Port Area), Asia Road 6865 financial and Trade Center North District 1 Building 1 door 1802 room -7

Patentee before: Xinji Lease (Tianjin) Co.,Ltd.

TR01 Transfer of patent right