CN109873941A - Full shot component and panorama generation method - Google Patents

Full shot component and panorama generation method Download PDF

Info

Publication number
CN109873941A
CN109873941A CN201910155213.4A CN201910155213A CN109873941A CN 109873941 A CN109873941 A CN 109873941A CN 201910155213 A CN201910155213 A CN 201910155213A CN 109873941 A CN109873941 A CN 109873941A
Authority
CN
China
Prior art keywords
mobile device
lens
fish eye
domain
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910155213.4A
Other languages
Chinese (zh)
Other versions
CN109873941B (en
Inventor
沈峘
王汉全
张佩泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NANJING HONGZHONG ELECTRONIC TECHNOLOGY Co Ltd
Original Assignee
NANJING HONGZHONG ELECTRONIC TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NANJING HONGZHONG ELECTRONIC TECHNOLOGY Co Ltd filed Critical NANJING HONGZHONG ELECTRONIC TECHNOLOGY Co Ltd
Priority to CN201910155213.4A priority Critical patent/CN109873941B/en
Publication of CN109873941A publication Critical patent/CN109873941A/en
Application granted granted Critical
Publication of CN109873941B publication Critical patent/CN109873941B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention discloses full shot component and panorama generation methods, the full shot component includes the first fish eye lens and the second fish eye lens, first fish eye lens and the preset lens of mobile device are nose heave folded, second fish eye lens is Chong Die with the postposition camera lens of mobile device, expand the front/rear field angle for setting camera lens of mobile device respectively, it is imaged on imaging sensor in front/rear set of mobile device, obtains the first/bis- fish eye images.The panorama generation method includes step 1: obtaining the first/bis- fish eye images;Step 2: obtaining the first/bis- longitude and latitude image;Step 3: obtaining two groups of overlapping regions;Step 4: calculating overlapping region shift value and merge;Step 5: integration region and non-fused region group symphysis are at panoramic pictures.The present invention combines the big field angle camera lens of one group of extension, constitutes one group of full shot component, which is at low cost, strong applicability.

Description

Full shot component and panorama generation method
Technical field
The present invention relates to full shot component and panorama generation methods, belong to panorama camera technical field.
Background technique
Panoramic pictures and video can be equipped with the viewing of VR equipment and obtain body on the spot in person due to can record 360 degree of information It tests, therefore gets growing concern for and apply.Currently, panoramic pictures and video mainly are shot to obtain by panorama camera, entirely Scape camera is divided into stand alone type and two kinds of plug-in type, and free-standing panorama camera price is higher, and post-processing generally need to be in computer End is realized, suitable for more professional application;Plug-in type camera is due to only including sensor and lens module, without processing Device, battery etc., price is slightly lower, is suitable for ordinary consumer demand.But for wanting to attempt pan-shot or filming frequency Not high consumer, existing panorama camera price are higher.Therefore, it is highly desirable to provide a entry level, price is low Honest and clean pan-shot solution.
Summary of the invention
To solve the above problems, the invention discloses a kind of full shot component and panorama generation method, Specific technical solution is as follows:
Full shot component, which is used to fix on the mobile apparatus, including the first fish eye lens 1 and the second fish Glasses head 4, first fish eye lens 1 and the second fish eye lens 4 are each attached on respective lens bracket 7, first fish Glasses head 1 is Chong Die with the preposition camera lens 2 of mobile device, expands the field angle of the preposition camera lens 2 of mobile device, before mobile device It sets and is imaged on imaging sensor 3, obtain the first fish eye images;Second fish eye lens 4 is Chong Die with the postposition camera lens 5 of mobile device, The field angle for expanding mobile device postposition camera lens 5, is imaged on the postposition imaging sensor 6 of mobile device, obtains the second flake Image, the application program in mobile device with panorama systematic function help the first fish eye images and the second fish eye images split Scape image.
Further, the image that the lens assembly that first fish eye lens 1 is constituted with the preposition camera lens 2 of mobile device is formed Image height is less than or equal to the smallest side length of the preposition imaging sensor 3 of mobile device;After second fish eye lens 4 and mobile device The image image height for setting the lens assembly formation of the composition of camera lens 5 is less than or equal to the smallest side of mobile device postposition imaging sensor 6 It is long.
Further, the first fish eye lens 1 is overlapped as far as possible with the optical axis of the preposition camera lens 2 of mobile device, the second fish eye lens 4 With the optical axis coincidence of mobile device postposition camera lens 5.
Further, the lens bracket 7 is provided with one or more compressing members 8, and compressing member 8 is elastic component, pressure Tight part 8 is an integral molding structure with lens bracket 7, and the junction of compressing member 8 and lens bracket 7 is one section of vertical section, vertical section Free end be one section and be in the shape of the letter V or the bending section of C font, under normal condition, the vertical section of compressing member 8 and lens bracket 7 Side wall is parallel, and when mobile device 9 is inserted into lens bracket 7, mobile device pushes bending section mobile, and bending section is in itself internal force Mobile device 9 is pressed to the side wall of lens bracket 7, so that mobile device 9 and lens bracket 7 cooperate closely under effect.
Further, when the compressing member 8 only one when, the width of the compressing member 8 is at least 7 width of lens bracket Half, when the compressing member 8 there are two or it is more than two when, the compressing member 8 is evenly distributed on the top of lens bracket 7.
Panorama generation method, including following operating procedure:
Step 1: full shot component being installed in mobile device, the first fish eye images and the second fish eye images are obtained;
Step 2: the first fish eye images and the second fish eye images being subjected to longitude and latitude expansion, obtain the first longitude and latitude image and second Longitude and latitude image;
Step 3: the intersection in the first longitude and latitude image of interception and the second longitude and latitude image, two groups of overlapping regions of acquisition, one Group is known as first and is overlapped domain and the second coincidence domain, and another group is known as third coincidence domain and the 4th and is overlapped domain;
Step 4: being overlapped the point-by-point grid division in domain for first, centered on mesh point, choose and refer to sub-district, this is with reference to sub-district the Two are overlapped in domains and match search, find the most similar target sub-district therewith, the center of the target sub-district and with reference in sub-district The difference of the heart is the shift value of mesh point;Same searching method acts on third and is overlapped domain and the 4th coincidence domain;
Step 5: according to shift value, under the coordinate system that the second coincidence domain is transformed to the first coincidence domain, being overlapped domain with first and carry out Fusion;4th coincidence domain is transformed to third to be overlapped under the coordinate system in domain, domain is overlapped with third and is merged, finally by corresponding circle of sensation Domain and non-fused region group symphysis are at panoramic pictures.
Further, when obtaining image in the step 1, the first fish eye images and the second fish eye images need to be shot simultaneously, If mobile device is not supported to shoot simultaneously, it is remain stationary when shooting, later image split is avoided the case where misalignment occur.
Further, after full shot component and mobile device cooperate, start the application program installed in mobile device, With surveying, light, shooting, image mosaic, panoramic picture rendering is shown the application program, panoramic picture shares immediately and panorama sketch As any one or Arbitrary Term combination in store function.
The beneficial effects of the present invention are:
The present invention makes full use of the imaging h ardware of mobile device itself, and in conjunction with the big field angle camera lens of one group of extension, one group of composition is complete Scape lens assembly, and the processor advantage of mobile device is given full play to, panoramic picture is generated, which is at low cost, strong applicability, Not needing to buy independent panorama camera can be realized the purpose of pan-shot.
Detailed description of the invention
Fig. 1 is preposition camera lens imaging schematic diagram of the invention,
Fig. 2 is postposition lens imaging schematic diagram of the invention,
Fig. 3 is the side view of lens bracket of the present invention,
Fig. 4 is the usage state diagram of lens bracket of the present invention,
Reference signs list: the 1-the first fish eye lens, 2-preposition camera lenses, 3-preposition imaging sensors, the 4-the second flake mirror Head, 5-postposition camera lenses, 6-postposition imaging sensors, 7-lens brackets, 8-compressing members, 9-mobile devices.
Specific embodiment
With reference to the accompanying drawings and detailed description, the present invention is furture elucidated.It should be understood that following specific embodiments are only For illustrating the present invention rather than limiting the scope of the invention.
Embodiment 1:
Fig. 1 is preposition camera lens imaging schematic diagram of the invention, and Fig. 2 is postposition lens imaging schematic diagram of the invention, in conjunction with attached drawing As it can be seen that this full shot component, including the first fish eye lens 1 and the second fish eye lens 4, the first fish eye lens 1 are fixed on preposition The front of camera lens 2, and be located in same horizontal line, expand the field angle of the preposition camera lens 2 of mobile device, in the preposition of mobile device It is imaged on imaging sensor 3, obtains the first fish eye images.After second fish eye lens 4 is fixed on the postposition camera lens 5 of mobile device Side, and be located in same horizontal line, expand the field angle of mobile device postposition camera lens 5, in the postposition image sensing of mobile device It is imaged on device 6, obtains the second fish eye images, the application program in mobile device with panorama systematic function is by the first fish eye images Panoramic picture is pieced together with the second fish eye images.
First fish eye lens 1 and the second fish eye lens 4 are each attached on respective lens bracket 7, are adjusted it and are fixed on pair The position of the mobile device answered preposition camera lens 2 and postposition camera lens 5 enables the preposition camera lens 2 of mobile device and postposition camera lens 5 to obtain It is suitable to expand field angle.
The image image height that the lens assembly that first fish eye lens 1 is constituted with the preposition camera lens 2 of mobile device is formed is less than or waits In the smallest side length of the preposition imaging sensor 3 of mobile device.
The image image height that second fish eye lens 4 is formed with the lens assembly that mobile device postposition camera lens 5 is constituted is less than or waits In the smallest side length of mobile device postposition imaging sensor 6.
Embodiment 2:
First fish eye lens 1 is overlapped as far as possible with the optical axis of the preposition camera lens 2 of mobile device, after the second fish eye lens 4 and mobile device The optical axis for setting camera lens 5 is overlapped as far as possible.
Embodiment 3:
The structure for further devising lens bracket 7, in conjunction with Fig. 3 and Fig. 4, lens bracket 7 is provided with one or more pressures Tight part 8, compressing member 8 are elastic component, and compressing member 8 is an integral molding structure with lens bracket 7, the company of compressing member 8 and lens bracket 7 Meeting place is one section of vertical section, and the free end of vertical section is one section and is in the shape of the letter V or the bending section of C font, under normal condition, compressing member 8 vertical section is parallel with the side wall of lens bracket 7, and when mobile device 9 is inserted into lens bracket 7, mobile device pushes bending section Mobile, mobile device 9 is pressed to the side wall of lens bracket 7 by bending section under the action of itself internal force, so that mobile device 9 and mirror Head bracket 7 cooperates closely.
When the compressing member 8 only one when, the width of the compressing member 8 is at least the half of 7 width of lens bracket, when When there are two the compressing members 8 or two or more, the compressing member 8 is evenly distributed on the top of lens bracket 7.
Panorama generation method of the present invention, including following operating procedure:
Step 1: full shot component being installed in mobile device, the first fish eye images and the second fish eye images are obtained;It obtains When image, the first fish eye images and the second fish eye images need to be shot simultaneously, if mobile device is not supported to shoot simultaneously, shot When remain stationary, avoid later image split from the case where misalignment occur.
Step 2: the first fish eye images and the second fish eye images are subjected to longitude and latitude expansion, obtain the first longitude and latitude image and Second longitude and latitude image;
Step 3: the intersection in the first longitude and latitude image of interception and the second longitude and latitude image, two groups of overlapping regions of acquisition, one Group is known as first and is overlapped domain and the second coincidence domain, and another group is known as third coincidence domain and the 4th and is overlapped domain;
Step 4: being overlapped the point-by-point grid division in domain for first, (mesh point is exactly on overlapping region in fact centered on mesh point A bit, it is fixed), it chooses and refers to sub-district, this is overlapped in domain second with reference to sub-district and matches search, finds therewith phase the most As target sub-district, the center of the target sub-district and the difference with reference to the center of sub-district are the shift value of mesh point;Similarly Searching method acts on third and is overlapped domain and the 4th coincidence domain;
Step 5: according to shift value, under the coordinate system that the second coincidence domain is transformed to the first coincidence domain, being overlapped domain with first and carry out Fusion;4th coincidence domain is transformed to third to be overlapped under the coordinate system in domain, domain is overlapped with third and is merged, finally by corresponding circle of sensation Domain and non-fused region group symphysis are at panoramic pictures.
Further, after full shot component and mobile device cooperate, start the application program installed in mobile device, With surveying, light, shooting, image mosaic, panoramic picture rendering is shown the application program, panoramic picture shares immediately and panorama sketch As any one or Arbitrary Term combination in store function.
The technical means disclosed in the embodiments of the present invention is not limited to the technical means disclosed in the above technical means, and further includes Technical solution consisting of any combination of the above technical features.
Taking the above-mentioned ideal embodiment according to the present invention as inspiration, through the above description, relevant staff is complete Various changes and amendments can be carried out without departing from the scope of the technological thought of the present invention' entirely.The technology of this invention Property range is not limited to the contents of the specification, it is necessary to which the technical scope thereof is determined according to the scope of the claim.

Claims (8)

1. full shot component, the full shot component is for fixing on the mobile apparatus, it is characterised in that including the first flake Camera lens (1) and the second fish eye lens (4), first fish eye lens (1) and the second fish eye lens (4) are each attached to respective mirror On head bracket (7), first fish eye lens (1) is Chong Die with preposition camera lens (2) of mobile device, expands mobile device preset lens The field angle of head (2), is imaged on the preposition imaging sensor (3) of mobile device, obtains the first fish eye images;
Second fish eye lens (4) is Chong Die with postposition camera lens (5) of mobile device, expands mobile device postposition camera lens (5) Field angle is imaged on the postposition imaging sensor (6) of mobile device, obtains the second fish eye images, has in mobile device complete First fish eye images and the second fish eye images are pieced together panoramic picture by the application program of scape systematic function.
2. full shot component according to claim 1, it is characterised in that first fish eye lens (1) and mobile device The image image height that the lens assembly that preposition camera lens (2) is constituted is formed is less than or equal to the preposition imaging sensor of mobile device (3) most Small side length, the image image height that the second fish eye lens (4) is formed with the lens assembly that mobile device postposition camera lens (5) is constituted are less than Or it is equal to mobile device postposition imaging sensor (6) the smallest side length.
3. full shot component according to claim 1, it is characterised in that first fish eye lens (1) and mobile device The optical axis coincidence of preposition camera lens (2), the optical axis coincidence of the second fish eye lens (4) and mobile device postposition camera lens (5).
4. full shot component according to claim 1, it is characterised in that the lens bracket (7) is provided with one or one A above compressing member (8), compressing member (8) are elastic component, and compressing member (8) is an integral molding structure with lens bracket (7), compressing member It (8) is one section of vertical section with the junction of lens bracket (7), the free end of vertical section is one section and is in the shape of the letter V or the bending of C font Section, under normal condition, the vertical section of compressing member (8) is parallel with the side wall of lens bracket (7), when mobile device (9) are inserted into camera lens When bracket (7), mobile device pushes bending section mobile, and mobile device (9) is pressed to mirror under the action of itself internal force by bending section The side wall of head bracket (7), so that mobile device (9) and lens bracket (7) cooperation are close.
5. full shot component according to claim 1, it is characterised in that when the compressing member (8) only one when, institute The width for stating compressing member (8) is at least the half of lens bracket (7) width, when the compressing member (8) there are two or it is more than two When, the compressing member (8) is evenly distributed on the top of lens bracket (7).
6. panorama generation method, it is characterised in that including following operating procedure:
Step 1: full shot component being installed in mobile device, the first fish eye images and the second fish eye images are obtained;
Step 2: the first fish eye images and the second fish eye images being subjected to longitude and latitude expansion, obtain the first longitude and latitude image and second Longitude and latitude image;
Step 3: the intersection in the first longitude and latitude image of interception and the second longitude and latitude image, two groups of overlapping regions of acquisition, one Group is known as first and is overlapped domain and the second coincidence domain, and another group is known as third coincidence domain and the 4th and is overlapped domain;
Step 4: being overlapped the point-by-point grid division in domain for first, centered on mesh point, choose and refer to sub-district, this is with reference to sub-district the Two are overlapped in domains and match search, find the most similar target sub-district therewith, the center of the target sub-district and with reference in sub-district The difference of the heart is the shift value of mesh point;Same searching method acts on third and is overlapped domain and the 4th coincidence domain;
Step 5: according to shift value, under the coordinate system that the second coincidence domain is transformed to the first coincidence domain, being overlapped domain with first and carry out Fusion;4th coincidence domain is transformed to third to be overlapped under the coordinate system in domain, domain is overlapped with third and is merged, finally by corresponding circle of sensation Domain and non-fused region group symphysis are at panoramic pictures.
7. panorama generation method according to claim 6, it is characterised in that when obtaining image in the step 1, need simultaneously The first fish eye images and the second fish eye images are shot, if mobile device is not supported to shoot simultaneously, remain stationary, keeps away when shooting Exempt from later image split and the case where misalignment occurs.
8. panorama generation method according to claim 6, it is characterised in that when full shot component and mobile device cooperate Afterwards, start the application program installed in mobile device, which, which has, surveys light, shooting, image mosaic, panoramic picture rendering It shows, panoramic picture is shared immediately and any one in panoramic picture store function or Arbitrary Term combine.
CN201910155213.4A 2019-03-01 2019-03-01 Panoramic lens assembly and panoramic generation method Active CN109873941B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910155213.4A CN109873941B (en) 2019-03-01 2019-03-01 Panoramic lens assembly and panoramic generation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910155213.4A CN109873941B (en) 2019-03-01 2019-03-01 Panoramic lens assembly and panoramic generation method

Publications (2)

Publication Number Publication Date
CN109873941A true CN109873941A (en) 2019-06-11
CN109873941B CN109873941B (en) 2020-11-20

Family

ID=66919599

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910155213.4A Active CN109873941B (en) 2019-03-01 2019-03-01 Panoramic lens assembly and panoramic generation method

Country Status (1)

Country Link
CN (1) CN109873941B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111813361A (en) * 2020-07-06 2020-10-23 广东智芯光电科技有限公司 Stereo image presenting method and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081091A1 (en) * 2005-10-07 2007-04-12 Patrick Pan Image pickup device of multiple lens camera system for generating panoramic image
CN104835118A (en) * 2015-06-04 2015-08-12 浙江得图网络有限公司 Method for acquiring panorama image by using two fish-eye camera lenses
CN105049569A (en) * 2015-08-20 2015-11-11 擎亚国际贸易(上海)有限公司 Panoramic photo composition method based on front and back cameras of cellphone
CN105376471A (en) * 2015-12-21 2016-03-02 景好 Panorama shooting system based on moving platform and method
CN106454046A (en) * 2016-11-01 2017-02-22 信利光电股份有限公司 360-degree panoramic camera module and electronic equipment
CN107274337A (en) * 2017-06-20 2017-10-20 长沙全度影像科技有限公司 A kind of image split-joint method based on improvement light stream
CN107948488A (en) * 2017-12-22 2018-04-20 深圳岚锋创视网络科技有限公司 Mobile terminal coordinates the method and lens assembly for realizing pan-shot with lens assembly
CN207652555U (en) * 2017-12-22 2018-07-24 深圳岚锋创视网络科技有限公司 A kind of cooperation mobile terminal realizes the lens assembly of pan-shot

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081091A1 (en) * 2005-10-07 2007-04-12 Patrick Pan Image pickup device of multiple lens camera system for generating panoramic image
CN104835118A (en) * 2015-06-04 2015-08-12 浙江得图网络有限公司 Method for acquiring panorama image by using two fish-eye camera lenses
CN105049569A (en) * 2015-08-20 2015-11-11 擎亚国际贸易(上海)有限公司 Panoramic photo composition method based on front and back cameras of cellphone
CN105376471A (en) * 2015-12-21 2016-03-02 景好 Panorama shooting system based on moving platform and method
CN106454046A (en) * 2016-11-01 2017-02-22 信利光电股份有限公司 360-degree panoramic camera module and electronic equipment
CN107274337A (en) * 2017-06-20 2017-10-20 长沙全度影像科技有限公司 A kind of image split-joint method based on improvement light stream
CN107948488A (en) * 2017-12-22 2018-04-20 深圳岚锋创视网络科技有限公司 Mobile terminal coordinates the method and lens assembly for realizing pan-shot with lens assembly
CN207652555U (en) * 2017-12-22 2018-07-24 深圳岚锋创视网络科技有限公司 A kind of cooperation mobile terminal realizes the lens assembly of pan-shot

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111813361A (en) * 2020-07-06 2020-10-23 广东智芯光电科技有限公司 Stereo image presenting method and system

Also Published As

Publication number Publication date
CN109873941B (en) 2020-11-20

Similar Documents

Publication Publication Date Title
TWI432870B (en) Image processing system and automatic focusing method
CN104980644B (en) A kind of image pickup method and device
JP2019149809A (en) System and method for imaging device modeling and calibration
CN105530431A (en) Reflective panoramic imaging system and method
WO2017088678A1 (en) Long-exposure panoramic image shooting apparatus and method
JP2005529559A (en) Method for generating a stereoscopic image from a monoscope image
JP2004536351A (en) A method for capturing a panoramic image using a rectangular image sensor
US20090309811A1 (en) Image display systems
CN106023073A (en) Image splicing system
JP2004072349A (en) Image pickup device and its control method
US20060203363A1 (en) Three-dimensional image display system
JP2002077947A (en) Method for correcting stereoscopic image and stereoscopic image apparatus using the same
JP2004135209A (en) Generation device and method for wide-angle view high-resolution video image
CN109873941A (en) Full shot component and panorama generation method
CN111127379B (en) Rendering method of light field camera 2.0 and electronic equipment
CN104537677A (en) Omni-directional virtual photography device
TWI435160B (en) Method for composing three dimensional image with long focal length and three dimensional imaging system
JP2010134617A (en) Panoramic imaging apparatus
CN206649565U (en) Panoramic camera and drive recorder
CN108205236B (en) Panoramic camera and lens thereof
CN112312041B (en) Shooting-based image correction method and device, electronic equipment and storage medium
CN113920011A (en) Multi-view panoramic video splicing method and system
JP4695557B2 (en) Element image group correction apparatus, element image group acquisition system, element image group correction method, and element image group correction program
JP4124995B2 (en) Video composition apparatus and information processing method
JPH08116556A (en) Image processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant