CN108259740A - A kind of method, apparatus and mobile terminal of panoramic picture generation - Google Patents
A kind of method, apparatus and mobile terminal of panoramic picture generation Download PDFInfo
- Publication number
- CN108259740A CN108259740A CN201711487904.1A CN201711487904A CN108259740A CN 108259740 A CN108259740 A CN 108259740A CN 201711487904 A CN201711487904 A CN 201711487904A CN 108259740 A CN108259740 A CN 108259740A
- Authority
- CN
- China
- Prior art keywords
- image
- depth
- view information
- field
- feature point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000004590 computer program Methods 0.000 claims description 10
- 239000000284 extract Substances 0.000 claims description 8
- 230000009466 transformation Effects 0.000 claims description 8
- 238000001514 detection method Methods 0.000 claims description 7
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 239000000203 mixture Substances 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims 1
- 230000006870 function Effects 0.000 description 14
- 230000008569 process Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 7
- 230000006854 communication Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
An embodiment of the present invention provides the method, apparatus and mobile terminal of a kind of generation of panoramic picture, the method is applied to mobile terminal, including：Under panorama photographing mode, the data of acquisition at least two field pictures；Wherein, the data of described image include structure light coding information；According to the structure light coding information, the depth of view information of at least two field pictures is determined respectively；Based on the depth of view information of at least two field pictures, image mosaic is carried out at least two field pictures, obtains panoramic picture.Through the embodiment of the present invention, the Panorama Mosaic based on structure light is realized, ensure that the accuracy of Panorama Mosaic, is avoided due to splicing dislocation caused by the shake of camera.
Description
Technical field
The present invention relates to technical field of mobile terminals, method, apparatus more particularly to a kind of generation of panoramic picture and
Mobile terminal.
Background technology
With the development of science and technology, mobile terminal is widely used, and the shooting function of mobile terminal also achieves
Larger progress is greatly improved the usage experience of mobile terminal.
At present, panoramic picture shooting becomes a kind of important shooting function of mobile terminal.By constantly acquiring image data,
Then the image data of acquisition is synthesized into a Zhang Quanjing image, obtains the visual field of resolution ratio more higher than single image and bigger.
However, since photographing panorama picture needs the continuous dollying head of user, with multiple image datas of continuous acquisition,
The shake of camera is easily caused in mobile process, the shake of camera can cause the splicing of image data to misplace, so as to lead
Cause Panorama Mosaic inaccurate.
Invention content
The embodiment of the present invention provides a kind of method, apparatus and mobile terminal of panoramic picture generation, to solve panorama sketch
As the problem of splicing inaccuracy.
In order to solve the above-mentioned technical problem, the invention is realized in this way：
In a first aspect, an embodiment of the present invention provides a kind of method of panoramic picture generation, the method is applied to movement
Terminal, including：
Under panorama photographing mode, the data of acquisition at least two field pictures；Wherein, the data of described image include structure light
Coding information；
According to the structure light coding information, the depth of view information of at least two field pictures is determined respectively；
Based on the depth of view information of at least two field pictures, image mosaic is carried out at least two field pictures, is obtained complete
Scape image.
Second aspect, the embodiment of the present invention additionally provide a kind of device of panoramic picture generation, and described device is applied to move
Dynamic terminal, including：
Image data acquiring module, under panorama photographing mode, acquiring the data of at least two field pictures；Wherein, institute
It states image data and includes structure light coding information；
Depth of view information determining module, for according to the structure light coding information, determining at least two field pictures respectively
Depth of view information；
Image mosaic module, for the depth of view information based on at least two field pictures, at least two field pictures into
Row image mosaic, obtains panoramic picture.
The third aspect, the embodiment of the present invention additionally provide a kind of mobile terminal, including processor, memory and are stored in institute
The computer program that can be run on memory and on the processor is stated, when the computer program is performed by the processor
The step of realizing the method for panoramic picture generation as described above.
Fourth aspect, the embodiment of the present invention additionally provide a kind of computer readable storage medium, described computer-readable to deposit
Computer program is stored on storage media, the computer program realizes panoramic picture generation as described above when being executed by processor
Method the step of.
The embodiment of the present invention includes advantages below：
In embodiments of the present invention, by acquiring the data of at least two field pictures, the number of image under panorama photographing mode
According to including structure light coding information, then according to structure light coding information, the depth of view information of at least two field pictures, base are determined respectively
Image mosaic is carried out at least two field pictures in depth of view information, panoramic picture is obtained, realizes the panoramic picture based on structure light
Splicing, ensure that the accuracy of Panorama Mosaic, avoid due to splicing dislocation caused by the shake of camera.
Description of the drawings
Fig. 1 is a kind of step flow chart of the method for panoramic picture generation of the embodiment of the present invention；
Fig. 2 is a kind of structure diagram of the device of panoramic picture generation of the embodiment of the present invention；
Fig. 3 is a kind of structure diagram of mobile terminal of the embodiment of the present invention.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present invention, the technical solution in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained without creative efforts
Example, shall fall within the protection scope of the present invention.
With reference to Fig. 1, a kind of step flow chart of the method for panoramic picture generation of the embodiment of the present invention, the side are shown
Method can be applied to mobile terminal, and mobile terminal includes but not limited to mobile phone, tablet computer, laptop, palm PC, vehicle
Mounted terminal, wearable device and pedometer etc..
Specifically, the embodiment of the present invention may include steps of：
Step 101, under panorama photographing mode, the data of acquisition at least two field pictures；Wherein, the data packet of described image
Include structure light coding information；
When needing using mobile terminal photographing panorama picture, user can open camera, and selection enters pan-shot
Pattern, under panorama photographing mode, mobile terminal can prompt user to move mobile terminal.
When detect mobile terminal it is mobile when, mobile terminal control camera according to preset time interval, continuously adopt
Collect at least two field pictures, and during image is acquired, mobile terminal can also acquire the corresponding structure light coding letter of image
Breath.
As a kind of example, structure light can be infrared light (Infrared Radiation, IR), structure light coding information
It can be with structure light coding pattern.
Specifically, RGB sensor (color sensor) acquisition image data of the mobile terminal using camera, and can adopt
Luminous point, light slit, grating, grid or speckle are projected on testee with structured light projector, may then pass through structure light
Sensor obtains the structure light coding information of testee, the coding pattern such as after the surface modulation of testee.
In a kind of preferable example, structured light sensor can be set in the RGB sensors of camera, such as by each G
The half of sensing unit replaces with IR sensors, by will partly replace with structure light sensing in any color sensing unit
Device, so that RGB sensors can receive the structure light of testee reflection, and can less structure light on mobile terminals
The trepanning of sensor promotes aesthetic appearance.
Step 102, according to the structure light coding information, the depth of view information of at least two field pictures is determined respectively；
In embodiments of the present invention, mobile terminal may be used space encoding mode and structure light encoded, such as
DeBruijn sequential codings and/or, structure light can be encoded with acquisition time coding mode, such as binary coding, Gray
Coding, space encoding mode can only project single preset structure pumped FIR laser information, such as the structure light coding image of single frames, time
Coding mode can project multiple and different preset structure pumped FIR laser information, the different structure light coding such as multiframe to testee
Image.
For space encoding mode, mobile terminal can lead to after collected structure light coding information is decoded
It crosses and structure light coding information is compared with preset structure pumped FIR laser information, obtain the matching relationship of the two, surveyed with reference to triangle
Away from principle, the depth of view information of testee in image data is calculated.
For time encoding mode, structured light sensor can be acquired to be compiled by the modulated multiple structure lights of testee
Code information, is decoded by multiple structure light coding information to acquisition, with reference to principle of triangulation, is calculated in image
The depth of view information of testee.
Step 103, the depth of view information based on at least two field pictures carries out image spelling at least two field pictures
It connects, obtains panoramic picture.
After the depth of view information per frame image is obtained, mobile terminal is according to depth of view information, using image mosaic technology to extremely
Few two field pictures are spliced, and obtain panoramic picture.
Specifically, step 103 can include following sub-step：
Sub-step 11 from at least two field pictures, determines adjacent image；Wherein, the adjacent image includes continuous
The two field pictures of acquisition；
Under panorama photographing mode, mobile terminal can be continuously shot at least two field pictures according to preset time interval,
Two field pictures are adjacent image before and after time interval.
Sub-step 12 determines the depth of field deviation between the adjacent image；
Since user will appear shake during continuous acquisition image, the depth of view information between adjacent image will appear
Deviation, mobile terminal can obtain the depth of field deviation between adjacent image.
In one preferred embodiment of the invention, adjacent image can include the first image and the second image, then sub-step
Rapid 12 can include following sub-step：
Sub-step 121 detects the overlapping region of described first image and the second image；
In embodiments of the present invention, the first image and the second image are adjacent image, due to being shot under panorama photographing mode
Time interval it is smaller, there are overlapping region between adjacent image, mobile terminal can detect the first image and the second image it
Between overlapping region.
Specifically, sub-step 121 can include following sub-step：
Sub-step 1211 extracts the fisrt feature point in described first image；
For the first image, the technologies such as SIFT feature detection, convolutional neural networks may be used therefrom in the embodiment of the present invention
Fisrt feature point is extracted, such as boundary point, inflection point.
Sub-step 1212 and, extract the second feature point in second image；
Correspondingly, the embodiment of the present invention can extract second feature point from the second image.
Sub-step 1213 matches the fisrt feature point and second feature point, obtains multiple overlapping features
Point；
It can be to fisrt feature point and second feature point in acquisition fisrt feature point and second feature point, the embodiment of the present invention
It is matched, using the characteristic point of successful match as overlapping feature point.
Sub-step 1214, it is overlapping with second image using the multiple overlapping feature point composition described first image
Region.
After multiple overlapping feature points are obtained, the embodiment of the present invention multiple overlapping feature points can be formed the first image with
The overlapping region of second image.
Sub-step 122 determines first depth of view information of the overlapping region in described first image；
After overlapping region is determined, the embodiment of the present invention can obtain each pixel in overlapping region in the first image
Depth of view information, calculate the average value of each pixel depth of view information, obtain the first depth of view information.
Sub-step 123 determines second depth of view information of the overlapping region in second image；
Correspondingly, the embodiment of the present invention can obtain the depth of field letter of each pixel in overlapping region in the second image
Breath, calculates the average value of each pixel depth of view information, obtains the second depth of view information.
Sub-step 124 calculates the difference of first depth of view information and second depth of view information, as first figure
Picture and the depth of field deviation between second image.
After the first depth of view information and the second depth of view information is obtained, the embodiment of the present invention can calculate the first depth of view information and
The difference of second depth of view information, using the difference as the depth of field deviation between the first image and the second image.
Based on the depth of field deviation, stretching is carried out to the adjacent image for sub-step 13；
After depth of field deviation is obtained, the embodiment of the present invention can be searched from initialized data base, determine depth of field deviation
Corresponding transformation parameter carries out adjacent image according to transformation parameter stretching conversion or reduces to convert.
Specifically, sub-step 13 can include following sub-step：
Sub-step 131 determines image on the basis of described first image；
In embodiments of the present invention, mobile terminal can from the first image and the second image, be chosen at time interval it
First image of preceding shooting converts the second image relative datum image as benchmark image.
When the depth of field deviation is more than first threshold, diminution transformation is carried out to second image for sub-step 132；
When the second depth of view information of the second image is more than the first depth of view information of the first image, and depth of field deviation is more than first
During threshold value, then according to depth of field deviation, diminution transformation is carried out to the second image.
When the depth of field deviation is less than second threshold, stretching conversion is carried out to second image for sub-step 133.
When the second depth of view information of the second image is less than the first depth of view information of the first image, and depth of field deviation is less than second
During threshold value, then according to depth of field deviation, diminution transformation is carried out to the second image.
Certainly, when depth of field deviation is between first threshold and second threshold, then the second image can not be carried out any
Map function directly merges the first image data with the second image.
In embodiments of the present invention, by determine adjacent image depth of field deviation, according to depth of field deviation to adjacent image into
Row stretching realizes and is aligned the picture region of depth same in adjacent image, ensure that the accurate of image mosaic
Property.
Sub-step 14 merges the adjacent image after the stretching, obtains panoramic picture.
After stretching is carried out to the second image, the embodiment of the present invention can be by the after the first image and stretching
Two images carry out fusion treatment, obtain the panoramic picture of smooth and seamless.
In embodiments of the present invention, by acquiring the data of at least two field pictures, the number of image under panorama photographing mode
According to including structure light coding information, then according to structure light coding information, the depth of view information of at least two field pictures, base are determined respectively
Image mosaic is carried out at least two field pictures in depth of view information, panoramic picture is obtained, realizes the panoramic picture based on structure light
Splicing, ensure that the accuracy of Panorama Mosaic, avoid due to splicing dislocation caused by the shake of camera.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of action group
It closes, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because according to
According to the embodiment of the present invention, certain steps may be used other sequences or be carried out at the same time.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
With reference to Fig. 2, a kind of structure diagram of the device of panoramic picture generation of the embodiment of the present invention, described device are shown
Applied to mobile terminal, it can specifically include following module：
Image data acquiring module 201, under panorama photographing mode, acquiring the data of at least two field pictures；Wherein,
The data of described image include structure light coding information；
Depth of view information determining module 202, for according to the structure light coding information, determining at least two frame figures respectively
The depth of view information of picture；
Image mosaic module 203, for the depth of view information based on at least two field pictures, at least two field pictures
Image mosaic is carried out, obtains panoramic picture.
In a kind of preferred embodiment of the present invention, described image concatenation module 203 includes：
Adjacent image data determination sub-module, for from at least two field pictures, determining adjacent image；Wherein, institute
State the two field pictures that adjacent image includes continuous acquisition；
Depth of field deviation determination sub-module, for determining the depth of field deviation between the adjacent image data；
For being based on the depth of field deviation, stretching is carried out to the adjacent image for stretching submodule；
Image co-registration submodule for being merged to the adjacent image after the stretching, obtains panoramic picture.
In a kind of preferred embodiment of the present invention, the adjacent image includes the first image and the second image, the depth of field
Deviation determination sub-module includes：
Overlapping region detection unit, for detecting the overlapping region of described first image and the second image；
First depth of view information determination unit, for determining that the overlapping region is believed in first depth of field of described first image
Breath；
Second depth of view information determination unit, for determining that the overlapping region is believed in second depth of field of second image
Breath；
Difference value determining unit, for calculating the difference of first depth of view information and second depth of view information, as institute
State the depth of field deviation between the first image and second image.
In a kind of preferred embodiment of the present invention, the overlapping region detection unit includes：
Fisrt feature point extracts subelement, for extracting the point of the fisrt feature in described first image；
Second feature point extracts subelement, for extracting the second feature point in second image；
Overlapping feature point obtains subelement, for being matched to the fisrt feature point and second feature point, obtains
To multiple overlapping feature points；
Overlapping region forms subelement, for using the multiple overlapping feature point composition described first image and described the
The overlapping region of two images.
In a kind of preferred embodiment of the present invention, the stretching submodule includes：
Benchmark image determination unit, for determining image on the basis of described first image data；
Converter unit is reduced, for when the depth of field deviation is more than first threshold, being reduced to second image
Transformation；
Stretching conversion unit, for when the depth of field deviation is less than second threshold, being stretched to second image
Transformation.
For device embodiment, since it is basicly similar to embodiment of the method, so description is fairly simple, it is related
Part illustrates referring to the part of embodiment of the method.
Mobile terminal provided in an embodiment of the present invention can realize that mobile terminal is realized each in the embodiment of the method for Fig. 1
Process is repeated to avoid, and which is not described herein again.
A kind of hardware architecture diagram of Fig. 3 mobile terminals of each embodiment to realize the present invention,
The mobile terminal 300 includes but not limited to：It is radio frequency unit 301, network module 302, audio output unit 303, defeated
Enter unit 304, sensor 305, display unit 306, user input unit 307, interface unit 308, memory 309, processor
The components such as 310 and power supply 311.It will be understood by those skilled in the art that the mobile terminal structure shown in Fig. 3 is not formed
Restriction to mobile terminal, mobile terminal can include than illustrate more or fewer components either combine certain components or
Different component arrangements.In embodiments of the present invention, mobile terminal include but not limited to mobile phone, tablet computer, laptop,
Palm PC, car-mounted terminal, wearable device and pedometer etc..
Processor 310, under panorama photographing mode, acquiring the data of at least two field pictures；Wherein, described image
Data include structure light coding information；According to the structure light coding information, the depth of field of at least two field pictures is determined respectively
Information；Based on the depth of view information of at least two field pictures, image mosaic is carried out at least two field pictures, obtains panorama sketch
Picture.
In embodiments of the present invention, by acquiring the data of at least two field pictures, the number of image under panorama photographing mode
According to including structure light coding information, then according to structure light coding information, the depth of view information of at least two field pictures, base are determined respectively
Image mosaic is carried out at least two field pictures in depth of view information, panoramic picture is obtained, realizes the panoramic picture based on structure light
Splicing, ensure that the accuracy of Panorama Mosaic, avoid due to splicing dislocation caused by the shake of camera.
It should be understood that the embodiment of the present invention in, radio frequency unit 301 can be used for receive and send messages or communication process in, signal
Send and receive, specifically, by from base station downlink data receive after, handled to processor 310；In addition, by uplink
Data are sent to base station.In general, radio frequency unit 301 includes but not limited to antenna, at least one amplifier, transceiver, coupling
Device, low-noise amplifier, duplexer etc..In addition, radio frequency unit 301 can also by radio communication system and network and other set
Standby communication.
Mobile terminal has provided wireless broadband internet to the user by network module 302 and has accessed, and such as user is helped to receive
It sends e-mails, browse webpage and access streaming video etc..
It is that audio output unit 303 can receive radio frequency unit 301 or network module 302 or in memory 309
The audio data of storage is converted into audio signal and exports as sound.Moreover, audio output unit 303 can also be provided and be moved
The relevant audio output of specific function that dynamic terminal 300 performs is (for example, call signal receives sound, message sink sound etc.
Deng).Audio output unit 303 includes loud speaker, buzzer and receiver etc..
Input unit 304 is used to receive audio or video signal.Input unit 304 can include graphics processor
(Graphics Processing Unit, GPU) 3041 and microphone 3042, graphics processor 3041 is in video acquisition mode
Or the static images or the image data of video obtained in image capture mode by image capture apparatus (such as camera) carry out
Reason.Treated, and picture frame may be displayed on display unit 306.Through graphics processor 3041, treated that picture frame can be deposited
Storage is sent in memory 309 (or other storage mediums) or via radio frequency unit 301 or network module 302.Mike
Wind 3042 can receive sound, and can be audio data by such acoustic processing.Treated audio data can be
The form output of mobile communication base station can be sent to via radio frequency unit 301 by being converted in the case of telephone calling model.
Mobile terminal 300 further includes at least one sensor 305, such as optical sensor, motion sensor and other biographies
Sensor.Specifically, optical sensor includes ambient light sensor and proximity sensor, wherein, ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 3061, and proximity sensor can close when mobile terminal 300 is moved in one's ear
Display panel 3061 and/or backlight.As one kind of motion sensor, accelerometer sensor can detect in all directions (general
For three axis) size of acceleration, size and the direction of gravity are can detect that when static, can be used to identify mobile terminal posture (ratio
Such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap)；It passes
Sensor 305 can also include fingerprint sensor, pressure sensor, iris sensor, molecule sensor, gyroscope, barometer, wet
Meter, thermometer, infrared ray sensor etc. are spent, details are not described herein.
Display unit 306 is used to show by information input by user or be supplied to the information of user.Display unit 306 can wrap
Display panel 3061 is included, liquid crystal display (Liquid Crystal Display, LCD), Organic Light Emitting Diode may be used
Display panel 3061 is configured in forms such as (Organic Light-Emitting Diode, OLED).
User input unit 307 can be used for receiving the number inputted or character information and generation and the use of mobile terminal
The key signals input that family is set and function control is related.Specifically, user input unit 307 include touch panel 3071 and
Other input equipments 3072.Touch panel 3071, also referred to as touch screen collect user on it or neighbouring touch operation
(for example user uses any suitable objects such as finger, stylus or attachment on touch panel 3071 or in touch panel 3071
Neighbouring operation).Touch panel 3071 may include both touch detecting apparatus and touch controller.Wherein, touch detection
Device detects the touch orientation of user, and detects the signal that touch operation is brought, and transmits a signal to touch controller；Touch control
Device processed receives touch information from touch detecting apparatus, and is converted into contact coordinate, then gives processor 310, receiving area
It manages the order that device 310 is sent and is performed.It is furthermore, it is possible to more using resistance-type, condenser type, infrared ray and surface acoustic wave etc.
Type realizes touch panel 3071.In addition to touch panel 3071, user input unit 307 can also include other input equipments
3072.Specifically, other input equipments 3072 can include but is not limited to physical keyboard, function key (such as volume control button,
Switch key etc.), trace ball, mouse, operating lever, details are not described herein.
Further, touch panel 3071 can be covered on display panel 3061, when touch panel 3071 is detected at it
On or near touch operation after, send to processor 310 with determine touch event type, be followed by subsequent processing device 310 according to touch
The type for touching event provides corresponding visual output on display panel 3061.Although in figure 3, touch panel 3071 and display
Panel 3061 is the component independent as two to realize the function that outputs and inputs of mobile terminal, but in some embodiments
In, can be integrated by touch panel 3071 and display panel 3061 and realize the function that outputs and inputs of mobile terminal, it is specific this
Place does not limit.
Interface unit 308 is the interface that external device (ED) is connect with mobile terminal 300.For example, external device (ED) can include
Line or wireless head-band earphone port, external power supply (or battery charger) port, wired or wireless data port, storage card end
Mouth, port, audio input/output (I/O) port, video i/o port, earphone end for connecting the device with identification module
Mouthful etc..Interface unit 308 can be used for receiving the input (for example, data information, electric power etc.) from external device (ED) and
One or more elements that the input received is transferred in mobile terminal 300 can be used in 300 He of mobile terminal
Data are transmitted between external device (ED).
Memory 309 can be used for storage software program and various data.Memory 309 can mainly include storing program area
And storage data field, wherein, storing program area can storage program area, the application program to be identified needed at least one function
(such as sound-playing function, image player function etc.) etc.；Storage data field can be stored uses created number according to mobile phone
According to (such as audio data, phone directory etc.) etc..In addition, memory 309 can include high-speed random access memory, can also wrap
Include nonvolatile memory, a for example, at least disk memory, flush memory device or other volatile solid-state parts.
Processor 310 is the control centre of mobile terminal, utilizes each of various interfaces and the entire mobile terminal of connection
A part is stored in storage by running or performing the software program being stored in memory 309 and/or module and call
Data in device 309 perform the various functions of mobile terminal and processing data, so as to carry out integral monitoring to mobile terminal.Place
Reason device 310 may include one or more processing units；Preferably, processor 310 can integrate application processor and modulatedemodulate is mediated
Device is managed, wherein, the main processing operation system of application processor, user interface and application program to be identified etc., modulation /demodulation processing
Device mainly handles wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 310.
Mobile terminal 300 can also include the power supply 311 (such as battery) powered to all parts, it is preferred that power supply 311
Can be logically contiguous by power-supply management system and processor 310, so as to realize management charging by power-supply management system, put
The functions such as electricity and power managed.
In addition, mobile terminal 300 includes some unshowned function modules, details are not described herein.
Preferably, the embodiment of the present invention also provides a kind of mobile terminal, and including processor 310, memory 309 is stored in
On memory 309 and the computer program that can be run on the processor 310, the computer program are performed by processor 310
A kind of above-mentioned each processes of the embodiment of the method for panoramic picture generation of Shi Shixian, and identical technique effect can be reached, to keep away
Exempt to repeat, which is not described herein again.
The embodiment of the present invention also provides a kind of computer readable storage medium, and meter is stored on computer readable storage medium
Calculation machine program, the computer program realize a kind of each of the embodiment of the method for above-mentioned panoramic picture generation when being executed by processor
Process, and identical technique effect can be reached, it is repeated to avoid, which is not described herein again.Wherein, the computer-readable storage
Medium, such as read-only memory (Read-Only Memory, abbreviation ROM), random access memory (Random Access
Memory, abbreviation RAM), magnetic disc or CD etc..
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or device including a series of elements not only include those elements, and
And it further includes other elements that are not explicitly listed or further includes intrinsic for this process, method, article or device institute
Element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including this
Also there are other identical elements in the process of element, method, article or device.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme of the present invention substantially in other words does the prior art
Going out the part of contribution can be embodied in the form of software product, which is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), used including some instructions so that a station terminal (can be mobile phone, computer services
Device, air conditioner or network equipment etc.) perform method described in each embodiment of the present invention.
The embodiment of the present invention is described above in conjunction with attached drawing, but the invention is not limited in above-mentioned specific
Embodiment, above-mentioned specific embodiment is only schematical rather than restricted, those of ordinary skill in the art
Under the enlightenment of the present invention, present inventive concept and scope of the claimed protection are not being departed from, can also made very much
Form is belonged within the protection of the present invention.
Claims (12)
- A kind of 1. method of panoramic picture generation, which is characterized in that the method is applied to mobile terminal, including：Under panorama photographing mode, the data of acquisition at least two field pictures；Wherein, the data of described image include structure light coding Information；According to the structure light coding information, the depth of view information of at least two field pictures is determined respectively；Based on the depth of view information of at least two field pictures, image mosaic is carried out at least two field pictures, obtains panorama sketch Picture.
- 2. according to the method described in claim 1, it is characterized in that, the depth of view information based on at least two field pictures, The step of carrying out image mosaic at least two field pictures, obtain panoramic picture includes：From at least two field pictures, adjacent image is determined；Wherein, the adjacent image includes two frame figures of continuous acquisition Picture；Determine the depth of field deviation between the adjacent image；Based on the depth of field deviation, stretching is carried out to the adjacent image；Adjacent image after the stretching is merged, obtains panoramic picture.
- 3. according to the method described in claim 2, it is characterized in that, the adjacent image include the first image and the second image, It is described determine the adjacent image between the depth of field deviation the step of include：Detect the overlapping region of described first image and the second image；Determine first depth of view information of the overlapping region in described first image；Determine second depth of view information of the overlapping region in second image；The difference of first depth of view information and second depth of view information is calculated, as described first image and second figure Depth of field deviation as between.
- 4. the according to the method described in claim 3, it is characterized in that, overlapping of the detection described first image and the second image The step of region, includes：Extract the fisrt feature point in described first image；And the second feature point in extraction second image；The fisrt feature point and second feature point are matched, obtain multiple overlapping feature points；Using the multiple overlapping feature point composition described first image and the overlapping region of second image.
- 5. method according to claim 3 or 4, which is characterized in that it is described based on the depth of field deviation, to described adjacent The step of image progress stretching, includes：Determine image on the basis of described first image；When the depth of field deviation is more than first threshold, diminution transformation is carried out to second image；When the depth of field deviation is less than second threshold, stretching conversion is carried out to second image.
- 6. a kind of device of panoramic picture generation, which is characterized in that described device is applied to mobile terminal, including：Image data acquiring module, under panorama photographing mode, acquiring the data of at least two field pictures；Wherein, the figure As data include structure light coding information；Depth of view information determining module, for according to the structure light coding information, determining the scape of at least two field pictures respectively Deeply convince breath；For the depth of view information based on at least two field pictures, figure is carried out at least two field pictures for image mosaic module As splicing, panoramic picture is obtained.
- 7. device according to claim 6, which is characterized in that described image concatenation module includes：Adjacent image data determination sub-module, for from at least two field pictures, determining adjacent image；Wherein, the phase Adjacent image includes the two field pictures of continuous acquisition；Depth of field deviation determination sub-module, for determining the depth of field deviation between the adjacent image；For being based on the depth of field deviation, stretching is carried out to the adjacent image for stretching submodule；Image co-registration submodule for being merged to the adjacent image after the stretching, obtains panoramic picture.
- 8. device according to claim 7, which is characterized in that the adjacent image includes the first image and the second image, The depth of field deviation determination sub-module includes：Overlapping region detection unit, for detecting the overlapping region of described first image and the second image；First depth of view information determination unit, for determining first depth of view information of the overlapping region in described first image；Second depth of view information determination unit, for determining second depth of view information of the overlapping region in second image；Difference value determining unit, for calculating the difference of first depth of view information and second depth of view information, as described Depth of field deviation between one image and second image.
- 9. device according to claim 8, which is characterized in that the overlapping region detection unit includes：Fisrt feature point extracts subelement, for extracting the point of the fisrt feature in described first image；Second feature point extracts subelement, for extracting the second feature point in second image；Overlapping feature point obtains subelement, for being matched to the fisrt feature point and second feature point, obtains more A overlapping feature point；Overlapping region forms subelement, for using the multiple overlapping feature point composition described first image and second figure The overlapping region of picture.
- 10. device according to claim 8 or claim 9, which is characterized in that the stretching submodule includes：Benchmark image determination unit, for determining image on the basis of described first image data；Converter unit is reduced, for when the depth of field deviation is more than first threshold, diminution change to be carried out to second image It changes；Stretching conversion unit, for when the depth of field deviation is less than second threshold, stretching change to be carried out to second image It changes.
- 11. a kind of mobile terminal, which is characterized in that including processor, memory and be stored on the memory and can be in institute The computer program run on processor is stated, such as claim 1 to 5 is realized when the computer program is performed by the processor Any one of described in panoramic picture generation method the step of.
- 12. a kind of computer readable storage medium, which is characterized in that computer journey is stored on the computer readable storage medium Sequence, the panoramic picture generation as described in any one of claim 1 to 5 is realized when the computer program is executed by processor The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711487904.1A CN108259740A (en) | 2017-12-29 | 2017-12-29 | A kind of method, apparatus and mobile terminal of panoramic picture generation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711487904.1A CN108259740A (en) | 2017-12-29 | 2017-12-29 | A kind of method, apparatus and mobile terminal of panoramic picture generation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108259740A true CN108259740A (en) | 2018-07-06 |
Family
ID=62724507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711487904.1A Pending CN108259740A (en) | 2017-12-29 | 2017-12-29 | A kind of method, apparatus and mobile terminal of panoramic picture generation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108259740A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756660A (en) * | 2019-01-04 | 2019-05-14 | Oppo广东移动通信有限公司 | Electronic equipment and mobile platform |
| CN110796596A (en) * | 2019-08-30 | 2020-02-14 | 深圳市德赛微电子技术有限公司 | Image splicing method, imaging device and panoramic imaging system |
| CN114615426A (en) * | 2022-02-17 | 2022-06-10 | 维沃移动通信有限公司 | Shooting method, shooting device, electronic equipment and readable storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102221887A (en) * | 2011-06-23 | 2011-10-19 | 康佳集团股份有限公司 | Interactive projection system and method |
| US20120249743A1 (en) * | 2011-03-31 | 2012-10-04 | Korea Institute Of Science And Technology | Method and apparatus for generating image with highlighted depth-of-field |
| CN105407280A (en) * | 2015-11-11 | 2016-03-16 | 广东欧珀移动通信有限公司 | Panoramic image synthesizing method and system |
| JP2016039613A (en) * | 2014-08-11 | 2016-03-22 | キヤノン株式会社 | Image processing system, control method thereof, program, and storage medium |
| CN106210474A (en) * | 2016-08-12 | 2016-12-07 | 信利光电股份有限公司 | A kind of image capture device, virtual reality device |
-
2017
- 2017-12-29 CN CN201711487904.1A patent/CN108259740A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120249743A1 (en) * | 2011-03-31 | 2012-10-04 | Korea Institute Of Science And Technology | Method and apparatus for generating image with highlighted depth-of-field |
| CN102221887A (en) * | 2011-06-23 | 2011-10-19 | 康佳集团股份有限公司 | Interactive projection system and method |
| JP2016039613A (en) * | 2014-08-11 | 2016-03-22 | キヤノン株式会社 | Image processing system, control method thereof, program, and storage medium |
| CN105407280A (en) * | 2015-11-11 | 2016-03-16 | 广东欧珀移动通信有限公司 | Panoramic image synthesizing method and system |
| CN106210474A (en) * | 2016-08-12 | 2016-12-07 | 信利光电股份有限公司 | A kind of image capture device, virtual reality device |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109756660A (en) * | 2019-01-04 | 2019-05-14 | Oppo广东移动通信有限公司 | Electronic equipment and mobile platform |
| CN110796596A (en) * | 2019-08-30 | 2020-02-14 | 深圳市德赛微电子技术有限公司 | Image splicing method, imaging device and panoramic imaging system |
| CN114615426A (en) * | 2022-02-17 | 2022-06-10 | 维沃移动通信有限公司 | Shooting method, shooting device, electronic equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107580184B (en) | A kind of image pickup method and mobile terminal | |
| CN108989672B (en) | Shooting method and mobile terminal | |
| CN106558039B (en) | A kind of facial image processing method and device | |
| CN107948499A (en) | A kind of image capturing method and mobile terminal | |
| CN107483836B (en) | A kind of image pickup method and mobile terminal | |
| CN109068116B (en) | Image processing method and device based on supplementary lighting, mobile terminal and storage medium | |
| CN107730460B (en) | Image processing method and mobile terminal | |
| CN108347558A (en) | A kind of method, apparatus and mobile terminal of image optimization | |
| CN108564613A (en) | A kind of depth data acquisition methods and mobile terminal | |
| CN107566749A (en) | Image pickup method and mobile terminal | |
| CN109618218B (en) | Video processing method and mobile terminal | |
| CN110213485A (en) | A kind of image processing method and terminal | |
| CN108462826A (en) | A kind of method and mobile terminal of auxiliary photo-taking | |
| CN108881544A (en) | A kind of method taken pictures and mobile terminal | |
| CN108307110A (en) | A kind of image weakening method and mobile terminal | |
| CN108198127A (en) | A kind of image processing method, device and mobile terminal | |
| CN107948516A (en) | A kind of image processing method, device and mobile terminal | |
| CN108174081B (en) | A kind of image pickup method and mobile terminal | |
| CN108259740A (en) | A kind of method, apparatus and mobile terminal of panoramic picture generation | |
| CN109544445A (en) | A kind of image processing method, device and mobile terminal | |
| CN108650466A (en) | The method and electronic equipment of photo tolerance are promoted when a kind of strong light or reversible-light shooting portrait | |
| CN108280405A (en) | A kind of method and apparatus of vehicle obstacle-avoidance | |
| CN108322639A (en) | A kind of method, apparatus and mobile terminal of image procossing | |
| CN108391011A (en) | A kind of face identification method and mobile terminal | |
| CN108259756A (en) | A kind of image capturing method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180706 |
|
| RJ01 | Rejection of invention patent application after publication |