CN111373730A - Panoramic shooting method and terminal - Google Patents

Panoramic shooting method and terminal Download PDF

Info

Publication number
CN111373730A
CN111373730A CN201780097103.6A CN201780097103A CN111373730A CN 111373730 A CN111373730 A CN 111373730A CN 201780097103 A CN201780097103 A CN 201780097103A CN 111373730 A CN111373730 A CN 111373730A
Authority
CN
China
Prior art keywords
panoramic image
terminal
shooting
panoramic
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780097103.6A
Other languages
Chinese (zh)
Other versions
CN111373730B (en
Inventor
黄健萍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Transsion Manufacturing Co ltd
Original Assignee
Shenzhen Transsion Manufacturing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Transsion Manufacturing Co ltd filed Critical Shenzhen Transsion Manufacturing Co ltd
Publication of CN111373730A publication Critical patent/CN111373730A/en
Application granted granted Critical
Publication of CN111373730B publication Critical patent/CN111373730B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules

Abstract

The invention discloses a panoramic shooting method and a terminal, wherein the method comprises the following steps: when the terminal takes a picture in a panoramic shooting mode, receiving a shooting pause instruction input by a user, pausing the panoramic shooting, and storing a panoramic image generated by the terminal at a pause moment; receiving a continuation instruction which is input by a user and aims at the panoramic image to continue panoramic shooting; acquiring a first non-panoramic image generated by a terminal in a random moving process; the method comprises the steps of obtaining a first contact ratio of a panoramic image and a first non-panoramic image, displaying a horizontal movement indicating line on a display screen when the first contact ratio is larger than a preset threshold value so as to indicate a user to move a terminal horizontally, updating the panoramic image in a preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process in a full screen mode on the display screen. The panoramic shooting method and the terminal enable a user to pause in the panoramic shooting process, and after the pause, the user can continue shooting based on the shot panoramic image.

Description

Panoramic shooting method and terminal Technical Field
The invention relates to the field of camera shooting, in particular to a panoramic shooting method and a terminal.
Background
Panoramic shooting is a common shooting mode, and in brief, the principle is to piece a plurality of shot images into a panoramic image so as to solve the limitation of the field of view of a lens. The panoramic photograph taken corresponds to a photograph taken over the full scene range of a person's eyes, including the normal effective viewing angle of the eyes (about 90 degrees horizontally, 70 degrees vertically) or including the aftereyes (about 180 degrees horizontally, 90 degrees vertically), or even 360 degrees.
The panoramic shooting process in the prior art is as follows: the user slowly rotates in situ to keep the lens at the same horizontal height, a plurality of photos are taken at intervals along with the rotation of the lens, and after the shooting is finished, all the taken photos are spliced in sequence to form a complete panoramic photo. However, in the panoramic photographing process, the user cannot pause the photographing, resulting in high operational difficulty of the panoramic photographing.
Therefore, how to realize pause in the panoramic shooting process is an urgent problem to be solved.
Disclosure of Invention
The embodiment of the invention provides a panoramic shooting method and a terminal, which enable a user to pause in the panoramic shooting process and continue shooting based on a shot panoramic image after the pause.
In a first aspect, the present invention provides a panoramic shooting method, including:
when the terminal takes a picture in a panoramic shooting mode, receiving a shooting pause instruction input by a user, pausing the panoramic shooting, and storing a panoramic image generated by the terminal at a pause moment;
receiving a continuation instruction which is input by the user and aims at the panoramic image to continue panoramic shooting, and displaying the panoramic image in a preset area of a display screen;
acquiring a first non-panoramic image generated by the terminal in the random moving process, and displaying the first non-panoramic image on the display screen in a full screen manner;
and when the first contact ratio is greater than a preset threshold value, displaying a horizontal movement indication line on the display screen to indicate the user to horizontally move the terminal, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process in a full screen mode on the display screen.
In one possible design, the method further includes: storing a third non-panoramic image which is acquired by the terminal at a pause moment and used for splicing the panoramic image;
the obtaining a first coincidence ratio of the panoramic image and the first non-panoramic image includes:
obtaining a second coincidence degree of the third non-panoramic image and the first non-panoramic image;
and acquiring the first coincidence degree according to the second coincidence degree and the actual pixel number of the panoramic image in the length direction.
In one possible design, the obtaining a second degree of overlap of the third non-panoramic image and the first non-panoramic image includes:
extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image;
performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched;
and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points.
In one possible design, the obtaining the first overlap ratio according to the second overlap ratio and an actual number of pixels of the panoramic image in a length direction includes:
judging whether the actual pixel number of the panoramic image in the length direction is greater than the standard pixel number;
if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
In one possible design, before receiving the photographing pause instruction input by the user, the method further includes:
displaying a shooting button on the display screen when the terminal enters a panoramic shooting mode;
when the first operation of the user on the shooting button is obtained, controlling the terminal to shoot in a panoramic shooting mode, and continuously displaying the shooting button on the display screen;
the receiving of the photographing pause instruction input by the user comprises the following steps:
and acquiring a second operation of the user on the shooting button to obtain a shooting pause instruction input by the user.
In one possible design, the receiving the user-input continuation instruction to continue panorama shooting for the panoramic image includes:
receiving a viewing instruction for viewing the panoramic image, which is input by the user;
displaying the panoramic image on the display screen in a full screen mode, and displaying the shooting button;
and acquiring a third operation of the user on the shooting button to obtain a continuing instruction input by the user.
In a second aspect, the present invention further provides a terminal, including:
the terminal comprises a pause module, a storage module and a control module, wherein the pause module is used for receiving a shooting pause instruction input by a user when the terminal shoots in a panoramic shooting mode, pausing the panoramic shooting and storing a panoramic image generated by the terminal at a pause moment;
a continuation module, configured to receive a continuation instruction, input by the user, for continuing panoramic shooting on the panoramic image, and display the panoramic image in a preset area of a display screen;
the acquisition module is used for acquiring a first non-panoramic image generated by the terminal in the random moving process and displaying the first non-panoramic image on the display screen in a full screen mode;
and the contact ratio module is used for acquiring a first contact ratio of the panoramic image and the first non-panoramic image, displaying a horizontal movement indicating line on the display screen when the first contact ratio is greater than a preset threshold value so as to indicate the user to horizontally move the terminal, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process on the display screen in a full screen mode.
In a possible design, the pause module is further configured to store a third non-panoramic image, obtained by the terminal at a pause time, for stitching the panoramic image;
the coincidence module is specifically configured to obtain a second coincidence degree of the third non-panoramic image and the first non-panoramic image;
the coincidence degree module is specifically configured to obtain the first coincidence degree according to the second coincidence degree and the actual number of pixels of the panoramic image in the length direction.
In one possible design, the obtaining a second degree of overlap of the third non-panoramic image and the first non-panoramic image includes:
extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image;
performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched;
and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points.
In a possible design, the overlap ratio module is further specifically configured to determine whether the actual number of pixels of the panoramic image in the length direction is greater than a standard number of pixels;
if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
In one possible design, the continuation module is further specifically configured to receive a viewing instruction for viewing the panoramic image, which is input by the user;
the continuation module is further specifically configured to display the panoramic image on the display screen in a full screen manner and display the shooting button;
the continuing module is further specifically configured to acquire a third operation of the user on the shooting button to obtain a continuing instruction input by the user.
In a third aspect, the present invention further provides a terminal, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
when the terminal takes a picture in a panoramic shooting mode, receiving a shooting pause instruction input by a user, pausing the panoramic shooting, and storing a panoramic image generated by the terminal at a pause moment;
receiving a continuation instruction which is input by the user and aims at the panoramic image to continue panoramic shooting, and displaying the panoramic image in a preset area of a display screen;
acquiring a first non-panoramic image generated by the terminal in the random moving process, and displaying the first non-panoramic image on the display screen in a full screen manner;
and when the first contact ratio is greater than a preset threshold value, displaying a horizontal movement indication line on the display screen to indicate the user to horizontally move the terminal, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process in a full screen mode on the display screen.
In a fourth aspect, the present invention also provides a storage medium comprising: a readable storage medium and a computer program for implementing the first aspect and various possible designs of the panoramic photographing method of the first aspect.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
The panoramic shooting method provided by the invention comprises the steps that when a terminal shoots in a panoramic shooting mode, the terminal receives a shooting pause instruction input by a user, pauses the panoramic shooting, and stores a panoramic image generated by the terminal at the pause time, and when the terminal receives a continuation instruction input by the user and aiming at the panoramic image to continue the panoramic shooting, the terminal displays the panoramic image in a preset area of a display screen, and simultaneously, the terminal acquires a first non-panoramic image generated by the terminal in the random moving process and displays the first non-panoramic image on the display screen in a full screen mode, by acquiring the first contact ratio of the panoramic image and the first non-panoramic image, and when the first contact ratio is larger than a preset threshold value, the terminal displays a horizontal moving indication line on the full screen to indicate the user to horizontally move the terminal, updates the panoramic image in the preset area in real time, and displays a second non-panoramic image generated in the horizontal moving process on the display screen, therefore, the user can pause during the panoramic shooting process, and can continue shooting based on the shot panoramic image after the pause.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a flowchart of a panorama shooting method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a pause interface according to an embodiment of the invention;
FIG. 3 is a schematic illustration of a continuation interface in an embodiment of the invention;
FIG. 4 is a flowchart of a method for a terminal to receive a resume instruction according to an embodiment of the present invention;
fig. 5 is a flowchart of a method for acquiring a first contact ratio by a terminal according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 7 is a block diagram of a terminal in an embodiment of the invention.
Detailed Description
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terms to which the present invention relates will be explained first:
panoramic shooting: the method is characterized in that shooting can be performed by taking a certain point as a center, and 360 degrees horizontally and 180 degrees vertically so as to acquire a panoramic image.
Pausing: temporarily stopping during the execution of a complete task and continuing the way to complete the task after stopping.
The contact ratio: to indicate the extent to which two images have the same portion.
Pixel: the basic codes, which refer to basic original pigments and their gray levels, are basic units constituting a digital image, and usually the size of the resolution of the image is expressed in units of ppi (pixels per inch).
Matching: and searching for similar image targets by analyzing the corresponding relation, similarity and consistency of image contents, characteristics, structures, relations, textures, gray levels and the like.
The invention provides a data transmission method, which aims to solve the technical problems in the prior art.
The following describes the technical solution of the present invention and how to solve the above technical problems with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present invention will be described below with reference to the accompanying drawings.
Fig. 1 is a flowchart of a panorama shooting method in an embodiment of the present invention, where an execution subject of the embodiment may be a terminal, and the terminal related in the embodiment of the present invention includes, but is not limited to: smart phones, tablet computers, notebook computers, desktop computers. As shown in fig. 1, the scheme of the present embodiment may include the following steps:
step S101, when the terminal takes a picture in a panoramic shooting mode, receiving a shooting pause instruction input by a user, pausing the panoramic shooting, and storing a panoramic image generated by the terminal at a pause moment.
For example, a user selects to enter a panoramic photographing mode on a mobile phone, and starts panoramic photographing after the user operates the mobile phone. The shooting process may be as follows: a user holds the terminal to slowly rotate in place, and during the period, the terminal shoots a current scene at intervals of a preset time, fig. 2 is a schematic view of a pause interface in an embodiment of the present invention, as shown in fig. 2, the terminal displays an image of the current scene on a display screen in a full screen manner, and the terminal displays a preview image of a panoramic image in a certain area on the display screen. Optionally, when shooting is performed, a pause button is arranged on a display screen of the terminal, and when a user touches, scratches and the like the pause button, the terminal receives a shooting pause instruction input by the user, pauses panoramic shooting, and stores a panoramic image generated by the terminal at a pause moment. The panoramic image generated at the pause time is formed by sequentially splicing a plurality of scene images before pause according to the shooting time sequence.
And S102, receiving a continuation instruction which is input by the user and aims at continuing panoramic shooting of the panoramic image, and displaying the panoramic image in a preset area of a display screen.
When the user needs to continue the panoramic shooting on the basis of the pause, the user can perform operations such as touching, sliding and the like on a continuation button on a display screen of the terminal, so that a continuation instruction which is input by the user and aims at continuing the panoramic shooting of the panoramic image is received, and the panoramic image is displayed in a preset area of the display screen. It should be noted that the predetermined area may be not only a rectangle but also other shapes and positions, which are not limited herein.
Step S103, a first non-panoramic image generated by the terminal in the random moving process is obtained, and the first non-panoramic image is displayed on the display screen in a full screen mode.
In this step, the first non-panoramic image may be a current scene image shot by the lens, and the first non-panoramic image is displayed to the user in a full screen manner to show the current scene to the user.
Step S104, obtaining a first contact ratio of the panoramic image and the first non-panoramic image, displaying a horizontal movement indication line on the display screen when the first contact ratio is larger than a preset threshold value so as to indicate the user to move the terminal horizontally, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process on the display screen in a full screen mode.
Specifically, when the terminal acquires the first non-panoramic image, the terminal determines a first contact ratio of the first non-panoramic image and the panoramic image at the time of pause. Alternatively, the first degree of overlap may be achieved not only by the image matching method but also by the polygon overlapping method. Briefly, the image matching method is as follows: extracting a first feature point in the first non-panoramic image and a second feature point in the panoramic image during pause, wherein the first feature point can be at least one specific area in the first non-panoramic image, the second feature point can be at least one specific area in the panoramic image, performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched, and determining the first contact ratio according to the ratio of the feature point logarithm to the number of the first feature points. For example: the logarithm of the feature points is 20, and the number of the first feature points is 40, a first coincidence ratio of 50% is obtained. In addition, it is worth mentioning that the polygon overlapping method is as follows: since both images, i.e. the first non-panoramic image and the panoramic image at pause, are known and both images are understood as polygons, the calculation of the overlapping area thereof is equivalent to finding the intersection of the polygons. And acquiring a point set of the overlapping area through polygon intersection, and restoring point set information of the original image by using a homography matrix to obtain the overlapping area. And then obtaining the first overlapping degree according to the ratio of the number of the pixels in the overlapping area to the number of the pixels of the panoramic image during pause.
As can be seen from the above, in the panorama shooting method in this embodiment, when the terminal takes a picture in the panorama shooting mode, the terminal receives a shooting pause command input by the user, pauses the panorama shooting, and stores a panorama image generated by the terminal at the time of the pause, and when the terminal receives a continuation command input by the user to continue the panorama shooting with respect to the panorama image, the terminal displays the panorama image in a preset area of the display screen, and at the same time, the terminal acquires a first non-panorama image generated by the terminal during a random movement and displays the first non-panorama image on the display screen in a full screen manner by acquiring a first coincidence degree of the panorama image and the first non-panorama image, and when the first coincidence degree is greater than a preset threshold, the terminal displays a horizontal movement indication line on the display screen to indicate the user to move the terminal horizontally and updates the panorama image in the preset area from time to time, and displaying the second non-panoramic image generated in the horizontal moving process in a full screen mode on the display screen, so that the user can pause in the panoramic shooting process, and continue shooting based on the shot panoramic image after the pause.
Fig. 3 is a schematic view of a continuation interface in an embodiment of the present invention, as shown in fig. 3, after a terminal obtains a first overlap degree, a relationship between the first overlap degree and a preset threshold is determined, when the first overlap degree is greater than the preset threshold, a horizontal movement indication line is displayed on the display screen to indicate the user to horizontally move the terminal, and the panoramic image is updated in the preset area from time to time, a second non-panoramic image generated in the horizontal movement process is displayed on the display screen in a full screen manner, and the second non-panoramic image is a current scene image in continuation, so as to prompt a user of a current shooting content, so as to continue shooting on the basis of suspension.
The following describes in detail the implementation process of the terminal receiving the photographing pause instruction.
Specifically, when the terminal enters a panoramic shooting mode, a shooting button is displayed on the display screen; when the first operation of the user on the shooting button is obtained, controlling the terminal to shoot in a panoramic shooting mode, and continuously displaying the shooting button on the display screen; and acquiring a second operation of the user on the shooting button to obtain a shooting pause instruction input by the user.
It can also be said that when the user controls the terminal to enter the panoramic shooting mode, a shooting button is displayed on the display screen of the terminal, and when the user triggers the shooting button through clicking or swiping operation (i.e. the first operation), the terminal starts panoramic shooting. If the user wants to pause in the process, the shooting button can be triggered by clicking or swiping again (namely, the second operation), so that the terminal obtains a shooting pause instruction.
Fig. 4 is a flowchart of a method for a terminal to receive a continue instruction according to an embodiment of the present invention, which specifically includes the following steps:
step S201, receiving a viewing instruction for viewing the panoramic image, which is input by the user;
s202, displaying the panoramic image on the display screen in a full screen mode, and displaying the shooting button;
and step S203, acquiring a third operation of the user on the shooting button to obtain a continuing instruction input by the user.
For example, when the user pauses shooting, the user may input a viewing instruction by clicking a viewing button to view a panoramic image shot before pausing, in the viewing interface, the display screen displays not only the panoramic image shot during pausing in full screen but also a shooting button, and when the user needs to continue shooting on the basis of pausing, the shooting button may be triggered by clicking or swiping or other operations (i.e., a third operation), so that the terminal obtains the continuation instruction input by the user to continue shooting.
The following describes in detail a manner of acquiring the first contact ratio when the terminal pauses during panorama shooting.
Fig. 5 is a flowchart of a method for acquiring a first contact ratio by a terminal according to an embodiment of the present invention, which includes the following steps:
s301, storing a third non-panoramic image which is acquired by the terminal at the pause time and used for splicing the panoramic image;
in this step, when the terminal pauses, the terminal also stores the current scene image, i.e., the third non-panoramic image, for stitching the panoramic image, which is acquired at the moment of pausing.
S302, acquiring a second overlapping ratio of the third non-panoramic image and the first non-panoramic image.
When the terminal continues shooting, the terminal obtains a second coincidence degree according to the current scene image, namely the first non-panoramic image, during continuous shooting, namely the coincidence degree of the third non-panoramic image and the first non-panoramic image. The second overlap ratio calculation method of the third non-panoramic image and the first non-panoramic image is similar to the first overlap ratio calculation method of the first non-panoramic image and the panoramic image during pause in the above embodiment, and the overlap ratio result may be obtained by an image matching method or a polygon overlap method.
For example, when a second degree of overlap is obtained by an image matching algorithm, extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image; performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched; and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points. Since it is similar to the above method for obtaining the first contact ratio by the image matching method, it is not described herein.
And S303, acquiring the first coincidence degree according to the second coincidence degree and the actual pixel number of the panoramic image in the length direction.
When the terminal obtains the second coincidence degree, the terminal can also obtain the first coincidence degree according to the actual pixel number of the panoramic image in the length direction. For example, the terminal finds the second degree of overlap to be 80% according to the polygon overlap method, and the actual number of pixels of the panorama image in the length direction is 7680, and the number of standard pixels is 1920, the actual number of pixels of the panorama image in the length direction is 4 times the number of standard pixels, and thus the second degree of overlap is 4 times the first degree of overlap, and finds the first degree of overlap to be 20%.
Optionally, when the terminal obtains the second overlap ratio, the terminal may further obtain the first overlap ratio according to an actual number of pixels of the panoramic image in the length direction.
Specifically, judging whether the actual pixel number of the panoramic image in the length direction is greater than the standard pixel number; if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
For example, the terminal obtains the second overlap ratio of 80% according to the polygon overlap method, the number of actual pixels of the panoramic image in the length direction is 7680, and the number of standard pixels is 1920, the difference between the number of actual pixels of the panoramic image in the length direction and the number of standard pixels is 5760, which is greater than the number of standard pixels, so that the second overlap ratio is decreased to obtain the first overlap ratio of 20%.
The terminal finds the second coincidence ratio to be 20% according to the polygon superposition method, the actual number of pixels of the panoramic image in the length direction is 480, and the number of standard pixels is 1920, the difference between the actual number of pixels of the panoramic image in the length direction and the number of standard pixels is-1440, which is smaller than the number of standard image pixels, so the terminal presents the second coincidence ratio to find the first coincidence ratio to be 80%.
Fig. 6 is a schematic structural diagram of a terminal according to an embodiment of the present invention. As shown in fig. 4, the terminal 40 includes:
the pause module 41 is configured to receive a shooting pause instruction input by a user when the terminal takes a picture in the panoramic shooting mode, pause the panoramic shooting, and store a panoramic image generated by the terminal at a pause time;
a continuing module 42, configured to receive a continuing instruction, input by the user, for continuing panoramic shooting on the panoramic image, and display the panoramic image in a preset area of a display screen;
an obtaining module 43, configured to obtain a first non-panoramic image generated by the terminal in a random moving process, and display the first non-panoramic image on the display screen in a full screen manner;
the contact ratio module 44 is configured to obtain a first contact ratio between the panoramic image and the first non-panoramic image, display a horizontal movement indicator line on the display screen when the first contact ratio is greater than a preset threshold value, so as to indicate the user to move the terminal horizontally, update the panoramic image in the preset area from time to time, and display a second non-panoramic image generated in the horizontal movement process on the display screen in a full screen manner.
Optionally, the pausing module 41 is further configured to store a third non-panoramic image, obtained by the terminal at a pausing moment, for stitching the panoramic image;
the overlap ratio module 44 is specifically configured to obtain a second overlap ratio of the third non-panoramic image and the first non-panoramic image;
the coincidence degree module 44 is specifically configured to obtain the first coincidence degree according to the second coincidence degree and the actual number of pixels of the panoramic image in the length direction.
Optionally, the obtaining a second coincidence of the third non-panoramic image and the first non-panoramic image includes:
extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image;
performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched;
and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points.
Optionally, the coincidence module 44 is further specifically configured to determine whether the actual number of pixels of the panoramic image in the length direction is greater than a standard number of pixels;
if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
Optionally, the continuing module 42 is further specifically configured to receive a viewing instruction for viewing the panoramic image, which is input by the user;
the continuation module 42 is further specifically configured to display the panoramic image on the display screen in a full screen manner and display the shooting button;
the continuing module 42 is further specifically configured to obtain a third operation of the shooting button by the user, so as to obtain a continuing instruction input by the user.
Fig. 7 is a block diagram of a terminal, which may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, etc., in one embodiment of the invention.
Terminal 500 may include one or more of the following components: processing component 502, memory 504, power component 506, multimedia component 508, audio component 510, input/output (I/O) interface 512, sensor component 514, and communication component 516.
The processing component 502 generally controls overall operation of the terminal 500, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 502 may include one or more processors 520 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 502 can include one or more modules that facilitate interaction between the processing component 502 and other components. For example, the processing component 502 can include a multimedia module to facilitate interaction between the multimedia component 508 and the processing component 502.
The memory 504 is configured to store various types of data to support operations at the terminal 500. Examples of such data include instructions for any application or method operating on terminal 500, contact data, phonebook data, messages, images, videos, and so forth. The memory 504 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power components 506 provide power to the various components of the terminal 500. The power components 506 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal 500.
The multimedia component 508 includes a screen providing an output interface between the terminal 500 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the terminal 500 is in an operation mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 510 is configured to output and/or input audio signals. For example, the audio component 510 includes a Microphone (MIC) configured to receive external audio signals when the terminal 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 504 or transmitted via the communication component 516. In some embodiments, audio component 510 further includes a speaker for outputting audio signals.
The I/O interface 512 provides an interface between the processing component 502 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the terminal 500. For example, sensor assembly 514 can detect an open/closed state of terminal 500, relative positioning of components, such as a display and keypad of terminal 500, position changes of terminal 500 or a component of terminal 500, presence or absence of user contact with terminal 500, orientation or acceleration/deceleration of terminal 500, and temperature changes of terminal 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 516 is configured to facilitate communications between the terminal 500 and other devices in a wired or wireless manner. The terminal 500 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one embodiment, the communication component 516 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In one embodiment, the communications component 516 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an embodiment, the terminal 500 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 504 comprising instructions, executable by the processor 520 of the terminal 500 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A storage medium, comprising: a readable storage medium and a computer program for implementing the panorama shooting method in the above-described embodiments.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (10)

  1. A panorama shooting method, characterized by comprising:
    when the terminal takes a picture in a panoramic shooting mode, receiving a shooting pause instruction input by a user, pausing the panoramic shooting, and storing a panoramic image generated by the terminal at a pause moment;
    receiving a continuation instruction which is input by the user and aims at the panoramic image to continue panoramic shooting, and displaying the panoramic image in a preset area of a display screen;
    acquiring a first non-panoramic image generated by the terminal in the random moving process, and displaying the first non-panoramic image on the display screen in a full screen manner;
    and when the first contact ratio is greater than a preset threshold value, displaying a horizontal movement indication line on the display screen to indicate the user to horizontally move the terminal, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process in a full screen mode on the display screen.
  2. The method of claim 1, further comprising: storing a third non-panoramic image which is acquired by the terminal at a pause moment and used for splicing the panoramic image;
    the obtaining a first coincidence ratio of the panoramic image and the first non-panoramic image includes:
    obtaining a second coincidence degree of the third non-panoramic image and the first non-panoramic image;
    and acquiring the first coincidence degree according to the second coincidence degree and the actual pixel number of the panoramic image in the length direction.
  3. The method of claim 2, wherein obtaining a second degree of coincidence of the third non-panoramic image with the first non-panoramic image comprises:
    extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image;
    performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched;
    and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points.
  4. The method of claim 2, wherein the obtaining the first overlap ratio according to the second overlap ratio and an actual number of pixels of the panoramic image in a length direction comprises:
    judging whether the actual pixel number of the panoramic image in the length direction is greater than the standard pixel number;
    if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
    and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
  5. The method of claim 1, further comprising, prior to receiving a user-entered pause-in-taking instruction:
    displaying a shooting button on the display screen when the terminal enters a panoramic shooting mode;
    when the first operation of the user on the shooting button is obtained, controlling the terminal to shoot in a panoramic shooting mode, and continuously displaying the shooting button on the display screen;
    the receiving of the photographing pause instruction input by the user comprises the following steps:
    and acquiring a second operation of the user on the shooting button to obtain a shooting pause instruction input by the user.
  6. The method of claim 5, wherein the receiving the user-input continuation instruction to continue panoramic shooting for the panoramic image comprises:
    receiving a viewing instruction for viewing the panoramic image, which is input by the user;
    displaying the panoramic image on the display screen in a full screen mode, and displaying the shooting button;
    and acquiring a third operation of the user on the shooting button to obtain a continuing instruction input by the user.
  7. A terminal, comprising:
    the terminal comprises a pause module, a storage module and a control module, wherein the pause module is used for receiving a shooting pause instruction input by a user when the terminal shoots in a panoramic shooting mode, pausing the panoramic shooting and storing a panoramic image generated by the terminal at a pause moment;
    a continuation module, configured to receive a continuation instruction, input by the user, for continuing panoramic shooting on the panoramic image, and display the panoramic image in a preset area of a display screen;
    the acquisition module is used for acquiring a first non-panoramic image generated by the terminal in the random moving process and displaying the first non-panoramic image on the display screen in a full screen mode;
    and the contact ratio module is used for acquiring a first contact ratio of the panoramic image and the first non-panoramic image, displaying a horizontal movement indicating line on the display screen when the first contact ratio is greater than a preset threshold value so as to indicate the user to horizontally move the terminal, updating the panoramic image in the preset area from time to time, and displaying a second non-panoramic image generated in the horizontal movement process on the display screen in a full screen mode.
  8. The terminal of claim 7, wherein the pause module is further configured to store a third non-panoramic image obtained by the terminal at a pause time for stitching the panoramic image;
    the coincidence module is specifically configured to obtain a second coincidence degree of the third non-panoramic image and the first non-panoramic image;
    the coincidence degree module is specifically configured to obtain the first coincidence degree according to the second coincidence degree and the actual number of pixels of the panoramic image in the length direction.
  9. The terminal of claim 8, wherein obtaining a second degree of coincidence of the third non-panoramic image with the first non-panoramic image comprises:
    extracting a first feature point in the third non-panoramic image and a second feature point in the first non-panoramic image;
    performing a feature point matching process on the first feature point and the second feature point to obtain a feature point logarithm which is successfully matched;
    and determining the second coincidence degree according to the ratio of the feature point logarithm to the number of the first feature points.
  10. The terminal according to claim 8, wherein the coincidence module is further specifically configured to determine whether an actual number of pixels of the panoramic image in a length direction is greater than a standard number of pixels;
    if so, performing decrement processing on the second coincidence degree according to a decrement corresponding to a first difference value between the actual pixel quantity and the standard pixel quantity to obtain the first coincidence degree;
    and if not, carrying out incremental processing on the second coincidence degree according to the increment corresponding to the second difference value of the standard pixel quantity and the actual pixel quantity to obtain the first coincidence degree.
CN201780097103.6A 2017-09-28 2017-09-28 Panoramic shooting method and terminal Active CN111373730B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/103860 WO2019061118A1 (en) 2017-09-28 2017-09-28 Panoramic capture method and terminal

Publications (2)

Publication Number Publication Date
CN111373730A true CN111373730A (en) 2020-07-03
CN111373730B CN111373730B (en) 2021-04-13

Family

ID=65902540

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780097103.6A Active CN111373730B (en) 2017-09-28 2017-09-28 Panoramic shooting method and terminal

Country Status (2)

Country Link
CN (1) CN111373730B (en)
WO (1) WO2019061118A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113469924A (en) * 2021-06-18 2021-10-01 汕头大学 Rapid image splicing method capable of keeping brightness consistent
CN114356163A (en) * 2022-01-06 2022-04-15 青海省第三地质勘查院 Display method and device of data operation page and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189849A1 (en) * 2003-03-31 2004-09-30 Hofer Gregory V. Panoramic sequence guide
CN102970478A (en) * 2011-08-30 2013-03-13 三星电子株式会社 Digital photographing apparatus for displaying panoramic images and method of controlling the same
US20130322845A1 (en) * 2012-06-01 2013-12-05 Hal Laboratory, Inc. Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method
CN104486544A (en) * 2014-12-08 2015-04-01 广东欧珀移动通信有限公司 Method and device for shooting panoramic photo
CN104902183A (en) * 2015-05-28 2015-09-09 广东欧珀移动通信有限公司 Panoramic photographing method and device
CN106605403A (en) * 2014-08-29 2017-04-26 三星电子株式会社 Photographing method and electronic device
US20180070043A1 (en) * 2016-09-08 2018-03-08 Samsung Electronics Co., Ltd. Display apparatus and controlling method thereof
CN110806848A (en) * 2019-11-02 2020-02-18 徐书诚 Computer system for realizing display of panoramic image player

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4244973B2 (en) * 2005-08-03 2009-03-25 ソニー株式会社 Imaging system, camera control device, panoramic image display method and program
KR101784176B1 (en) * 2011-05-25 2017-10-12 삼성전자주식회사 Image photographing device and control method thereof
EP2860957B1 (en) * 2012-06-11 2020-11-18 Sony Interactive Entertainment Inc. Image capturing device, image capturing method and computer-readable recording medium
KR102067620B1 (en) * 2013-05-21 2020-01-17 삼성전자주식회사 Apparatus, method and computer readable recording medium for displaying the thumbnail image of a panorama picture

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189849A1 (en) * 2003-03-31 2004-09-30 Hofer Gregory V. Panoramic sequence guide
CN102970478A (en) * 2011-08-30 2013-03-13 三星电子株式会社 Digital photographing apparatus for displaying panoramic images and method of controlling the same
US20130322845A1 (en) * 2012-06-01 2013-12-05 Hal Laboratory, Inc. Storage medium storing information processing program, information processing device, information processing system, and panoramic video display method
CN106605403A (en) * 2014-08-29 2017-04-26 三星电子株式会社 Photographing method and electronic device
CN104486544A (en) * 2014-12-08 2015-04-01 广东欧珀移动通信有限公司 Method and device for shooting panoramic photo
CN104902183A (en) * 2015-05-28 2015-09-09 广东欧珀移动通信有限公司 Panoramic photographing method and device
US20180070043A1 (en) * 2016-09-08 2018-03-08 Samsung Electronics Co., Ltd. Display apparatus and controlling method thereof
CN110806848A (en) * 2019-11-02 2020-02-18 徐书诚 Computer system for realizing display of panoramic image player

Also Published As

Publication number Publication date
WO2019061118A1 (en) 2019-04-04
CN111373730B (en) 2021-04-13

Similar Documents

Publication Publication Date Title
CN105159640B (en) Display interface rotating method and device and mobile terminal
US9674395B2 (en) Methods and apparatuses for generating photograph
EP3182716A1 (en) Method and device for video display
US9667774B2 (en) Methods and devices for sending virtual information card
CN110662095B (en) Screen projection processing method and device, terminal and storage medium
EP3173970A1 (en) Image processing method and apparatus
CN107515669B (en) Display method and device
KR101788496B1 (en) Method and apparatus for controlling video image and terminal
US9652823B2 (en) Method and terminal device for controlling display of video image
US11372516B2 (en) Method, device, and storage medium for controlling display of floating window
CN104850643B (en) Picture comparison method and device
CN107797662B (en) Viewing angle control method and device and electronic equipment
EP2990905A1 (en) Method and device for displaying image
CN111373730B (en) Panoramic shooting method and terminal
CN114071001B (en) Control method, control device, electronic equipment and storage medium
CN110597443B (en) Calendar display method, device and medium
EP3799415A2 (en) Method and device for processing videos, and medium
CN109255839B (en) Scene adjustment method and device
CN107832112B (en) Wallpaper setting method and device
CN106354464B (en) Information display method and device
CN105975188B (en) Picture position adjusting method and device
CN114339019B (en) Focusing method, focusing device and storage medium
CN109407942B (en) Model processing method and device, control client and storage medium
CN109389547B (en) Image display method and device
CN115567762A (en) Zoom control method, apparatus and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant