CN113906727A - Panoramic playback method, device and system, shooting equipment and movable platform - Google Patents
Panoramic playback method, device and system, shooting equipment and movable platform Download PDFInfo
- Publication number
- CN113906727A CN113906727A CN202080039570.5A CN202080039570A CN113906727A CN 113906727 A CN113906727 A CN 113906727A CN 202080039570 A CN202080039570 A CN 202080039570A CN 113906727 A CN113906727 A CN 113906727A
- Authority
- CN
- China
- Prior art keywords
- panoramic image
- processor
- image
- initial
- library
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Abstract
The application provides a panoramic playback method, which comprises the steps of outputting and playing back an initial panoramic image synthesized by a plurality of specimen images; acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area; and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image. The target panoramic image can be synthesized again according to any selected area on the played back panoramic image to output and play back. The application also provides a panoramic playback device, shooting equipment, a movable platform and a panoramic playback system.
Description
Technical Field
The present application relates to the field of panoramic images, and in particular, to a panoramic playback method, a panoramic playback apparatus, a shooting device, a movable platform, and a panoramic playback system.
Background
When a panoramic image shot by shooting equipment is subjected to panoramic playback on a playback interface, a user cannot directly edit the played-back panoramic image to obtain a panoramic image wanted by the user, if the user is unsatisfied with the shot panoramic image, the user can only shoot again until the satisfactory panoramic image is shot and then downloaded, or the user can only passively download the unsatisfactory panoramic image, and then the panoramic image is imported into other image editing software for editing in a later period.
Disclosure of Invention
In a first aspect, an embodiment of the present application provides a method for panoramic playback, including:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
In a second aspect, an embodiment of the present application provides an apparatus for panoramic playback, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
In a third aspect, an embodiment of the present application provides a shooting device, including:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
In a fourth aspect, an embodiment of the present application provides a movable platform, on which a shooting device is mounted, where the shooting device includes:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
In a fifth aspect, an embodiment of the present application provides a system for panoramic playback, including a movable platform and a specified application, where a shooting device is installed on the movable platform, and the specified application is installed on an electronic device, where the movable platform is communicatively connected to the electronic device, and the shooting device includes a processor and a memory, where the memory is used to store instructions, and the processor, in response to a request of the specified application, calls the instructions stored in the memory to implement the following operations:
outputting an initial panoramic image synthesized by a plurality of specimen images to an interface of a designated application on the electronic equipment for playback;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen image into a target panoramic image again, and outputting the target panoramic image to an interface of a designated application on the electronic equipment for playback.
By determining the proof image which is used for synthesizing the initial panoramic image and corresponds to the selected area on the output and playback initial panoramic image, the method and the device realize that the target panoramic image can be synthesized again aiming at any selected area on the played back panoramic image to output and playback.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive labor.
Fig. 1 is a flowchart illustrating a method for panoramic playback according to an exemplary embodiment of the present application.
Fig. 2 is a schematic diagram of an initial panoramic image according to an exemplary embodiment of the present application.
Fig. 3 is a schematic diagram of a re-synthesized panoramic image according to an exemplary embodiment of the present application.
Fig. 4 is a detailed flowchart illustrating a spherical panorama playback according to an exemplary embodiment of the present application.
Fig. 5 is a schematic diagram of an apparatus for panoramic playback according to an exemplary embodiment of the present application.
Fig. 6 is a schematic diagram of a photographing apparatus according to an exemplary embodiment of the present application.
FIG. 7 is a schematic diagram of a movable platform shown in an exemplary embodiment of the present application.
Fig. 8 is a system diagram of panoramic playback shown in an exemplary embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the embodiment of the application, the panoramic image refers to an image synthesized by a plurality of shot specimen images, and the panoramic playback refers to output playback, namely output preview, on a playback interface after the various images shot by the shooting equipment are synthesized into the panoramic image, so that the images can be downloaded by a user. The shooting device refers to an electronic device with an image capturing function, and may be, for example, a camera, a mobile phone, a tablet computer, or the like.
The shooting device can output the synthesized panoramic image to a corresponding playback interface on other electronic devices which establish connection relation with the shooting device for playback, wherein the connection can be wireless connection or wired connection; of course, when the shooting device has a display function, the shooting device may use the synthesized panoramic image for output and playback on a playback interface of the home device.
In addition, if the panoramic playback is performed by other electronic equipment which establishes a connection relationship with the shooting equipment, the shooting equipment can synthesize various shot images into panoramic images and then output the panoramic images to a playback interface corresponding to the electronic equipment which establishes a connection relationship with the shooting equipment for playback; or the shooting equipment can transmit various shot images to the electronic equipment which establishes a connection relation with the shooting equipment, and the electronic equipment synthesizes the images into a panoramic image and then carries out panoramic playback. For example, an actual scene of the application may be that a user on the ground operates the remote control electronic device, controls the unmanned aerial vehicle equipped with the camera to fly according to a pre-planned route and acquire a certain number of specimen images, synthesizes the acquired specimen images into a panoramic image, and returns the panoramic image to the remote control electronic device of the user on the ground for panoramic playback.
For panoramic images shot by shooting equipment, when a playback interface performs panoramic playback, a user cannot edit the panoramic images, for example, an area in which the user is interested is selected to download the panoramic images, and only the whole image is passively downloaded and then the image which the user is satisfied with can be obtained through later editing.
In contrast, the embodiment of the present application provides a new panoramic playback method, and as an improvement, the panoramic image of the playback interface may be edited to regenerate a new panoramic image for the user to download, so that the abandonment rate of the panoramic image shot by the user and the re-editing workload of the panoramic image shot by the user are effectively reduced, and the stickiness of the user is greatly improved. The method can be applied to shooting equipment, and of course, can also be applied to electronic equipment which is connected with the shooting equipment and can receive images.
Referring to fig. 1, fig. 1 is a flowchart illustrating a method for panoramic playback according to an exemplary embodiment of the present application, as shown in fig. 1, including the following steps:
s101, outputting and replaying an initial panoramic image synthesized by a plurality of sample images;
s102, obtaining a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
s103, synthesizing the corresponding sample images into a target panoramic image again, and outputting and replaying the target panoramic image.
The panoramic image may be a banner panoramic image or a spherical panoramic image, and the application does not limit the type of the panoramic image. And the initial panoramic image and the newly synthesized target panoramic image may be different types of panoramic images, for example, when the initial panoramic image is a spherical panoramic image, the corresponding proof image may be determined based on a selected area on the spherical panoramic image, and then the banner panoramic image corresponding to the content of the selected area is synthesized again, or vice versa.
In addition, for the newly synthesized target panoramic image, the selected area on the newly synthesized target panoramic image can be continuously obtained, and the target panoramic image is synthesized again based on the corresponding sample corresponding to the selected area and then output and played back until the user obtains a satisfactory panoramic image to download. And for each panoramic image, the number of the selected areas can be only 1, or a plurality of selected areas can be provided, and the corresponding panoramic image can be synthesized again for each selected area on the panoramic image.
Optionally, the initial panoramic image and each newly synthesized target panoramic image may be displayed in a partition in a playback interface, so that a user can see the initial panoramic image and all newly synthesized target panoramic images, and may select any one of the panoramic images for downloading, or may select any one of the panoramic images for newly synthesizing the panoramic image. Of course, in addition to the split display, the playback interface may display the panoramic images in multiple layers, one panoramic image for each layer, and the user may set the panoramic image to be previewed as the uppermost layer. It is to be understood that the above display manner is merely exemplary, and the application is not limited as to how the initial panoramic image and each newly synthesized target panoramic image are displayed in the playback interface.
In one embodiment, when synthesizing the initial panoramic image, synthesis information of each sample image, such as matching information of feature points between the sample images, specific gravity information of an overlapped part between the sample images on the related sample images, and the like, may be recorded, so that synthesis may be performed directly according to the synthesis information when synthesizing the target panoramic image again in the following, thereby avoiding repeated calculation and improving the efficiency of re-synthesis.
Of course, editing the panoramic image may include, in addition to re-synthesizing the panoramic image based on the selected area on the panoramic image, intercepting a designated area on the output playback panoramic image or adding a label. For example, any panoramic image displayed on the panoramic playback interface can be cut based on a region specified by the user, wherein the specified region can be a region with any shape, such as a rectangle, a circle, a heart and the like, and the cut panoramic image can be downloaded by the user; for any panoramic image displayed on the panoramic playback interface, a user may add a label to the panoramic image, for example, may designate any region to add a text label, where the text may be a text with any font, and the size of the text may be adjusted arbitrarily, and certainly, it is not excluded that a label in the form of a picture, an animation expression, or the like may also be added to the designated region.
It should be noted that, the quality of the panoramic image obtained by directly capturing the panoramic image displayed on the panoramic playback interface and the panoramic image obtained by re-synthesizing the sample image corresponding to the selected area of the panoramic image displayed on the panoramic playback interface may be greatly different in some specific situations, and the following actual scenes may be referred to: the remote control electronic equipment is controlled by a user on the ground, the unmanned aerial vehicle carrying the camera is controlled to fly according to a preplanned air route and collect a certain number of specimen images, the collected specimen images are synthesized into a panoramic image, and then the panoramic image is transmitted back to the remote control electronic equipment of the user on the ground for panoramic playback. In the scene, a camera carried by an unmanned aerial vehicle synthesizes a panoramic image and transmits the panoramic image back to electronic equipment held by a ground user for playback, because the camera synthesizes the panoramic image, the camera only transmits the synthesized panoramic image back, and because the synthesized panoramic image has large capacity, the panoramic image after certain compression processing is transmitted back in consideration of the transmission efficiency and the playback real-time requirement, the actually played back panoramic image has a certain degree of reduction of resolution compared with the really synthesized panoramic image, and if the played back panoramic image is directly intercepted, the problem that the resolution is reduced to a certain degree also exists. However, if the synthesis is performed again based on the corresponding sample image of the selected area on the played back panoramic image, the number of the used sample images is reduced because the synthesized panoramic image is a local panoramic image, so the capacity of the newly synthesized panoramic image is also reduced, the newly synthesized panoramic image can be directly returned without being compressed, and the resolution of the played back panoramic image is the resolution of the real synthesis, so the quality of the obtained new panoramic image is better than that obtained by directly capturing.
In an embodiment, a user may freely select any area on the panoramic image of the playback interface to re-synthesize, and of course, the playback interface may also be based on performing image recognition on the played-back panoramic image to recommend some areas to be selected for the user to select, specifically, the elements specified on the played-back panoramic image may be marked and a marking library may be established, for example, the elements specified on the initial panoramic image are marked, where the elements described in this embodiment may refer to any photographic objects included in the panoramic image, such as buildings, roads, bridges and some more typical photographic objects, the elements existing on the initial panoramic image are identified through image recognition, and some typical elements are marked, for example, if buildings, roads, bridges and other typical elements exist on the initial panoramic image, the type of element may be marked and a region to be selected may be generated on the initial panoramic image based on the marked element for selection by the user.
The area to be selected can be generated by taking the marked element as the center, and the size of the generated area to be selected can be freely adjusted according to the requirement of a user. The solution of the embodiment of the present application is more clearly described below with reference to fig. 2 and 3.
Referring to fig. 2, fig. 2 is an initial panoramic image shown in an exemplary embodiment of the present application, after the initial panoramic image is recognized, a mark library is created by marking typical elements in the image based on a recognition result while displaying a playback interface, as shown in fig. 2, a tall building and a bridge are marked respectively, and a corresponding candidate area A, B is generated, and when a user selects a candidate area B, a target panoramic image shown in fig. 3 is obtained by re-synthesizing based on a sample image corresponding to the candidate area. It is to be understood that the candidate areas generated by marking the initial panoramic image shown in fig. 2 are not only A, B two areas, but also more areas are not shown in the figure, and the above is only A, B as an example, and the number of the generated candidate areas is not limited. According to the method and the device, the preferred regions to be selected are recommended to the user for the user to recompose, so that the trouble of manual selection of the user is avoided, the user can conveniently recompose the composition, and the quality of the recomposed panoramic image is guaranteed.
In one embodiment, the candidate region may be further continuously generated on the subsequently re-synthesized panoramic image based on the established marker library, so as to continue synthesizing a new panoramic image output playback based on the selected candidate region.
Since it is necessary to know which thumbnail images are used for re-synthesis until the thumbnail images corresponding to the selected area on the played-back panoramic image are known, a method for determining the thumbnail images corresponding to the selected area on the panoramic image will be described below.
In an embodiment, for the synthesized initial panoramic image and each sample image synthesizing the initial panoramic image, a mapping library between elements on the initial panoramic image and each sample image may be established, for a selected area on the initial panoramic image of a user, the elements included in the selected area may be determined, and a sample image corresponding to the selected area may be determined based on the elements included in the selected area and the mapping library.
In addition, since the identification of the elements on the initial panoramic image is mainly performed by identifying the feature points, and a certain mapping exists between the feature points corresponding to the elements on the initial panoramic image and the respective sample images, a mapping library between the elements on the initial panoramic image and the respective sample images is established, specifically, the mapping library between different elements and the respective sample images can be established by detecting and extracting the feature points on the initial panoramic image for identifying the elements included in the initial panoramic image, and then based on the mapping relationship between the respective groups of feature points and the respective sample images.
Referring to fig. 4, fig. 4 is a flowchart illustrating an exemplary embodiment of the present application, where the flowchart illustrates a spherical panoramic playback, and includes the following steps:
s401, collecting a plurality of sample sheet images and synthesizing a spherical panoramic image;
s402, marking the appointed elements on the spherical panoramic image, establishing a marking library, and establishing a mapping library between the elements on the initial spherical panoramic image and the plurality of specimen images;
s403, generating a region to be selected on the spherical panorama based on the mark library, outputting and playing back the region to be selected, and prompting a user to download or select the region to be selected for recomposition;
s404, determining whether a selected area exists on the played back spherical panorama, if so, executing S405; otherwise, the flow is ended;
s405, determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library, and synthesizing a spherical panorama again, and executing S403.
The above steps can be referred to the description of the previous embodiment, and the description is not repeated here.
An embodiment of the present application further provides an apparatus for panoramic playback, as shown in fig. 5, fig. 5 is an apparatus 50 for panoramic playback shown in an exemplary embodiment of the present application, including:
a processor 501;
a memory 502 for storing instructions executable by the processor 501;
wherein the processor 501 is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
An embodiment of the present application further provides a shooting device, as shown in fig. 6, where fig. 6 is a shooting device 60 shown in an exemplary embodiment of the present application, and the shooting device includes:
a processor 601;
a memory 602 for storing instructions executable by the processor 601;
wherein the processor 601 is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
An embodiment of the present application further provides a movable platform, as shown in fig. 7, fig. 7 is a movable platform 70 shown in an exemplary embodiment of the present application, on which the shooting device 60 shown in fig. 6 is mounted, as can be seen from the description related to fig. 6, where the movable platform may be an unmanned aerial vehicle, an unmanned vehicle, or the like.
The present application further provides a system for panoramic playback, as shown in fig. 8, fig. 8 is a system for panoramic playback shown in an exemplary embodiment of the present application, and includes a movable platform 70 and a specified application 80 as shown in fig. 7, the specified application 80 is installed on an electronic device 81, the movable platform 70 is in communication connection with the electronic device 81, and a processor 601 in the shooting device 60, in response to a request of the specified application 80, invokes an instruction stored in a memory 602 to implement the following operations:
outputting the initial panoramic image synthesized from the plurality of proof images to an interface of a designated application 80 on the electronic device 81 for playback;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and outputting the corresponding proof image re-synthesis target panoramic image to an interface of a designated application 80 on the electronic equipment 81 for playback.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The method and apparatus provided by the embodiments of the present application are described in detail above, and the principle and the embodiments of the present application are explained herein by applying specific examples, and the description of the embodiments above is only used to help understand the method and the core idea of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (50)
1. A method of panoramic playback, comprising:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
2. The method of claim 1, wherein the initial panoramic image is a spherical panoramic image.
3. The method of claim 1, further comprising:
marking the designated elements on the initial panoramic image and establishing a marking library; wherein the element is an arbitrary photographic object included in the initial panoramic image;
generating a candidate region on the initial panoramic image based on the tag library.
4. The method of claim 3, wherein the generating a candidate region on the initial panoramic image based on the tag library comprises:
and generating a region to be selected by taking the marked elements included in the mark library as centers.
5. The method of claim 3, further comprising:
and generating a candidate area on the target panoramic image based on the mark library, and synthesizing a new target panoramic image based on the selected candidate area for outputting and replaying.
6. The method of claim 3, further comprising:
establishing a mapping library between elements on the initial panoramic image and each specimen image;
the determining of the proof image corresponding to the selected area includes:
determining elements included in the selected region;
and determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library.
7. The method of claim 6, wherein the establishing a mapping library between elements on the initial panoramic image and the respective proof images comprises:
detecting and extracting feature points on the initial panoramic image, wherein the feature points are used for identifying elements on the initial panoramic image;
and establishing a mapping library between the elements and the respective sample images based on the mapping relation between the feature points and the respective sample images.
8. The method of claim 1, further comprising:
and recording the synthesis information of each sample image so as to synthesize according to the synthesis information when the target panoramic image is synthesized again.
9. The method of claim 1, wherein the number of selected regions is 1 or more than 1.
10. The method of claim 1, further comprising:
and intercepting and/or adding labels to the specified area on the initial panoramic image and/or the target panoramic image which are output and played back.
11. An apparatus for panoramic playback, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
12. The apparatus of claim 11, wherein the initial panoramic image is a spherical panoramic image.
13. The apparatus of claim 11, wherein the processor is further configured to:
marking the designated elements on the initial panoramic image and establishing a marking library; wherein the element is an arbitrary photographic object included in the initial panoramic image;
generating a candidate region on the initial panoramic image based on the tag library.
14. The apparatus of claim 13, wherein the processor is further configured to:
and generating a region to be selected by taking the marked elements included in the mark library as centers.
15. The apparatus of claim 13, wherein the processor is further configured to:
and generating a candidate area on the target panoramic image based on the mark library, and synthesizing a new target panoramic image based on the selected candidate area for outputting and replaying.
16. The apparatus of claim 13, wherein the processor is further configured to:
establishing a mapping library between elements on the initial panoramic image and each specimen image;
the determining of the proof image corresponding to the selected area includes:
determining elements included in the selected region;
and determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library.
17. The apparatus of claim 16, wherein the processor is further configured to:
detecting and extracting feature points on the initial panoramic image, wherein the feature points are used for identifying elements on the initial panoramic image;
and establishing a mapping library between the elements and the respective sample images based on the mapping relation between the feature points and the respective sample images.
18. The apparatus of claim 11, wherein the processor is further configured to:
and recording the synthesis information of each sample image so as to synthesize according to the synthesis information when the target panoramic image is synthesized again.
19. The apparatus of claim 11, wherein the number of selected regions is 1 or more than 1.
20. The apparatus of claim 11, wherein the processor is further configured to:
and intercepting and/or adding labels to the specified area on the initial panoramic image and/or the target panoramic image which are output and played back.
21. A photographing apparatus, characterized by comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
22. The photographing apparatus of claim 11, wherein the initial panoramic image is a spherical panoramic image.
23. The camera device of claim 21, wherein the processor is further configured to:
marking the designated elements on the initial panoramic image and establishing a marking library; wherein the element is an arbitrary photographic object included in the initial panoramic image;
generating a candidate region on the initial panoramic image based on the tag library.
24. The camera device of claim 23, wherein the processor is further configured to:
and generating a region to be selected by taking the marked elements included in the mark library as centers.
25. The camera device of claim 23, wherein the processor is further configured to:
and generating a candidate area on the target panoramic image based on the mark library, and synthesizing a new target panoramic image based on the selected candidate area for outputting and replaying.
26. The camera device of claim 23, wherein the processor is further configured to:
establishing a mapping library between elements on the initial panoramic image and each specimen image;
the determining of the proof image corresponding to the selected area includes:
determining elements included in the selected region;
and determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library.
27. The camera device of claim 26, wherein the processor is further configured to:
detecting and extracting feature points on the initial panoramic image, wherein the feature points are used for identifying elements on the initial panoramic image;
and establishing a mapping library between the elements and the respective sample images based on the mapping relation between the feature points and the respective sample images.
28. The camera device of claim 21, wherein the processor is further configured to:
and recording the synthesis information of each sample image so as to synthesize according to the synthesis information when the target panoramic image is synthesized again.
29. The photographing apparatus according to claim 21, wherein the number of the selected regions is 1 or more than 1.
30. The camera device of claim 21, wherein the processor is further configured to:
and intercepting and/or adding labels to the specified area on the initial panoramic image and/or the target panoramic image which are output and played back.
31. A movable platform on which a photographing apparatus is mounted, the photographing apparatus comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to:
outputting and playing back an initial panoramic image synthesized by a plurality of specimen images;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen images into a target panoramic image again, and outputting and replaying the target panoramic image.
32. The movable platform of claim 31, wherein the initial panoramic image is a spherical panoramic image.
33. The movable platform of claim 31, wherein the processor is further configured to:
marking the designated elements on the initial panoramic image and establishing a marking library; wherein the element is an arbitrary photographic object included in the initial panoramic image;
generating a candidate region on the initial panoramic image based on the tag library.
34. The movable platform of claim 33, wherein the processor is further configured to:
and generating a region to be selected by taking the marked elements included in the mark library as centers.
35. The movable platform of claim 33, wherein the processor is further configured to:
and generating a candidate area on the target panoramic image based on the mark library, and synthesizing a new target panoramic image based on the selected candidate area for outputting and replaying.
36. The movable platform of claim 33, wherein the processor is further configured to:
establishing a mapping library between elements on the initial panoramic image and each specimen image;
the determining of the proof image corresponding to the selected area includes:
determining elements included in the selected region;
and determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library.
37. The movable platform of claim 36, wherein the processor is further configured to:
detecting and extracting feature points on the initial panoramic image, wherein the feature points are used for identifying elements on the initial panoramic image;
and establishing a mapping library between the elements and the respective sample images based on the mapping relation between the feature points and the respective sample images.
38. The movable platform of claim 31, wherein the processor is further configured to:
and recording the synthesis information of each sample image so as to synthesize according to the synthesis information when the target panoramic image is synthesized again.
39. The movable platform of claim 31, wherein the number of selected regions is 1 or more than 1.
40. The movable platform of claim 41, wherein the processor is further configured to:
and intercepting and/or adding labels to the specified area on the initial panoramic image and/or the target panoramic image which are output and played back.
41. A system for panoramic playback, comprising a movable platform and a designated application, wherein the movable platform is provided with a shooting device, the designated application is installed on an electronic device, the movable platform is in communication connection with the electronic device, and the shooting device comprises a processor and a memory, wherein the memory is used for storing instructions, and the processor calls the instructions stored in the memory to realize the following operations when responding to the request of the designated application:
outputting an initial panoramic image synthesized by a plurality of specimen images to an interface of a designated application on the electronic equipment for playback;
acquiring a selected area on the initial panoramic image, and determining a specimen image corresponding to the selected area;
and synthesizing the corresponding specimen image into a target panoramic image again, and outputting the target panoramic image to an interface of a designated application on the electronic equipment for playback.
42. The system of claim 41, wherein the initial panoramic image is a spherical panoramic image.
43. The system of claim 41, wherein the processor is further configured to:
marking the designated elements on the initial panoramic image and establishing a marking library; wherein the element is an arbitrary photographic object included in the initial panoramic image;
generating a candidate region on the initial panoramic image based on the tag library.
44. The system of claim 43, wherein the processor is further configured to:
and generating a region to be selected by taking the marked elements included in the mark library as centers.
45. The system of claim 43, wherein the processor is further configured to:
and generating a candidate area on the target panoramic image based on the mark library, and synthesizing a new target panoramic image based on the selected candidate area for outputting and replaying.
46. The system of claim 43, wherein the processor is further configured to:
establishing a mapping library between elements on the initial panoramic image and each specimen image;
the determining of the proof image corresponding to the selected area includes:
determining elements included in the selected region;
and determining a sample image corresponding to the selected area based on the elements included in the selected area and the mapping library.
47. The system of claim 46, wherein the processor is further configured to:
detecting and extracting feature points on the initial panoramic image, wherein the feature points are used for identifying elements on the initial panoramic image;
and establishing a mapping library between the elements and the respective sample images based on the mapping relation between the feature points and the respective sample images.
48. The system of claim 41, wherein the processor is further configured to:
and recording the synthesis information of each sample image so as to synthesize according to the synthesis information when the target panoramic image is synthesized again.
49. The system according to claim 41, wherein the number of selected regions is 1 or more than 1.
50. The system of claim 41, wherein the processor is further configured to:
and intercepting and/or adding labels to the specified area on the initial panoramic image and/or the target panoramic image which are output and played back.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2020/108980 WO2022032589A1 (en) | 2020-08-13 | 2020-08-13 | Panoramic playback method, apparatus and system, photographing device, and movable platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113906727A true CN113906727A (en) | 2022-01-07 |
Family
ID=79186967
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202080039570.5A Pending CN113906727A (en) | 2020-08-13 | 2020-08-13 | Panoramic playback method, device and system, shooting equipment and movable platform |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113906727A (en) |
| WO (1) | WO2022032589A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361596A (en) * | 2022-07-04 | 2022-11-18 | 浙江大华技术股份有限公司 | Panoramic video data processing method and device, electronic device and storage medium |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120105577A1 (en) * | 2010-11-01 | 2012-05-03 | Olympus Imaging Corp. | Panoramic image generation device and panoramic image generation method |
| US20150149960A1 (en) * | 2013-11-22 | 2015-05-28 | Samsung Electronics Co., Ltd. | Method of generating panorama image, computer-readable storage medium having recorded thereon the method, and panorama image generating device |
| US20150213577A1 (en) * | 2014-01-30 | 2015-07-30 | Google Inc. | Zoom images with panoramic image capture |
| US20160191798A1 (en) * | 2014-12-26 | 2016-06-30 | Kt Corporation | Panoramic view customization |
| CN106791483A (en) * | 2016-12-20 | 2017-05-31 | 北京小米移动软件有限公司 | Image transfer method and device, electronic equipment |
| US20170180680A1 (en) * | 2015-12-21 | 2017-06-22 | Hai Yu | Object following view presentation method and system |
| US20180096452A1 (en) * | 2016-09-30 | 2018-04-05 | Samsung Electronics Co., Ltd. | Image processing apparatus and control method thereof |
| CN108476305A (en) * | 2017-03-21 | 2018-08-31 | 深圳市大疆创新科技有限公司 | A kind of image transfer method, device and equipment |
| US10666941B1 (en) * | 2016-04-06 | 2020-05-26 | Ambarella International Lp | Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4345829B2 (en) * | 2007-03-09 | 2009-10-14 | ソニー株式会社 | Image display system, image display apparatus, image display method, and program |
| FR3023406B1 (en) * | 2014-07-07 | 2019-07-12 | Airbus | METHOD FOR AIDING THE FLIGHT OF AN AIRCRAFT AND SYSTEM FOR ITS IMPLEMENTATION |
| KR101782582B1 (en) * | 2015-12-04 | 2017-09-28 | 카페24 주식회사 | Method, Apparatus and System for Transmitting Video Based on Eye Tracking |
| KR102567002B1 (en) * | 2016-08-16 | 2023-08-14 | 삼성전자주식회사 | Image display apparatus and operating method for the same |
| KR102536945B1 (en) * | 2016-08-30 | 2023-05-25 | 삼성전자주식회사 | Image display apparatus and operating method for the same |
| CN107682638A (en) * | 2017-10-31 | 2018-02-09 | 北京疯景科技有限公司 | Generation, the method and device of display panoramic picture |
-
2020
- 2020-08-13 WO PCT/CN2020/108980 patent/WO2022032589A1/en active Application Filing
- 2020-08-13 CN CN202080039570.5A patent/CN113906727A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120105577A1 (en) * | 2010-11-01 | 2012-05-03 | Olympus Imaging Corp. | Panoramic image generation device and panoramic image generation method |
| US20150149960A1 (en) * | 2013-11-22 | 2015-05-28 | Samsung Electronics Co., Ltd. | Method of generating panorama image, computer-readable storage medium having recorded thereon the method, and panorama image generating device |
| US20150213577A1 (en) * | 2014-01-30 | 2015-07-30 | Google Inc. | Zoom images with panoramic image capture |
| US20160191798A1 (en) * | 2014-12-26 | 2016-06-30 | Kt Corporation | Panoramic view customization |
| US20170180680A1 (en) * | 2015-12-21 | 2017-06-22 | Hai Yu | Object following view presentation method and system |
| US10666941B1 (en) * | 2016-04-06 | 2020-05-26 | Ambarella International Lp | Low bitrate encoding of panoramic video to support live streaming over a wireless peer-to-peer connection |
| US20180096452A1 (en) * | 2016-09-30 | 2018-04-05 | Samsung Electronics Co., Ltd. | Image processing apparatus and control method thereof |
| CN106791483A (en) * | 2016-12-20 | 2017-05-31 | 北京小米移动软件有限公司 | Image transfer method and device, electronic equipment |
| CN108476305A (en) * | 2017-03-21 | 2018-08-31 | 深圳市大疆创新科技有限公司 | A kind of image transfer method, device and equipment |
Non-Patent Citations (3)
| Title |
|---|
| 易才钦;: "全景图像拼接技术发展研究", no. 14, pages 149 - 151 * |
| 王亚洲: "基于无人机航拍图像的拼接算法研究", pages 1 * |
| 王勇;何晓川;刘清华;许录平;: "一种感兴趣区域寻优搜索的全自动图像拼接算法", vol. 31, no. 02, pages 261 - 264 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361596A (en) * | 2022-07-04 | 2022-11-18 | 浙江大华技术股份有限公司 | Panoramic video data processing method and device, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022032589A1 (en) | 2022-02-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101193007B1 (en) | Information processing apparatus and method, and recording medium | |
| CN101910936B (en) | Guided photography based on image capturing device rendered user recommendations | |
| JP4760892B2 (en) | Display control apparatus, display control method, and program | |
| US7110592B2 (en) | Image recording apparatus, image reproducing apparatus and methods therefor | |
| JP2008537228A (en) | Interactive shooting and distribution system and related methods | |
| CN109525674B (en) | System and method for making house panorama | |
| JP2009093478A (en) | Virtual space broadcasting apparatus | |
| CN106095881A (en) | Method, system and the mobile terminal of a kind of display photos corresponding information | |
| JP2021061035A (en) | Method and system for controlling server | |
| CN109540122B (en) | Method and device for constructing map model | |
| KR20160021706A (en) | Playing method and the system of 360 degree spacial video | |
| KR101038940B1 (en) | System and method for managing image information using object extracted from image | |
| CN113906727A (en) | Panoramic playback method, device and system, shooting equipment and movable platform | |
| JP4603403B2 (en) | Video album automatic creation system and computer program | |
| JP2010198104A (en) | Image display system, portable terminal system, portable terminal equipment, server, and image display method thereof | |
| CN108391048A (en) | Data creation method with functions and panoramic shooting system | |
| JP2009200601A (en) | Video editing device and method | |
| JP2009010967A (en) | Photographing aid device | |
| JP3984155B2 (en) | Subject estimation method, apparatus, and program | |
| KR101695209B1 (en) | A system and method for composing real-time image and chroma-key Image of subject | |
| JP2008152374A (en) | Image system, photographing direction specifying device, photographing direction specifying method and program | |
| KR101700421B1 (en) | Image recording for launch vehicle and exhibition system | |
| KR102445296B1 (en) | management systems of image by drone | |
| JP6610030B2 (en) | Video processing apparatus and video processing method | |
| JP2001218134A (en) | Image forming device and its method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |