CN111194556A - Panoramic photo display method and display device based on intelligent terminal - Google Patents
Panoramic photo display method and display device based on intelligent terminal Download PDFInfo
- Publication number
- CN111194556A CN111194556A CN201780095570.5A CN201780095570A CN111194556A CN 111194556 A CN111194556 A CN 111194556A CN 201780095570 A CN201780095570 A CN 201780095570A CN 111194556 A CN111194556 A CN 111194556A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- panoramic photo
- display
- moving
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
The invention provides a panoramic photo display method and a display device based on an intelligent terminal, wherein the display method comprises the following steps: moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object; forming continuous images recorded with the moving direction of the intelligent terminal in the intelligent terminal; synthesizing the continuous image into a panoramic photo; and moving the intelligent terminal according to the moving direction, and displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the direction opposite to the moving direction. After the technical scheme is adopted, the panoramic picture is synchronously displayed in a rolling mode in combination with the movement of the intelligent terminal, and a shooting scene is restored; the number of cameras of the intelligent terminal is saved, and cost is reduced.
Description
The invention relates to the field of intelligent terminals, in particular to a panoramic photo display method and a panoramic photo display device based on an intelligent terminal.
The intelligent terminal can be an intelligent device with a photographing function, such as an intelligent mobile phone, a tablet personal computer and a digital camera. With the development of the intelligent terminal technology, the functions integrated on the intelligent terminal are more and more abundant, and particularly, the photographing function can support the user to realize the functions of normal photographing, continuous photographing, self-photographing and the like. The intelligent terminal integrates the photographing function, and depends on hardware equipment such as a camera and a software module for processing photos, for example, pixels of the camera are increased to more than ten million from about one million in the past, so that the photos shot by the intelligent terminal are very clear, and even can be compared with professional cameras; for example, the intelligent terminal can realize functions of automatic focusing, background blurring, photographing range selection and the like by means of a software module. In some application scenarios, a user needs to take a panoramic photograph, which is generally a photograph taken in accordance with the normal effective viewing angle of the human eyes (about 90 degrees horizontally and 70 degrees vertically) or including the full scene range of above the binocular vision angle (about 180 degrees horizontally and 90 degrees vertically), and even 360 degrees. However, the shooting range of the camera of the intelligent terminal is constant, only targets within the limit angle range can be shot in the same shooting state, and it is difficult to shoot targets outside the limit angle range at the same time.
The prior art has made efforts in the above technical field, for example, chinese patent publication (publication number: CN104287700A) discloses a VR mobile phone and a VR video system based on the VR mobile phone, where the VR mobile phone includes a mobile phone body, and a first lens, a second lens, a third lens, and a fourth lens; the first lens and the second lens are positioned on the front surface of the mobile phone body; the third lens and the fourth lens are positioned on the back of the mobile phone body; the first lens and the third lens are distributed back to back in a staggered mode, and the second lens and the fourth lens are distributed back to back in a staggered mode. Through adopting above technical scheme, on the integration of current cell-phone, install four camera lenses for 360 degrees panoramic video take a picture, this kind of mode, for current adoption 4 cameras take panoramic video, not only the cost is cheaper, and the volume is littleer moreover, and it is more convenient to carry.
Although the invention has realized that a plurality of lenses are integrated on the smart phone to realize the shooting of VR panorama, the following problems still exist:
1. only the composition and preview viewing of panoramic video is involved, and the composition and preview of panoramic photos is not involved;
2. the position and the motion state of the mobile phone are not recorded in the shooting process, so that the final synthesis and preview effects of the panoramic video or the photo are influenced;
3. the design cost of multiple cameras is high.
Therefore, how to preview and display the shot panoramic picture on the intelligent terminal according to the original motion trail and restore the shot content during shooting is a technical problem to be solved.
Disclosure of Invention
In order to overcome the technical defects, the invention aims to provide a panoramic photo display method and a display device based on an intelligent terminal, which are used for shooting a panoramic photo, recording the moving direction of the intelligent terminal, and displaying the panoramic photo in a reverse rolling manner when the intelligent terminal is moved according to the moving direction so as to realize dynamic display of the panoramic photo.
The first aspect of the application discloses a panoramic photo display method based on an intelligent terminal, which comprises the following steps:
moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object;
forming a continuous image recorded with the moving direction of the intelligent terminal in the intelligent terminal;
synthesizing the continuous image into a panoramic photo;
and moving the intelligent terminal according to the moving direction, and displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the direction opposite to the moving direction.
In certain embodiments of the first aspect of the present application, in the step of moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object, a frequency of continuous shooting by the intelligent terminal is not lower than a frequency threshold preset in the intelligent terminal.
In certain embodiments of the first aspect of the present application, before the step of moving the smart terminal and operating the smart terminal to continuously photograph a target object, the display method further includes:
and positioning the position of the intelligent terminal.
In some embodiments of the first aspect of the present application, the moving the smart terminal according to the moving direction, and the scrolling the panoramic photo in the display interface of the smart terminal in the direction opposite to the moving direction includes:
judging whether the intelligent terminal is at the position;
when the intelligent terminal is located at the position, the intelligent terminal is moved according to the moving direction, and meanwhile, the moving speed of the intelligent terminal is recorded;
scrolling and displaying the panoramic photo in a display interface of the intelligent terminal along the reverse direction of the moving direction according to the moving speed;
and when the intelligent terminal is not positioned at the position, the intelligent terminal statically displays the panoramic photo.
In certain embodiments of the first aspect of the present application, the step of composing the sequential images into a panoramic photograph comprises:
acquiring an image part which is right corresponding to a shooting lens of the intelligent terminal in each continuous image;
and splicing each image part to obtain the panoramic photo.
In a second aspect of the present application, a panoramic photo display device based on an intelligent terminal is disclosed, the display device includes:
the camera module is used for shooting a target object when the intelligent terminal is moved;
the recording module is connected with the camera module and forms a continuous image recorded with the moving direction of the intelligent terminal;
the synthesis module is connected with the recording module and synthesizes the continuous image into a panoramic photo;
and the display module is connected with the synthesis module and displays the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the reverse direction of the moving direction.
In certain embodiments of the second aspect of the present application, when the camera module continuously shoots a target object, the frequency of continuous shooting by the camera module is not lower than a frequency threshold preset in the smart terminal.
In certain embodiments of the second aspect of the present application, the display device further comprises:
and the positioning module is used for positioning the position of the intelligent terminal.
In certain embodiments of the second aspect of the present application, the display module comprises:
the position judging unit is used for judging whether the intelligent terminal is positioned at the position or not;
the speed detection unit is used for detecting and recording the moving speed of the intelligent terminal when the intelligent terminal is positioned at the position;
the dynamic display unit is used for displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the reverse direction of the moving direction according to the moving speed;
and the static display module is used for statically displaying the panoramic photo when the intelligent terminal is not positioned at the position.
In certain embodiments of the second aspect of the present application, the synthesis module comprises:
the acquisition unit is used for acquiring the image part which is just opposite to the shot lens in each continuous image;
and the splicing unit is used for splicing each continuous image part to obtain the panoramic photo.
After the technical scheme is adopted, compared with the prior art, the method has the following beneficial effects:
1. synchronously displaying the panoramic photos in a rolling manner in combination with the movement of the intelligent terminal, and restoring the shot scene;
2. the number of cameras of the intelligent terminal is saved, and cost is reduced.
Fig. 1 is a schematic flow chart of a panoramic photo display method based on an intelligent terminal according to a preferred embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a panoramic photo display method based on an intelligent terminal according to another preferred embodiment of the present invention;
fig. 3 is a schematic flowchart of a panoramic photo display method based on an intelligent terminal according to still another preferred embodiment of the present invention;
fig. 4 is a schematic flowchart of a panoramic photo display method based on an intelligent terminal according to still another preferred embodiment of the present invention;
fig. 5 is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to a preferred embodiment of the present invention;
fig. 6 is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to another preferred embodiment of the present invention;
fig. 7 is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to still another preferred embodiment of the present invention;
FIG. 8 is a schematic diagram of a synthesis module according to a preferred embodiment of the present invention.
Reference numerals:
10-display device, 11-camera module, 12-recording module, 13-synthesis module, 131-acquisition unit, 132-splicing unit, 14-display module, 141-position judgment unit, 142-speed detection unit, 143-dynamic display unit, 144-static display unit and 15-positioning module.
The following description of the embodiments of the present application is provided for illustrative purposes, and other advantages and capabilities of the present application will become apparent to those skilled in the art from the present disclosure.
In the following description, reference is made to the accompanying drawings that describe several embodiments of the application. The following detailed description is not to be taken in a limiting sense, and the scope of embodiments of the present application is defined only by the claims of the issued patent. Spatially relative terms, such as "upper," "lower," "left," "right," "lower," "below," "lower," "above," "upper," and the like, may be used herein to facilitate describing one element or feature's relationship to another element or feature as illustrated in the figures.
Although the terms first, second, etc. may be used herein to describe various elements in some instances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another.
Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context indicates otherwise, it should be further understood that the terms "comprises" and "comprising" indicate the presence of the stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, items, species, and/or groups. A; b; c; a and B; a and C; b and C; A. b and C ". an exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.
Referring to fig. 1, a schematic flow chart of a panoramic photo display method based on an intelligent terminal according to a preferred embodiment of the present invention is shown, in which the panoramic photo is displayed through the following steps:
s1: and moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object.
The intelligent terminal is an intelligent device integrated with a photographing function, and can be a smart phone, a tablet personal computer, a digital camera and the like. The intelligent terminal at least comprises a camera module, wherein the camera module comprises a hardware part, namely a camera, and a target object is shot by utilizing an optical imaging principle; the camera module also comprises a software part, namely corresponding image processing software, which records and processes the images shot by the camera to form digital photos. The working principle of the camera module is that light enters the intelligent terminal through the camera, the light is converted into a digital signal through the imaging element, and the digital signal is stored in the storage device through the image operation chip. The imaging element is a CCD or a CMOS, and is characterized in that when light passes through, the light can be converted into electronic signals according to different light. In the step, the intelligent terminal is moved when photographing, and meanwhile, the photographing module continuously photographs the target object, so that a group of photographs photographed from different photographing positions can be obtained; and the picture content of two adjacent pictures in the group of pictures is nearly the same, and only a slight difference exists between the shooting range and the shooting angle. The group of photos reflects the panoramic content of the target object, and the panoramic content is dispersedly displayed in each photo. The main stream intelligent terminal supports the continuous shooting function, after a user starts the function, the user does not need to intervene, the intelligent terminal continuously shoots a target object according to a certain frequency, and pictures shot each time are stored. The moving mode of the intelligent terminal may be that the target object is used as a center, and the intelligent terminal rotates around the target object for a circle or rotates for a specific angle, such as 180 degrees or 270 degrees, and the moving mode is that the intelligent terminal rotates around the sun compared with the earth, the target object is the sun, the intelligent terminal is the earth, and when moving, the intelligent terminal is noticed that the camera of the intelligent terminal always faces the target object. The moving mode of the intelligent terminal can also be that the intelligent terminal automatically rotates around the intelligent terminal to shoot the scene around the intelligent terminal, and the shot scene surrounds the intelligent terminal. The intelligent terminal may also be moved in a linear manner, for example, from left to right or from top to bottom.
S2: and forming continuous images recorded with the moving direction of the intelligent terminal in the intelligent terminal.
In this step, the continuous images are a group of images continuously captured in step S1, and the continuous images are captured by the camera module and are in a digital information format, such as jpg, tiff, bmp, png, and the like. In this step, the continuous image is also associated with the moving direction of the intelligent terminal corresponding to the target object. Since the smart terminal performs photographing in the moving state in step S1, the smart terminal has a moving direction during the entire photographing process, particularly a moving direction corresponding to each photographing time. The intelligent terminal records the moving direction of the picture while taking the picture, and for the continuous images, the moving direction of the intelligent terminal corresponding to each image is obtained. When the camera module forms the continuous images, the moving direction of the intelligent terminal corresponding to the continuous images is recorded at the same time. The continuous images are associated with the moving direction, and when any image is found, associated moving direction information can be obtained. The moving direction of the intelligent terminal can be represented by a vector in a three-dimensional coordinate system, namely, the vector is represented as a projection component on an x axis, a y axis and a z axis, for example, (1, 1, 1) indicates that the components on the x axis, the y axis and the z axis are a unit length.
S3: and synthesizing the continuous image into a panoramic photo.
This step synthesizes the continuous images into a panoramic photograph. In a conventional optical panoramic photograph, scenes (cylindrical panorama) of 90 to 360 degrees are all displayed on a two-dimensional plane, and the front, back, left and right of one scene are comprehensively seen in front of a viewer. The panoramic photo in the invention is a shot target with a large angle recorded in a digital information form, and the whole panoramic photo is recorded in an integral data file. The continuous image obtained in step S2 is a set of data files in the form of images, and therefore, it is necessary to combine the set of image data files into one image data file so that one photograph can display the panoramic content. And the mode of synthesizing the continuous images is that the first image is taken as a reference, newly added image information in subsequent images is sequentially extracted and spliced until the content in all the continuous images is spliced, and finally the panoramic photo can be obtained. According to different movement actions of the intelligent terminal, the display range of the panoramic photo is different, and the panoramic photo can be a rectangle like a picture roll or a closed sphere and the like.
S4: and moving the intelligent terminal according to the moving direction, and displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the direction opposite to the moving direction.
In this step, when the intelligent terminal is moved according to the moving direction recorded in step S2, the display interface of the intelligent terminal dynamically displays the panoramic photo in a scrolling manner, where the direction of the dynamic display is opposite to the moving direction. The purpose of this step is to dynamically scroll display the panoramic photo so that the user can conveniently browse the content of the panoramic photo; and the premise of dynamically scrolling and displaying the panoramic photo is to move the intelligent terminal according to the moving direction, namely to move the intelligent terminal according to the moving direction during shooting, so as to restore the moving state during shooting. Since the moving direction has been recorded in step S2 and is associated with the successive images, as long as the moving direction is detected, the corresponding successive images can be found accordingly. And when the panoramic photo is displayed in a rolling manner, only the part of the continuous image corresponding to the current moving direction and combined into the panoramic photo is displayed in the middle of the display interface. The display interface can be a display screen of the intelligent terminal, and after the panoramic photos are synthesized, the panoramic photos are previewed and displayed. The reverse scrolling display is that, in the display interface, the scrolling direction of the panoramic image is opposite to the moving direction, for example, when the intelligent terminal moves from left to right, the panoramic image in the display interface scrolls from right to left, which is exactly consistent with the content shot while the intelligent terminal moves when shooting in step S1. And the panoramic photo is displayed in the display interface in a rolling manner, and only the central part of the display interface is needed to be confirmed, and then the display is expanded to the periphery of the display interface according to the pixel points until the display reaches the boundary of the display interface.
In certain embodiments of the first aspect of the present application, in step S1, the frequency of the continuous shooting of the smart terminal is not lower than a frequency threshold preset in the smart terminal. In this embodiment, the frequency of the continuous shooting by the camera module is preferably not lower than a frequency threshold preset in the intelligent terminal. The continuous shooting frequency is a key technical parameter, if the frequency is too low, the shooting frequency in the whole mobile shooting process is too small, the contact ratio of each photo is low, and the subsequent synthesis of panoramic photos is not facilitated; if the frequency is too high, too many resources of the intelligent terminal are occupied, for example, a large amount of storage space needs to be occupied to store the continuous images, and the camera needs to be frequently used, so that the workload of the camera is too heavy, and the service life is influenced. The frequency threshold value is preferably once every 1 second, and considering that the moving speed is about 0.05 m/s-0.2 m/s when the user moves the intelligent terminal, the user keeps shooting at least once within 1 second, and the shot continuous images can be guaranteed to have better continuity.
Referring to fig. 2, which is a schematic flow chart of a panoramic photo display method based on an intelligent terminal according to another preferred embodiment of the present invention, before step S1, the photographing method further includes:
s0: and positioning the position of the intelligent terminal.
In this step, the position of the intelligent terminal is first located. The intelligent terminal is internally provided with a sensor or a module related to positioning, such as an infrared sensor, an ultrasonic sensor, a GPS module, a Beidou module and the like, and the sensor or the module is used for positioning the position of the intelligent terminal in a physical sensing or external auxiliary mode. For example, when the positioning is performed by using an infrared sensor, a nearby reference object may be selected, the distance between the intelligent terminal and the reference object is measured by using the infrared sensor, and the positioning may be performed. If the GPS module is used for positioning, the method is more suitable for application scenes with longer moving distance, and the position of the intelligent terminal can be acquired by carrying out signal interaction with an external GPS system.
Referring to fig. 3, a schematic flowchart of a panoramic photo display method based on an intelligent terminal according to still another preferred embodiment of the present invention is shown, where step S4 includes:
s4-1: judging whether the intelligent terminal is at the position;
s4-2: when the intelligent terminal is located at the position, the intelligent terminal is moved according to the moving direction, and meanwhile, the moving speed of the intelligent terminal is recorded;
s4-3: scrolling and displaying the panoramic photo in a display interface of the intelligent terminal along the reverse direction of the moving direction according to the moving speed;
s4-4: and when the intelligent terminal is not positioned at the position, the intelligent terminal statically displays the panoramic photo.
In this embodiment, step S4 is detailed. First, in step S4-1, it is determined whether the smart terminal is located at the position of the smart terminal located in step S0 in the previous embodiment. When the position of the intelligent terminal is judged, the intelligent terminal is positioned again only according to the mode in the step S0, the obtained positioning information is compared with the positioning information in the step S0, and if the positioning information is matched with the positioning information, the intelligent terminal is located at the position.
If the intelligent terminal is judged to be at the position in the step S4-1, the step S4-2 is performed, in this step, the intelligent terminal is moved according to the moving direction, which is the moving direction of the intelligent terminal in the step S1, that is, the intelligent terminal is moved according to the situation during shooting. In the step, the intelligent terminal is moved, and meanwhile, the moving speed of the intelligent terminal is recorded, and the moving speed can be detected and recorded through a speed sensor.
In step S4-3, the panoramic photograph is scrolled in a direction opposite to the moving direction and at a speed suitable for the moving speed. Therefore, the panoramic photos can be synchronously displayed in a rolling mode while the intelligent terminal moves. The moving speed of the rolling display of the panoramic photo should be adapted to the moving speed of the intelligent terminal, namely when the intelligent terminal moves from the initial position to the end position, the rolling display of the panoramic photo is just finished. The moving speed of the intelligent terminal can be converted into the corresponding pixel point display speed, the intelligent terminal can calculate how long the intelligent terminal can move to the end position according to the current moving speed, namely, the residual moving time is predicted, and the number of the pixel points which are not displayed and remain in the panoramic photo is divided by the time, so that the display speed of the pixel points can be obtained. Since the initial positioning position of the intelligent terminal is known, the position of the intelligent terminal at the end of shooting can be calculated according to the moving direction, and therefore the predicted residual moving time of the intelligent terminal can be calculated.
And if the intelligent terminal is not at the position judged in the step S4-1, the step S4-4 is carried out, and in this case, the panoramic photo is displayed statically. The panoramic photo is statically displayed, that is, the static panoramic photo is displayed on the display interface of the intelligent terminal, and the displayed content may be the whole panoramic photo, or may be only a part of the panoramic photo, for example, the shooting content of the previous shot of the panoramic photo, or the middle content of the whole panoramic photo. The technical means for statically displaying the panoramic photo is consistent with the technical means for displaying the normal photo, and the difference is that part or all pixel points in the panoramic photo are selected for displaying.
Referring to fig. 4, which is a schematic flowchart of a panoramic photo display method based on an intelligent terminal according to still another preferred embodiment of the present invention, step S3 includes:
s3-1: acquiring an image part which is right corresponding to a shooting lens of the intelligent terminal in each continuous image;
s3-2: and splicing each image part to obtain the panoramic photo.
The preferred embodiment further refines step S3, and in step S3-1, the image portion of each of the consecutive images that is facing the shot to be taken is obtained. In step S2, each of the continuous images is shot from the front of the lens, so that the continuous image has to have a portion corresponding to the shooting lens, that is, the middle of the continuous image. And then extracting the image part, wherein the image is digitized pixel point information, so that the pixel point information of the image part to be extracted is copied. When the image part is extracted, attention needs to be paid that the image extracted each time is not overlapped with the image extracted last time, and the mode of judging whether the image is overlapped can be that a row of pixel point information is taken and compared with each row of pixel point information at the edge of the previous image, if the pixel point information of a certain row in the previous image is the same as that of the next image, two rows of pixels are overlapped.
In step S3-2, the image parts obtained in step S3-1 are stitched together to obtain the panoramic photo. And splicing the image part, namely determining a reference image, copying the pixel point information of the image part onto the reference image, and extending the pixel point information at the boundary of the reference image instead of covering the existing reference image content. When all the extracted parts of the contact images are copied to the reference image, the reference image is the panoramic photo.
Referring to fig. 5, which is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to a preferred embodiment of the present invention, the display device 10 includes:
a camera module 11
And the camera module 11 is used for continuously shooting a target object when the intelligent terminal is moved. The camera module comprises a hardware part and a software part; the hardware part, namely a camera and a related connecting circuit, shoots a target object by using an optical imaging principle and converts an optical signal into a digital signal; the software part, namely corresponding image processing software, records and processes the images shot by the camera to form digital photos. In this embodiment, the camera module 11 is disposed in the intelligent terminal, and may include one camera or a plurality of cameras. The camera module 11 supports a continuous photographing function, i.e., continuously photographing at a certain frequency. The continuous images also correspond to the moving direction information of the intelligent terminal, and when the camera module 11 records the continuous images, the moving direction information of the intelligent terminal during shooting of the continuous images is also related. The moving direction of the intelligent terminal is recorded by a recording module 12 in the intelligent terminal, and the camera module 11 synchronously acquires the moving direction information from the recording module 12 during shooting.
A recording module 12
And a recording module 12 connected to the camera module 11 to form a continuous image in which the moving direction of the smart terminal is recorded. The recording module 12 records continuous images continuously captured by the camera module 11, and stores the continuous images in a digital format supported by the intelligent terminal, such as jpg, png, and the like. The continuous images also correspond to the moving direction information of the intelligent terminal, and when the recording module 12 records the continuous images, the moving direction information of the intelligent terminal when the continuous images are shot is also related. The moving direction of the intelligent terminal is recorded by the recording module 12, and the recording module 12 can be implemented by a sensor, such as one or a combination of an acceleration sensor, a speed sensor, an infrared sensor and an ultrasonic sensor. When the recording module 12 is an acceleration sensor, the acceleration and the acceleration direction of the intelligent terminal can be detected, and the acceleration direction can be approximated as the moving direction because the intelligent terminal has a slow moving speed. The recording module 12 may also detect the distance between the intelligent terminal and an external reference object through the infrared sensor or the ultrasonic sensor, and detect two sets of distance parameters in a short time, that is, the moving direction of the intelligent terminal can be calculated; for example, the recording module 12 may detect distance parameters on three coordinate axes, i.e., an x axis, a y axis, and a z axis, and obtain the moving distance on the three coordinate axes, i.e., the components of the moving distance on the three coordinate axes, by using a vector method.
-a synthesis module 13
And the synthesis module 13 is connected with the recording module 12 and synthesizes the continuous images into a panoramic photo. The synthesis module 13 is a software module, and acquires the continuous images from the recording module 12, extracts partial pixel point information in each continuous image, and splices the pixel point information to obtain a panoramic photo. When the synthesis module 13 extracts the pixel point information in the continuous image, firstly determining a pixel point region overlapped with other images, finding a boundary coordinate, and then copying the non-overlapped pixel point information; and then splicing one image (generally the first image) as a reference, copying the non-coincident pixel point information into the reference image, and expanding the pixel coordinate range of the reference image until all the images are spliced.
Display module 14
And the display module 14 is connected with the synthesis module 13, and displays the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the reverse direction of the moving direction. The display module 14 obtains the panoramic photo from the synthesis module 13. The display module 14 is further connected with a display module in the intelligent terminal, and sends information to be displayed to the display module for displaying. The display module 14 displays the panoramic photo in a rolling display manner, that is, refreshes and displays the content of the panoramic photo at a certain frequency, the displayed content is different each time, and the pixel point information in the panoramic photo is selected to be displayed according to the reverse direction of the moving direction. Finally, the display module 14 realizes the effect of reverse scrolling the panoramic photo along with the movement of the terminal, and reproduces the target scene which can be seen when shooting.
In some embodiments of the second aspect of the present application, when the camera module 11 continuously shoots a target object, the frequency of continuous shooting by the camera module 11 is not lower than a frequency threshold preset in the smart terminal. The camera module 11 is internally provided with a software timing task, and starts to shoot once every other period, wherein the reciprocal of the period is the shooting frequency. The shooting frequency is not lower than the preset frequency threshold, and the frequency threshold is preferably 1 time in 1 second.
Referring to fig. 6, which is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to another preferred embodiment of the present invention, the display device 10 further includes:
-a positioning module 15
And the positioning module 15 is used for positioning the position of the intelligent terminal. The positioning module 15 can be a sensor or a module with a positioning function, such as an infrared sensor, an ultrasonic sensor, a GPS module, a Beidou module and the like, and the sensor or the module positions the position of the intelligent terminal in a physical sensing or external auxiliary mode. For example, when the positioning is performed by using an infrared sensor, a nearby reference object may be selected, the distance between the intelligent terminal and the reference object is measured by using the infrared sensor, and the positioning may be performed. If the positioning module 15 is a GPS module, the positioning module is more suitable for an application scene with a longer moving distance, and the position of the intelligent terminal can be acquired by performing signal interaction with an external GPS system.
Referring to fig. 7, which is a schematic structural diagram of a panoramic photo display device based on an intelligent terminal according to still another preferred embodiment of the present invention, the display module 14 further includes:
a position judgment unit 141
And a position judgment unit 141 for judging whether the intelligent terminal is at the position. When the position determining unit 141 works, at least two sets of positioning information need to be acquired from the positioning module 15, wherein one set of positioning information is the position information of the intelligent terminal when the photographing starts, and the other set of positioning information is the position information when the panoramic photo starts to be displayed. And then comparing whether the two sets of positioning information are the same, wherein if the two sets of positioning information are the same, the intelligent terminal is located at the same position. The positioning information obtained by the positioning module 15 is digitized position information, such as coordinates or parameters such as distance, and therefore, the method has comparability. For convenience of operation, when the position determining unit 141 determines the position, a certain deviation may be allowed, and after all, if the user performs the operation manually, it is difficult to ensure that the intelligent terminals are located at the same position.
Speed detection unit 142
And a speed detection unit 142, which detects and records the moving speed of the intelligent terminal when the intelligent terminal is at the position. The speed detection unit 142 may be implemented by a speed sensor, and the speed sensor may measure the speed by using a laser speed measurement principle or a radar speed measurement principle, so as to finally obtain the moving speed of the mobile terminal.
Dynamic display unit 143
And the dynamic display unit 143 displays the panoramic photo in a display interface of the intelligent terminal by scrolling in a direction opposite to the moving direction according to the moving speed. The dynamic display unit 143 refreshes and displays the content of the panoramic photo at a certain frequency, and the displayed content is different each time, obtains the moving speed of the intelligent terminal from the speed detection unit 142, and selects the pixel point information in the panoramic photo in the reverse direction of the moving direction according to the moving speed for displaying.
A static display unit 144
And a static display unit 144 for statically displaying the panoramic photo when the intelligent terminal is not at the position. The working condition of the static display module 144 is that the intelligent terminal is not at the position, and is just mutually exclusive with the working condition of the dynamic display unit 143. The static display unit 144 selects part of the pixel points in the panoramic photo, and transmits the selected pixel points to a display module in the intelligent terminal for display; the range of the pixel points selected by the static display unit 144 conforms to the pixel specification of the display screen of the intelligent terminal. For example, if the screen of the intelligent terminal has a resolution of 1024 × 768, the static display unit 144 selects the pixel points in the panoramic photo according to the number of the pixel points that can be accommodated by the screen. The static display unit 144 may also select all panoramic photos, compress the pixels thereof, and display the panoramic photos integrally through the display module.
Referring to fig. 8, which is a schematic structural diagram of a synthesis module according to a preferred embodiment of the present invention, the synthesis module 13 includes:
an acquisition unit 131
The obtaining unit 131 obtains an image portion of each of the continuous images, which directly corresponds to the shooting lens of the intelligent terminal. The obtaining unit 131 calculates a range of an area of the continuous image, which is directly opposite to the shot lens, and copies pixel point information within the range. When the area range is calculated by the obtaining unit 131 of the stitching unit 132, the pixel point of a small area is selected to be compared with the similar area in the previous image, so that whether the small area is overlapped or not can be known, and the boundary of the overlapped area in the image is found by the method, wherein the other side of the boundary is the image part needing to be obtained.
Splicing unit 132
And a splicing unit 132 for splicing each image part to obtain the panoramic photo. The stitching unit 132 first uses an image as a reference image, and generally selects a first image as the reference image; then, the image parts to be spliced are obtained from the obtaining unit 131, then the pixel point information of the image parts is spliced on the reference image in sequence according to the shooting sequence, and the pixel point range of the reference image is locked and spliced to be continuously expanded until the splicing of all the image parts is finished.
It should be noted that the embodiments of the present invention have been described in terms of preferred embodiments, and not by way of limitation, and that those skilled in the art can make modifications and variations of the embodiments described above without departing from the spirit of the invention.
Claims (10)
- A panoramic photo display method based on an intelligent terminal is characterized by comprising the following steps:moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object;forming continuous images recorded with the moving direction of the intelligent terminal in the intelligent terminal;synthesizing the continuous image into a panoramic photo;and moving the intelligent terminal according to the moving direction, and displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the direction opposite to the moving direction.
- The display method according to claim 1,and in the step of moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object, the continuous shooting frequency of the intelligent terminal is not lower than a frequency threshold preset in the intelligent terminal.
- The display method according to claim 1 or 2,before the step of moving the intelligent terminal and operating the intelligent terminal to continuously shoot a target object, the display method further comprises:and positioning the position of the intelligent terminal.
- The display method according to claim 3,moving the intelligent terminal according to the moving direction, wherein the step of displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the direction opposite to the moving direction comprises the following steps:judging whether the intelligent terminal is at the position;when the intelligent terminal is located at the position, the intelligent terminal is moved according to the moving direction, and meanwhile, the moving speed of the intelligent terminal is detected and recorded;scrolling and displaying the panoramic photo in a display interface of the intelligent terminal along the reverse direction of the moving direction according to the moving speed;and when the intelligent terminal is not positioned at the position, the intelligent terminal statically displays the panoramic photo.
- The display method according to claim 1 or 2,the step of composing the sequential images into a panoramic photograph comprises:acquiring an image part which is right corresponding to a shooting lens of the intelligent terminal in each continuous image;and splicing each image part to obtain the panoramic photo.
- The utility model provides a panorama photo display device based on intelligent terminal which characterized in that, display device includes:the camera module is used for continuously shooting a target object when the intelligent terminal is moved;the recording module is connected with the camera module and forms a continuous image recorded with the moving direction of the intelligent terminal;the synthesis module is connected with the recording module and synthesizes the continuous image into a panoramic photo;and the display module is connected with the synthesis module and displays the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the reverse direction of the moving direction.
- The display device of claim 6,when the camera module continuously shoots a target object, the continuous shooting frequency of the camera module is not lower than a frequency threshold preset in the intelligent terminal.
- The display device according to claim 6 or 7,the display device further includes:and the positioning module is used for positioning the position of the intelligent terminal.
- The display device of claim 8,the display module includes:the position judging unit is used for judging whether the intelligent terminal is positioned at the position or not;the speed detection unit is used for detecting and recording the moving speed of the intelligent terminal when the intelligent terminal is positioned at the position;the dynamic display unit is used for displaying the panoramic photo in a display interface of the intelligent terminal in a rolling manner along the reverse direction of the moving direction according to the moving speed;and the static display unit is used for statically displaying the panoramic photo when the intelligent terminal is not positioned at the position.
- The display device according to claim 6 or 7,the synthesis module comprises:the acquisition unit is used for acquiring an image part which is right corresponding to the shooting lens of the intelligent terminal in each continuous image;and the splicing unit is used for splicing each image part to obtain the panoramic photo.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2017/095636 WO2019023991A1 (en) | 2017-08-02 | 2017-08-02 | Panoramic photograph displaying method and device based on intelligent terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111194556A true CN111194556A (en) | 2020-05-22 |
| CN111194556B CN111194556B (en) | 2021-05-04 |
Family
ID=65232248
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201780095570.5A Active CN111194556B (en) | 2017-08-02 | 2017-08-02 | Panoramic photo display method and display device based on intelligent terminal |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111194556B (en) |
| WO (1) | WO2019023991A1 (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120300023A1 (en) * | 2011-05-25 | 2012-11-29 | Samsung Electronics Co., Ltd. | Image photographing device and control method thereof |
| CN104394451A (en) * | 2014-12-05 | 2015-03-04 | 宁波菊风系统软件有限公司 | Video presenting method for intelligent mobile terminal |
| CN104471519A (en) * | 2014-06-16 | 2015-03-25 | 华为技术有限公司 | Method and apparatus for displaying panoramic photo in mobile terminal, and mobile terminal |
| JP5948927B2 (en) * | 2012-02-09 | 2016-07-06 | ソニー株式会社 | Image processing apparatus, image processing method, program, and imaging apparatus |
| CN106354868A (en) * | 2016-09-13 | 2017-01-25 | 乐视控股（北京）有限公司 | Photographing processing method and device |
| CN106851117A (en) * | 2017-03-31 | 2017-06-13 | 联想(北京)有限公司 | A kind of method and electronic equipment for obtaining distant view photograph |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5428210B2 (en) * | 2008-06-11 | 2014-02-26 | ソニー株式会社 | Information processing apparatus, imaging system, recording control method, and program |
| JP2012075018A (en) * | 2010-09-29 | 2012-04-12 | Casio Comput Co Ltd | Reproduction device and method, and program |
| CN104363372A (en) * | 2014-10-27 | 2015-02-18 | 广东欧珀移动通信有限公司 | Image processing method and image processing terminal |
-
2017
- 2017-08-02 WO PCT/CN2017/095636 patent/WO2019023991A1/en active Application Filing
- 2017-08-02 CN CN201780095570.5A patent/CN111194556B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120300023A1 (en) * | 2011-05-25 | 2012-11-29 | Samsung Electronics Co., Ltd. | Image photographing device and control method thereof |
| JP5948927B2 (en) * | 2012-02-09 | 2016-07-06 | ソニー株式会社 | Image processing apparatus, image processing method, program, and imaging apparatus |
| CN104471519A (en) * | 2014-06-16 | 2015-03-25 | 华为技术有限公司 | Method and apparatus for displaying panoramic photo in mobile terminal, and mobile terminal |
| CN104394451A (en) * | 2014-12-05 | 2015-03-04 | 宁波菊风系统软件有限公司 | Video presenting method for intelligent mobile terminal |
| CN106354868A (en) * | 2016-09-13 | 2017-01-25 | 乐视控股（北京）有限公司 | Photographing processing method and device |
| CN106851117A (en) * | 2017-03-31 | 2017-06-13 | 联想(北京)有限公司 | A kind of method and electronic equipment for obtaining distant view photograph |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019023991A1 (en) | 2019-02-07 |
| CN111194556B (en) | 2021-05-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101343220B1 (en) | Real-time preview for panoramic images | |
| JP5659305B2 (en) | Image generating apparatus and image generating method | |
| WO2017088678A1 (en) | Long-exposure panoramic image shooting apparatus and method | |
| JP5659304B2 (en) | Image generating apparatus and image generating method | |
| JP5769813B2 (en) | Image generating apparatus and image generating method | |
| US7746404B2 (en) | Digital camera with panoramic image capture | |
| US8587658B2 (en) | Imaging device, image display device, and program with intruding object detection | |
| JP5865388B2 (en) | Image generating apparatus and image generating method | |
| US20100321470A1 (en) | Imaging apparatus and control method therefor | |
| TW201215124A (en) | Imaging apparatus, image processing method, and recording medium for recording program thereon | |
| CN107395957B (en) | Photographing method and device, storage medium and electronic equipment | |
| CN101292513A (en) | Method and apparatus for reducing motion distortion in digital image-forming | |
| KR20120012201A (en) | Method for photographing panorama picture | |
| JP5477777B2 (en) | Image acquisition device | |
| KR20170000311A (en) | Digital photographing apparatus and the operating method for the same | |
| CN110944101A (en) | Image pickup apparatus and image recording method | |
| JP2008281385A (en) | Image processing device | |
| JP5519376B2 (en) | Electronics | |
| US20120229503A1 (en) | Reproduction processing apparatus, imaging apparatus, reproduction processing method, and program | |
| CN108810326B (en) | Photographing method and device and mobile terminal | |
| CN111194556B (en) | Panoramic photo display method and display device based on intelligent terminal | |
| WO2020238312A1 (en) | Photographing method and apparatus, storage medium and electronic device | |
| JP2014067142A (en) | Image processing apparatus, image processing method, imaging apparatus, and imaging method | |
| JP2020009099A (en) | Image processing device, image processing method, and program | |
| JP2003324723A (en) | Monitoring system and method, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |