WO2019023991A1 - 一种基于智能终端的全景照片显示方法及显示装置 - Google Patents

一种基于智能终端的全景照片显示方法及显示装置 Download PDF

Info

Publication number
WO2019023991A1
WO2019023991A1 PCT/CN2017/095636 CN2017095636W WO2019023991A1 WO 2019023991 A1 WO2019023991 A1 WO 2019023991A1 CN 2017095636 W CN2017095636 W CN 2017095636W WO 2019023991 A1 WO2019023991 A1 WO 2019023991A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart terminal
panoramic photo
moving
display
moving direction
Prior art date
Application number
PCT/CN2017/095636
Other languages
English (en)
French (fr)
Inventor
唐圣杰
Original Assignee
深圳传音通讯有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳传音通讯有限公司 filed Critical 深圳传音通讯有限公司
Priority to PCT/CN2017/095636 priority Critical patent/WO2019023991A1/zh
Priority to CN201780095570.5A priority patent/CN111194556B/zh
Publication of WO2019023991A1 publication Critical patent/WO2019023991A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering

Definitions

  • the present invention relates to the field of intelligent terminals, and in particular, to a panoramic photo display method and a display device based on an intelligent terminal.
  • the smart terminal may be a smart device with a camera function, such as a smart phone, a tablet computer, or a digital camera.
  • a camera function such as a smart phone, a tablet computer, or a digital camera.
  • the functions integrated on the smart terminal are also more and more abundant, especially the camera function, which can support the user to realize functions such as normal photographing, continuous photographing, and self-timer.
  • the integration of the camera function by the smart terminal depends on hardware devices such as a camera and software modules for photo processing, for example, the pixels of the camera are increased from about one million to more than ten million, so that the photos taken by the smart terminal are taken. Very clear, even comparable to professional cameras; for example, the smart terminal can rely on software modules to achieve auto focus, background blur, camera range selection and other functions.
  • the user needs to take a panoramic photo, usually referring to the normal effective viewing angle of the person's eyes (about 90 degrees horizontally, 70 degrees vertical) or including the binocular residual light angle (about 180 degrees horizontally, 90 degrees vertical). Even photos taken in 360-degree full scene range.
  • the camera shooting range of the smart terminal is constant, and only targets within the limit angle range can be captured in the same shooting state, and it is difficult to simultaneously shoot targets other than the shooting limit angle.
  • the Chinese invention patent publication discloses a VR mobile phone, a VR video system based on a VR mobile phone, the VR mobile phone includes a mobile phone body, and a first lens, a second lens, a third lens, and a fourth lens; the first lens and the second lens are located on the front side of the mobile phone body; the third lens and the fourth lens are located on the back of the mobile phone body; the first lens and the third lens are interlaced Back-to-back distribution, the second lens and the fourth lens are distributed in a staggered back-to-back configuration.
  • four lenses are installed on the integration of the existing mobile phone for taking a 360-degree panoramic video, which is not only cheaper than the existing four-camera shooting panoramic video. And it is smaller and more convenient to carry.
  • the position and movement status of the mobile phone are not recorded during the shooting process, which affects the synthesis and preview effect of the final panoramic video or photo;
  • an object of the present invention is to provide a panoramic photo display method and a display device based on a smart terminal, recording a moving direction of the smart terminal while taking a panoramic photo, and moving the smart according to the moving direction
  • the terminal displays the panoramic photo in reverse scrolling to realize dynamic display of the panoramic photo.
  • a first aspect of the present application discloses a method for displaying a panoramic photo based on a smart terminal, comprising the following steps:
  • the frequency of consecutive shooting by the smart terminal is not lower than a preset The frequency threshold within the intelligent terminal.
  • the displaying method before the step of moving the smart terminal and operating the smart terminal to continuously capture a target object, the displaying method further includes:
  • the smart terminal is moved according to the moving direction, and the step of displaying the panoramic photo in a reverse scrolling direction along the moving direction in a display interface of the smart terminal includes: :
  • the smart terminal When the smart terminal is not in the location, the smart terminal statically displays the panoramic photo.
  • the step of synthesizing the continuous image into a panoramic photo comprises:
  • the panoramic photo is obtained by splicing each of the image portions.
  • a panoramic photo display device based on a smart terminal comprising:
  • a camera module that captures a target object when the smart terminal is moved
  • a recording module connected to the camera module to form a continuous image in which a moving direction of the smart terminal is recorded
  • a synthesis module connected to the recording module, synthesizing the continuous image into a panoramic photo
  • a display module connected to the synthesis module, and displaying the panoramic photo in a reverse direction of the moving direction in a display interface of the smart terminal.
  • the camera module when the camera module continuously captures a target object, the camera module continuously captures a frequency that is not lower than a frequency threshold preset in the smart terminal.
  • the display device further includes:
  • a positioning module that locates the location of the smart terminal.
  • the display module includes:
  • a location determining unit determining whether the smart terminal is in the location
  • a speed detecting unit that detects and records a moving speed of the smart terminal when the smart terminal is in the position
  • a dynamic display unit that displays the panoramic photo in a reverse direction of the moving direction according to the moving speed in a display interface of the smart terminal
  • a static display module that statically displays the panoramic photo when the smart terminal is not in the location.
  • the synthesizing module includes:
  • Obtaining a unit acquiring an image portion of each of the consecutive images that corresponds to the photographing lens
  • a splicing unit splicing each of the continuous image portions to obtain the panoramic photo.
  • FIG. 1 is a schematic flow chart of a method for displaying a panoramic photo based on a smart terminal according to a preferred embodiment of the present invention
  • FIG. 2 is a schematic flow chart of a method for displaying a panoramic photo based on a smart terminal according to another preferred embodiment of the present invention
  • FIG. 3 is a schematic flow chart of a method for displaying a panoramic photo based on a smart terminal according to still another preferred embodiment of the present invention.
  • FIG. 4 is a schematic flow chart of a method for displaying a panoramic photo based on a smart terminal according to still another preferred embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a panoramic photo display device based on a smart terminal according to a preferred embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of a panoramic photo display device based on a smart terminal according to another preferred embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a panoramic photo display device based on a smart terminal according to still another preferred embodiment of the present invention.
  • Figure 8 is a schematic view showing the structure of a synthesis module in accordance with a preferred embodiment of the present invention.
  • 10-display device 11-camera module, 12-recording module, 13-synthesis module, 131-acquisition unit, 132-splicing unit, 14-display module, 141-position judging unit, 142-speed detecting unit, 143-dynamic Display unit, 144-static display unit, 15-position module.
  • FIG. 1 is a schematic flowchart of a method for displaying a panoramic photo based on a smart terminal according to a preferred embodiment of the present invention
  • the panoramic photo is displayed by the following steps:
  • the smart terminal is a smart device integrated with a camera function, and may be a smart phone, a tablet computer, a digital camera, or the like.
  • the smart terminal includes at least one camera module, the camera module includes a hardware portion, that is, a camera, and the target object is photographed by using an optical imaging principle; the camera module further includes a software portion, that is, corresponding image processing software, The images captured by the camera are recorded and processed to form a digital photo.
  • the working principle of the camera module is that light enters the smart terminal through the camera, is converted into a digital signal by the imaging component, and the digital signal is stored in the storage device through the image computing chip.
  • the imaging element is a CCD or a CMOS, and the imaging element is characterized in that when the light passes, it can be converted into an electrical signal according to the light.
  • the smart terminal In this step, the smart terminal must be moved while taking a picture, and the camera module continuously shoots the target object, so that a group of photos taken from different photographing positions can be obtained; and the photos taken in the two photos in the group of photos are taken twice.
  • the content is close to the same, with only minor differences in shooting range and shooting angle.
  • the set of photos reflects the panoramic content captured on the target object and is displayed in a scattered manner in each photo.
  • the mainstream smart terminals support the continuous camera function.
  • the manner of moving the smart terminal may be centered around the target object, rotated around the target object or rotated by a specific angle, such as 180 degrees or 270 degrees, which is like the rotation of the earth around the sun.
  • the target object is the sun
  • the smart terminal is the earth.
  • the camera of the smart terminal is always facing the target object.
  • the moving manner of the smart terminal may also be rotated around the smart terminal, and the scene around the smart terminal is captured, and the captured scene surrounds the smart terminal.
  • the manner in which the smart terminal moves can also be in the form of a line, such as from left to right or from top to bottom.
  • the continuous image is a group of images continuously captured in step S1, and the continuous image is formed by the camera module, and is an image in a digitized information format, which may be jpg, tiff, bmp, png. And other formats.
  • the continuous image in this step is also associated with the moving direction of the smart terminal corresponding to the target object. Since the smart terminal performs shooting in the moving state in step S1, the smart terminal has a moving direction throughout the shooting process, and in particular, there is a moving direction corresponding to each shooting time. The smart terminal records the moving direction at this time while taking a photo, and for the continuous image, there is a moving direction of the smart terminal corresponding to each image.
  • the moving direction of the smart terminal corresponding to the continuous image is simultaneously recorded.
  • the continuous image is associated with the moving direction, and finds that any of the images can acquire the associated moving direction information.
  • the moving direction of the smart terminal can be represented by a vector in a three-dimensional coordinate system, that is, represented as a projection component on the x-axis, the y-axis, and the z-axis, for example, (1, 1, 1) is represented on the x-axis and the y-axis.
  • the components on the z-axis are all one unit length.
  • This step combines the continuous images into a single panoramic photo.
  • the traditional optical photography panoramic photo shows all the scenes (column panoramas) of 90 degrees to 360 degrees on a two-dimensional plane, and pushes the front, back, left and right of a scene to the viewer's eyes.
  • the panoramic photo in the present invention records a large-angle shooting target in the form of digitized information, and records the entire panoramic photo as a whole data file.
  • the continuous image obtained in step S2 is a set of data files in the form of images, so it is necessary to merge the set of image data files into one image data file so that one photo can display the panoramic content.
  • the method of synthesizing the continuous image is based on the first image, and sequentially extracts the newly added image information in the subsequent image for splicing until the content in all consecutive images is spliced, and finally the panoramic photo is obtained.
  • the display range of the panoramic photo is also different according to the movement action of the smart terminal, and the panoramic photo may be a rectangle like a scroll, a closed sphere, or the like.
  • S4 moving the smart terminal according to the moving direction, and displaying the panoramic photo in a reverse scrolling direction of the moving direction in a display interface of the smart terminal.
  • the smart terminal is moved according to the moving direction recorded in the step S2, and the display interface of the smart terminal dynamically scrolls and displays the panoramic photo, and the direction of the dynamic display is opposite to the moving direction.
  • the purpose of this step is to dynamically scroll the panoramic photo so that the user can conveniently browse the content of the panoramic photo; and the dynamic scrolling display of the panoramic photo is based on moving the smart terminal according to the moving direction. That is, the smart terminal is moved in accordance with the moving direction at the time of shooting, and the moving state at the time of shooting is restored. Since the moving direction has been recorded in step S2 and the moving direction is associated with the continuous image, as long as the moving direction is detected, The corresponding continuous image can be found accordingly.
  • the display interface may be a display screen of the smart terminal, and when the panoramic photo is synthesized, the panoramic photo is preview displayed.
  • the reverse scroll display means that, in the display interface, the scrolling direction of the panoramic photo is opposite to the moving direction. For example, if the smart terminal moves from left to right, the panoramic photo in the display interface is from Scrolling right to left, this coincides with the content captured while the smart terminal is moving while shooting in step S1.
  • Scrolling and displaying the panoramic photo in the display interface only need to confirm which part of the pixel is displayed in the middle of the display interface, and then expanding the display to the periphery of the display interface according to the pixel point until the display is Displays the boundaries of the interface.
  • the frequency of the smart end-continuous shooting is not lower than a frequency threshold preset in the smart terminal.
  • the frequency of continuous shooting of the camera module is preferred, that is, the frequency is not lower than a frequency threshold preset in the smart terminal.
  • the frequency of the continuous shooting is a key technical parameter.
  • the frequency threshold is preferably once every 1 second. Considering that when the user moves the smart terminal, the moving speed is about 0.05 m/s to 0.2 m/s, and the shooting is kept at least once in one second, and the continuous image can be guaranteed. Have good continuity.
  • step S1 the photographing method further includes:
  • the smart terminal has positioning related sensors or modules, such as an infrared sensor, an ultrasonic sensor, a GPS module, a Beidou module, etc., and the sensor or module locates the position of the smart terminal by means of physical sensing or external assistance. For example, when positioning by using an infrared sensor, a reference object in the vicinity can be selected, and the distance between the smart terminal and the reference object can be measured by using the infrared sensor, and the positioning can be performed. If more precise positioning is required, two or more different ones can be selected. The reference object is positioned in multiple sets of distance coordinates. If the GPS module is used for positioning, it is more suitable for an application scenario with a long moving distance, and the position of the intelligent terminal can be obtained by performing signal interaction with an external GPS system.
  • positioning related sensors or modules such as an infrared sensor, an ultrasonic sensor, a GPS module, a Beidou module, etc.
  • Step S4 includes:
  • S4-1 determining whether the smart terminal is in the location
  • S4-3 displaying, in the display interface of the smart terminal, the panoramic photo in the reverse direction of the moving direction according to the moving speed;
  • step S4 is refined.
  • step S4-1 it is determined whether the smart terminal is in the position, which is the location of the smart terminal located in step S0 in the previous embodiment.
  • the smart terminal is only located in the manner of step S0, and the obtained positioning information is compared with the positioning information in step S0.
  • the smart terminal is in the position.
  • step S4-1 If it is determined in step S4-1 that the smart terminal is in the location, the process proceeds to step S4-2, in which the smart terminal is moved according to the moving direction, and the moving direction is the mobile terminal in step S1.
  • the direction that is, moving the smart terminal according to the situation at the time of shooting.
  • the moving speed of the smart terminal is also recorded, and the moving speed can be detected and recorded by the speed sensor.
  • step S4-3 a scroll display is performed on the panoramic photo, the direction of the scroll display is opposite to the moving direction, and the speed of the scroll display is adapted to the moving speed. This ensures that the panoramic photo is displayed in a synchronized scroll while the smart terminal is moving.
  • the moving speed of the scroll display of the panoramic photo should be adapted to the moving speed of the smart terminal, that is, when the smart terminal moves from the initial position to the ending position, the panoramic photo is just scrolled and displayed.
  • the moving speed of the smart terminal can be converted into a corresponding pixel point display speed, and the smart terminal can calculate how long it takes to move to the end position according to the current moving speed, that is, the estimated remaining moving time, and then The display speed of the pixel is obtained by dividing the number of remaining pixels in the panoramic photo by the time. Since the initial positioning position of the smart terminal is known, the position at which the smart terminal ends shooting can also be derived from the moving direction, and thus the estimated remaining moving time of the smart terminal can be calculated.
  • step S4-4 in which case the panoramic photo is statically displayed.
  • Statically displaying the panoramic photo that is, displaying a still panorama on the display interface of the smart terminal, and the displayed content may be an entire panoramic photo or only a part of the panoramic photo, for example, The content of the pre-shot of the panoramic photo, or the middle content of the entire panoramic photo.
  • the static display of the panoramic photo is consistent with the technical means of displaying a normal photo, with the difference that some or all of the pixels in the panoramic photo are selected for display.
  • step S3 includes:
  • S3-1 acquiring an image portion of each of the consecutive images that corresponds to a shooting lens of the smart terminal
  • step S3-1 an image portion corresponding to the photographing lens in each of the continuous images is acquired.
  • step S2 each of the consecutive images is taken by the front side of the lens, so the continuous image must have a portion corresponding to the photographing lens, that is, a middle portion of the continuous image.
  • the image portion is extracted. Since the image is digitized pixel point information, it is only necessary to copy the pixel point information of the image portion to be extracted.
  • each extracted image does not coincide with the previously extracted image, and the manner of determining whether the images overlap may be a column of pixel point information, and each column of pixel information of the edge of the previous image. For comparison, if the information of one column of pixels in the previous image is the same as that of the latter image, the two columns of pixels coincide.
  • step S3-2 the panoramic image is obtained by splicing the image portion acquired in step S3-1. Splicing the image portion, that is, determining the reference image first, and then copying the pixel point information of the image portion onto the reference image without overwriting the existing reference image content, but continuing at the boundary of the reference image Expand pixel information.
  • the reference image is a panoramic photo.
  • the display device 10 includes:
  • the camera module 11 continuously captures a target object when the smart terminal is moved.
  • the camera module comprises a hardware part and a software part;
  • the hardware part is a camera and an associated connection circuit, and the target object is photographed by using an optical imaging principle, and the optical signal is converted into a digital signal;
  • the software part is a corresponding image processing software And recording and processing the image captured by the camera to form a digitized photo.
  • the camera module 11 in the embodiment is disposed in the smart terminal, and may include a camera, and may also include multiple cameras.
  • the camera module 11 supports a continuous shooting function, that is, continuous shooting at a certain frequency.
  • the continuous image also corresponds to the moving direction information of the smart terminal.
  • the smart terminal moving direction information at the time of the continuous image capturing is also associated.
  • the moving direction of the smart terminal is recorded by the recording module 12 in the smart terminal, and the camera module 11 synchronously acquires the moving direction information from the recording module 12 at the time of shooting.
  • the recording module 12 is connected to the camera module 11 to form a continuous image in which the moving direction of the smart terminal is recorded.
  • the recording module 12 records consecutive images obtained by the camera module 11 continuously, and saves the continuous images as digital formats supported by the smart terminal, such as jpg, png, and the like.
  • the continuous image also corresponds to the moving direction information of the smart terminal.
  • the recording module 12 records the continuous image, the smart terminal moving direction information at the time of the continuous image capturing is also associated.
  • the moving direction of the smart terminal is recorded by the recording module 12, and the recording module 12 can be implemented by a sensor, such as one or a combination of an acceleration sensor, a speed sensor, an infrared sensor, and an ultrasonic sensor.
  • the recording module 12 When the recording module 12 is an acceleration sensor, the acceleration and acceleration directions of the smart terminal may be detected. Since the smart terminal moves at a slow speed, the acceleration direction may be approximated as the moving direction.
  • the recording module 12 can also detect the distance between the smart terminal and the external reference object by using the infrared sensor or the ultrasonic sensor, and detect two sets of distance parameters in a short time, so as to calculate the moving direction of the smart terminal; for example, The recording module 12 can detect the distance parameters on the three axes of the x-axis, the y-axis, and the z-axis, and the movement distances on the three coordinate axes can be known through two sets of parameters, that is, the movement distance is in three coordinate axes.
  • the upper component can be obtained by the vector method.
  • the synthesizing module 13 is connected to the recording module 12 to synthesize the continuous image into a panoramic photo.
  • the synthesizing module 13 is a software module, and the continuous image is obtained from the recording module 12, and part of the pixel information in each successive image is extracted, and the pixel information is spliced to obtain a panoramic photo.
  • the synthesizing module 13 When extracting the pixel point information in the continuous image, the synthesizing module 13 first determines a pixel point region that coincides with other images, finds the boundary coordinates, and then copies the non-coincident pixel point information; and then one of the images ( Generally, the first image is spliced for the reference, and the non-coincident pixel point information is copied into the reference image, and the pixel coordinate range of the reference image is expanded until all the image splicing is completed.
  • the display module 14 is connected to the synthesizing module 13 and displays the panoramic photo in the reverse direction of the moving direction in the display interface of the smart terminal.
  • the display module 14 acquires the panoramic photo from the synthesis module 13.
  • the display module 14 is further connected to the display module in the smart terminal, and sends information to be displayed to the display module for display.
  • the display module 14 displays the panoramic photo in a scrolling display manner, that is, refreshing the content of the panoramic photo at a certain frequency, and the content displayed each time is different, and the panoramic view is selected according to the reverse direction of the moving direction.
  • the pixel information in the photo is displayed.
  • the display module 14 realizes the effect that the panoramic photo scrolls back in reverse with the movement of the terminal, and reproduces the target scene that can be seen at the time of shooting.
  • the frequency of continuous shooting of the camera module 11 is not lower than a frequency threshold preset in the smart terminal.
  • the camera module 11 is provided with a software timing task, and the shooting is started every other cycle, and the reciprocal of the cycle is the frequency of the shooting.
  • the frequency of the shooting is not lower than the preset frequency threshold, and the frequency threshold is preferably 1 second.
  • the display device 10 further includes:
  • the positioning module 15 locates the location of the smart terminal.
  • the positioning module 15 may be a sensor or a module with a positioning function, such as an infrared sensor, an ultrasonic sensor, a GPS module, a Beidou module, etc., and the sensor or module locates the position of the smart terminal by means of physical sensing or external assistance. For example, when positioning by using an infrared sensor, a reference object in the vicinity can be selected, and the distance between the smart terminal and the reference object can be measured by using the infrared sensor, and the positioning can be performed. If more precise positioning is required, two or more different ones can be selected. The reference object is positioned in multiple sets of distance coordinates. If the positioning module 15 is a GPS module, it is more suitable for an application scenario with a long moving distance, and the position of the smart terminal can be obtained by performing signal interaction with an external GPS system.
  • FIG. 7 is a schematic structural diagram of a panoramic photo display device based on a smart terminal according to still another preferred embodiment of the present invention.
  • the display module 14 further includes:
  • the position determining unit 141 determines whether the smart terminal is in the position. When the location determining unit 141 is in operation, it is required to obtain at least two sets of positioning information from the positioning module 15, wherein one set of positioning information is position information of the smart terminal when starting photographing, and another set of positioning information is to start displaying The location information when the panorama is described. Then, whether the two sets of positioning information are the same is compared, and if they are the same, it means that the smart terminals are in the same position. Since the positioning information obtained by the positioning module 15 is digitized position information, such as coordinates or distance, it is comparable. In order to facilitate the operation, the position determining unit 141 may allow a certain deviation when performing position determination. After all, if the user manually operates, it is difficult to ensure that the smart terminals are in the same position without any difference.
  • the speed detecting unit 142 detects and records the moving speed of the smart terminal when the smart terminal is in the position.
  • the speed detecting unit 142 can be realized by a speed sensor, which can perform speed measurement by using a laser speed measuring principle or a radar speed measuring principle, and finally obtain a moving speed of the mobile terminal.
  • the dynamic display unit 143 is in the moving direction according to the moving speed in the display interface of the smart terminal.
  • the reverse scrolling shows the panoramic photo.
  • the dynamic display unit 143 refreshes the content of the panoramic photo at a certain frequency, and the content displayed each time is different, and the moving speed of the smart terminal is acquired from the speed detecting unit 142, and according to the moving speed. And selecting pixel point information in the panoramic photo for display in the reverse direction of the moving direction.
  • the static display unit 144 statically displays the panoramic photo when the smart terminal is not in the position.
  • the working condition of the static display module 144 is that the smart terminal is not in the position, and the working condition of the dynamic display unit 143 is exactly mutually exclusive.
  • the static display unit 144 selects a part of the pixel in the panoramic photo and transmits it to the display module in the smart terminal for display; the range of the pixel selected by the static display unit 144 is consistent with the display screen of the smart terminal. Pixel specifications. For example, if the smart terminal screen has a resolution of 1024*768, the static display unit 144 selects pixel points in the panoramic photo according to the number of pixel points that the screen can accommodate.
  • the static display unit 144 may also select all the panoramic photos, compress the pixels, and display the whole through the display module.
  • the synthesis module 13 includes:
  • the obtaining unit 131 acquires an image portion of each of the consecutive images that corresponds to the photographing lens of the smart terminal.
  • the acquisition unit 131 calculates a range of the region of the continuous image that corresponds to the photographing lens, and copies the pixel point information within the range.
  • the splicing unit 132 obtains the range of the area, the pixel points of a small area are compared with the similar areas in the previous image to know whether the small area overlaps.
  • the boundary of the coincident region in the image, the other side of the boundary is the portion of the image that needs to be acquired.
  • the splicing unit 132 splicing each of the image portions to obtain the panoramic photo.
  • the splicing unit 132 first takes an image as a reference image, generally selects the first image as a reference image, and then acquires an image portion to be spliced from the acquiring unit 131, and then sequentially performs the image portion in the order of shooting.
  • the pixel point information is spliced on the reference image, and the pixel point range of the reference image is continuously expanded by locking the splicing until the splicing ends of all the image parts.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

本发明提供了一种基于智能终端的全景照片显示方法及显示装置，所述显示方法包括以下步骤：移动所述智能终端并操作所述智能终端连续拍摄一目标物体；于所述智能终端内形成记录有所述智能终端的移动方向的连续图像；合成所述连续图像为一全景照片；根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。采用了上述技术方案后，结合智能终端的移动同步滚动显示全景照片，还原拍摄场景；节省智能终端的摄像头数目，降低成本。

Description

一种基于智能终端的全景照片显示方法及显示装置 技术领域
本发明涉及智能终端领域，尤其涉及一种基于智能终端的全景照片显示方法及显示装置。
背景技术
所述智能终端可以是智能手机、平板电脑、数码相机等具备照相功能的智能设备。随着智能终端技术的发展，所述智能终端上集成的功能也越来越丰富，特别是照相功能，可以支持用户实现正常拍照、连续拍照、自拍等功能。所述智能终端对照相功能的集成，依赖于摄像头等硬件设备以及对照片处理的软件模块，例如摄像头的像素从以前的一百万左右提升至一千万以上，使得所述智能终端拍摄的照片非常清晰，甚至可与专业相机比肩；再例如所述智能终端可以依靠软件模块实现自动对焦、背景虚化、照相范围选取等功能。在某些应用场景，用户需要拍摄全景照片，通常是指符合人的双眼正常有效视角(大约水平90度，垂直70度)或包括双眼余光视角(大约水平180度，垂直90度)以上，乃至360度完整场景范围拍摄的照片。然而，所述智能终端的摄像头拍摄范围是恒定的，在同一拍摄状态下仅能拍摄极限角度范围内的目标，很难同时对拍摄极限角度以外的目标进行拍摄。
现有技术已经在上述技术领域作了努力，如中国发明专利公开说明书(公开号：CN104287700A)公开了一种VR手机、基于VR手机的VR视频系统，VR手机包括手机本体，以及第一镜头、第二镜头、第三镜头、第四镜头；所述第一镜头和第二镜头位于手机本体正面；所述第三镜头和第四镜头位于手机本体背面；第一镜头和第三镜头成交错式背靠背分布，第二镜头和第四镜头成交错式背靠背分布。通过采用以上技术方案，在现有手机的集成上，安装四个镜头，用于拍照360度全景视频，这种方式，相对于现有的采用4个相机来拍摄全景视频，不仅成本更低廉，而且体积更小，携带更方便。
上述发明虽然已经实现了在智能手机上集成了多个镜头以实现VR全景的拍摄，但 仍存在如下问题：
1.仅涉及了全景视频的合成与预览观看，未涉及全景照片的合成与预览；
2.在拍摄过程中未对手机的位置和运动状态进行记录，影响了最终的全景视频或照片的合成及预览效果；
3.多摄像头的设计成本较高。
因此如何在智能终端上实现对拍摄的全景照片按照原始的运动轨迹进行预览显示，还原拍摄时的镜头内容，将是一个需要解决的技术问题。
发明内容
为了克服上述技术缺陷，本发明的目的在于提供一种基于智能终端的全景照片显示方法及显示装置，拍摄全景照片的同时记录所述智能终端的移动方向，并按照所述移动方向移动所述智能终端时反向滚动显示所述全景照片，实现对全景照片的动态显示。
本申请的第一方面公开了一种基于智能终端的全景照片显示方法，包括以下步骤：
移动所述智能终端并操作所述智能终端连续拍摄一目标物体；
于所述智能终端内形成记录有所述智能终端的移动方向的＝连续图像；
合成所述连续图像为一全景照片；
根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。
在本申请第一方面的某些实施方式中，移动所述智能终端并操作所述智能终端连续拍摄一目标物体的步骤内，所述智能终端连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。
在本申请第一方面的某些实施方式中，移动所述智能终端并操作所述智能终端连续拍摄一目标物体的步骤之前，所述显示方法还包括：
定位所述智能终端的位置。
在本申请第一方面的某些实施方式中，根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片的步骤包括：
判断所述智能终端是否处于所述位置；
当所述智能终端处于所述位置时，则根据所述移动方向移动所述智能终端，同时记录所述智能终端的移动速度；
于所述智能终端的显示界面内按照所述移动速度沿所述移动方向的反向滚动显示所 述全景照片；
当所述智能终端不处于所述位置时，则所述智能终端静态显示所述全景照片。
在本申请第一方面的某些实施方式中，合成所述连续图像为一全景照片的步骤包括：
获取每一所述连续图像中正对应所述智能终端的拍摄镜头的图像部分；
拼接每一所述图像部分获得所述全景照片。
本申请的第二方面，公开了一种基于智能终端的全景照片显示装置，所述显示装置包括：
照相模块，当所述智能终端被移动时，拍摄一目标物体；
记录模块，与所述照相模块连接，形成记录有所述智能终端的移动方向的连续图像；
合成模块，与所述记录模块连接，合成所述连续图像为一全景照片；
显示模块，与所述合成模块连接，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。
在本申请第二方面的某些实施方式中，所述照相模块连续拍摄一目标物体时，所述照相模块连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。
在本申请第二方面的某些实施方式中，所述显示装置还包括：
定位模块，定位所述智能终端的位置。
在本申请第二方面的某些实施方式中，所述显示模块包括：
位置判断单元，判断所述智能终端是否处于所述位置；
速度检测单元，当所述智能终端处于所述位置时，检测并记录所述智能终端的移动速度；
动态显示单元，于所述智能终端的显示界面内按照所述移动速度沿所述移动方向的反向滚动显示所述全景照片；
静态显示模块，当所述智能终端不处于所述位置时，静态显示所述全景照片。
在本申请第二方面的某些实施方式中，所述合成模块包括：
获取单元，获取每一所述连续图像中正对应拍摄镜头的图像部分；
拼接单元，拼接每一所述连续图像部分获得所述全景照片。
采用了上述技术方案后，与现有技术相比，具有以下有益效果：
1.结合智能终端的移动同步滚动显示全景照片，还原拍摄场景；
2.节省智能终端的摄像头数目，降低成本。
附图说明
图1为符合本发明一优选实施例中基于智能终端的全景照片显示方法的流程示意图；
图2为符合本发明另一优选实施例中基于智能终端的全景照片显示方法的流程示意图；
图3为符合本发明再一优选实施例中基于智能终端的全景照片显示方法的流程示意图；
图4为符合本发明再一优选实施例中基于智能终端的全景照片显示方法的流程示意图；
图5为符合本发明一优选实施例中基于智能终端的全景照片显示装置的结构示意图；
图6为符合本发明另一优选实施例中基于智能终端的全景照片显示装置的结构示意图；
图7为符合本发明再一优选实施例中基于智能终端的全景照片显示装置的结构示意图；
图8为符合本发明一优选实施例中合成模块的结构示意图。
附图标记：
10-显示装置、11-照相模块、12-记录模块、13-合成模块、131-获取单元、132-拼接单元、14-显示模块、141-位置判断单元、142-速度检测单元、143-动态显示单元、144-静态显示单元、15-定位模块。
具体实施方式
以下由特定的具体实施例说明本申请的实施方式，熟悉此技术的人士可由本说明书所揭露的内容轻易地了解本申请的其他优点及功效。
在下述描述中，参考附图，附图描述了本申请的若干实施例。应当理解，还可使用其他实施例，并且可以在不背离本公开的精神和范围的情况下进行机械组成、结构、电气以及操作上的改变.下面的详细描述不应该被认为是限制性的，并且本申请的实施例的范围仅由公布的专利的权利要求书所限定.这里使用的术语仅是为了描述特定实施例，而并非旨在限制本申请。空间相关的术语，例如“上”、“下”、“左”、“右”、“下面”、“下方”、“下部”、“上方”、“上部”等，可在文中使用以便于说明图中所示的一个元件或特征与另一元件或特征的关系。
虽然在一些实例中术语第一、第二等在本文中用来描述各种元件，但是这些元件不 应当被这些术语限制。这些术语仅用来将一个元件与另一个元件进行区分。
再者，如同在本文中所使用的，单数形式“一”、“一个”和“该”旨在也包括复数形式，除非上下文中有相反的指示.应当进一步理解，术语“包含”、“包括”表明存在所述的特征、步骤、操作、元件、组件、项目、种类、和/或组，但不排除一个或多个其他特征、步骤、操作、元件、组件、项目、种类、和/或组的存在、出现或添加.此处使用的术语“或”和“和/或”被解释为包括性的，或意味着任一个或任何组合.因此，“A、B或C”或者“A、B和/或C”意味着“以下任一个：A；B；C；A和B；A和C；B和C；A、B和C”.仅当元件、功能、步骤或操作的组合在某些方式下内在地互相排斥时，才会出现该定义的例外。
参阅图1，为符合本发明一优选实施例中基于智能终端的全景照片显示方法的流程示意图，通过以下步骤对全景照片进行显示：
S1：移动所述智能终端并操作所述智能终端连续拍摄一目标物体。
所述智能终端为集成了照相功能的智能设备，可以是智能手机、平板电脑、数码相机等设备。所述智能终端至少包括一个照相模块，所述照相模块包括硬件部分，即摄像头，利用光学成像原理对目标物体进行拍摄；所述照相模块还包括软件部分，即相应的图像处理软件，对所述摄像头拍摄到的图像进行记录和处理，形成数字化的照片。所述照相模块的工作原理是，光线通过摄像头进入所述智能终端，通过成像元件转化为数字信号，数字信号通过影像运算芯片储存在存储设备中。所述成像元件是CCD或者CMOS，该成像元件的特点是光线通过时，能根据光线的不同转化为电子信号。本步骤中，拍照时须移动所述智能终端，同时所述照相模块对目标物体进行连续拍摄，这样可以得到一组从不同拍照位置拍摄的照片；且该组照片中相邻两次拍摄的照片内容是接近相同的，仅有拍摄范围和拍摄角度的微小差别。该组照片反映了对所述目标物体拍摄的全景内容，分散显示在每个照片中。主流的智能终端都支持连续拍照功能，用户启动该功能后，无需干预，所述智能终端按照某个频率对目标物体进行连续拍摄，并保存每次拍摄的照片。所述智能终端的移动方式可以是以所述目标物体为中心，围绕所述目标物体转动一周或转动特定的角度，如180度或270度，这种移动方式就好比地球围绕太阳转，所述目标物体即为太阳，所述智能终端为地球，移动时注意所述智能终端的摄像头始终对着所述目标物体。所述智能终端的移动方式还可以是以所述智能终端为中心自转，拍摄所述智能终端四周的景象，被拍摄的景象围绕所述智能终端。所述智能终端的移动方式还可以是直线形式，例如从左往右或从上到下。
S2：于所述智能终端内形成记录有所述智能终端的移动方向的连续图像。
本步骤中，所述连续图像即步骤S1中连续拍摄所得的一组图像，所述连续图像由所述照相模块拍摄后形成，为数字化信息格式的图像，可以是jpg、tiff、bmp、png等格式。本步骤中所述连续图像还与对应所述目标物体的所述智能终端的移动方向关联。由于步骤S1中，所述智能终端在移动状态下进行拍摄，因此所述智能终端在拍摄的整个过程中具有移动方向，特别是对应每次拍摄的时刻都会有移动方向。在拍摄照片的同时所述智能终端会记录此时的移动方向，对于所述连续图像，会有对应每张图像的所述智能终端的移动方向。所述照相模块形成所述连续图像时，同时记录了与所述连续图像对应的所述智能终端的移动方向。所述连续图像与所述移动方向相关联，找到其中任一图像都能获取关联的移动方向信息。所述智能终端的移动方向可以用三维坐标系下的向量来表示，即表示为在x轴、y轴、z轴上的投影分量，例如(1，1，1)表示在x轴、y轴、z轴上的分量均为一个单位长度。
S3：合成所述连续图像为一全景照片。
本步骤将所述连续图像合成为一张全景照片。传统的光学摄影全景照片，是把90度至360度的场景(柱形全景)全部展现在一个二维平面上，把一个场景的前后左右一览无余地推到观者的眼前。本发明中的全景照片，则是以数字化信息形式记录大角度的拍摄目标，以一个整体的数据文件记录整个全景照片。步骤S2中得到的连续图像是一组图像形式的数据文件，因此需要将这一组图像数据文件合并到一个图像数据文件中，使得一张照片即可显示全景内容。合成所述连续图像的方式是以第一张图像为基准，依次提取后续图像中新增的图像信息进行拼接，直至所有连续图像中的内容都被拼接完成，最后即可得到所述全景照片。根据所述智能终端移动动作的不同，所述全景照片的展示范围也不同，所述全景照片可以是像画卷一样的矩形，也可以是封闭的球形等等。
S4：根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。
本步骤中，按照步骤S2中记录的移动方向移动所述智能终端，则所述智能终端的显示界面动态滚动显示所述全景照片，动态显示的方向为与所述移动方向相反。本步骤的目的是为了动态滚动显示所述全景照片，以便用户能够方便地浏览所述全景照片的内容；而动态滚动显示所述全景照片的前提是按照所述移动方向移动所述智能终端，也就是按照拍摄时的移动方向移动所述智能终端，还原拍摄时的移动状态。由于步骤S2中已经记录了所述移动方向，并将所述移动方向与所述连续图像关联，因此只要检测到移动方向， 即可相应地找到对应的连续图像。滚动显示所述全景照片时，只需将当前移动方向对应的连续图像被合并入所述全景照片的部分显示在显示界面中部即可。所述显示界面可以是所述智能终端的显示屏，当所述全景照片合成后，预览显示所述全景照片。所述反向滚动显示是指在所述显示界面，所述全景照片的滚动方向与所述移动方向相反，例如所述智能终端从左往右移动，则所述显示界面内的全景照片则从右往左滚动，这样正好与步骤S1中拍摄时所述智能终端一边移动一边拍摄的内容相符。在所述显示界面内滚动显示所述全景照片的实现，只需确认好哪部分像素在所述显示界面中部显示，然后按照像素点向所述显示界面周边扩展显示即可，直至显示至所述显示界面的边界。
在本申请第一方面的某些实施方式中，步骤S1内，所述智能终连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。本实施例中，对所述照相模块连续拍摄的频率进行了优选，即所述频率不低于一预设于所述智能终端内的频率阈值。所述连续拍摄的频率是一个关键的技术参数了，若所述频率过低，则整个移动拍摄过程中的拍摄次数过少，每张照片的重合度低，不利于后续的全景照片合成；若所述频率过高，则会占用所述智能终端过多的资源，例如需要占用大量的存储空间存放所述连续图像，还需频繁使用摄像头，使所述摄像头的工作负荷过重，影响使用寿命。所述频率阈值优选为1秒钟一次，考虑到用户移动所述智能终端时，移动速度在0.05m/s～0.2m/s左右，保持1秒钟内至少拍摄一次，能够保证拍摄的连续图像有较好的连续性。
参阅图2，为符合本发明另一优选实施例中基于智能终端的全景照片显示方法的流程示意图，步骤S1之前，所述拍照方法还包括：
S0：定位所述智能终端的位置。
本步骤中，首先对所述智能终端的位置进行定位。所述智能终端内有定位相关的传感器或模块，如红外传感器、超声波传感器、GPS模块、北斗模块等，上述传感器或模块通过物理感知或外部辅助的方式对所述智能终端的位置进行定位。例如使用红外传感器定位时，可以选择附近一参照物，使用所述红外传感器测量所述智能终端与所述参照物的距离，即可定位，若想更加精准地定位，可选择两个以上不同的参照物，以多组距离坐标进行位置定位。若使用GPS模块定位，比较适合移动距离较长的应用场景，通过与外部的GPS系统进行信号交互，即可获取所述智能终端的位置。
参阅图3，为符合本发明再一优选实施例中基于智能终端的全景照片显示方法的流程示意图，步骤S4包括：
S4-1：判断所述智能终端是否处于所述位置；
S4-2：当所述智能终端处于所述位置时，则根据所述移动方向移动所述智能终端，同时记录所述智能终端的移动速度；
S4-3：于所述智能终端的显示界面内按照所述移动速度沿所述移动方向的反向滚动显示所述全景照片；
S4-4：当所述智能终端不处于所述位置时，则所述智能终端静态显示所述全景照片。
本实施例中，对步骤S4作了细化。首先在步骤S4-1中，判断所述智能终端是否处于所述位置，所述位置即上一实施例中所述步骤S0中定位的所述智能终端的位置。判断所述智能终端的位置时，只需按照步骤S0中的方式再次对所述智能终端进行定位，并将得到的定位信息与所述步骤S0中的定位信息相比较，若吻合则意味着所述智能终端处于所述位置。
若步骤S4-1判断所述智能终端处于所述位置，则进入步骤S4-2，本步骤中根据所述移动方向移动所述智能终端，所述移动方向为步骤S1中所述智能终端的移动方向，即按照拍摄时的情况移动所述智能终端。本步骤在移动所述智能终端的同时，还记录了所述智能终端的移动速度，所述移动速度可通过速度传感器进行检测并记录。
步骤S4-3中，对所述全景照片实施滚动显示，滚动显示的方向与所述移动方向相反，滚动显示的速度与所述移动速度相适应。这样可保证在所述智能终端移动的同时，同步滚动显示所述全景照片。所述全景照片的滚动显示的移动速度，应当与所述智能终端的移动速度相适应，即当所述智能终端从初始位置移动至结束位置时，所述全景照片正好滚动显示完毕。可以将所述智能终端的移动速度换算为相应的像素点显示速度，所述智能终端可以计算按照当前的移动速度，需要多长时间可以移动至结束位置，即预计剩余移动时间，再将所述全景照片中剩余未显示的像素点数除以所述时间，即可得到所述像素点的显示速度。由于所述智能终端的初始定位位置已知，所述智能终端拍摄结束的位置也可由移动方向推算出，因而可以计算所述智能终端的预计剩余移动时间。
若步骤S4-1判断所述智能终端不处于所述位置，则进入步骤S4-4，这种情况下静态显示所述全景照片。静态显示所述全景照片，即在所述智能终端的显示界面上显示静止不动的全景照片，显示的内容既可以是整张全景照片，也可以仅为所述全景照片的一部分，例如所述全景照片的前期镜头的拍摄内容，或者是整个全景照片的中部内容。静态显示所述全景照片与显示正常照片的技术手段一致，差别在于选取所述全景照片中的部分或全部像素点进行显示。
参阅图4，为符合本发明再一优选实施例中基于智能终端的全景照片显示方法的流程 示意图，步骤S3包括：
S3-1：获取每一所述连续图像中正对应所述智能终端的拍摄镜头的图像部分；
S3-2：拼接每一所述图像部分获得所述全景照片。
本优选实施例对步骤S3进一步细化，步骤S3-1中，获取每一所述连续图像中正对应拍摄镜头的图像部分。在步骤S2中，每一所述连续图像均是由镜头正面拍摄，因此所述连续图像必有正对应所述拍摄镜头的部分，也就是所述连续图像的中部。而后提取所述图像部分，由于所述图像为数字化的像素点信息，因此只需将所需提取的图像部分的像素点信息拷贝出来即可。提取所述图像部分时，还需注意每次提取的图像不与前次提取的图像重合，判断图像是否重合的方式可以为取一列像素点信息，与前一图像的边缘的各列像素点信息进行对比，若前一图像中某一列像素点信息与后一图像的相同，则两列像素重合。
步骤S3-2中，拼接步骤S3-1中获取的图像部分，即可得到所述全景照片。拼接所述图像部分，即先确定好基准图像，再将所述图像部分的像素点信息拷贝至所述基准图像上，不覆盖已有的基准图像内容，而是在所述基准图像的边界延续扩展像素点信息。当所有的联系图像的被提取的部分都已拷贝至所述基准图像上时，所述基准图像即为全景照片。
参阅图5，为符合本发明一优选实施例中基于智能终端的全景照片显示装置的结构示意图，所述显示装置10包括：
-照相模块11
照相模块11，当所述智能终端被移动时，连续拍摄一目标物体。所述照相模块包括硬件部分和软件部分；所述硬件部分即摄像头及相关连接电路，利用光学成像原理对目标物体进行拍摄，将光学信号转换为数字信号；所述软件部分即相应的图像处理软件，对所述摄像头拍摄到的图像进行记录和处理，形成数字化的照片。本实施例中所述照相模块11设于所述智能终端内，可以包括一个摄像头，也可以包括多个摄像头。所述照相模块11支持连续拍摄功能，即按照一定的频率持续地进行拍摄。所述连续图像还对应有所述智能终端的移动方向信息，当所述照相模块11记录所述连续图像时，同时还关联所述连续图像拍摄时的所述智能终端移动方向信息。所述智能终端移动方向由所述智能终端内的记录模块12记录，所述照相模块11在拍摄时同步从所述记录模块12获取所述移动方向信息。
-记录模块12
记录模块12，与所述照相模块11连接，形成记录有所述智能终端的移动方向的连续图像。所述记录模块12记录所述照相模块11连续拍摄所得的连续图像，将所述连续图像保存为所述智能终端支持的数字格式，例如jpg、png等。所述连续图像还对应有所述智能终端的移动方向信息，当所述记录模块12记录所述连续图像时，同时还关联所述连续图像拍摄时的所述智能终端移动方向信息。所述智能终端移动方向由所述记录模块12记录，所述记录模块12，可以由传感器实现，例如加速度传感器、速度传感器、红外传感器、超声波传感器中的一种或几种组合。当所述记录模块12为加速度传感器时，可以检测所述智能终端的加速度及加速度方向，由于所述智能终端移动速度较慢，可将所述加速度方向近似当做所述移动方向。所述记录模块12还可以通过所述红外传感器或超声波传感器探测所述智能终端与外部参照物的距离，探测短时间内的两组距离参数，即可推算出所述智能终端的移动方向；例如所述记录模块12可以探测x轴、y轴、z轴三个坐标轴上的距离参数，则通过两组参数可以得知在三个坐标轴上的移动距离，即移动距离在三个坐标轴上的分量，利用向量法即可得出移动方向。
-合成模块13
合成模块13，与所述记录模块12连接，合成所述连续图像为一全景照片。所述合成模块13为软件模块，从所述记录模块12获取所述连续图像，提取各个所述连续图像中的部分像素点信息，并将上述像素点信息进行拼接，即得到全景照片。所述合成模块13提取所述连续图像中的像素点信息时，首先确定与其他图像重合的像素点区域，找到边界坐标，而后将不重合的像素点信息拷贝出来；再以其中一张图像(一般是首张图像)为基准进行拼接，将所述不重合的像素点信息拷贝至所述基准图像中，扩展所述基准图像的像素坐标范围，直至所有的图像拼接完成。
-显示模块14
显示模块14，与所述合成模块13连接，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。所述显示模块14从所述合成模块13中获取所述全景照片。所述显示模块14还与所述智能终端内显示模块连接，将待显示的信息发送至所述显示模块进行显示。所述显示模块14以滚动显示方式显示所述全景照片，即以一定的频率刷新显示所述全景照片的内容，且每次显示的内容都不同，按照所述移动方向的反向选取所述全景照片中的像素点信息进行显示。最终，所述显示模块14实现所述全景照片随着所述终端的移动而反向滚动显示的效果，再现了拍摄时能够看到的目标场景。
在本申请第二方面的某些实施方式中，所述照相模块11连续拍摄一目标物体时，所 述照相模块11连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。所述照相模块11内设有软件定时任务，每隔一个周期即启动拍摄一次，周期的倒数即所述拍摄的频率。所述拍摄的频率不低于预设的所述频率阈值，所述频率阈值优选为1秒钟1次。
参阅图6，为符合本发明另一优选实施例中基于智能终端的全景照片显示装置的结构示意图，所述显示装置10还包括：
-定位模块15
定位模块15，定位所述智能终端的位置。所述定位模块15，可以是红外传感器、超声波传感器、GPS模块、北斗模块等具备定位功能的传感器或模块，上述传感器或模块通过物理感知或外部辅助的方式对所述智能终端的位置进行定位。例如使用红外传感器定位时，可以选择附近一参照物，使用所述红外传感器测量所述智能终端与所述参照物的距离，即可定位，若想更加精准地定位，可选择两个以上不同的参照物，以多组距离坐标进行位置定位。若所述定位模块15为GPS模块，比较适用于移动距离较长的应用场景，通过与外部的GPS系统进行信号交互，即可获取所述智能终端的位置。
参阅图7，为符合本发明再一优选实施例中基于智能终端的全景照片显示装置的结构示意图，所述显示模块14还包括：
-位置判断单元141
位置判断单元141，判断所述智能终端是否处于所述位置。所述位置判断单元141工作时，需要从所述定位模块15获取至少两组定位信息，其中一组定位信息为开始拍照时的所述智能终端的位置信息，另一组定位信息为开始显示所述全景照片时的位置信息。而后比较所述两组定位信息是否相同，若相同则意味着所述智能终端所处的位置相同。由于所述定位模块15得到的定位信息为数字化的位置信息，例如坐标或距离等参数，因此具有可比较性。为了便于操作，所述位置判断单元141进行位置判断时，可以允许一定的偏差，毕竟若用户手动进行操作，很难保证分毫不差地使所述智能终端处于同一个位置上。
-速度检测单元142
速度检测单元142，当所述智能终端处于所述位置时，检测并记录所述智能终端的移动速度。所述速度检测单元142可通过速度传感器实现，所述速度传感器可以利用激光测速原理或雷达测速原理进行测速，最终得到所述移动终端的移动速度。
-动态显示单元143
动态显示单元143，于所述智能终端的显示界面内按照所述移动速度沿所述移动方向 的反向滚动显示所述全景照片。所述动态显示单元143以一定的频率刷新显示所述全景照片的内容，且每次显示的内容都不同，从所述速度检测单元142获取所述智能终端的移动速度，并按照所述移动速度，沿所述移动方向的反向选取所述全景照片中的像素点信息进行显示。
-静态显示单元144
静态显示单元144，当所述智能终端不处于所述位置时，静态显示所述全景照片。所述静态显示模块144的工作条件为所述智能终端不处于所述位置，与所述动态显示单元143的工作条件正好互斥。所述静态显示单元144，选取所述全景照片中的部分像素点，传送给所述智能终端内的显示模块进行显示；所述静态显示单元144选取的像素点范围符合所述智能终端显示屏幕的像素规格。例如所述智能终端屏幕为1024*768的分辨率，则所述静态显示单元144按照该屏幕所能容纳的像素点数选取所述全景照片中的像素点。所述静态显示单元144也可以选取全部的全景照片，对其像素进行压缩后通过所述显示模块整体显示。
参阅图8，为符合本发明一优选实施例中合成模块的结构示意图，所述合成模块13包括：
-获取单元131
获取单元131，获取每一所述连续图像中正对应所述智能终端的拍摄镜头的图像部分。所述获取单元131计算所述连续图像中正对应拍摄镜头的区域的范围，并将范围内的像素点信息复制出来。所述拼接单元132获取单元131计算所述区域范围时，选取一小片区域的像素点与前一图像中的相似区域进行对比，即可得知所述小片区域是否重合，以此方法找到所述图像中重合区域的边界，所述边界的另一侧即需要被获取的图像部分。
-拼接单元132
拼接单元132，拼接每一所述图像部分获得所述全景照片。所述拼接单元132首先以一幅图像为基准图像，一般选取首幅图像为基准图像；而后从所述获取单元131获取需要被拼接的图像部分，而后按照拍摄的顺序依次将所述图像部分的像素点信息拼接在所述基准图像上，所述基准图像的像素点范围会锁着拼接的进行不断扩展，直至所有图像部分拼接结束。
应当注意的是，本发明的实施例有较佳的实施性，且并非对本发明作任何形式的限制，任何熟悉该领域的技术人员可能利用上述揭示的技术内容变更或修饰为等同的有效实施例，但凡未脱离本发明技术方案的内容，依据本发明的技术实质对以上实施例所作 的任何修改或等同变化及修饰，均仍属于本发明技术方案的范围内。

Claims (10)

  1. 一种基于智能终端的全景照片显示方法，其特征在于，包括以下步骤：
    移动所述智能终端并操作所述智能终端连续拍摄一目标物体；
    于所述智能终端内形成记录有所述智能终端的移动方向的连续图像；
    合成所述连续图像为一全景照片；
    根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。
  2. 如权利要求1所述的显示方法，其特征在于，
    移动所述智能终端并操作所述智能终端连续拍摄一目标物体的步骤内，所述智能终端连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。
  3. 如权利要求1或2所述的显示方法，其特征在于，
    移动所述智能终端并操作所述智能终端连续拍摄一目标物体的步骤之前，所述显示方法还包括：
    定位所述智能终端的位置。
  4. 如权利要求3所述的显示方法，其特征在于，
    根据所述移动方向移动所述智能终端，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片的步骤包括：
    判断所述智能终端是否处于所述位置；
    当所述智能终端处于所述位置时，则根据所述移动方向移动所述智能终端，同时检测并记录所述智能终端的移动速度；
    于所述智能终端的显示界面内按照所述移动速度沿所述移动方向的反向滚动显示所述全景照片；
    当所述智能终端不处于所述位置时，则所述智能终端静态显示所述全景照片。
  5. 如权利要求1或2所述的显示方法，其特征在于，
    合成所述连续图像为一全景照片的步骤包括：
    获取每一所述连续图像中正对应所述智能终端的拍摄镜头的图像部分；
    拼接每一所述图像部分获得所述全景照片。
  6. 一种基于智能终端的全景照片显示装置，其特征在于，所述显示装置包括：
    照相模块，当所述智能终端被移动时，连续拍摄一目标物体；
    记录模块，与所述照相模块连接，形成记录有所述智能终端的移动方向的连续图像；
    合成模块，与所述记录模块连接，合成所述连续图像为一全景照片；
    显示模块，与所述合成模块连接，于所述智能终端的显示界面内沿所述移动方向的反向滚动显示所述全景照片。
  7. 如权利要求6所述的显示装置，其特征在于，
    所述照相模块连续拍摄一目标物体时，所述照相模块连续拍摄的频率不低于一预设于所述智能终端内的频率阈值。
  8. 如权利要求6或7所述的显示装置，其特征在于，
    所述显示装置还包括：
    定位模块，定位所述智能终端的位置。
  9. 如权利要求8所述的显示装置，其特征在于，
    所述显示模块包括：
    位置判断单元，判断所述智能终端是否处于所述位置；
    速度检测单元，当所述智能终端处于所述位置时，检测并记录所述智能终端的移动速度；
    动态显示单元，于所述智能终端的显示界面内按照所述移动速度沿所述移动方向的反向滚动显示所述全景照片；
    静态显示单元，当所述智能终端不处于所述位置时，静态显示所述全景照片。
  10. 如权利要求6或7所述的显示装置，其特征在于，
    所述合成模块包括：
    获取单元，获取每一所述连续图像中正对应所述智能终端的拍摄镜头的图像部分；
    拼接单元，拼接每一所述图像部分获得所述全景照片。
PCT/CN2017/095636 2017-08-02 2017-08-02 一种基于智能终端的全景照片显示方法及显示装置 WO2019023991A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2017/095636 WO2019023991A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的全景照片显示方法及显示装置
CN201780095570.5A CN111194556B (zh) 2017-08-02 2017-08-02 一种基于智能终端的全景照片显示方法及显示装置

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/095636 WO2019023991A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的全景照片显示方法及显示装置

Publications (1)

Publication Number Publication Date
WO2019023991A1 true WO2019023991A1 (zh) 2019-02-07

Family

ID=65232248

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/095636 WO2019023991A1 (zh) 2017-08-02 2017-08-02 一种基于智能终端的全景照片显示方法及显示装置

Country Status (2)

Country Link
CN (1) CN111194556B (zh)
WO (1) WO2019023991A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090309987A1 (en) * 2008-06-11 2009-12-17 Manabu Kimura Information processing apparatus, image-capturing system, reproduction control method, recording control method, and program
CN102572258A (zh) * 2010-09-29 2012-07-11 卡西欧计算机株式会社 能再现全景图像的图像再现装置
CN104363372A (zh) * 2014-10-27 2015-02-18 广东欧珀移动通信有限公司 一种图片处理方法及终端
CN104394451A (zh) * 2014-12-05 2015-03-04 宁波菊风系统软件有限公司 一种智能移动终端的视频呈现方法
CN104471519A (zh) * 2014-06-16 2015-03-25 华为技术有限公司 移动终端中呈现全景照片的方法和装置、以及移动终端

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101784176B1 (ko) * 2011-05-25 2017-10-12 삼성전자주식회사 영상 촬영 장치 및 그 제어방법
JP5948927B2 (ja) * 2012-02-09 2016-07-06 ソニー株式会社 画像処理装置と画像処理方法とプログラムおよび撮像装置
CN106354868A (zh) * 2016-09-13 2017-01-25 乐视控股（北京）有限公司 一种拍照处理方法及装置
CN106851117B (zh) * 2017-03-31 2020-01-31 联想(北京)有限公司 一种获得全景照片的方法及电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090309987A1 (en) * 2008-06-11 2009-12-17 Manabu Kimura Information processing apparatus, image-capturing system, reproduction control method, recording control method, and program
CN102572258A (zh) * 2010-09-29 2012-07-11 卡西欧计算机株式会社 能再现全景图像的图像再现装置
CN104471519A (zh) * 2014-06-16 2015-03-25 华为技术有限公司 移动终端中呈现全景照片的方法和装置、以及移动终端
CN104363372A (zh) * 2014-10-27 2015-02-18 广东欧珀移动通信有限公司 一种图片处理方法及终端
CN104394451A (zh) * 2014-12-05 2015-03-04 宁波菊风系统软件有限公司 一种智能移动终端的视频呈现方法

Also Published As

Publication number Publication date
CN111194556A (zh) 2020-05-22
CN111194556B (zh) 2021-05-04

Similar Documents

Publication Publication Date Title
US9813607B2 (en) Method and apparatus for image capture targeting
WO2017088678A1 (zh) 长曝光全景图像拍摄装置和方法
US8976255B2 (en) Imaging apparatus
JP5659305B2 (ja) 画像生成装置および画像生成方法
JP5659304B2 (ja) 画像生成装置および画像生成方法
JP6198958B2 (ja) 写真を取得するための方法、装置、コンピュータプログラム、及び、コンピュータ可読記憶媒体
TWI586167B (zh) 以臉部偵測控制相機
JP5769813B2 (ja) 画像生成装置および画像生成方法
US8767036B2 (en) Panoramic imaging apparatus, imaging method, and program with warning detection
KR101343220B1 (ko) 파노라마 이미지에 대한 실시간 미리 보기
JP5865388B2 (ja) 画像生成装置および画像生成方法
TW201215124A (en) Imaging apparatus, image processing method, and recording medium for recording program thereon
CN108616733B (zh) 一种全景视频图像的拼接方法及全景相机
WO2014067422A1 (zh) 一种采集图像数据的处理方法及装置
JP2013027021A (ja) 全方位撮像装置及び全方位撮像方法
CN110944101A (zh) 摄像装置及图像记录方法
JP5248951B2 (ja) カメラ装置、画像撮影支援装置、画像撮影支援方法、及び画像撮影支援プログラム
JP5519376B2 (ja) 電子機器
WO2019000715A1 (zh) 图像处理方法及其系统
US8665317B2 (en) Imaging apparatus, imaging method and recording medium
JP6483661B2 (ja) 撮像制御装置、撮像制御方法およびプログラム
WO2019023991A1 (zh) 一种基于智能终端的全景照片显示方法及显示装置
JP2010263269A (ja) 撮像装置
WO2020238312A1 (zh) 一种拍摄方法及装置、存储介质、电子装置
JP2014067142A (ja) 画像処理装置、画像処理方法、撮像装置、および撮像方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17919714

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17919714

Country of ref document: EP

Kind code of ref document: A1