WO2018076941A1 - 一种实现全景拍摄的方法及装置 - Google Patents

一种实现全景拍摄的方法及装置 Download PDF

Info

Publication number
WO2018076941A1
WO2018076941A1 PCT/CN2017/101125 CN2017101125W WO2018076941A1 WO 2018076941 A1 WO2018076941 A1 WO 2018076941A1 CN 2017101125 W CN2017101125 W CN 2017101125W WO 2018076941 A1 WO2018076941 A1 WO 2018076941A1
Authority
WO
WIPO (PCT)
Prior art keywords
panoramic
shooting
image
information
captured image
Prior art date
Application number
PCT/CN2017/101125
Other languages
English (en)
French (fr)
Inventor
刘林汶
里强
苗雷
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2018076941A1 publication Critical patent/WO2018076941A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2228—Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing

Definitions

  • This document relates to, but is not limited to, image processing technology, and more particularly to a method and apparatus for implementing panoramic photography.
  • Panoramic shooting is a certain angle of shooting with a set point as the center (for example, horizontal 360-degree shooting; or horizontal 360-degree and vertical 180-degree shooting), stitching multiple images into a single panoramic image .
  • the basic principle of splicing a panoramic image is to search for the edge portions of the two images, and to superimpose the regions with the closest imaging effects, and to splicing the non-coincident regions to obtain a panoramic image.
  • Embodiments of the present invention provide a method and apparatus for implementing panoramic shooting, which can reduce the time consumption of the splicing process and improve the quality of the panoramic captured image.
  • An embodiment of the present invention provides an apparatus for implementing panoramic shooting, including: a recording unit and a splicing unit;
  • the recording unit is configured to record the shooting track information during the panoramic shooting by using the preset sensor
  • the splicing unit is configured to splicing the image frames of the panoramic shooting according to the recorded trajectory information to obtain a panoramic captured image.
  • the recording unit is configured to
  • the shooting angle of each image frame during panoramic shooting is separately recorded by the gyro sensor, and the shooting angle of each image frame in the panoramic shooting is respectively converted into corresponding encoding information according to a preset encoding manner;
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information identifying the image frame is used as the captured trajectory information.
  • the device further includes: the direction processing unit is configured to
  • the splicing unit is configured to
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain the panoramic captured image.
  • the device further includes:
  • a cache display unit configured to parse the panoramic captured image according to the encoded information of the panoramic captured image, and cache the parsed panoramic captured image; and read the buffered the panoramic captured image according to the terminal moving angle, to The panoramic captured image is displayed.
  • the device further includes:
  • the control module is configured to: after detecting that the camera is turned on, according to the shooting track information, determining that the cumulative degree of change of the shooting angle of the camera in the first direction is greater than a preset trigger threshold, starting the panoramic shooting;
  • the starting panoramic shooting includes: performing panoramic shooting starting from the first direction as the moving direction of the camera.
  • the preset trigger threshold includes at least one of a horizontal direction angle change threshold and a vertical direction change threshold.
  • control module is further configured to stop panoramic shooting when receiving a preset stop shooting instruction.
  • the matching order includes sorting by a fixed size or sorting according to a fixed encoding order.
  • an embodiment of the present invention further provides a method for implementing panoramic shooting, including:
  • the image frames of the panoramic shooting are stitched according to the recorded shooting track information to obtain a panoramic captured image.
  • the recording the trajectory information when the panoramic shooting is recorded by using the preset sensor includes:
  • the shooting angle of each image frame during panoramic shooting is separately recorded by the gyro sensor, and the shooting angle of each image frame in the panoramic shooting is respectively converted into corresponding encoding information according to a preset encoding manner;
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information identifying the image frame is used as the captured trajectory information.
  • the method further includes:
  • the splicing processing the image frame of the panoramic shooting according to the recorded trajectory information includes:
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain the panoramic captured image.
  • the method further includes:
  • the buffered panoramic panoramic captured image is read according to the terminal moving angle to display the panoramic captured image.
  • the method further includes:
  • the panoramic shooting After detecting that the camera is turned on, according to the shooting track information, when the cumulative degree of change of the shooting angle of the camera in the first direction is greater than the preset trigger threshold, the panoramic shooting is started;
  • the starting panoramic shooting includes: performing panoramic shooting starting from the first direction as the moving direction of the camera.
  • the preset trigger threshold includes at least one of a horizontal direction angle change threshold and a vertical direction change threshold.
  • the method further includes:
  • the matching order includes sorting by a fixed size or sorting according to a fixed encoding order.
  • the embodiment of the invention further provides a mobile terminal, including:
  • the sensor is set to record the shooting track information when the panoramic shooting is performed
  • Memory set to store instructions
  • the processor is configured to, after receiving the shooting track information recorded by the sensor, execute the instruction to implement the step of implementing panoramic shooting as described above.
  • Embodiments of the present invention also provide a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of panoramic photography as described above.
  • the application records the shooting track information during panoramic shooting by using a preset sensor; and stitching the image frames of the panoramic shooting according to the recorded shooting track information to obtain a panoramic shooting image.
  • the recorded trajectory information of the embodiment of the invention reduces the time consumption of the splicing process, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.
  • FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal embodying various embodiments of the present invention
  • FIG. 2 is a block diagram of a main electrical structure of a camera according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of a method for implementing panoramic shooting according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of working coordinates of a gyro sensor according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a panoramic image of an image frame that has not been deleted
  • FIG. 6 is a schematic diagram of a panoramic image after deleting an image frame according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of adjusting an angle ratio according to an embodiment of the present invention.
  • FIG. 8 is a flowchart of a method for implementing panoramic shooting according to another embodiment of the present invention.
  • FIG. 9 is a structural block diagram of an apparatus for implementing panoramic shooting according to an embodiment of the present invention.
  • the mobile terminal can be implemented in a variety of forms.
  • the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like. Under In the face, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
  • FIG. 1 is a schematic diagram showing the hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
  • the mobile terminal 100 may include an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, a controller 180, a power supply unit 190, and the like.
  • Figure 2 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
  • the A/V input unit 120 is arranged to receive an audio or video signal.
  • the A/V input unit 120 may include a camera 121 that processes image data of still pictures or video obtained by an image capturing device in a video capturing mode or an image capturing mode.
  • the processed image frame can be displayed on the display unit 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium), and two or more cameras 1210 may be provided according to the configuration of the mobile terminal.
  • the user input unit 130 may be configured to generate key input data in accordance with a command input by the user to control various operations of the mobile terminal.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of the user's contact with the mobile terminal 100 (ie, touch input), the orientation of the mobile terminal 100, the acceleration or deceleration movement of the mobile terminal 100, and The direction or the like, and a command or signal for controlling the operation of the mobile terminal 100 is generated.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.
  • the sensing unit 140 may include a gyro sensor 141.
  • the output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in at least one of a visual, an audio, and a tactile manner.
  • the output unit 150 may include a display unit 151.
  • the display unit 151 can be set to display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display at least one of a captured image and a received image, a UI or GUI showing a video or image and related functions, and the like.
  • UI user interface
  • GUI graphical user interface
  • the display unit 151 can function as an input device and an output device.
  • the display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) .
  • the touch screen can be set to detect touch input pressure as well as touch input position and touch input area.
  • the memory 160 may be provided as a software program or the like that stores processing and control operations performed by the controller 180, or may temporarily store data that has been output or is to be output (for example, a phone book, a message, a still image, a video, etc.) . Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic memory, magnetic disk, optical disk, and the like.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 is typically arranged to control the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like.
  • the controller 180 may be configured to perform a pattern recognition process to perform handwriting input or picture drawing on the touch screen The input is recognized as a character or image.
  • the power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.
  • the various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by
  • the mobile terminal has been described in terms of its function.
  • a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • the mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • the photographic lens 701 is composed of a plurality of optical lenses provided to form a subject image, and is a single focus lens or a zoom lens, and in the present embodiment, the photographic lens 701 is two.
  • the photographic lens 701 can be moved in the optical axis direction by the lens driving unit 711, and controls the focus position of the taking lens 701 based on the control signal from the lens driving control unit 712, and also controls the focus distance in the case of the zoom lens.
  • the lens drive control circuit 712 performs drive control of the lens drive unit 711 in accordance with a control command from the microcomputer 707.
  • An imaging element 702 is disposed in the vicinity of a position where the subject image is formed by the photographing lens 701 on the optical axis of the photographing lens 701.
  • the imaging element 702 functions as an imaging unit that captures a subject image and acquires captured image data.
  • the imaging element 702 is two-dimensionally arranged in a matrix to form each pixel.
  • Photodiode. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode.
  • the front surface of each pixel is provided with a Bayer array of RGB color filters.
  • the imaging element 702 is connected to an imaging circuit 703 that performs charge accumulation control and image signal readout control in the imaging element 702, and performs waveform shaping after reducing the reset noise of the read image signal (analog image signal). Further, gain improvement or the like is performed to obtain an appropriate signal level.
  • the imaging circuit 703 is connected to an analog-to-digital conversion (A/D) conversion unit 704 that performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 199.
  • A/D analog-to-digital conversion
  • the bus 199 is arranged to transfer a transmission path of various data read or generated inside the camera.
  • the A/D conversion unit 704 is connected to the bus 199, and an image processor 705, a JPEG processor 706, a microcomputer 707, a dynamic random access memory (SDRAM) 708, and a memory interface are connected (hereinafter referred to as A memory I/F) 709, a liquid crystal display (LCD) driver 710.
  • a memory I/F liquid crystal display
  • the image processor 705 performs various types of images such as OB subtraction processing, white balance adjustment, color matrix calculation, gamma conversion, color difference signal processing, noise removal processing, simultaneous processing, edge processing, and the like on the image data based on the output of the imaging element 702. deal with.
  • the JPEG processor 706 compresses the image data read out from the SDRAM 708 in accordance with the JPEG compression method when the image data is recorded on the recording medium 715. Further, the JPEG processor 706 performs decompression of JPEG image data for image reproduction display.
  • the file recorded in the recording medium 715 is read, and after the compression processing is performed in the JPEG processor 706, the decompressed image data is temporarily stored in the SDRAM 708 and displayed on the LCD 716.
  • the JPEG method is employed as the image compression/decompression method.
  • the compression/decompression method is not limited thereto, and other compression/decompression methods such as MPEG, TIFF, and H.264 may be employed.
  • the microcomputer 707 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera.
  • the microcomputer 707 is connected to the operation unit 713 and the flash memory 714.
  • the operation unit 713 includes a physical button or a virtual button, and the entity or virtual button can be a power button, a camera button, an edit button, a dynamic image button, a reproduction button, a menu button, a cross button, an OK button, a delete button, an enlarge button, and the like.
  • the detection result is output to the microcomputer 707. Further, a touch panel is provided on the front surface of the LCD 716 as a display portion, and the touch position of the user is detected, and the touch position is output to the microcomputer 707.
  • the microcomputer 707 executes various processing sequences corresponding to the operation of the user based on the detection result of the operation member from the operation unit 713. Also, here, the computer 707 may perform various processing sequences corresponding to the user's operation based on the detection result of the touch panel in front of the LCD 716.
  • the flash memory 714 is arranged to store programs for executing various processing sequences of the microcomputer 707.
  • the microcomputer 707 performs overall control of the camera in accordance with the program. Further, the flash memory 714 stores various adjustment values of the camera, and the microcomputer 707 reads out the adjustment value, and performs control of the camera in accordance with the adjustment value.
  • the SDRAM 708 is an electrically rewritable volatile memory that is set to temporarily store image data or the like.
  • the SDRAM 708 temporarily stores the image data output from the A/D conversion unit 704 and the image data processed in the image processor 705, the JPEG processor 706, and the like.
  • the memory interface 709 is connected to the recording medium 715, and performs control for writing image data and a file header attached to the image data to the recording medium 715 and reading out from the recording medium 715.
  • the recording medium 715 is, for example, a recording medium such as a memory card that can be detachably attached to the camera body.
  • the recording medium 715 is not limited thereto, and may be a hard disk or the like built in the camera body.
  • the LCD driver 710 is connected to the LCD 716, and stores image data processed by the image processor 705 in the SDRAM.
  • the image data stored in the SDRAM is read and displayed on the LCD 716, or the image data stored in the JPEG processor 706 is compressed.
  • the JPEG processor 706 reads the compressed image data of the SDRAM, decompresses it, and displays the decompressed image data through the LCD 716.
  • the LCD 716 is disposed on the back of the camera body or the like to perform image display.
  • the LCD 716 is provided with a touch panel that detects a user's touch operation.
  • the liquid crystal display panel (LCD 716) is disposed in the present embodiment.
  • the present invention is not limited thereto, and various display panels such as an organic EL may be employed.
  • the area where the imaging effect is closest is required to be overlapped before the splicing of the panoramic image, and the implementation thereof is mainly realized by the feature matching technology, the feature matching is time consuming, and the splicing process is long; in addition, the feature matching is performed in the connection area.
  • the connection area is unnatural, which affects the quality of the panoramic image.
  • FIG. 3 is a flowchart of a method for implementing panoramic shooting according to an embodiment of the present invention. As shown in FIG. 3, the method includes:
  • Step 300 Record shooting track information during panoramic shooting by using a preset sensor
  • the information about the shooting track when the panoramic shooting is recorded by using the preset sensor includes:
  • the shooting angle of each image frame during panoramic shooting is separately recorded by the gyro sensor, and the shooting angle of each image frame in the panoramic shooting is respectively converted into corresponding encoding information according to a preset encoding manner;
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information of the identified image frame is taken as the captured trajectory information.
  • the embodiment of the present invention further includes:
  • the panoramic shooting After detecting that the camera is turned on, according to the shooting track information, when the cumulative degree of change of the shooting angle of the camera in the first direction is greater than the preset trigger threshold, the panoramic shooting is started;
  • the starting panoramic shooting includes: performing panoramic shooting starting from the first direction as the moving direction of the camera.
  • the implementation trigger threshold of the present invention may include at least one of a horizontal direction angle change threshold and a vertical direction angle change threshold.
  • 4 is a schematic diagram showing the working coordinates of the gyro sensor according to the embodiment of the present invention. As shown in FIG. 4, the X axis represents the horizontal direction and the Y axis represents the vertical direction. Taking 360 degree shooting around the center M (Middle) as an example, the trigger threshold may be a horizontal direction angle change threshold. Here, in the embodiment of the present invention, the trigger threshold may be an angle between 3 and 20 degrees. The size of the trigger threshold may be determined according to actual conditions. When the trigger threshold is small, the collected image frames are generally larger; the trigger threshold is larger. At the same time, fewer image frames are acquired.
  • Step 301 splicing the image frame of the panoramic shooting according to the recorded shooting track information To get a panoramic shot.
  • the method of the embodiment of the present invention further includes:
  • the shooting track information it is determined that the moving direction of the camera is a second direction different from the first direction in which the panoramic shooting is performed, and when the moving time length in the second direction is greater than or equal to the preset time length threshold, the panoramic shooting is stopped.
  • the embodiment of the present invention may further include: stopping the panoramic shooting when receiving the preset stop shooting instruction.
  • the splicing processing of the image frames of the panoramic shooting according to the recorded trajectory information includes:
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain the above-mentioned panoramic captured image.
  • conforming to the sorting rule means that the reference encoding method is sorted according to a fixed size or in a fixed coding order; it is assumed that the positive integers are 1, 2, 3, 4, 5, 6, 7, 8, ... N The positive integer encodes the image frame.
  • FIG. 5 is a schematic diagram of a panoramic image of an unremoved image frame, as shown in FIG.
  • FIG. 5 is a schematic diagram of a panoramic image after deleting an image frame according to an embodiment of the present invention.
  • a portion where the second frame image does not coincide with the first frame image is represented by a rectangle numbered 2; a portion where the third frame image does not coincide with the second frame image is represented by a rectangle numbered 3; the fourth frame image and the third frame
  • the portion where the frame image does not coincide is represented by a rectangle numbered 4; the portion where the fifth frame image does not coincide with the fourth frame image is represented by a rectangle numbered 5; due to an encoded letter that does not conform to the sorting rule
  • the encoded information is in accordance with the sorting rule: 1, 2, 3, 4, 5, 6, 7, 8...
  • the splicing is performed by using the embodiment of the present invention, which avoids the situation that the splicing is unnatural due to the change of the moving direction of the camera during the process of capturing the panoramic image, and improves the image quality of the panoramic shooting.
  • the embodiment of the present invention further includes:
  • the panoramic captured image is displayed according to the terminal moving angle based on the encoded information of the stitched panoramic captured image.
  • the image when the panoramic captured image is displayed, the image may be panned according to the moving angle of the playing process; the ratio of the moving angle to the shooting angle may be 1, that is, when moving 1 degree, the panorama is The captured image is displayed in a 1 degree change; in the embodiment of the present invention, the cumulative change of the shooting angle is greater than 360 degrees, and the ratio of the moving angle to the shooting angle may be less than 1.
  • the general moving angle reaches 360 degrees, the panoramic shooting image of all shooting angles is completed.
  • the display; the ratio of the moving angle to the shooting angle can be adjusted according to the actual situation.
  • FIG. 7 is a schematic diagram of adjusting an angle ratio according to an embodiment of the present invention. As shown in FIG.
  • an angle ratio represents a ratio of a moving angle to a shooting angle, and an angular ratio may be increased according to a preset step by an erect triangular virtual button;
  • the angle ratio can be reduced by the preset step size by the inverted triangle virtual button; here
  • the preset step size may be a preset fixed value, for example, 0.05; if the desired angle ratio cannot be obtained by adjusting the preset step size, the preset step size may be modified or the angle ratio may be determined by manual input. The size of the value.
  • the method of the embodiment of the present invention further includes:
  • the panoramic captured image is parsed according to the encoded information of the stitched panoramic captured image, and the parsed panoramic captured image is buffered, and the buffered analyzed panoramic captured image is read according to the terminal moving angle to display the panoramic captured image.
  • the display of the panoramic captured image generally includes the following steps: acquiring a panoramic captured image, analyzing the panoramic captured image, and outputting the panoramic captured image; after analyzing the panoramic captured image, the embodiment of the present invention caches the parsed panoramic captured image.
  • the cached data can be directly read, thereby improving the display efficiency.
  • audio information is generated when the panoramic captured image is generated, the audio information does not affect the implementation of the above process, and only needs to be parsed to output. Add audio processing to the process.
  • the recorded trajectory information of the embodiment of the invention reduces the time consumption of the splicing process, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.
  • FIG. 8 is a flowchart of a method for implementing panoramic shooting according to another embodiment of the present invention. As shown in FIG. 8, the method includes:
  • Step 800 Record shooting track information during panoramic shooting by using a preset sensor
  • the information of the shooting track when the panoramic shooting is recorded by the preset sensor includes:
  • the shooting angle of each image frame during panoramic shooting is separately recorded by the gyro sensor, and the shooting angle of each image frame in the panoramic shooting is respectively converted into corresponding encoding information according to a preset encoding manner;
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information of the identified image frame is taken as the captured trajectory information.
  • the embodiment of the present invention further includes:
  • the panoramic shooting After detecting that the camera is turned on, according to the shooting track information, when the cumulative degree of change of the shooting angle of the camera in the first direction is greater than the preset trigger threshold, the panoramic shooting is started;
  • Starting the panoramic shooting includes: taking the first direction as the panoramic direction of the camera moving direction Photographed.
  • the implementation threshold of the present invention may include at least one of a horizontal direction angle change threshold and a vertical direction angle change threshold.
  • the trigger threshold may be a horizontal direction angle change threshold.
  • the trigger threshold may be an angle between 3 and 20 degrees.
  • the size of the trigger threshold may be determined according to the actual situation. When the trigger threshold is small, the collected image frames are generally larger. When the trigger threshold is larger, the collected threshold is larger. There are fewer image frames.
  • the method of the embodiment of the present invention further includes:
  • the shooting track information it is determined that the moving direction of the camera is a second direction different from the first direction in which the panoramic shooting is performed, and when the moving time length in the second direction is greater than or equal to the preset time length threshold, the panoramic shooting is stopped.
  • the embodiment of the present invention may further include: stopping the panoramic shooting when receiving the preset stop shooting instruction.
  • Step 801 Perform splicing processing on the image frame of the panoramic shooting according to the recorded trajectory information to obtain a panoramic captured image.
  • the splicing process of the image frame of the panoramic shooting according to the recorded trajectory information according to the recorded embodiment of the present invention includes:
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain a panoramic captured image.
  • conforming to the sorting rule means that the reference encoding method is sorted according to a fixed size or in a fixed coding order; it is assumed that the positive integers are 1, 2, 3, 4, 5, 6, 7, 8, ... N
  • the positive integer encodes the image frame, then if the panorama is taken, the camera moves The moving direction is always moved in the first direction, and the encoding of the image frames during the panoramic shooting is 1, 2, 3, 4, 5, 6, 7, 8, ... N; if the camera is moving in the first direction, Since the operation error is after the image frame numbered 5, it moves to a certain angle in the second direction opposite to the first direction, and thereafter returns to the movement in the first direction, assuming that the angle of the second direction moves corresponds to three images.
  • the encoding of the image frames in the panoramic shooting process is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5...N; after the encoding information that does not match the sorting rule is deleted, the sorting is met.
  • the regular coding information is: 1, 2, 3, 4, 5, 6, 7, 8, ... N; the splicing is performed by using the embodiment of the present invention, which avoids the unnatural splicing due to the change of the moving direction of the camera during the process of capturing the panoramic image. The situation improves the image quality of panoramic shooting.
  • Step 802 Display the panoramic captured image according to the moving angle of the terminal according to the encoded information of the stitched panoramic captured image.
  • the image when the panoramic captured image is displayed, the image may be panned according to the moving angle of the playing process; the ratio of the moving angle to the shooting angle may be 1, that is, when moving 1 degree, the panorama is The captured image is displayed in a 1 degree change; in the embodiment of the present invention, the cumulative change of the shooting angle is greater than 360 degrees, and the ratio of the moving angle to the shooting angle may be less than 1.
  • the general moving angle reaches 360 degrees, the panoramic shooting image of all shooting angles is completed.
  • the display; the ratio of the moving angle to the shooting angle can be adjusted according to the actual situation.
  • the ratio of the moving angle and the shooting angle is represented by the angle ratio, and the angle ratio may be adjusted according to the preset step size; wherein the preset step size may be a preset fixed value, for example, 0.05; Adjust the preset step size to obtain the desired angle ratio. You can modify the preset step size or determine the value of the angle ratio by manual input.
  • displaying the panoramic captured image according to the moving angle of the terminal includes:
  • the panoramic captured image is parsed according to the encoded information of the stitched panoramic captured image, and the parsed panoramic captured image is buffered, and the buffered analyzed panoramic captured image is read according to the terminal moving angle to display the panoramic captured image.
  • the display of the panoramic captured image generally includes the following steps: acquiring a panoramic captured image, analyzing the panoramic captured image, and outputting the panoramic captured image; after analyzing the panoramic captured image, the embodiment of the present invention caches the parsed panoramic captured image.
  • the cached data can be directly read, which improves the display efficiency; in addition, if the panoramic captured image is generated
  • the audio information is generated, and the audio information does not affect the implementation of the above process, and only the audio processing process needs to be added in the parsing to output process.
  • the recorded trajectory information of the embodiment of the invention reduces the time consumption of the splicing process, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.
  • FIG. 9 is a structural block diagram of an apparatus for implementing panoramic shooting according to an embodiment of the present invention. As shown in FIG. 9, the method includes: a recording unit and a splicing unit;
  • the recording unit is configured to record the shooting track information during the panoramic shooting by using the preset sensor
  • the recording unit is set to,
  • the shooting angle of each image frame during panoramic shooting is separately recorded by the gyro sensor, and the shooting angle of each image frame in the panoramic shooting is respectively converted into corresponding encoding information according to a preset encoding manner;
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information of the identified image frame is taken as the captured trajectory information.
  • the embodiment of the present invention further includes:
  • the control module is configured to: after detecting that the camera is turned on, according to the shooting track information, determining that the cumulative degree of change of the shooting angle of the camera in the first direction is greater than a preset trigger threshold, starting the panoramic shooting;
  • Starting the panoramic shooting includes: taking the first direction as the panoramic shooting starting from the moving direction of the camera.
  • the implementation threshold of the present invention may include at least one of a horizontal direction angle change threshold and a vertical direction angle change threshold.
  • the trigger threshold may be a horizontal direction angle change threshold.
  • the trigger threshold may be an angle between 3 and 20 degrees.
  • the size of the trigger threshold may be determined according to actual conditions. When the trigger threshold is small, the collected image frames are generally larger; the trigger threshold is larger. At the same time, fewer image frames are acquired.
  • the splicing unit is configured to splicing the image frames of the panoramic shooting according to the recorded trajectory information to obtain a panoramic captured image.
  • the apparatus of the embodiment of the present invention further includes: the direction processing unit is configured to
  • the shooting track information it is determined that the moving direction of the camera is a second direction different from the first direction in which the panoramic shooting is performed, and when the moving time length in the second direction is greater than or equal to the preset time length threshold, the panoramic shooting is stopped.
  • control module is further configured to stop panoramic shooting when receiving a preset stop shooting instruction.
  • the splicing unit is set to,
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain a panoramic captured image.
  • the matching order includes sorting according to a fixed size or sorting according to a fixed coding order; assuming a positive integer pair of positive integers 1, 2, 3, 4, 5, 6, 7, 8...N
  • the encoding of the image frames during the panoramic shooting is 1, 2, 3, 4, 5, 6, 7, 8...N If the camera moves in the first direction, after the image error of 5 in the operation direction, the camera moves to a certain angle in the second direction opposite to the first direction, and then returns to the movement in the first direction.
  • the coding order of the image frames during the panoramic shooting is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5...N;
  • the coding information that is inconsistent with the ordering rule is deleted, the coding information that meets the ordering rule is: 1, 2, 3, 4, 5, 6, 7, 8, ... N; splicing is performed by using the embodiment of the present invention, thereby avoiding shooting a panoramic image.
  • the direction of camera movement changes during the process This leads to unnatural splicing and improves the image quality of panoramic shooting.
  • the embodiment of the present invention further includes:
  • Cache display unit set to encode the image according to the encoded information of the stitched panoramic image
  • the captured image is displayed according to the moving angle of the terminal.
  • the image when the panoramic captured image is displayed, the image may be panned according to the moving angle of the playing process; the ratio of the moving angle to the shooting angle may be 1, that is, when moving 1 degree, the panorama is The captured image is displayed in a 1 degree change; in the embodiment of the present invention, the cumulative change of the shooting angle is greater than 360 degrees, and the ratio of the moving angle to the shooting angle may be less than 1.
  • the general moving angle reaches 360 degrees, the panoramic shooting image of all shooting angles is completed.
  • the display; the ratio of the moving angle to the shooting angle can be adjusted according to the actual situation.
  • the ratio of the moving angle and the shooting angle is represented by the angle ratio, and the angle ratio may be adjusted according to the preset step size; wherein the preset step size may be a preset fixed value, for example, 0.05; Adjust the preset step size to obtain the desired angle ratio. You can modify the preset step size or determine the value of the angle ratio by manual input.
  • the cache display unit is configured to parse the panoramic captured image according to the encoding information of the stitched panoramic captured image, and cache the parsed panoramic captured image, and read the cached parsed panoramic image according to the moving angle of the terminal. Image to display the panoramic shot image.
  • the display of the panoramic captured image generally includes the following steps: acquiring a panoramic captured image, analyzing the panoramic captured image, and outputting the panoramic captured image; after analyzing the panoramic captured image, the embodiment of the present invention caches the parsed panoramic captured image.
  • the cached data can be directly read, thereby improving the display efficiency.
  • audio information is generated when the panoramic captured image is generated, the audio information does not affect the implementation of the above process, and only needs to be parsed to output. Add audio processing to the process.
  • the recorded trajectory information of the embodiment of the invention reduces the time consumption of the splicing process, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.
  • the embodiment of the invention further provides an apparatus for realizing panoramic shooting, comprising: a recording unit, a direction processing unit, a splicing unit and a cache display unit; wherein
  • the recording unit is configured to record the shooting track information during the panoramic shooting by using the preset sensor
  • the recording unit is set to,
  • Each of the image frames corresponding to the panoramic shot is identified by each of the encoded information obtained by the conversion, and all the encoded information of the identified image frame is taken as the captured trajectory information.
  • the recording unit is further configured to:
  • the panoramic shooting After detecting that the camera is turned on, according to the shooting track information, when the cumulative degree of change of the shooting angle of the camera in the first direction is greater than the preset trigger threshold, the panoramic shooting is started;
  • Starting the panoramic shooting includes: taking the first direction as the panoramic shooting starting from the moving direction of the camera.
  • the implementation threshold of the present invention may include at least one of a horizontal direction angle change threshold and a vertical direction angle change threshold.
  • the trigger threshold may be a horizontal direction angle change threshold.
  • the trigger threshold may be an angle between 3 and 20 degrees.
  • the size of the trigger threshold may be determined according to actual conditions. When the trigger threshold is small, the collected image frames are generally larger; the trigger threshold is larger. At the same time, fewer image frames are acquired.
  • the splicing unit is configured to splicing the image frames of the panoramic shooting according to the recorded trajectory information to obtain a panoramic captured image.
  • the splicing unit is set to,
  • the image frames corresponding to the coding information conforming to the sorting rule are spliced to obtain a panoramic captured image.
  • the matching order includes sorting according to a fixed size or sorting according to a fixed coding order; assuming a positive integer pair of positive integers 1, 2, 3, 4, 5, 6, 7, 8...N
  • the encoding of the image frames during the panoramic shooting is 1, 2, 3, 4, 5, 6, 7, 8...N
  • the camera is moving in the first direction, due to operational errors
  • the image frame of number 5 it moves to a certain angle in a second direction opposite to the first direction, and then returns to the movement in the first direction, assuming that the angle of movement in the second direction corresponds to three image frames, and the panoramic shooting process
  • the coding order of the image frames is 1, 2, 3, 4, 5, 4, 3, 2, 3, 4, 5...N; after the coding information that does not match the ordering rule is deleted, the coding information conforming to the ordering rule is: 2, 3, 4, 5, 6, 7, 8...N; splicing is performed by using the embodiment of the present invention, which avoids the unnatural situation
  • the direction processing unit is configured to determine, according to the shooting track information, that the moving direction of the camera is a second direction different from the first direction in which the panoramic shooting is performed, and when the moving time in the second direction is less than the preset time threshold, continue the panoramic shooting;
  • the shooting track information determines that the camera moving direction is a second direction different from the first direction in which the panoramic shooting is performed, and when the motion duration in the second direction is greater than or equal to the preset time length threshold, the panoramic shooting is stopped.
  • the recording unit is further configured to stop panoramic shooting when receiving a preset stop shooting instruction.
  • the splicing unit is further configured to display the panoramic captured image according to the moving angle of the terminal according to the encoding information of the spliced panoramic captured image.
  • the image when the panoramic captured image is displayed, the image may be panned according to the moving angle of the playing process; the ratio of the moving angle to the shooting angle may be 1, that is, when moving 1 degree, the panorama is The captured image is displayed in a 1 degree change; in the embodiment of the present invention, the cumulative change of the shooting angle is greater than 360 degrees, and the ratio of the moving angle to the shooting angle may be less than 1.
  • the general moving angle reaches 360 degrees, the panoramic shooting image of all shooting angles is completed.
  • the display; the ratio of the moving angle to the shooting angle can be adjusted according to the actual situation.
  • the ratio of the moving angle and the shooting angle is represented by the angle ratio, and the angle ratio may be adjusted according to the preset step size; wherein the preset step size may be a preset fixed value, for example, 0.05; Adjust the preset step size to obtain the desired angle ratio. You can modify the preset step size or determine the value of the angle ratio by manual input.
  • the cache display unit is configured to parse the panoramic captured image according to the coding information of the stitched panoramic captured image, cache the parsed panoramic captured image, and read the buffered parsed panoramic captured image according to the terminal moving angle to capture the panoramic captured image. Display.
  • the display of the panoramic panoramic image generally includes the following processes: acquiring a panoramic captured image, analyzing the panoramic captured image, and outputting the panoramic captured image; in the embodiment of the present invention, after parsing the panoramic captured image, the parsed panoramic captured image is cached.
  • the cached data can be directly read, thereby improving the display efficiency; in addition, if audio information is generated when the panoramic captured image is generated, the audio information does not affect the implementation of the above process, and only needs to be resolved to Add audio processing to the output process.
  • the recorded trajectory information of the embodiment of the invention reduces the time consumption of the splicing process, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.
  • the embodiment of the invention further provides a mobile terminal, including:
  • the sensor is set to record the shooting track information when the panoramic shooting is performed
  • Memory set to store instructions
  • the processor is configured to, after receiving the shooting track information recorded by the sensor, execute the instruction to implement the step of implementing the panoramic shooting method as described in the foregoing embodiment.
  • the sensor includes a gyro sensor
  • the sensor may be disposed in the sensing unit 140 of the mobile terminal illustrated in FIG. 1; the memory may be the memory 160 of the mobile terminal illustrated in FIG. 1; the processor may be disposed in the controller of the mobile terminal illustrated in FIG. 180.
  • the embodiment of the invention further provides a computer readable storage medium, on which a computer program is stored, and when the computer program is executed by the processor, the steps of implementing the panoramic shooting method as described in the above embodiments are implemented.
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules, or other data. , removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media.
  • the embodiment of the invention reduces the time consumption of the splicing process by recording the trajectory information, avoids the unnaturalness of the splicing process, and improves the quality and user experience of the panoramic captured image.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

一种实现全景拍摄的方法及装置，包括：通过预设传感器记录全景拍摄时的拍摄轨迹信息；根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。

Description

一种实现全景拍摄的方法及装置 技术领域
本文涉及但不限于图像处理技术，尤指一种实现全景拍摄的方法及装置。
背景技术
全景拍摄就是以设定的一个点作为中心进行一定角度的拍摄(例如、进行水平360度的拍摄；或进行水平360度和垂直180度的拍摄)，将拍摄的多幅图片拼接成一张全景图像。拼接全景图像的基本原理是搜索两张图片的边缘部分，并将成像效果最为接近的区域加以重合，对非重合区域进行拼接以获得全景图像。
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本发明实施例提供一种实现全景拍摄的方法及装置，能够降低拼接过程的时间消耗，提高全景拍摄图像质量。
本发明实施例提供了一种实现全景拍摄的装置，包括：记录单元和拼接单元；其中，
记录单元设置为，通过预设传感器记录全景拍摄时的拍摄轨迹信息；
拼接单元设置为，根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
可选的，所述记录单元是设置为，
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识所述图像帧的所有编码信息作为所述拍摄轨迹信息。
可选的，所述装置还包括：方向处理单元设置为，
根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在所述第二方向的运动时长小于预设时长阈值时，继续所述全景拍摄；
根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于所述预设时长阈值时，停止所述全景拍摄。
可选的，所述拼接单元是设置为，
根据所述预设编码方式确定编码信息的排序规律；
确定与所述排序规律不符的编码信息，并删除与所述排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得所述全景拍摄图像。
可选的，所述装置还包括：
缓存显示单元，设置为根据拼接所述全景拍摄图像的编码信息对全景拍摄图像进行解析，缓存解析后的全景拍摄图像；根据终端移动角度读取缓存的所述解析后的全景拍摄图像，以对所述全景拍摄图像进行显示。
可选的，所述装置还包括：
控制模块，设置为检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
所述启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
可选的，所述预设的触发阈值包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。
可选的，所述控制模块，还设置为接收到预设的停止拍摄指令时，停止全景拍摄。
可选的，符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序。
另一方面，本发明实施例还提供一种实现全景拍摄的方法，包括：
通过预设传感器记录全景拍摄时的拍摄轨迹信息；
根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
可选的，所述通过预设传感器记录全景拍摄时的拍摄轨迹信息包括：
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识所述图像帧的所有编码信息作为所述拍摄轨迹信息。
可选的，所述方法还包括：
根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在所述第二方向的运动时长小于预设时长阈值时，继续所述全景拍摄；
根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于所述预设时长阈值时，停止所述全景拍摄。
可选的，所述根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理包括：
根据所述预设编码方式确定编码信息的排序规律；
确定与所述排序规律不符的编码信息，并删除与所述排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得所述全景拍摄图像。
可选的，所述方法还包括：
根据拼接所述全景拍摄图像的编码信息对全景拍摄图像进行解析，缓存解析后的全景拍摄图像；
根据终端移动角度读取缓存的所述解析后的全景拍摄图像，以对所述全景拍摄图像进行显示。
可选的，所述方法还包括：
检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
所述启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
可选的，所述预设的触发阈值包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。
可选的，所述方法还包括：
接收到预设的停止拍摄指令时，停止全景拍摄。
可选的，符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序。
本发明实施例还提供了一种移动终端，包括：
传感器，设置为记录全景拍摄时的拍摄轨迹信息；
存储器，设置为存储指令；
处理器，设置为当接收所述传感器记录的拍摄轨迹信息后，执行所述指令，实现如上所述的实现全景拍摄的步骤。
本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如上所述的全景拍摄的步骤。
本申请通过预设传感器记录全景拍摄时的拍摄轨迹信息；根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。本发明实施例通过记录的拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。
在阅读并理解了附图和详细描述后，可以明白其他方面。
附图概述
图1为实现本发明各个实施例的一可选移动终端的硬件结构示意图；
图2为本发明实施例的相机的主要电气结构的框图；
图3为本发明实施例实现全景拍摄的方法的流程图；
图4为本发明实施例陀螺仪传感器的工作坐标示意图；
图5为未删除图像帧的全景图像示意图；
图6为本发明实施例删除图像帧后的全景图像示意图；
图7为本发明实施例调整角度比值的示意图；
图8为本发明另一实施例实现全景拍摄的方法的流程图；
图9为本发明实施例实现全景拍摄的装置的结构框图。
本发明的实施方式
现在将参考附图描述实现本发明各个实施例的移动终端。在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明的说明，其本身并没有特定的意义。因此，"模块"与"部件"可以混合地使用。
移动终端可以以多种形式来实施。例如，本发明实施例中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下 面，假设终端是移动终端。然而，本领域技术人员将理解的是，除了特别用于移动目的的元件之外，根据本发明的实施方式的构造也能够应用于固定类型的终端。
图1为实现本发明各个实施例的一可选移动终端的硬件结构示意。
移动终端100可以包括A/V(音频/视频)输入单元120、用户输入单元130、感测单元140、输出单元150、存储器160、控制器180和电源单元190等等。图2示出了具有各种组件的移动终端，但是应理解的是，并不要求实施所有示出的组件。可以替代地实施更多或更少的组件。将在下面详细描述移动终端的元件。
A/V输入单元120设置为接收音频或视频信号。A/V输入单元120可以包括相机121，相机121对在视频捕获模式或图像捕获模式中由图像捕获装置获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元151上。经相机121处理后的图像帧可以存储在存储器160(或其它存储介质)中，可以根据移动终端的构造提供两个或更多相机1210。
用户输入单元130可以设置为根据用户输入的命令生成键输入数据以控制移动终端的各种操作。用户输入单元130允许用户输入各种类型的信息，并且可以包括键盘、锅仔片、触摸板(例如，检测由于被接触而导致的电阻、压力、电容等等的变化的触敏组件)、滚轮、摇杆等等。特别地，当触摸板以层的形式叠加在显示单元151上时，可以形成触摸屏。
感测单元140检测移动终端100的当前状态、移动终端100的位置、用户对于移动终端100的接触(即，触摸输入)的有无、移动终端100的取向、移动终端100的加速或减速移动和方向等等，并且生成用于控制移动终端100的操作的命令或信号。例如，当移动终端100实施为滑动型移动电话时，感测单元140可以感测该滑动型电话是打开还是关闭。另外，感测单元140能够检测电源单元190是否提供电力或者接口单元170是否与外部装置耦接。感测单元140可以包括陀螺仪传感器141。
输出单元150被构造为以视觉、音频和触觉方式中至少一种提供输出信号(例如，音频信号、视频信号、警报信号、振动信号等等)。输出单元150可以包括显示单元151。
显示单元151可以设置为显示在移动终端100中处理的信息。例如，当移动终端100处于电话通话模式时，显示单元151可以显示与通话或其它通信(例如，文本消息收发、多媒体文件下载等等)相关的用户界面(UI)或图形用户界面(GUI)。当移动终端100处于视频通话模式或者图像捕获模式时，显示单元151可以显示捕获的图像和接收的图像中至少一种、示出视频或图像以及相关功能的UI或GUI等等。
同时，当显示单元151和触摸板以层的形式彼此叠加以形成触摸屏时，显示单元151可以用作输入装置和输出装置。显示单元151可以包括液晶显示器(LCD)、薄膜晶体管LCD(TFT-LCD)、有机发光二极管(OLED)显示器、柔性显示器、三维(3D)显示器等等中的至少一种。这些显示器中的一些可以被构造为透明状以允许用户从外部观看，这可以称为透明显示器，典型的透明显示器可以例如为TOLED(透明有机发光二极管)显示器等等。根据特定想要的实施方式，移动终端100可以包括两个或更多显示单元(或其它显示装置)，例如，移动终端可以包括外部显示单元(未示出)和内部显示单元(未示出)。触摸屏可设置为检测触摸输入压力以及触摸输入位置和触摸输入面积。
存储器160可以设置为存储由控制器180执行的处理和控制操作的软件程序等等，或者可以暂时地存储己经输出或将要输出的数据(例如，电话簿、消息、静态图像、视频等等)。而且，存储器160可以存储关于当触摸施加到触摸屏时输出的各种方式的振动和音频信号的数据。
存储器160可以包括至少一种类型的存储介质，所述存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如，SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储器、磁盘、光盘等等。而且，移动终端100可以与通过网络连接执行存储器160的存储功能的网络存储装置协作。
控制器180通常设置为控制移动终端的总体操作。例如，控制器180执行与语音通话、数据通信、视频通话等等相关的控制和处理。控制器180可以设置为执行模式识别处理，以将在触摸屏上执行的手写输入或者图片绘 制输入识别为字符或图像。
电源单元190在控制器180的控制下接收外部电力或内部电力并且提供操作各元件和组件所需的适当的电力。
这里描述的各种实施方式可以以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施，这里描述的实施方式可以通过使用特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施，在一些情况下，这样的实施方式可以在控制器180中实施。对于软件实施，诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施，软件代码可以存储在存储器160中并且由控制器180执行。
至此，己经按照其功能描述了移动终端。下面，为了简要起见，将描述诸如折叠型、直板型、摆动型、滑动型移动终端等等的各种类型的移动终端中的滑动型移动终端作为示例。因此，本发明能够应用于任何类型的移动终端，并且不限于滑动型移动终端。
如图1中所示的移动终端100可以被构造为利用经由帧或分组发送数据的诸如有线和无线通信系统以及基于卫星的通信系统来操作。
图2为本发明实施例的相机的主要电气结构的框图。摄影镜头701由设置为形成被摄体像的多个光学镜头构成，是单焦点镜头或变焦镜头，其中在本实施例中，摄影镜头701为两个。摄影镜头701能够通过镜头驱动部711在光轴方向上移动，根据来自镜头驱动控制部712的控制信号，控制摄影镜头701的焦点位置，在变焦镜头的情况下，也控制焦点距离。镜头驱动控制电路712按照来自微型计算机707的控制命令进行镜头驱动部711的驱动控制。
在摄影镜头701的光轴上、由摄影镜头701形成被摄体像的位置附近配置有摄像元件702。摄像元件702发挥作为对被摄体像摄像并取得摄像图像数据的摄像部的功能。在摄像元件702上二维地呈矩阵状配置有构成各像素 的光电二极管。各光电二极管产生与受光量对应的光电转换电流，该光电转换电流由与各光电二极管连接的电容器进行电荷蓄积。各像素的前表面配置有拜耳排列的RGB滤色器。
摄像元件702与摄像电路703连接，该摄像电路703在摄像元件702中进行电荷蓄积控制和图像信号读出控制，对该读出的图像信号(模拟图像信号)降低重置噪声后进行波形整形，进而进行增益提高等以成为适当的信号电平。摄像电路703与模拟数字转换(A/D)转换部704连接，该A/D转换部704对模拟图像信号进行模数转换，向总线199输出数字图像信号(以下称之为图像数据)。
总线199设置为传送在相机的内部读出或生成的各种数据的传送路径。在总线199连接着上述A/D转换部704，此外还连接着图像处理器705、JPEG处理器706、微型计算机707、动态随机访问存储器(SDRAM，Synchronous DRAM)708、存储器接口(以下称之为存储器I/F)709、液晶显示器(LCD，Liquid Crystal Display)驱动器710。
图像处理器705对基于摄像元件702的输出的图像数据进行OB相减处理、白平衡调整、颜色矩阵运算、伽马转换、色差信号处理、噪声去除处理、同时化处理、边缘处理等各种图像处理。JPEG处理器706在将图像数据记录于记录介质715时，按照JPEG压缩方式压缩从SDRAM 708读出的图像数据。此外，JPEG处理器706为了进行图像再现显示而进行JPEG图像数据的解压缩。进行解压缩时，读出记录在记录介质715中的文件，在JPEG处理器706中实施了解压缩处理后，将解压缩的图像数据暂时存储于SDRAM 708中并在LCD716上进行显示。另外，在本实施例中，作为图像压缩解压缩方式采用的是JPEG方式，然而压缩解压缩方式不限于此，当然可以采用MPEG、TIFF、H.264等其他的压缩解压缩方式。
微型计算机707发挥作为该相机整体的控制部的功能，统一控制相机的各种处理序列。微型计算机707连接着操作单元713和闪存714。
操作单元713包括实体按键或者虚拟按键，该实体或虚拟按键可以为电源按钮、拍照键、编辑按键、动态图像按钮、再现按钮、菜单按钮、十字键、OK按钮、删除按钮、放大按钮等各种输入按钮和各种输入键等操作部 材，检测这些操作部材的操作状态。
将检测结果向微型计算机707输出。此外，在作为显示部的LCD716的前表面设有触摸面板，检测用户的触摸位置，将该触摸位置向微型计算机707输出。微型计算机707根据来自操作单元713的操作部材的检测结果，执行与用户的操作对应的各种处理序列。同样，此处可以是计算机707根据LCD716前面的触摸面板的检测结果，执行与用户的操作对应的各种处理序列。)
闪存714设置为存储用于执行微型计算机707的各种处理序列的程序。微型计算机707根据该程序进行相机整体的控制。此外，闪存714存储相机的各种调整值，微型计算机707读出调整值，按照该调整值进行相机的控制。
SDRAM 708是设置为对图像数据等进行暂时存储的可电改写的易失性存储器。该SDRAM708暂时存储从A/D转换部704输出的图像数据和在图像处理器705、JPEG处理器706等中进行了处理后的图像数据。
存储器接口709与记录介质715连接，进行将图像数据和附加在图像数据中的文件头等数据写入记录介质715和从记录介质715中读出的控制。记录介质715例如为能够在相机主体上自由拆装的存储器卡等记录介质，然而不限于此，也可以是内置在相机主体中的硬盘等。
LCD驱动器710与LCD716连接，将由图像处理器705处理后的图像数据存储于SDRAM，需要显示时，读取SDRAM存储的图像数据并在LCD716上显示，或者，JPEG处理器706压缩过的图像数据存储于SDRAM，在需要显示时，JPEG处理器706读取SDRAM的压缩过的图像数据，再进行解压缩，将解压缩后的图像数据通过LCD716进行显示。
LCD716配置在相机主体的背面等上，进行图像显示。该LCD716设有检测用户的触摸操作的触摸面板。另外，作为显示部，在本实施例中配置的是液晶表示面板(LCD716)，然而不限于此，也可以采用有机EL等各种显示面板。
基于上述移动终端硬件结构以及相机，提出本发明方法各个实施例。
前述背景技术部分提到，全景图像的拼接之前需要将成像效果最为接近的区域加以重合，其实现主要通过特征匹配技术实现，特征匹配耗时，拼接过程长；另外，在连接区域采用特征匹配进行拼接时，若特征匹配精度低会造成连接区不自然，影响了全景拍摄图像的质量。
图3为本发明实施例实现全景拍摄的方法的流程图，如图3所示，包括：
步骤300、通过预设传感器记录全景拍摄时的拍摄轨迹信息；
可选的，本发明实施例，通过预设传感器记录全景拍摄时的拍摄轨迹信息包括：
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识图像帧的所有编码信息作为拍摄轨迹信息。
可选的，本发明实施例还包括：
检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
其中，启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
需要说明的是，本发明实施触发阈值可以包括水平方向角度变化阈值和垂直方向的角度变化阈值中的至少一个。图4为本发明实施例陀螺仪传感器的工作坐标示意图，如图4所示，X轴表示水平方向，Y轴表示垂直方向。以围绕中心M(Middle)进行360度拍摄为例，触发阈值可以是水平方向角度变化阈值。这里，本发明实施例触发阈值可以是3度～20度之间的一个角度值，触发阈值的大小可以根据实际情况进行确定，触发阈值较小时，采集的图像帧一般较多；触发阈值较大时，采集的图像帧比较少。
步骤301、根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处 理，以获得全景拍摄图像。
可选的，本发明实施例方法还包括：
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在第二方向的运动时长小于预设时长阈值时，继续全景拍摄；
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于预设时长阈值时，停止全景拍摄。
可选的，本发明实施例还可以包括：接收到预设的停止拍摄指令时，停止全景拍摄。
可选的，根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理包括：
根据预设编码方式确定编码信息的排序规律；
确定与排序规律不符的编码信息，删除与排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得上述全景拍摄图像。
需要说明的是，符合排序规律是指参照编码方式按照固定的大小排序、或按照固定的编码顺序进行排序；假设按照正整数1、2、3、4、5、6、7、8……N的正整数对图像帧进行编码，如果全景拍摄时，摄像头移动方向一直沿第一方向移动，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、6、7、8……N；如果摄像头在向第一方向移动过程中，由于操作上的失误在编号为5的图像帧之后，向第一方向相反的第二方向移动了一定角度，并在此后恢复为第一方向的移动，假设第二方向移动的角度对应三个图像帧，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、4、3、2、3、4、5……N；图5为未删除图像帧的全景图像示意图，如图5所示，图中除标号为1的图像帧为完整图像外，第二帧图像与第一帧图像不重合的部分通过编号为2的矩形表示；同理，第三帧图像与第二帧图像不重合的部 分通过编号为3的矩形表示；第四帧图像与第三帧图像不重合的部分通过编号为4的矩形表示；第五帧图像与第四帧图像不重合的部分通过编号为5的矩形表示；由于，摄像头向第二方向移动了三个图像帧，后续拼接按照编码排序显示的应该是编号5的矩形、编号4的矩形、编号3的矩形；然后摄像头恢复第一方向的运动后，继续编号3的矩形、编号4的矩形、编号5的矩形；图6为本发明实施例删除图像帧后的全景图像示意图，如图6所示，图中除标号为1的图像帧为完整图像外，第二帧图像与第一帧图像不重合的部分通过编号为2的矩形表示；第三帧图像与第二帧图像不重合的部分通过编号为3的矩形表示；第四帧图像与第三帧图像不重合的部分通过编号为4的矩形表示；第五帧图像与第四帧图像不重合的部分通过编号为5的矩形表示；由于与排序规律不符的编码信息后，删除了与排序规律不符的编码信息所对应的图像帧，因此，进行删除处理后，编码信息为符合排序规律的：1、2、3、4、5、6、7、8……N；即拼接编号5的部分之后，继续拼接通过编号为6的矩形表示的第六帧图像与第五帧图像不重合的部分，通过编号为7的矩形表示的第七帧图像与第六帧图像不重合的部分……。采用本发明实施例方式进行拼接，避免了拍摄全景图像过程中由于摄像头移动方向发生变化导致拼接不自然的情况，提升了全景拍摄的图像质量。
可选的，本发明实施例还包括：
根据拼接全景拍摄图像的编码信息，对全景拍摄图像根据终端移动角度进行显示。
需要说明的是，本发明实施例，进行全景拍摄图像的显示时，可以根据播放过程的移动角度全景拍摄图像的播放；移动角度与拍摄角度的比值可以是1，即移动1度时，对全景拍摄图像进行1度的变化显示；本发明实施例拍摄角度累计变化大于360度，则移动角度与拍摄角度的比值可以小于1，一般的移动角度达到360度时要完成所有拍摄角度的全景拍摄图像的显示；移动角度和拍摄角度的比值可以根据实际情况进行调整。图7为本发明实施例调整角度比值的示意图，如图7所示，角度比值表示的是移动角度和拍摄角度的比值，通过正立的三角形虚拟按键可以按照预设步长增大角度比值；通过倒立的三角形虚拟按键可以按照预设步长减小角度比值；这里 预设步长可以是预先设定的一个固定值，例如、0.05；如果无法通过预设步长的调整获得所需的角度比值，可以修改预设步长或通过手动输入的方式确定角度比值的数值大小。
可选的，本发明实施例方法还包括：
根据拼接全景拍摄图像的编码信息对全景拍摄图像进行解析，缓存解析后的全景拍摄图像，根据终端移动角度读取缓存的解析后的全景拍摄图像，以对全景拍摄图像进行显示。
需要说明的是，全景拍摄图像的显示一般包括以下流程：获取全景拍摄图像、解析全景拍摄图像、输出全景拍摄图像；本发明实施例在解析全景拍摄图像后，对解析的全景拍摄图像进行缓存，在进行显示时，直接读取缓存数据即可，提高了显示效率；另外，如果在生成全景拍摄图像时还生成了音频信息，则音频信息并不影响上述过程的实施，只需要在解析到输出过程中加入音频处理过程即可。
本发明实施例通过记录的拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。
图8为本发明另一实施例实现全景拍摄的方法的流程图，如图8所示，包括：
步骤800、通过预设传感器记录全景拍摄时的拍摄轨迹信息；
可选的，通过预设传感器记录全景拍摄时的拍摄轨迹信息包括：
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识图像帧的所有编码信息作为拍摄轨迹信息。
可选的，本发明实施例还包括：
检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍 摄。
需要说明的是，本发明实施触发阈值可以包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。以围绕M进行360度拍摄为例，触发阈值可以是水平方向角度变化阈值。这里，触发阈值可以是3度～20度之间的一个角度值，触发阈值的大小可以根据实际情况进行确定，触发阈值较小时，采集的图像帧一般较多；触发阈值较大时，采集的图像帧比较少。
可选的，本发明实施例方法还包括：
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在第二方向的运动时长小于预设时长阈值时，继续全景拍摄；
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于预设时长阈值时，停止全景拍摄。
可选的，本发明实施例还可以包括：接收到预设的停止拍摄指令时，停止全景拍摄。
步骤801、根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
可选的，本发明实施例根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理包括：
根据预设编码方式确定编码信息的排序规律；
确定与排序规律不符的编码信息，并删除与排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得全景拍摄图像。
需要说明的是，符合排序规律是指参照编码方式按照固定的大小排序、或按照固定的编码顺序进行排序；假设按照正整数1、2、3、4、5、6、7、8……N的正整数对图像帧进行编码，则如果全景拍摄时，摄像头移 动方向一直沿第一方向移动，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、6、7、8……N；如果摄像头在向第一方向移动过程中，由于操作上的失误在编号为5的图像帧之后，向第一方向相反的第二方向移动了一定角度，并在此后恢复为第一方向的移动，假设第二方向移动的角度对应三个图像帧，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、4、3、2、3、4、5……N；删除与排序规律不符的编码信息后，符合排序规律编码信息为：1、2、3、4、5、6、7、8……N；采用本发明实施例方式进行拼接，避免了拍摄全景图像过程中由于摄像头移动方向发生变化导致拼接不自然的情况，提升了全景拍摄的图像质量。
步骤802、根据拼接全景拍摄图像的编码信息，对全景拍摄图像根据终端移动角度进行显示。
需要说明的是，本发明实施例，进行全景拍摄图像的显示时，可以根据播放过程的移动角度全景拍摄图像的播放；移动角度与拍摄角度的比值可以是1，即移动1度时，对全景拍摄图像进行1度的变化显示；本发明实施例拍摄角度累计变化大于360度，则移动角度与拍摄角度的比值可以小于1，一般的移动角度达到360度时要完成所有拍摄角度的全景拍摄图像的显示；移动角度和拍摄角度的比值可以根据实际情况进行调整。本发明实施例以角度比值表示的是移动角度和拍摄角度的比值，可以按照预设步长调整角度比值；这里预设步长可以是预先设定的一个固定值，例如、0.05；如果无法通过预设步长的调整获得所需的角度比值，可以修改预设步长或通过手动输入的方式确定角度比值的数值大小。
可选的，对全景拍摄图像根据终端移动角度进行显示包括：
根据拼接全景拍摄图像的编码信息对全景拍摄图像进行解析，缓存解析后的全景拍摄图像，根据终端移动角度读取缓存的解析后的全景拍摄图像，以对全景拍摄图像进行显示。
需要说明的是，全景拍摄图像的显示一般包括以下流程：获取全景拍摄图像、解析全景拍摄图像、输出全景拍摄图像；本发明实施例在解析全景拍摄图像后，对解析的全景拍摄图像进行缓存，在进行显示时，直接读取缓存数据即可，提高了显示效率；另外，如果在生成全景拍摄图像时还 生成了音频信息，则音频信息并不影响上述过程的实施，只需要在解析到输出过程中加入音频处理过程即可。
本发明实施例通过记录的拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。
图9为本发明实施例实现全景拍摄的装置的结构框图，如图9所示，包括：记录单元和拼接单元；其中，
记录单元设置为，通过预设传感器记录全景拍摄时的拍摄轨迹信息；
可选的，记录单元是设置为，
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识图像帧的所有编码信息作为拍摄轨迹信息。
可选的，本发明实施例还包括：
控制模块，设置为检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
需要说明的是，本发明实施触发阈值可以包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。以围绕M进行360度拍摄为例，触发阈值可以是水平方向角度变化阈值。这里，本发明实施例触发阈值可以是3度～20度之间的一个角度值，触发阈值的大小可以根据实际情况进行确定，触发阈值较小时，采集的图像帧一般较多；触发阈值较大时，采集的图像帧比较少。
拼接单元设置为，根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
可选的，本发明实施例装置还包括：方向处理单元设置为，
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在第二方向的运动时长小于预设时长阈值时，继续全景拍摄；
根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于预设时长阈值时，停止全景拍摄。
可选的，所述控制模块，还设置为接收到预设的停止拍摄指令时，停止全景拍摄。
可选的，拼接单元是设置为，
根据预设编码方式确定编码信息的排序规律；
确定与排序规律不符的编码信息，并删除与排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得全景拍摄图像。
需要说明的是，符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序；假设按照正整数1、2、3、4、5、6、7、8……N的正整数对图像帧进行编码，则如果全景拍摄时，摄像头移动方向一直沿第一方向移动，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、6、7、8……N；如果摄像头在向第一方向移动过程中，由于操作上的失误在编号为5的图像帧之后，向第一方向相反的第二方向移动了一定角度，并在此后恢复为第一方向的移动，假设第二方向移动的角度对应三个图像帧，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、4、3、2、3、4、5……N；删除与排序规律不符的编码信息后，符合排序规律编码信息为：1、2、3、4、5、6、7、8……N；采用本发明实施例方式进行拼接，避免了拍摄全景图像过程中由于摄像头移动方向发生变化导致拼接不自然的情况，提升了全景拍摄的图像质量。
可选的，本发明实施例还包括：
缓存显示单元，设置为根据拼接全景拍摄图像的编码信息，对全景拍 摄图像根据终端移动角度进行显示。
需要说明的是，本发明实施例，进行全景拍摄图像的显示时，可以根据播放过程的移动角度全景拍摄图像的播放；移动角度与拍摄角度的比值可以是1，即移动1度时，对全景拍摄图像进行1度的变化显示；本发明实施例拍摄角度累计变化大于360度，则移动角度与拍摄角度的比值可以小于1，一般的移动角度达到360度时要完成所有拍摄角度的全景拍摄图像的显示；移动角度和拍摄角度的比值可以根据实际情况进行调整。本发明实施例以角度比值表示的是移动角度和拍摄角度的比值，可以按照预设步长调整角度比值；这里预设步长可以是预先设定的一个固定值，例如、0.05；如果无法通过预设步长的调整获得所需的角度比值，可以修改预设步长或通过手动输入的方式确定角度比值的数值大小。
可选的，所述缓存显示单元，是设置为根据拼接全景拍摄图像的编码信息排序对全景拍摄图像进行解析，缓存解析后的全景拍摄图像，根据终端移动角度读取缓存的解析后的全景拍摄图像，以对全景拍摄图像进行显示。
需要说明的是，全景拍摄图像的显示一般包括以下流程：获取全景拍摄图像、解析全景拍摄图像、输出全景拍摄图像；本发明实施例在解析全景拍摄图像后，对解析的全景拍摄图像进行缓存，在进行显示时，直接读取缓存数据即可，提高了显示效率；另外，如果在生成全景拍摄图像时还生成了音频信息，则音频信息并不影响上述过程的实施，只需要在解析到输出过程中加入音频处理过程即可。
本发明实施例通过记录的拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。
本发明实施例还提供了一种实现全景拍摄的装置，包括：记录单元、方向处理单元、拼接单元和缓存显示单元；其中，
记录单元设置为，通过预设传感器记录全景拍摄时的拍摄轨迹信息；
可选的，记录单元是设置为，
通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全 景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识图像帧的所有编码信息作为拍摄轨迹信息。
可选的，记录单元还设置为：
检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
需要说明的是，本发明实施触发阈值可以包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。以围绕M进行360度拍摄为例，触发阈值可以是水平方向角度变化阈值。这里，本发明实施例触发阈值可以是3度～20度之间的一个角度值，触发阈值的大小可以根据实际情况进行确定，触发阈值较小时，采集的图像帧一般较多；触发阈值较大时，采集的图像帧比较少。
拼接单元设置为，根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
可选的，拼接单元是设置为，
根据预设编码方式确定编码信息的排序规律；
确定与排序规律不符的编码信息，并删除与排序规律不符的编码信息所对应的图像帧；
对符合排序规律的编码信息对应的图像帧进行拼接，获得全景拍摄图像。
需要说明的是，符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序；假设按照正整数1、2、3、4、5、6、7、8……N的正整数对图像帧进行编码，则如果全景拍摄时，摄像头移动方向一直沿第一方向移动，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、6、7、8……N；如果摄像头在向第一方向移动过程中，由于操作上的失误在编 号为5的图像帧之后，向第一方向相反的第二方向移动了一定角度，并在此后恢复为第一方向的移动假设第二方向移动的角度对应三个图像帧，则全景拍摄过程中图像帧的编码排序为1、2、3、4、5、4、3、2、3、4、5……N；删除与排序规律不符的编码信息后，符合排序规律编码信息为：1、2、3、4、5、6、7、8……N；采用本发明实施例方式进行拼接，避免了拍摄全景图像过程中由于摄像头移动方向发生变化导致拼接不自然的情况，提升了全景拍摄的图像质量。
方向处理单元设置为，根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在第二方向的运动时长小于预设时长阈值时，继续全景拍摄；根据拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于预设时长阈值时，停止全景拍摄。
可选的，所述记录单元还设置为，接收到预设的停止拍摄指令时，停止全景拍摄。
可选的，所述拼接单元还设置为，根据拼接全景拍摄图像的编码信息，对全景拍摄图像根据终端移动角度进行显示。
需要说明的是，本发明实施例，进行全景拍摄图像的显示时，可以根据播放过程的移动角度全景拍摄图像的播放；移动角度与拍摄角度的比值可以是1，即移动1度时，对全景拍摄图像进行1度的变化显示；本发明实施例拍摄角度累计变化大于360度，则移动角度与拍摄角度的比值可以小于1，一般的移动角度达到360度时要完成所有拍摄角度的全景拍摄图像的显示；移动角度和拍摄角度的比值可以根据实际情况进行调整。本发明实施例以角度比值表示的是移动角度和拍摄角度的比值，可以按照预设步长调整角度比值；这里预设步长可以是预先设定的一个固定值，例如、0.05；如果无法通过预设步长的调整获得所需的角度比值，可以修改预设步长或通过手动输入的方式确定角度比值的数值大小。
缓存显示单元，设置为根据拼接全景拍摄图像的编码信息排序对全景拍摄图像进行解析，缓存解析后的全景拍摄图像，根据终端移动角度读取缓存的解析后的全景拍摄图像，以对全景拍摄图像进行显示。
需要说明的是，中全景拍摄图像的显示一般包括以下流程：获取全景拍摄图像、解析全景拍摄图像、输出全景拍摄图像；本发明实施例在解析全景拍摄图像后，对解析的全景拍摄图像进行缓存，在进行显示时，直接读取缓存数据即可，提高了显示效率；另外，如果在生成全景拍摄图像时还生成了音频信息，则音频信息并不影响上述过程的实施，只需要在解析到输出过程中加入音频处理过程即可。
本发明实施例通过记录的拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。
本发明实施例还提供了一种移动终端，包括：
传感器，设置为记录全景拍摄时的拍摄轨迹信息；
存储器，设置为存储指令；
处理器，设置为当接收所述传感器记录的拍摄轨迹信息后，执行所述指令，实现如上实施例所述的实现全景拍摄方法的步骤。
所述传感器包括陀螺仪传感器；
所述传感器可设置在图1所述移动终端的感测单元140中；所述存储器可为图1所述移动终端的存储器160；所述处理器可设置在图1所述移动终端的控制器180中。
本发明实施例还提供了一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现如上实施例所述的实现全景拍摄方法的步骤。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分 不一定对应于物理单元的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
虽然本发明所揭露的实施方式如上，但所述的内容仅为便于理解本发明而采用的实施方式，并非用以限定本发明。任何本发明所属领域内的技术人员，在不脱离本发明所揭露的精神和范围的前提下，可以在实施的形式及细节上进行任何的修改与变化，但本发明的专利保护范围，仍须以所附的权利要求书所界定的范围为准。
工业实用性
本发明实施例通过记录拍摄轨迹信息，降低了拼接过程的时间消耗，避免了拼接过程的不自然，提升了全景拍摄图像的质量和用户体验。

Claims (20)

  1. 一种实现全景拍摄的装置，包括：记录单元和拼接单元；其中，
    记录单元设置为，通过预设传感器记录全景拍摄时的拍摄轨迹信息；
    拼接单元设置为，根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
  2. 根据权利要求1所述的装置，其中，所述记录单元是设置为，
    通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
    利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧，将标识所述图像帧的所有编码信息作为所述拍摄轨迹信息。
  3. 根据权利要求1所述的装置，所述装置还包括：方向处理单元设置为，
    根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在所述第二方向的运动时长小于预设时长阈值时，继续所述全景拍摄；
    根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于所述预设时长阈值时，停止所述全景拍摄。
  4. 根据权利要求2或3所述的装置，其中，所述拼接单元是设置为，
    根据所述预设编码方式确定编码信息的排序规律；
    确定与所述排序规律不符的编码信息，并删除与所述排序规律不符的编码信息所对应的图像帧；
    对符合排序规律的编码信息对应的图像帧进行拼接，获得所述全景拍摄图像。
  5. 根据权利要求4所述的装置，所述装置还包括：
    缓存显示单元，设置为根据拼接所述全景拍摄图像的编码信息对全景 拍摄图像进行解析，缓存解析后的全景拍摄图像；根据终端移动角度读取缓存的所述解析后的全景拍摄图像，以对所述全景拍摄图像进行显示。
  6. 根据权利要求3所述的装置，所述装置还包括：
    控制模块，设置为检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
    所述启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
  7. 根据权利要求6所述的装置，其中，
    所述预设的触发阈值包括水平方向角度变化阈值和垂直方向的角度变化阈值中至少一个。
  8. 根据权利要求6所述的装置，
    所述控制模块，还设置为接收到预设的停止拍摄指令时，停止全景拍摄。
  9. 根据权利要求4所述的装置，其中，
    符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序。
  10. 一种实现全景拍摄的方法，包括：
    通过预设传感器记录全景拍摄时的拍摄轨迹信息；
    根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理，以获得全景拍摄图像。
  11. 根据权利要求10所述的方法，其中，所述通过预设传感器记录全景拍摄时的拍摄轨迹信息包括：
    通过陀螺仪传感器分别记录全景拍摄时每一图像帧的拍摄角度，将全景拍摄时每一图像帧的拍摄角度按照预设编码方式分别转换为对应的编码信息；
    利用转换获得的每一个编码信息标识全景拍摄对应的每一个图像帧， 将标识所述图像帧的所有编码信息作为所述拍摄轨迹信息。
  12. 根据权利要求10所述的方法，所述方法还包括：
    根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向相异的第二方向，且在所述第二方向的运动时长小于预设时长阈值时，继续所述全景拍摄；
    根据所述拍摄轨迹信息确定摄像头运动方向为与进行全景拍摄的第一方向不同的第二方向，且在第二方向的运动时长大于或等于所述预设时长阈值时，停止所述全景拍摄。
  13. 根据权利要求11或12所述的方法，其中，所述根据记录的拍摄轨迹信息对全景拍摄的图像帧进行拼接处理包括：
    根据所述预设编码方式确定编码信息的排序规律；
    确定与所述排序规律不符的编码信息，并删除与所述排序规律不符的编码信息所对应的图像帧；
    对符合排序规律的编码信息对应的图像帧进行拼接，获得所述全景拍摄图像。
  14. 根据权利要求13所述的方法，所述方法还包括：
    根据拼接所述全景拍摄图像的编码信息对全景拍摄图像进行解析，缓存解析后的全景拍摄图像；
    根据终端移动角度读取缓存的所述解析后的全景拍摄图像，以对所述全景拍摄图像进行显示。
  15. 根据权利要求12所述的方法，所述方法还包括：
    检测到开启摄像头后，根据拍摄轨迹信息确定摄像头的拍摄角度在第一方向的累计变化度数大于预设的触发阈值时，启动全景拍摄；
    所述启动全景拍摄包括：按照第一方向作为摄像头移动方向开始的全景拍摄。
  16. 根据权利要求15所述的方法，其中，
    所述预设的触发阈值包括水平方向角度变化阈值和垂直方向的角度变 化阈值中至少一个。
  17. 根据权利要求15所述的方法，所述方法还包括：
    接收到预设的停止拍摄指令时，停止全景拍摄。
  18. 根据权利要求13所述的方法，其中，
    符合排序规律包括按照固定的大小排序、或按照固定的编码顺序进行排序。
  19. 一种移动终端，包括：
    传感器，设置为记录全景拍摄时的拍摄轨迹信息；
    存储器，设置为存储指令；
    处理器，设置为当接收所述传感器记录的拍摄轨迹信息后，执行所述指令，实现如权利要求10至18任意一项所述的实现全景拍摄的步骤。
  20. 一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现权利要求10至18中任意一项所述的全景拍摄的步骤。
PCT/CN2017/101125 2016-10-28 2017-09-08 一种实现全景拍摄的方法及装置 WO2018076941A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610962352.4A CN108012073B (zh) 2016-10-28 2016-10-28 一种实现全景拍摄的方法及装置
CN201610962352.4 2016-10-28

Publications (1)

Publication Number Publication Date
WO2018076941A1 true WO2018076941A1 (zh) 2018-05-03

Family

ID=62024342

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/101125 WO2018076941A1 (zh) 2016-10-28 2017-09-08 一种实现全景拍摄的方法及装置

Country Status (2)

Country Link
CN (1) CN108012073B (zh)
WO (1) WO2018076941A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110874699A (zh) * 2018-08-31 2020-03-10 杭州海康机器人技术有限公司 记录物品的物流信息方法、装置及系统
CN112683244A (zh) * 2020-12-18 2021-04-20 广东电网有限责任公司 一种基于全景照片的电缆通道定位方法及系统
CN114827472A (zh) * 2022-04-29 2022-07-29 北京城市网邻信息技术有限公司 全景拍摄方法、装置、电子设备及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114007056A (zh) * 2021-10-28 2022-02-01 幻境虚拟现实科技(广州)有限公司 一种立体全景图像的生成方法和装置
CN114945088A (zh) * 2022-05-11 2022-08-26 北京有竹居网络技术有限公司 三维模型生成方法、装置、拍摄终端和终端设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120026283A1 (en) * 2010-07-30 2012-02-02 Samsung Electronics Co., Ltd. Method and apparatus for photographing a panoramic image
CN102420898A (zh) * 2011-09-27 2012-04-18 惠州Tcl移动通信有限公司 一种基于手机的全景照相实现方法及手机
CN102957868A (zh) * 2011-08-24 2013-03-06 宏达国际电子股份有限公司 拍摄全景图的方法与电子装置
CN103176347A (zh) * 2011-12-22 2013-06-26 百度在线网络技术（北京）有限公司 全景图拍摄方法及拍摄装置和电子设备
CN103795924A (zh) * 2014-02-07 2014-05-14 宇龙计算机通信科技(深圳)有限公司 全景拍照装置及方法
CN104660897A (zh) * 2013-11-20 2015-05-27 浪潮乐金数字移动通信有限公司 基于移动终端的360度全景图像获取方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070081081A1 (en) * 2005-10-07 2007-04-12 Cheng Brett A Automated multi-frame image capture for panorama stitching using motion sensor
CN102207674A (zh) * 2010-03-30 2011-10-05 鸿富锦精密工业（深圳）有限公司 全景图像拍摄装置及方法
JP5005080B2 (ja) * 2010-09-06 2012-08-22 キヤノン株式会社 パノラマ画像の生成方法
CN105120155A (zh) * 2015-08-21 2015-12-02 小米科技有限责任公司 全景照片的生成方法及装置
CN105262948B (zh) * 2015-10-14 2018-06-29 广东欧珀移动通信有限公司 一种全景拍摄方法及移动终端
CN105847673B (zh) * 2016-03-21 2019-05-14 Oppo广东移动通信有限公司 照片显示方法、装置和移动终端
CN105847851A (zh) * 2016-04-19 2016-08-10 北京金山安全软件有限公司 全景视频直播方法、装置和系统以及视频源控制设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120026283A1 (en) * 2010-07-30 2012-02-02 Samsung Electronics Co., Ltd. Method and apparatus for photographing a panoramic image
CN102957868A (zh) * 2011-08-24 2013-03-06 宏达国际电子股份有限公司 拍摄全景图的方法与电子装置
CN102420898A (zh) * 2011-09-27 2012-04-18 惠州Tcl移动通信有限公司 一种基于手机的全景照相实现方法及手机
CN103176347A (zh) * 2011-12-22 2013-06-26 百度在线网络技术（北京）有限公司 全景图拍摄方法及拍摄装置和电子设备
CN104660897A (zh) * 2013-11-20 2015-05-27 浪潮乐金数字移动通信有限公司 基于移动终端的360度全景图像获取方法
CN103795924A (zh) * 2014-02-07 2014-05-14 宇龙计算机通信科技(深圳)有限公司 全景拍照装置及方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110874699A (zh) * 2018-08-31 2020-03-10 杭州海康机器人技术有限公司 记录物品的物流信息方法、装置及系统
CN110874699B (zh) * 2018-08-31 2024-02-09 杭州海康机器人股份有限公司 记录物品的物流信息方法、装置及系统
CN112683244A (zh) * 2020-12-18 2021-04-20 广东电网有限责任公司 一种基于全景照片的电缆通道定位方法及系统
CN112683244B (zh) * 2020-12-18 2023-01-24 广东电网有限责任公司 一种基于全景照片的电缆通道定位方法及系统
CN114827472A (zh) * 2022-04-29 2022-07-29 北京城市网邻信息技术有限公司 全景拍摄方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN108012073B (zh) 2020-05-19
CN108012073A (zh) 2018-05-08

Similar Documents

Publication Publication Date Title
WO2018076941A1 (zh) 一种实现全景拍摄的方法及装置
CN107690649B (zh) 数字拍摄装置及其操作方法
WO2017107629A1 (zh) 移动终端、数据传输系统及移动终端拍摄方法
KR101278335B1 (ko) 휴대용 전기 장치, 그에 적용된 듀얼 이미지 캡처링 방법, 및 그에 로드된 컴퓨터 프로그램 제품
US10484602B2 (en) Camera arrangements for wide-angle imaging
WO2017088678A1 (zh) 长曝光全景图像拍摄装置和方法
WO2017221659A1 (ja) 撮像装置、表示装置、及び撮像表示システム
WO2017054704A1 (zh) 生成视频图片的方法及装置
KR20190017113A (ko) 미러를 회전 시킬수 있는 구동 장치를 포함하는 카메라를 이용하여 이미지를 획득하는 방법 및 전자 장치
JP5383356B2 (ja) 撮像装置、情報処理装置、撮像装置の制御方法、情報処理装置の制御方法、及びコンピュータプログラム
WO2017118353A1 (zh) 显示视频文件的装置及方法
WO2017088609A1 (zh) 图像去噪装置和方法
WO2017088714A1 (zh) 移动终端及其三维形象的生成方法
US20130286250A1 (en) Method And Device For High Quality Processing Of Still Images While In Burst Mode
US20170111574A1 (en) Imaging apparatus and imaging method
WO2017054677A1 (zh) 移动终端拍摄系统和移动终端拍摄方法
US11689819B2 (en) Techniques for capturing video in landscape mode by a handheld device
US20150029224A1 (en) Imaging apparatus, control method and program of imaging apparatus, and recording medium
JP2005348212A (ja) 撮像装置
JP4748442B2 (ja) 撮像装置及びそのプログラム
JP2018007041A (ja) 撮像装置、表示装置、及び撮像表示システム
JP7215414B2 (ja) 表示制御装置、撮像装置及び表示制御方法
JP2004112550A (ja) 撮像装置、カメラ、プログラム及び記録媒体
JP2017046160A (ja) 画像処理装置、その制御方法、および制御プログラム、並びに記憶媒体
US8928764B2 (en) Method and device for correcting user's hand tremor in imaging device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17863665

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 27.09.2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17863665

Country of ref document: EP

Kind code of ref document: A1