WO2019169840A1 - Photographing method, photographing apparatus and photographing system - Google Patents

Photographing method, photographing apparatus and photographing system Download PDF

Info

Publication number
WO2019169840A1
WO2019169840A1 PCT/CN2018/104013 CN2018104013W WO2019169840A1 WO 2019169840 A1 WO2019169840 A1 WO 2019169840A1 CN 2018104013 W CN2018104013 W CN 2018104013W WO 2019169840 A1 WO2019169840 A1 WO 2019169840A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
photographing
display terminal
time information
acquired
Prior art date
Application number
PCT/CN2018/104013
Other languages
French (fr)
Chinese (zh)
Inventor
邹圣仕
Original Assignee
深圳市道通智能航空技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市道通智能航空技术有限公司 filed Critical 深圳市道通智能航空技术有限公司
Publication of WO2019169840A1 publication Critical patent/WO2019169840A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/66Remote control of cameras or camera parts, e.g. by remote control devices
    • H04N23/661Transmitting camera control signals through networks, e.g. control via the Internet

Definitions

  • the present invention relates to the field of camera technologies, and in particular, to a photographing method, a photographing device, and a photographing system.
  • more and more shooting devices such as cameras, cameras, etc.
  • a communication module that can access the network to communicate with the display terminal.
  • the user on the side of the display terminal can establish a communication connection with the photographing device through the wireless network, and remotely view the image taken by the photographing device on the display terminal at any time; and some photographing devices, for example, can be moved on the unmanned aerial vehicle.
  • the camera on the terminal device transmits the image to the user who operates the unmanned aerial vehicle on the ground through the communication module built in the unmanned aerial vehicle for the user to watch and perform remote control shooting operations on the display terminal, such as recording video and shooting.
  • the display terminal may be a remote controller with a display device or a remote controller having a port for connecting an external display device such as a tablet or a mobile phone.
  • a user views an image acquired by a camera in real time and transmitted to a display terminal through a display terminal, which are usually preview images and are not saved by the camera on a storage medium thereof.
  • the photo command is transmitted to the camera end by clicking the photo button on the display terminal, and then the camera end executes the photographing instruction, collects the image and saves the image.
  • the screen viewed by the user on the display terminal is not a real-time display of the shooting scene.
  • the picture viewed by the user at the current time is actually an image of the shooting scene captured by the camera five hundred milliseconds ago. If the user presses the camera button and wants to capture the picture viewed from the display terminal at this moment, the camera cannot be realized - the camera actually captures the picture that appears in the shooting scene after the user presses the button. Therefore, due to the display delay, the photo actually taken by the user is inconsistent with the currently displayed picture. When shooting images that move faster, the difference in picture caused by this delay becomes noticeable, and the user cannot capture the desired picture.
  • the embodiment of the present invention provides a photographing method and a mobile terminal to solve the problem that the photograph taken by the user is inconsistent with the currently displayed screen due to the display delay in the conventional photographing method for remote control by the wireless control signal.
  • an embodiment of the present invention provides a shooting method, where the method includes:
  • the display terminal receives a photo request input by the user
  • the display terminal generates a photographing instruction including time information according to the photographing request
  • the display terminal sends the photographing instruction to the image capturing device
  • the image capturing device searches, in the cache, an image collected by the image capturing device at a time indicated by the time information according to the time information;
  • the time information includes a timestamp.
  • the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  • the method further includes:
  • the imaging device collects an image
  • the image acquired by the imaging device and the time stamp when the collected image is acquired are saved in the cache.
  • the method further includes:
  • the imaging device encodes the acquired image
  • the display terminal displays the encoded image.
  • the storing the found image comprises:
  • the imaging device permanently stores the found image on the imaging device
  • the image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image;
  • the camera device transmits the found image to other devices to store the found image on the other device.
  • the time information includes a time period.
  • the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
  • an embodiment of the present invention further provides a photographing method, which is applied to a display terminal, and the display terminal communicates with an image capturing device to display an image captured by the image capturing device, and the photographing method includes:
  • the time information includes a timestamp.
  • the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  • the timestamp is recorded by the imaging device while the image is being acquired and is saved by the imaging device in the cache.
  • the method further includes:
  • the encoded image is obtained by encoding, by the imaging device, the acquired image, and the data of the encoded image records a time stamp when the collected image is collected.
  • the imaging device stores the found image, including:
  • the imaging device permanently stores the found image on the imaging device
  • the image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image;
  • the camera device transmits the found image to other devices to store the found image on the other device.
  • the time information includes a time period.
  • the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
  • an embodiment of the present invention further provides a photographing method, which is applied to an image capturing apparatus, wherein the image capturing apparatus communicates with a display terminal to display an image collected by the image capturing apparatus on the display terminal,
  • Shooting methods include:
  • the time information includes a timestamp.
  • the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when a user inputs a photo request to the display terminal.
  • the method further includes:
  • the acquired image is saved in the cache and the time stamp when the collected image is acquired.
  • the method further includes:
  • the camera device controls storage of the found image, including:
  • the imaging device permanently stores the found image on the imaging device
  • the image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image;
  • the camera device transmits the found image to other devices to store the found image on the other device.
  • the time information includes a time period.
  • the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
  • an embodiment of the present invention further provides a photographing system including an image capturing apparatus and a display terminal, wherein the image capturing apparatus communicates with the display terminal to display on the display terminal the image captured by the image capturing apparatus.
  • Image including an image capturing apparatus and a display terminal, wherein the image capturing apparatus communicates with the display terminal to display on the display terminal the image captured by the image capturing apparatus.
  • the display terminal is used to:
  • the camera device is used to:
  • an embodiment of the present invention further provides a photographing apparatus, where the apparatus is disposed in a display terminal, and the display terminal communicates with an image capturing apparatus to display an image collected by the image capturing apparatus, and the photographing apparatus includes :
  • a first receiving module configured to receive a photo request input by a user
  • a photographing instruction generating module configured to generate a photographing instruction including time information according to the photographing request
  • a first sending module configured to send the photographing instruction to the image capturing device, where the image capturing device searches the cache for an image captured by the image capturing device at a time indicated by the time information according to the time information. And control the storage of the found image.
  • an embodiment of the present invention further provides a photographing apparatus, where the apparatus is configured in an image capturing apparatus, and the image capturing apparatus communicates with a display terminal to display an image collected by the image capturing apparatus on the display terminal.
  • the photographing device includes:
  • a third receiving module configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information
  • An image search module configured to search, in the cache, an image collected by the camera device at a time indicated by the time information according to the time information;
  • a storage control module for controlling storage of the found image.
  • an embodiment of the present invention further provides a display terminal, where the display terminal includes a processor and a memory communicatively coupled to the processor;
  • the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the photographing method described above.
  • an embodiment of the present invention further provides an image capturing apparatus, where the image capturing apparatus includes a processor and a memory communicably connected to the processor;
  • the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the photographing method described above.
  • the photographing instruction generated by the display terminal since the photographing instruction generated by the display terminal includes time information, it can be used to request an image corresponding to the time information from the image capturing device. Therefore, after the photographing device receives the photographing instruction, According to the time information, the image captured by the imaging device at the time indicated by the time information can be found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is stored. Therefore, the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay of the display terminal is solved.
  • FIG. 1 is a schematic diagram of an application environment according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of processing data of an image captured by an imaging device on a time axis corresponding to a position in the photographing method according to an embodiment of the present invention
  • FIG. 3 is a flowchart of a method for photographing a display terminal according to an embodiment of the present invention
  • FIG. 4 is a diagram showing a step of capturing an image, recording a captured image, and storing the collected image and the time stamp when it is acquired in the buffer in the photographing method according to an embodiment of the present invention
  • FIG. 5 is a flowchart of a method for photographing applied to an image capturing apparatus according to an embodiment of the present invention
  • FIG. 6 is a diagram showing a step of encoding an image acquired by an imaging device in a photographing method applied to an image pickup apparatus according to an embodiment of the present invention
  • FIG. 7 is a flowchart of a shooting method applied to a photographing system including an image capturing apparatus and a display terminal according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of a signaling interaction between a display terminal and an imaging device according to an embodiment of the present invention, and illustrates a shooting method according to an embodiment of the invention
  • FIG. 9 is a block diagram of a photographing apparatus applied to a display terminal according to an embodiment of the present invention.
  • FIG. 10 is a block diagram of a photographing apparatus applied to a display terminal according to another embodiment of the present invention.
  • FIG. 11 is a block diagram of a photographing apparatus applied to an image pickup apparatus according to an embodiment of the present invention.
  • FIG. 12 is a block diagram of a photographing apparatus applied to an image pickup apparatus according to another embodiment of the present invention.
  • FIG. 13 is a block diagram of a photographing apparatus according to an embodiment of the present invention.
  • FIG. 14 is a block diagram of a photographing apparatus according to an embodiment of the present invention.
  • the embodiment of the present application is applicable to an image capturing device that performs remote control by a display terminal by wireless transmission, for example, for an unmanned aerial vehicle with a shooting function controlled by a remote controller.
  • the application environment may include an unmanned aerial vehicle 10 as an imaging apparatus and a remote controller 20 as a display terminal, wherein the unmanned aerial vehicle 10 has a photographing function, and specifically, in the embodiment of the present invention, the unmanned aerial vehicle 10 is provided with useful
  • a camera 100 that realizes a photographing function
  • a display device 200 for realizing a display function thereof is mounted on the remote controller 20.
  • a wireless communication connection is established between the UAV 10 and the remote controller 20.
  • the UAV 10 and the remote controller 20 can transmit data by wireless communication, and the remote controller 20 transmits a remote control signal to the UAV 10 to The flight, shooting, etc. of the aircraft 10 are remotely controlled.
  • the UAV 10 and the remote controller 20 have modules for performing data transmission between each other, for example, a radio frequency module (RF module).
  • RF module radio frequency module
  • the signals and the like collected by the camera 100 are transmitted to the RF module of the remote controller 20 in real time through the RF module of the UAV 10, and then displayed to the user through the display device 200 on the remote controller 20.
  • the remote controller 20 when the user inputs a photographing request through the display device 200, the remote controller 20 generates a photographing instruction based on the photographing request, and the radio frequency module of the remote controller 20 transmits the radio frequency module to the unmanned aerial vehicle 10, and the radio frequency module of the unmanned aerial vehicle 10
  • the processor is sent to the camera 100, and the camera 100 completes the corresponding photographing task, including searching for an image in the cache and controlling the saving of the found image.
  • the display device 200 mounted on the remote controller 20 is a display screen provided by the remote controller 20.
  • the display device 200 is a liquid crystal display (LCD). It can be understood that, in other application environments, the display device 200 can be not only a display screen built in the remote controller 20, but also a mobile terminal with a display function externally connected to the remote controller, such as a smart phone or a tablet computer. Wait.
  • LCD liquid crystal display
  • the image capturing apparatus is an unmanned aerial vehicle 10 having a photographing function
  • the photographing function is realized by the camera 100 mounted on the unmanned aerial vehicle 10
  • the user located at the display terminal can acquire the camera by the unmanned aerial vehicle 10. 100 captured images.
  • the image pickup apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function or the like, or a fixing device having a photographing function such as a camera or the like. Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
  • the display terminal is the remote controller 20 having the display device 200.
  • the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like capable of displaying a screen, and the user can view the image captured by the camera device on the display terminal and remotely control the camera device, thereby realizing Remote shooting.
  • the camera device is an unmanned aerial vehicle and the display terminal is a mobile phone
  • the user can run an app provided by the manufacturer of the unmanned aerial vehicle to operate the unmanned aerial vehicle on the mobile phone, thereby realizing flight, shooting, etc. of the unmanned aerial vehicle 10. Long distance control.
  • the previewed image observed by the user on the display device 200 on the remote controller 20 is not the captured image displayed in real time, but has a certain delay. Time.
  • the photographing method provided by the embodiment of the present invention solves the existing photographing method for remotely controlling by the wireless control signal, and the photograph actually taken by the user through the photographing device and the preview currently displayed on the display terminal due to the display delay The problem of inconsistent pictures. The following description will be made in the specific examples.
  • the processing process mainly includes: the imaging device collects an image; the imaging device encodes the collected image, and records the time information in the data of the encoded image; the imaging device sends the encoded image to the display terminal; The terminal displays the encoded image; the display terminal generates a photographing instruction including the time information based on the photographing request of the user, and sends the photographing instruction to the photographing device; and the photographing device searches for the image collected by the time indicated by the time information according to the time information. Finally, the imaging device then controls the storage of the found image (not shown in Figure 2).
  • the image pickup apparatus in FIG. 2 is, for example, the unmanned aerial vehicle 10 shown in FIG. 1
  • the display terminal in FIG. 2 is, for example, the remote controller 20 shown in FIG. 1 .
  • the flow of the photographing method provided by the embodiment of the present invention will be further described from the unmanned aerial vehicle 10 on the side of the image pickup apparatus and the remote controller 20 on the side of the display terminal.
  • the abscissa represents the time axis
  • the ordinate shows the transmission of data of the image, etc. at various points in time on the time axis.
  • FIG. 2 an embodiment of the present invention will be described by taking an example in which the unmanned aerial vehicle 10 performs image acquisition at intervals of one unit time by the camera 100 at the time t.
  • the UAV 10 is collected from the time of the time axis by the camera of the camera 100, and is collected for the shooting scene at times t, t+1, t+2, t+3, t+4, and t+5, respectively.
  • Images a 0 , b 0 , c 0 , d 0 , e 0 , and f 0 and record time information F(t) when acquiring images a 0 , b 0 , c 0 , d 0 , e 0 , and f 0 , respectively F(t+1), F(t+2), F(t+3), F(t+4), and F(t+5).
  • the unmanned aerial vehicle 10 encodes the acquired images a 0 , b 0 , c 0 , d 0 , e 0 and f 0 , and images a 0 , b 0 , c 0 , d 0 , e 0 and f 0 are
  • the time information F(t), F(t+1), F(t+2), F(t+3), F(t+4) and F(t+5) at the time of acquisition are recorded in the encoded image.
  • the data a, b, c, d, e, and f are transmitted from the unmanned aerial vehicle 10 to the remote controller 20 to display the encoded image on the remote controller 20.
  • the image acquired by the UAV through the camera 100 is specifically transmitted by the signal transmitting module of the UAV 10, and the remote controller 20 has a corresponding signal receiving module, and the remote controller 20 first receives the unmanned aerial vehicle 10 to transmit.
  • the data of the image is displayed on the display device 200.
  • the remote controller 20 When the user inputs the photographing request on the display device 200, the remote controller 20 generates a photographing instruction based on the photographing request, and passes the photographing command through the signal transmitting module of the remote controller 20.
  • the camera 100 performs a corresponding signal receiving module. After receiving the camera command sent by the remote controller 20, the unmanned aerial vehicle 10 transmits the camera command to the camera 100, and the camera 100 performs a corresponding operation.
  • the signal transmitting module and the signal receiving module on the UAV 10 may be the same communication module, and the signal transmitting module and the signal receiving module of the remote controller 20 may also be the same communication module.
  • the transmission of the image takes time, the time when the image arrives at the remote controller 20 may be delayed, and there is a time difference ⁇ T.
  • the preview screen observed on the display device 200 is actually an image captured by the camera 100 before 5 unit time.
  • the user inputs a photographing request.
  • the user inputs the photographing command at time t+8 as an example.
  • the display device 200 displays It is the image d 0 acquired at the time indicated by the time information F(t+3). That is to say, what the user actually observes and wants to take a picture is the picture on which the image d 0 is displayed on the display device 200.
  • the remote controller 20 based on the photographing request generator contains the t + 8 time displayed on the display device 200 of the image d 0 time information F (t + 3) photographing instruction,
  • the photographing instruction is sent to the unmanned aerial vehicle 10, and the unmanned aerial vehicle 10 receives the photographing instruction including the time information F(t+3) sent by the remote controller 20, according to the time information F(t+3), in the cache.
  • the time indicated by the time information F(t+3) is obtained by the image captured by the camera 100, that is, the image d 0 , which is known from the above, and the image d 0 is consistent with the picture actually observed by the user and intended to be photographed. .
  • the found image d 0 is stored. Specifically, after the unmanned aerial vehicle 10 finds the corresponding image, the image is stored for the user to view and download at any time.
  • the photographing method provided by the embodiment of the present invention can find the image collected by the unmanned aerial vehicle 10 through the camera 100 at the time indicated by the time information in the cache of the unmanned aerial vehicle 10 by using the time information contained in the photographing instruction.
  • the image corresponding to the preview screen that the user actually wants to capture is found, and the image is stored, thereby solving the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay.
  • FIG. 3 is a flowchart of a photographing method according to an exemplary embodiment of the present invention.
  • the method can be applied to a display terminal that communicates with an imaging device to display an image captured by the imaging device.
  • the display terminal is, for example, the remote controller 20 shown in Fig. 1
  • the image pickup apparatus is, for example, the unmanned aerial vehicle 10 shown in Fig. 1.
  • the method may include:
  • step S210 a photo request input by the user is received.
  • the photographing request can be used to indicate that the user intends to take a picture of the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal.
  • the UAV 10 transmits an image captured by the camera 100 to the remote controller 20 and displays it on the display device 200 of the remote controller 20, the user who views the preview screen at one end of the remote controller 20 is one of them or The picture of some time or time period is of interest, and the picture request operation for the preview picture may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to take a picture of the picture.
  • the user inputs a photographing request to the remote controller 20 through the interactive interface.
  • the interactive interface is located on the display device 200 of the remote controller 20.
  • the interactive interface may be an app interface displayed on the display device 200, and the app interface includes A virtual reminder button for completing the photo.
  • the user may also input a photo request to the remote control 10 via a physical button on the remote control 20, which may be a physical button located at a particular location on the body of the remote control 20.
  • step S220 a photographing instruction including time information is generated according to the photographing request.
  • the photographing instruction is configured to request an image corresponding to the time information from the image capturing device.
  • the time information includes a timestamp or a time period.
  • the time stamp may be a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal.
  • the remote controller 20 has been recorded in the data of the encoded image for display on the display device 200 before receiving the photographing request input by the user, along with the data of the encoded image from the unmanned aerial vehicle 10 One end is sent to one end of the remote controller 20 so that the user requests an image corresponding to the time stamp based on the time stamp.
  • the image of the picture, video, or the like collected by the UAV 10 through the camera 100 is not encoded, and cannot be directly displayed/played on the remote controller 20 as the display terminal, and therefore needs to be encoded into the encoded image.
  • Real-time display/playback can be performed on the remote controller 20, and when the unmanned aerial vehicle 10 performs encoding processing on the acquired image, the recorded time stamps for collecting each image are respectively included in each encoded image.
  • the time stamp of the image is collected in the data of each encoded image.
  • the timestamp is 10:31
  • the image corresponding to the timestamp may include an image acquired by the UAV 10 at 10:31, when encoding the image.
  • the time stamp 10:31 is recorded in the data of the encoded image, and is transmitted to the remote controller 20 along with the encoded image, and the encoded image is displayed by the display device 200 of the remote controller 20.
  • the photographing instruction generated by the remote controller 20 as the display terminal includes time information
  • the time information included in the photographing command can be used to request the unmanned aerial vehicle 10
  • An image corresponding to the time information is searched by the unmanned aerial vehicle 10 in the cache for an image acquired by the unmanned aerial vehicle 10 through the time indicated by the camera 100 at the time information, and after the image is found, the unmanned aerial vehicle 10 controls The image is stored so that the user can view and download it at any time.
  • step S230 the photographing instruction is sent to the image capturing device, so that the image capturing device searches the cache for an image captured by the image capturing device at the time indicated by the time information according to the time information, and Store the found image.
  • the time information is a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. Since the time stamp is carried by the data of the encoded image and sent to the remote controller 20 together, the remote controller 20 first acquires the data of the image currently displayed on the remote controller 20 when generating the photographing instruction based on the photographing request input by the user. The time stamp information carried in the time stamp is used as the time information, and is included in the generated photographing instruction.
  • the unmanned aerial vehicle 10 parses out the information of the time stamp contained in the photographing instruction, and finds from the cache the time when the unmanned aerial vehicle 10 is indicated by the time stamp.
  • the captured image Since the time stamp reflects the image corresponding to the screen displayed on the display device 200 when the user specifically wants to take a picture at the moment of inputting the photographing instruction, the time stamp can be engaged according to the time stamp of the image that the user wants to take.
  • the image corresponding to the timestamp is first found in a plurality of images cached in the memory of the unmanned aerial vehicle 10.
  • a time stamp when an image capturing apparatus collects an image records an acquired image, and collects an image in a buffer and a time when the image is collected.
  • Stamp the steps to save. Specifically include:
  • Step S110 the imaging device collects an image
  • Step S120 recording a time stamp when the image is collected
  • Step S130 saving an image collected by the imaging device and a time stamp when the collected image is collected in the cache.
  • the UAV 10 buffers the acquired image, and records the time stamp when the image is acquired and buffers the time stamp for the purpose of the image-based data included after receiving the photographing instruction from the remote controller 20
  • the timestamp finds the corresponding image.
  • the cache space of the UAV 10 is limited, and over time, the UAV 10 continuously acquires and caches images and time stamps when each captured image is acquired, in the UAV 10
  • each time the new image and its timestamp data are collected the old image that has been cached in the cache space and its timestamp data will be The data is sequentially cleared in the order of the acquisition time, that is, whenever a new image and/or time stamp data is about to be cached in the UAV 10, the cache space of the UAV 10 is the earliest in the time sequence.
  • the cached image and/or timestamp data will be erased, and as the UAV 10 continually caches new image and/or timestamp data, the old image and/or
  • the timestamp may be placed in the data of the acquired image and stored in the cache along with the data of the acquired image; the timestamp may also be stored separately in the cache. When the timestamp is separately stored in the cache, it is necessary to save the correspondence between each timestamp and the acquired image.
  • the cache is a buffer (referred to as a Cache) for data exchange on the image capturing device, and usually uses RAM (non-permanent storage that is powered off), for example, the cache may be on the camera device. Memory stick.
  • the cache may be a memory module on the UAV 10 that may be disposed on any component of the UAV 10.
  • the UAV 10 controls the storage of the found images so that the user can view, save, and/or download at any time.
  • the UAV 10 permanently stores the found image on the UAV 10, for example, on a memory card of the UAV 10; or, the UAV 10 sends the found image to
  • the remote controller 20 stores the searched image by the remote controller 20, for example, on a memory card of the remote controller 20; or the unmanned aerial vehicle 10 transmits the found image to other third party devices by the third party The device stores the found image.
  • the UAV 10 can also upload the found images to the web disk via a cloud storage service on the World Wide Web.
  • the user can remove the memory card from the unmanned aerial vehicle 10 and read and save the memory card with an external device such as a computer, a notebook, or a hard disk.
  • the image may not be removed from the unmanned aerial vehicle 10, but may be wirelessly connected to the unmanned aerial vehicle 10 by an external device such as a mobile phone, and the image stored on the unmanned aerial vehicle 10 may be directly downloaded to the external device.
  • the searched image may be saved as a picture in a raw format as a final output photo; or the searched image may be compression-encoded to generate a compression-encoded image, and The compression-encoded image is saved as a final output photo.
  • the searched image is directly saved as a picture in the raw format, and is provided as a final output photo to the user; if the user takes a picture of the camera 100
  • the output format is set to a compression-encoded image format, such as a common format such as JPG, JPEG, TIFF, TIF, etc., according to the user's setting, first compressing and encoding the searched image to generate a camera set by the user.
  • the image output format of 100 is compressed and encoded, and the compression-encoded image is saved as a final output photo, which is provided to the user.
  • the photographing method provided by the embodiment of the present invention can be used to request an image corresponding to the time information from the image capturing device because the photographing instruction generated by the display terminal includes the time information, and therefore, after the photographing device receives the photographing instruction, According to the time information, the image captured by the imaging device at the time indicated by the time information is found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is stored. Thereby, the problem that the photo actually taken by the user is inconsistent with the currently displayed picture due to the display delay of the display terminal is solved.
  • FIG. 5 is a flowchart of a photographing method according to another exemplary embodiment of the present invention.
  • the method can be applied to an imaging apparatus that communicates with a display terminal to display an image captured by the imaging apparatus on the display terminal.
  • the image capturing apparatus is, for example, an unmanned aerial vehicle having a photographing function as shown in FIG. 1, and the photographing function of the unmanned aerial vehicle 10 is realized by the camera 100 mounted thereon; the display terminal has a display function as shown in FIG.
  • the remote controller 20 has its display function implemented by the display device 200 on the remote controller 20.
  • the method may include steps S310-S330:
  • step S310 a photographing instruction is received from the display terminal, and the photographing instruction includes time information.
  • the remote controller 20 as the display terminal After receiving the photographing request input by the user, the remote controller 20 as the display terminal generates a photographing instruction including time information according to the photographing request, and transmits the photographing instruction to the unmanned aerial vehicle 10 as the photographing device, and the unmanned aerial vehicle 10 acts as The remote controller 20 of the display terminal receives the photographing instruction including the time information. Specifically, in the embodiment of the present invention, the remote controller 20 transmits the photographing instruction to the unmanned aerial vehicle 10 through the radio frequency module on the remote controller 20, and is received by the radio frequency module of the unmanned aerial vehicle 10, and the radio frequency module of the unmanned aerial vehicle 10 receives the radio frequency module. After the photographing instruction, the corresponding shooting task is completed by the processor, including searching for an image in the cache and controlling the saving of the found image.
  • the photographing request can be used to indicate that the user intends to take a picture of the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal.
  • the user who views the preview screen at one end of the remote controller 20 is one or some of them.
  • the pictures of the moments or time periods are of interest, and the photographing request operation for the preview screen may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to take a picture of the picture.
  • the remote controller 20 can receive the photographing request.
  • the interactive interface is located on the display device 200 of the remote controller 20.
  • the interactive interface may be an app interface displayed on the display device 200, and the app interface includes a virtual prompt button for completing the photographing.
  • the user may also complete a photo request for a screen displayed by the current display device 200 by a physical button on the remote controller 20, which may be a button located at a specific position on the body of the remote controller 20. .
  • the time information includes a timestamp or a time period.
  • the time stamp may be a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal.
  • the remote controller 20 has been recorded in the data of the encoded image for display on the display device 200 before receiving the photographing request input by the user, along with the data of the encoded image from the unmanned aerial vehicle 10 One end is sent to one end of the remote controller 20 so that the user requests an image corresponding to the time stamp based on the time stamp.
  • the unmanned aerial vehicle 10 as an imaging device further collects an image, records a time stamp when the image is collected, and saves the collected image and the time stamp when it is collected in the cache.
  • the imaging device encodes the acquired image, and transmits data of the encoded image that can be displayed on the remote controller 20 as the display terminal to the remote controller or the like, steps S140 to S160; and as the display terminal
  • the remote controller 20 receives the photographing request of the user, and generates steps S210 to S230 including the photographing instruction of the time information and transmitting the photographing instruction to the unmanned aerial vehicle 10 according to the photographing request.
  • Steps S110 to S130 and steps S210 to S230 have been described in connection with FIG. 4 and FIG. 3 in the previous embodiment, and will not be described in detail herein. Steps S140 to S160 are specifically described below:
  • step S140 the acquired image is encoded; and in step S150, the time stamp when the collected image is acquired is recorded in the data of the encoded image.
  • the time information included in the photographing instruction generated by the remote controller 20 is currently displayed on the display device 200 of the remote controller 20 when the user inputs a photographing request to the remote controller 20 as the display terminal.
  • a time stamp when each of the images is acquired is recorded (step S120 described above).
  • the data of the image, video, and the like collected by the camera 100 is not encoded, it cannot be directly displayed/played on the remote controller 20 as the display terminal, and therefore it is necessary to perform encoding processing into the encoded image to be used as the display terminal. Displayed/played on the remote controller 20.
  • the camera 100 encodes the data
  • the recorded time stamps for collecting each image are respectively included in the data of each of the encoded images, so that the data of each of the encoded images is recorded. The timestamp when it was acquired. These time stamps are carried by the data of the encoded image and sent to the remote controller 20 together.
  • step S160 the encoded image is transmitted to the display terminal to display the encoded image on the display terminal. Therefore, the data of each encoded image received by the remote controller 20 as the display terminal includes a time stamp when the image is acquired, and the time stamp is used as data in each encoded image.
  • the recorded time information is used by the remote controller 20 as a display terminal to generate a photographing instruction including time information based on a photographing request input by the user.
  • the photographing command generated by the remote controller 20 as the display terminal includes time information, when the photographing command is transmitted to the unmanned aerial vehicle 10, the image corresponding to the time information can be requested from the unmanned aerial vehicle 10.
  • the unmanned aerial vehicle 10 searches the cache for the unmanned aerial vehicle 10 according to the time information.
  • the image acquired at the time indicated by the time information after the UAV 10 finds the image, in step S330, the UAV 10 controls the storage of the image so that the user can view and download it at any time.
  • the time information is a time stamp when the encoded image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. . Since the time stamp is carried by the data of the encoded image, and sent to the unmanned aerial vehicle 10 by the remote controller 20, after receiving the photographing instruction from the remote controller 20, the unmanned aerial vehicle 10 parses out the image capturing command. The timestamp information is retrieved from the cache for images captured by the UAV 10 at the time indicated by the timestamp.
  • the time stamp reflects that the user specifically wants to capture the image displayed on the display device 200 at the moment of inputting the photographing instruction
  • the time stamp can be cached in advance according to the time stamp of the image that the user wants to take.
  • the image corresponding to the time stamp is found in a plurality of images in the memory of the unmanned aerial vehicle 10.
  • the UAV 10 acquires an image through the camera 100, it also needs to buffer the acquired image and its time stamp when it is acquired, as this process is in the embodiment described in connection with FIG. Steps S110 to S130 are the same, and will not be described again.
  • step S330 the UAV 10 controls the storage of the found images so that the user can view, save, and/or download at any time.
  • the UAV 10 permanently stores the found image on the UAV 10, for example, on a memory card of the UAV 10; or, the UAV 10 sends the found image to
  • the remote controller 20 stores the searched image by the remote controller 20, for example, on a memory card of the remote controller 20; or the unmanned aerial vehicle 10 transmits the found image to other third party devices by the third party
  • the device stores the found image.
  • the UAV 10 can also upload the found images to the web disk via a cloud storage service on the World Wide Web.
  • the searched image is stored on the memory card of the unmanned aerial vehicle 10
  • the user can remove the memory card from the unmanned aerial vehicle 10 and read and save the memory card with an external device such as a computer, a notebook, or a hard disk.
  • the image may not be removed from the unmanned aerial vehicle 10, but may be wirelessly connected to the unmanned aerial vehicle 10 by an external device such as a mobile phone, and the image stored on the unmanned aerial vehicle 10 may be directly downloaded to the external device.
  • the searched image may be saved as a picture in a raw format as a final output photo; or the searched image may be compression-encoded to generate a compression-encoded image.
  • the image is saved and the compression-encoded image is saved as a final output photo.
  • the searched image is directly saved as a picture in the raw format, and is provided as a final output photo to the user; if the user takes a picture of the camera 100
  • the output format is set to a compression-encoded image format, such as a common format such as JPG, JPEG, TIFF, TIF, etc., according to the user's setting, first compressing and encoding the searched image to generate a camera set by the user.
  • the image output format of 100 is compressed and encoded, and the compression-encoded image is saved as a final output photo, which is provided to the user.
  • an embodiment of the present invention further provides a photographing method, which is applied to a photographing system including an image pickup apparatus and a display terminal, wherein the image pickup apparatus communicates with the display terminal to display on the display terminal
  • the image captured by the camera device is, for example, an unmanned aerial vehicle 10 having a photographing function as shown in FIG. 1, and the photographing function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; for example, the display terminal has a display as shown in FIG.
  • the function remote controller 20 whose display function is realized by the display device 200 on the remote controller 20. A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10.
  • the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
  • the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen.
  • the method includes the following steps:
  • step S210 the display terminal receives a photo request input by the user
  • step S220 the display terminal generates a photographing instruction including time information according to the photographing request
  • step S230 the display terminal sends the photographing instruction to the image capturing device
  • step S310 a photographing instruction is received from the display terminal, and the photographing instruction includes time information
  • step S320 the imaging device searches the cache for an image acquired by the imaging device at the time indicated by the time information according to the time information;
  • step S330 the image pickup apparatus controls storage of the searched image.
  • This embodiment relates to some or all of the above steps for the display terminal and one or more methods for the image pickup apparatus, and thus, the specific steps thereof will not be described in detail herein.
  • the photographing method provided by the embodiment of the present invention can be used to request an image corresponding to the time information by the image capturing device, because the photographing instruction received by the image capturing device from the display terminal can be used to receive the photographing instruction.
  • the image captured by the imaging device at the time indicated by the time information can be found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is
  • the storage is performed to solve the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay of the display terminal.
  • FIG. 8 is a signaling interaction diagram between a display terminal and an imaging apparatus according to an exemplary embodiment of the present invention, and illustrates a photographing method according to an embodiment of the present invention.
  • the display terminal is, for example, a remote controller 20 having a display function as shown in FIG. 1
  • the image pickup apparatus is, for example, the unmanned aerial vehicle 10 having a photographing function shown in FIG. 1.
  • the imaging apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
  • the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like capable of displaying a screen, and the user can view the image captured by the camera device on the display terminal and remotely control the camera device, thereby realizing Remote shooting.
  • the camera device is an unmanned aerial vehicle and the display terminal is a mobile phone
  • the user can run an app provided by the manufacturer of the unmanned aerial vehicle to operate the unmanned aerial vehicle on the mobile phone, thereby realizing flight, shooting, etc. of the unmanned aerial vehicle 10. Long distance control.
  • Figure 8 relates to some or all of the above steps for displaying a terminal and one or more methods for an imaging device, and thus, will not be described in detail herein.
  • FIG. 9 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention.
  • the apparatus is applicable to a display terminal that communicates with an imaging apparatus to display an image acquired by the imaging apparatus.
  • the display terminal is, for example, a remote controller 20 having a display function as shown in FIG. 1 , and its display function is implemented by the display device 200 on the remote controller 20; for example, the imaging device has the photographing function as shown in FIG. 1 .
  • the unmanned aerial vehicle 10 has a photographing function realized by a camera 100 mounted on the unmanned aerial vehicle 10.
  • the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen. Referring to FIG.
  • the apparatus may include a first receiving module 410, configured to receive a photographing request input by a user, and a photographing instruction generating module 420, configured to generate a photographing instruction including time information according to the photographing request.
  • the photographing instruction is configured to request an image corresponding to the time information from the image capturing device.
  • the first sending module 430 is configured to send the photographing instruction to the image capturing device, so that the image capturing device searches the cache for the time taken by the camera device at the time indicated by the time information according to the time information. Images and store the found images
  • FIG. 10 it is a block diagram of a photographing apparatus according to another exemplary embodiment of the present invention.
  • the apparatus is applicable to a display terminal that communicates with an imaging apparatus to display an image acquired by the imaging apparatus.
  • the device includes a first receiving module 410, a photographing instruction generating module 420 and a first transmitting module 430, which are included in the embodiment shown in FIG. 9, and a second receiving module 440 and a display module 450.
  • the first receiving module 410, the photographing instruction generating module 420, and the first sending module 430 are the same as those in the embodiment described in conjunction with FIG. 9, and are not described again.
  • the second receiving module 440 is configured to receive an encoded image from the imaging device
  • the display module 450 is configured to display the encoded image received from the imaging device, wherein the A time stamp when the image is acquired is recorded in the encoded image.
  • the display module can be, for example, the display device 200 of the remote controller 20 shown in FIG. 1, and the display device 200 can include a liquid crystal display (LCD) and/or a touch panel (TP).
  • the display module can be a display screen and/or a touch panel of a smartphone, tablet, PC, laptop, or the like.
  • FIG. 11 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention.
  • the apparatus is applicable to an imaging apparatus that communicates with a display terminal to display an image acquired by the imaging apparatus on the display terminal.
  • the imaging device is, for example, the unmanned aerial vehicle 10 having the photographing function shown in FIG. 1 , and the photographing function of the unmanned aerial vehicle 10 is implemented by the camera 100 mounted thereon; the display terminal is, for example, the one shown in FIG. 1 .
  • Remote control 20 A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10.
  • the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, etc., or a fixing device having a photographing function, such as a camera. Wait. Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
  • the photographing apparatus includes: a third receiving module 510, configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information; and an image searching module 520, configured to be in the cache according to the time information.
  • the image captured by the imaging device at the time indicated by the time information is searched; the storage control module 530 is configured to control storage of the searched image.
  • the display terminal is, for example, the remote controller 20 shown in FIG. 1 . In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like.
  • FIG. 12 is a block diagram of a photographing apparatus according to another embodiment of the present invention.
  • the apparatus is applicable to an imaging apparatus that communicates with a display terminal to display an image acquired by the imaging apparatus on the display terminal.
  • the camera device includes an image receiving module 610, a time stamp recording module 620, a cache module 630, and a third receiving module 510, an image searching module 520, and a storage control module 530, which are included in the embodiment shown in FIG. Encoding module 640 and second transmitting module 650.
  • the third receiving module 510, the image searching module 520, and the storage control module 530 are the same as those in the embodiment described in connection with FIG. 11, and details are not described herein.
  • the image acquisition module 610 is configured to acquire an image; the timestamp recording module 620 is configured to record a timestamp when the image is collected; the cache module 630 is configured to save the collected image in the cache and a timestamp when the collected image is collected; the encoding module 640 is configured to encode the collected image, and record the timestamp when the collected image is collected in the data of the encoded image;
  • the second sending module 650 is configured to send the encoded image to the display terminal to display the encoded image on the display terminal. Specifically, the second sending module 650 is in communication with the second receiving module 440 (FIG. 10) of the display terminal, and the encoded image is received by the second receiving module 440 and displayed by the display module 450 of the display terminal.
  • An embodiment of the present invention further provides a photographing system including an image capturing device and a display terminal, wherein the image capturing device communicates with the display terminal to display an image collected by the image capturing device on the display terminal.
  • the image pickup apparatus is, for example, an unmanned aerial vehicle 10 having a photographing function as shown in FIG. 1, and the photographing function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; for example, the display terminal has a display as shown in FIG.
  • the function remote controller 20 whose display function is realized by the display device 200 on the remote controller 20. A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10.
  • the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
  • the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen.
  • the display terminal is configured to: receive a photographing request input by a user; generate a photographing instruction including time information according to the photographing request; and send the photographing instruction to the photographing device.
  • the image capturing device is configured to: receive the photographing instruction; search for an image captured by the camera device at a time indicated by the time information in a cache according to the time information; and control storage of the searched image.
  • FIG. 13 is a block diagram of a photographing apparatus 2000 according to an embodiment of the invention.
  • the photographing device 2000 may be a terminal having a display function such as a smartphone, a tablet, a PC, a notebook computer, a messaging device, a game console, or the like.
  • the photographing apparatus 2000 may include one or more of the following components: a processing component 2001, a memory 2002, a multimedia component 2003, an input/output (I/O) interface 2004, and a communication component 2005.
  • the processing component 2001 controls the overall operation of the photographing device 2000, such as operations associated with display, data communication, photographing operations, control of flight of a mobile terminal such as an unmanned aerial vehicle, and the like.
  • Processing component 2001 may include one or more processors 2010 to execute instructions to perform all or part of the steps of the method on the display terminal side of the various embodiments described above.
  • the memory 2002 is configured to store various types of data supporting operations on the photographing device 2000, such as instructions for any application or method operating on the photographing device 2000, contact data, messages, pictures, videos, files, etc. .
  • the memory 2002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • the multimedia component 2003 includes a display device that provides an output interface between the camera device 2000 and a user, such as the display device 200 shown in FIG.
  • the display device can include a liquid crystal display (LCD) and/or a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • LCD liquid crystal display
  • TP touch panel
  • An input/output (I/O) interface 2004 provides an interface between the processing component 2001 and a peripheral interface module, which may be a keyboard, a button, a virtual button, etc., such as a Home button, a volume button, a lock screen on a smartphone. Button.
  • a peripheral interface module which may be a keyboard, a button, a virtual button, etc., such as a Home button, a volume button, a lock screen on a smartphone. Button.
  • the communication component 2005 is configured for wired or wireless communication between the camera 2000 and other devices.
  • the photographing device 2000 can access a wireless network based on a communication standard such as a WiFi, 3G or 4G network.
  • the illustrated communication component 2005 also includes a near field communication (NFC) module for short range communication, for example, the NFC module can be based on radio frequency identification (RF ID) technology, infrared communication (I rDA) technology, super Broadband (UWB) technology, Bluetooth (BT) technology and other technologies to achieve.
  • RF ID radio frequency identification
  • I rDA infrared communication
  • UWB super Broadband
  • Bluetooth Bluetooth
  • the photographing apparatus 2000 may be composed of one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing equipment (DSro), programmable logic devices (PLDs), and field programmable.
  • a gate array (FPGA), controller, microcontroller, microprocessor or other electronic component is implemented to perform the method on the display terminal side described above.
  • the embodiment of the present invention further provides a non-transitory computer readable storage medium, such as a memory 2002, which stores computer-executable instructions stored by the photographing device 2000.
  • the processor 2010 is executed to complete the photographing method in any of the above method embodiments on the display terminal side, for example, to perform some or all of the steps of the methods described above in FIGS. 1-3, 7, and 8.
  • the functions of the modules in Figures 9 and 10 are implemented.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • FIG. 14 is a block diagram of a photographing apparatus 3000 according to an embodiment of the invention.
  • the imaging device 3000 may be a smart camera or a smart camera having a storage function and/or a processing function, or the like, or may be a camera mounted on a mobile terminal such as an unmanned aerial vehicle or a handheld cloud platform.
  • the photographing apparatus 3000 may include one or more of the following components: a processing component 3001, a memory 3002, a multimedia component 3003, an input/output (I/O) interface 3004, and a communication component 3005.
  • the processing component 3001 controls the overall operation of the photographing device 3000, such as operations associated with display, data communication, photographing, recording video, and the like.
  • the processing component 3001 can include one or more processors 3010 to execute instructions to perform all or part of the steps of the method of the camera device side of the various embodiments described above.
  • the memory 3002 is configured to store various types of data supporting operations on the photographing device 3000, such as instructions, pictures, videos, files, and the like for any application or method operating on the photographing device 3000.
  • the memory 3002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read only memory
  • EPROM Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Disk Disk or Optical Disk.
  • the multimedia component 3003 includes a display device that provides an output interface between the camera device 3000 and a user.
  • the display device can include a liquid crystal display (LCD) and/or a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
  • the display device may be a display screen and/or a touch panel on the camera that provides a function of previewing and viewing a picture.
  • An input/output (I/O) interface 3004 provides an interface between the processing component 4001 and a peripheral interface module, which may be a keyboard, a button, a virtual button, etc., such as a menu button, a shutter button, a volume button, and the like on the camera. Mode dials, etc.
  • a peripheral interface module which may be a keyboard, a button, a virtual button, etc., such as a menu button, a shutter button, a volume button, and the like on the camera. Mode dials, etc.
  • the communication component 3005 is configured to communicate in a wired or wireless manner between the camera device 3000 and other devices.
  • the photographing device 3000 can access a wireless network based on a communication standard such as a WiFi, 3G or 4G network.
  • the illustrated communication component 3005 also includes a near field communication (NFC) module for short range communication, for example, the NFC module can be based on radio frequency identification (RF ID) technology, infrared communication (I rDA) technology, super Broadband (UWB) technology, Bluetooth (BT) technology and other technologies to achieve.
  • RF ID radio frequency identification
  • I rDA infrared communication
  • UWB super Broadband
  • Bluetooth Bluetooth
  • the photographing device 3000 is the camera 100 carried by the unmanned aerial vehicle 10 shown in FIG. 1
  • the NFC module may be a radio frequency module installed in the inner cavity of the unmanned aerial vehicle 10.
  • the photographing device 3000 may be composed of one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSro), programmable logic devices (PLDs), and field programmable.
  • a gate array (FPGA), controller, microcontroller, microprocessor or other electronic component is implemented to perform the method on the side of the imaging device described above.
  • the embodiment of the present invention further provides a non-transitory computer readable storage medium, such as a memory 3002, which stores computer-executable instructions stored by the photographing device 3000.
  • the processor 3010 is executed to complete the photographing method in any of the above-described image pickup apparatus embodiments, for example, to perform the method steps of FIG. 1 and FIG. 2, FIG. 4 to FIG. 8 described above to implement FIG. 11 and FIG. The function of the module in 12.
  • the non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The present invention relates to a photographing method, a photographing apparatus and a photographing system. The photographing method comprises: a display terminal receiving a photographing request input by a user; the display terminal generating, according to the photographing request, a photographing instruction including time information; the display terminal sending the photographing instruction to a photographing device; according to the time information, the photographing device searching a cache for an image collected by the photographing device at a time indicated by the time information; and storing the image found. According to the photographing method provided in the embodiments of the present invention, by means of time information included in a photographing instruction, an image collected by a photographing device at a time indicated by the time information is found in a cache of the photographing device, so that an image corresponding to a preview picture which a user actually wants to take can be accurately found, and the image is stored, thereby solving the problem that a picture which the user actually takes and a current displayed picture are inconsistent due to a display delay.

Description

一种拍摄方法、拍摄装置及拍摄系统Shooting method, photographing device and photographing system
申请要求于2018年3月9日申请的、申请号为201810195280.4、申请名称为“一种拍摄方法、拍摄装置及拍摄系统”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。The application claims the priority of the Chinese patent application filed on March 9, 2018, the application number is 201101195280.4, the application name is "a photographing method, a photographing device, and a photographing system", the entire contents of which are incorporated herein by reference. .
【技术领域】[Technical Field]
本发明涉及摄像技术领域,尤其涉及一种拍摄方法、拍摄装置、及拍摄系统。The present invention relates to the field of camera technologies, and in particular, to a photographing method, a photographing device, and a photographing system.
【背景技术】【Background technique】
目前,越来越多的拍摄装置——例如相机、摄像机等,都设置有可以接入网络的通信模块,以便与显示终端进行通讯。位于显示终端一侧的用户可以通过无线网络与拍摄装置建立通信连接,随时在该显示终端上对拍摄装置拍摄的图像进行远程查看;另有一些拍摄装置,例如搭载在无人飞行器这样的可移动终端设备上的相机,通过无人飞行器内置的通信模块,将图像传输给在地面用操纵无人飞行器的用户,供用户在显示终端上观看和进行远距离控制的拍摄操作,例如录制视频和拍摄照片等,该显示终端可以是自带显示装置的遥控器或具有用于连接平板、手机等外部显示装置的端口的遥控器。At present, more and more shooting devices, such as cameras, cameras, etc., are provided with a communication module that can access the network to communicate with the display terminal. The user on the side of the display terminal can establish a communication connection with the photographing device through the wireless network, and remotely view the image taken by the photographing device on the display terminal at any time; and some photographing devices, for example, can be moved on the unmanned aerial vehicle. The camera on the terminal device transmits the image to the user who operates the unmanned aerial vehicle on the ground through the communication module built in the unmanned aerial vehicle for the user to watch and perform remote control shooting operations on the display terminal, such as recording video and shooting. For a photo or the like, the display terminal may be a remote controller with a display device or a remote controller having a port for connecting an external display device such as a tablet or a mobile phone.
在通过无线控制信号进行远距离控制的拍摄方法中,用户通过显示终端观看由相机实时获取并传输至显示终端的图像,这些图像通常是预览的画面,并不会被相机保存在其存储介质上,当用户对某个画面感兴趣想要进行拍照时,通过点击显示终端上的拍照按键,将拍照指令传输给相机端,此时相机端才执行该拍照指令,采集图像并对图像进行保存。然而,由于从相机端到显示终端的图像传输存在一定的延时,一般为几百毫秒,导致用户在显示终端上观看到的画面并非是对拍摄场景进行实时显示的画面。例如,对于延时为五百毫秒的情况,用户在当前时刻观看到的画面其实上是相机在五百毫秒前捕捉的拍摄场 景的图像。若用户按下拍照按键想要抓拍到此刻从显示终端上观看到的画面,则相机并不能实现——相机实际上拍摄到的是用户按下按键之后才会在拍摄场景中出现的画面。因此,由于显示延时,导致了用户实际拍摄的照片与当前显示的画面不一致。在拍摄移动速度较快的影像时,这种延时所带来的画面差异将变得明显,导致用户无法抓拍到想要的画面。In a photographing method for remotely controlling by a wireless control signal, a user views an image acquired by a camera in real time and transmitted to a display terminal through a display terminal, which are usually preview images and are not saved by the camera on a storage medium thereof. When the user is interested in a certain picture and wants to take a picture, the photo command is transmitted to the camera end by clicking the photo button on the display terminal, and then the camera end executes the photographing instruction, collects the image and saves the image. However, since there is a certain delay in image transmission from the camera end to the display terminal, generally several hundred milliseconds, the screen viewed by the user on the display terminal is not a real-time display of the shooting scene. For example, for a case where the delay is five hundred milliseconds, the picture viewed by the user at the current time is actually an image of the shooting scene captured by the camera five hundred milliseconds ago. If the user presses the camera button and wants to capture the picture viewed from the display terminal at this moment, the camera cannot be realized - the camera actually captures the picture that appears in the shooting scene after the user presses the button. Therefore, due to the display delay, the photo actually taken by the user is inconsistent with the currently displayed picture. When shooting images that move faster, the difference in picture caused by this delay becomes noticeable, and the user cannot capture the desired picture.
【发明内容】[Summary of the Invention]
本发明实施例提供一种拍摄方法及移动终端,以解决现有通过无线控制信号进行远距离控制的拍摄方法中,由于显示延时而导致用户实际拍摄的照片与当前显示的画面不一致的问题。The embodiment of the present invention provides a photographing method and a mobile terminal to solve the problem that the photograph taken by the user is inconsistent with the currently displayed screen due to the display delay in the conventional photographing method for remote control by the wireless control signal.
为了解决上述技术问题,本发明实施例提供一种拍摄方法,所述方法包括:In order to solve the above technical problem, an embodiment of the present invention provides a shooting method, where the method includes:
显示终端接收用户输入的拍照请求;The display terminal receives a photo request input by the user;
所述显示终端根据所述拍照请求,生成包含时间信息的拍照指令;The display terminal generates a photographing instruction including time information according to the photographing request;
所述显示终端向摄像设备发送所述拍照指令;The display terminal sends the photographing instruction to the image capturing device;
所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及The image capturing device searches, in the cache, an image collected by the image capturing device at a time indicated by the time information according to the time information;
存储查找到的图像。Store the found image.
在一些实施例中,所述时间信息包括时间戳。In some embodiments, the time information includes a timestamp.
在一些实施例中,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。In some embodiments, the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
所述摄像设备采集图像;The imaging device collects an image;
记录采集图像时的时间戳;Record the timestamp when the image was acquired;
在所述缓存中保存所述摄像设备采集到的图像以及所述采集到的图像被采集时的时间戳。The image acquired by the imaging device and the time stamp when the collected image is acquired are saved in the cache.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
所述摄像设备对采集到的图像进行编码;The imaging device encodes the acquired image;
将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;Recording a time stamp when the collected image is collected in data of the encoded image;
将所述编码后的图像发送给所述显示终端;Transmitting the encoded image to the display terminal;
所述显示终端显示所述编码后的图像。The display terminal displays the encoded image.
在一些实施例中,所述存储查找到的图像,包括:In some embodiments, the storing the found image comprises:
所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
在一些实施例中,所述时间信息包括一个时间段。In some embodiments, the time information includes a time period.
在一些实施例中,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。In some embodiments, the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
为了解决上述技术问题,本发明实施例还提供一种拍摄方法,应用于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像,所述拍摄方法包括:In order to solve the above technical problem, an embodiment of the present invention further provides a photographing method, which is applied to a display terminal, and the display terminal communicates with an image capturing device to display an image captured by the image capturing device, and the photographing method includes:
接收用户输入的拍照请求;Receiving a photo request input by a user;
根据所述拍照请求,生成包含时间信息的拍照指令;Generating a photographing instruction including time information according to the photographing request;
向所述摄像设备发送所述拍照指令,以供所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并存储查找到的图像。Sending the photographing instruction to the image capturing device, so that the image capturing device searches for an image captured by the image capturing device at the time indicated by the time information in the cache according to the time information, and stores the image that is found. .
在一些实施例中,所述时间信息包括时间戳。In some embodiments, the time information includes a timestamp.
在一些实施例中,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。In some embodiments, the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
在一些实施例中,所述时间戳由所述摄像设备在采集图像时进行记录,并由所述摄像设备保存在所述缓存中。In some embodiments, the timestamp is recorded by the imaging device while the image is being acquired and is saved by the imaging device in the cache.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
从所述摄像设备接收编码后的图像;以及Receiving an encoded image from the imaging device;
并对所述编码后的图像进行显示;And displaying the encoded image;
其中,所述编码后的图像由所述摄像设备对采集到的图像进行编码而获得,所述编码后的图像的数据中记录有所述采集到的图像被采集时的时间戳。The encoded image is obtained by encoding, by the imaging device, the acquired image, and the data of the encoded image records a time stamp when the collected image is collected.
在一些实施例中,所述摄像设备存储查找到的图像,包括:In some embodiments, the imaging device stores the found image, including:
所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
在一些实施例中,所述时间信息包括一个时间段。In some embodiments, the time information includes a time period.
在一些实施例中,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。In some embodiments, the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
为了解决上述技术问题,本发明实施例还提供一种拍摄方法,应用于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像,所述拍摄方法包括:In order to solve the above technical problem, an embodiment of the present invention further provides a photographing method, which is applied to an image capturing apparatus, wherein the image capturing apparatus communicates with a display terminal to display an image collected by the image capturing apparatus on the display terminal, Shooting methods include:
从所述显示终端接收拍照指令,所述拍照指令中包含有时间信息;Receiving a photographing instruction from the display terminal, where the photographing instruction includes time information;
根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及Obtaining, in the cache, an image collected by the imaging device at a time indicated by the time information according to the time information;
控制对查找到的图像的存储。Controls the storage of the found images.
在一些实施例中,所述时间信息包括时间戳。In some embodiments, the time information includes a timestamp.
在一些实施例中,所述时间戳为用户向所述显示终端输入拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。In some embodiments, the timestamp is a timestamp when an image currently displayed on the display terminal is acquired when a user inputs a photo request to the display terminal.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
采集图像;Collecting images;
记录采集图像时的时间戳;Record the timestamp when the image was acquired;
在所述缓存中保存采集到的图像以及所述采集到的图像被采集时的时间戳。The acquired image is saved in the cache and the time stamp when the collected image is acquired.
在一些实施例中,所述方法还包括:In some embodiments, the method further includes:
对采集到的图像进行编码;Encoding the acquired image;
将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;以及Recording a time stamp when the collected image is acquired in data of the encoded image;
将所述编码后的图像发送给所述显示终端,以在所述显示终端显示所述编码后的图像。And transmitting the encoded image to the display terminal to display the encoded image on the display terminal.
在一些实施例中,所述摄像设备控制对查找到的图像的存储,包括:In some embodiments, the camera device controls storage of the found image, including:
所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
在一些实施例中,所述时间信息包括一个时间段。In some embodiments, the time information includes a time period.
在一些实施例中,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。In some embodiments, the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.
为了解决上述技术问题,本发明实施例还提供一种拍摄系统,包括摄像设备和显示终端,所述摄像设备与所述显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像;其中,In order to solve the above technical problem, an embodiment of the present invention further provides a photographing system including an image capturing apparatus and a display terminal, wherein the image capturing apparatus communicates with the display terminal to display on the display terminal the image captured by the image capturing apparatus. Image; among them,
所述显示终端用于:The display terminal is used to:
接收用户输入的拍照请求;Receiving a photo request input by a user;
根据所述拍照请求,生成包含时间信息的拍照指令;Generating a photographing instruction including time information according to the photographing request;
向所述摄像设备发送所述拍照指令;Sending the photographing instruction to the imaging device;
所述摄像设备用于:The camera device is used to:
接收所述拍照指令;Receiving the photographing instruction;
根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及Obtaining, in the cache, an image collected by the imaging device at a time indicated by the time information according to the time information;
控制对查找到的图像的存储。Controls the storage of the found images.
为了解决上述技术问题,本发明实施例还提供一种拍摄装置,所述装置配 置于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像,所述拍摄装置包括:In order to solve the above technical problem, an embodiment of the present invention further provides a photographing apparatus, where the apparatus is disposed in a display terminal, and the display terminal communicates with an image capturing apparatus to display an image collected by the image capturing apparatus, and the photographing apparatus includes :
第一接收模块,用于接收用户输入的拍照请求;a first receiving module, configured to receive a photo request input by a user;
拍照指令生成模块,用于根据所述拍照请求,生成包含时间信息的拍照指令;a photographing instruction generating module, configured to generate a photographing instruction including time information according to the photographing request;
第一发送模块,用于向所述摄像设备发送所述拍照指令,以供所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并控制对查找到的图像的存储。a first sending module, configured to send the photographing instruction to the image capturing device, where the image capturing device searches the cache for an image captured by the image capturing device at a time indicated by the time information according to the time information. And control the storage of the found image.
为了解决上述技术问题,本发明实施例还提供一种拍摄装置,所述装置配置于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像,所述拍摄装置包括:In order to solve the above technical problem, an embodiment of the present invention further provides a photographing apparatus, where the apparatus is configured in an image capturing apparatus, and the image capturing apparatus communicates with a display terminal to display an image collected by the image capturing apparatus on the display terminal. The photographing device includes:
第三接收模块,用于从所述显示终端接收拍照指令,所述拍照指令中包含有时间信息;a third receiving module, configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information;
图像查找模块,用于根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及An image search module, configured to search, in the cache, an image collected by the camera device at a time indicated by the time information according to the time information;
存储控制模块,用于控制对查找到的图像的存储。A storage control module for controlling storage of the found image.
为了解决上述技术问题,本发明实施例还提供一种显示终端,所述显示终端包括处理器和与所述处理器通信连接的存储器;In order to solve the above technical problem, an embodiment of the present invention further provides a display terminal, where the display terminal includes a processor and a memory communicatively coupled to the processor;
其中,所述存储器存储有可被所述处理器执行的指令程序,所述指令程序被所述处理器执行,以使所述处理器能够执行上述的拍摄方法。Wherein the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the photographing method described above.
为了解决上述技术问题,本发明实施例还提供一种摄像设备,所述摄像设备包括处理器和与所述处理器通信连接的存储器;In order to solve the above technical problem, an embodiment of the present invention further provides an image capturing apparatus, where the image capturing apparatus includes a processor and a memory communicably connected to the processor;
其中,所述存储器存储有可被所述处理器执行的指令程序,所述指令程序被所述处理器执行,以使所述处理器能够执行上述的拍摄方法。Wherein the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the photographing method described above.
在本发明实施例的技术方案中,由于显示终端生成的拍照指令中包含有时间信息,能够用于向摄像设备请求与该时间信息对应的图像,因此,在摄像设备接收到该拍照指令后,能够根据该时间信息,在缓存中查找到该摄像设备在所述时间信息指示的时间所采集的图像,从而准确查找到用户实际想要拍摄的那个预览画面对应的图像,并对该图像进行存储,从而解决了由于显示终端的显示延时而导致用户实际拍摄的照片与当前显示的画面不一致的问题。In the technical solution of the embodiment of the present invention, since the photographing instruction generated by the display terminal includes time information, it can be used to request an image corresponding to the time information from the image capturing device. Therefore, after the photographing device receives the photographing instruction, According to the time information, the image captured by the imaging device at the time indicated by the time information can be found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is stored. Therefore, the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay of the display terminal is solved.
【附图说明】[Description of the Drawings]
为了更清楚地说明本发明实施例的技术方案,下面将对本发明实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in view of the drawings.
图1为本发明实施例的应用环境示意图;FIG. 1 is a schematic diagram of an application environment according to an embodiment of the present invention;
图2为本发明实施例提供的拍摄方法中,由摄像设备所采集图像的数据在时间轴上对应位置进行处理的示意图;FIG. 2 is a schematic diagram of processing data of an image captured by an imaging device on a time axis corresponding to a position in the photographing method according to an embodiment of the present invention; FIG.
图3为本发明一实施例提供的应用于显示终端的拍摄方法的流程图;FIG. 3 is a flowchart of a method for photographing a display terminal according to an embodiment of the present invention;
图4示出本发明一实施例提供的拍摄方法中,摄像设备采集图像、记录采集图像时的时间戳,并在缓存中对所采集的图像及其被采集时的时间戳进行保存的步骤;FIG. 4 is a diagram showing a step of capturing an image, recording a captured image, and storing the collected image and the time stamp when it is acquired in the buffer in the photographing method according to an embodiment of the present invention;
图5为本发明一实施例提供的应用于摄像设备的拍摄方法的流程图;FIG. 5 is a flowchart of a method for photographing applied to an image capturing apparatus according to an embodiment of the present invention; FIG.
图6示出本发明一实施例提供的应用于摄像设备的拍摄方法中,摄像设备对采集到的图像进行编码等的步骤;FIG. 6 is a diagram showing a step of encoding an image acquired by an imaging device in a photographing method applied to an image pickup apparatus according to an embodiment of the present invention;
图7为本发明一实施例提供的应用于包含摄像设备和显示终端的拍摄系统的拍摄方法的流程图;FIG. 7 is a flowchart of a shooting method applied to a photographing system including an image capturing apparatus and a display terminal according to an embodiment of the present invention; FIG.
图8为本发明一实施例提供的显示终端与摄像设备之间的信令交互图,该图示出了根据本发明一实施例提供的拍摄方法;FIG. 8 is a schematic diagram of a signaling interaction between a display terminal and an imaging device according to an embodiment of the present invention, and illustrates a shooting method according to an embodiment of the invention;
图9为本发明一实施例提供的应用于显示终端的拍摄装置的框图;FIG. 9 is a block diagram of a photographing apparatus applied to a display terminal according to an embodiment of the present invention; FIG.
图10为本发明另一实施例提供的应用于显示终端的拍摄装置的框图;FIG. 10 is a block diagram of a photographing apparatus applied to a display terminal according to another embodiment of the present invention; FIG.
图11为本发明一实施例提供的应用于摄像设备的拍摄装置的框图;FIG. 11 is a block diagram of a photographing apparatus applied to an image pickup apparatus according to an embodiment of the present invention; FIG.
图12为本发明另一实施例提供的应用于摄像设备的拍摄装置的框图;FIG. 12 is a block diagram of a photographing apparatus applied to an image pickup apparatus according to another embodiment of the present invention; FIG.
图13为本发明一实施例提供的一种拍摄装置的框图;FIG. 13 is a block diagram of a photographing apparatus according to an embodiment of the present invention;
图14为本发明一实施例提供的一种拍摄装置的框图。FIG. 14 is a block diagram of a photographing apparatus according to an embodiment of the present invention.
【具体实施方式】【Detailed ways】
为了便于理解本发明,下面结合附图和具体实施例,对本发明进行更详细的说明。需要说明的是,当元件被表述“固定于”另一个元件,它可以直接在另一个元件上、或者其间可以存在一个或多个居中的元件。当一个元件被表述“连接”另一个元件,它可以是直接连接到另一个元件、或者其间可以存在一个或多个居中的元件。本说明书所使用的术语“上”、“下”、“内”、“外”、“底部”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。此外,术语“第一”、“第二”“第三”等仅用于描述目的,而不能理解为指示或暗示相对重要性。In order to facilitate the understanding of the present invention, the present invention will be described in more detail below with reference to the accompanying drawings and specific embodiments. It is to be noted that when an element is described as being "fixed" to another element, it can be directly on the other element, or one or more central elements can be present. When an element is referred to as "connected" to another element, it can be a <RTI ID=0.0> </ RTI> </ RTI> <RTIgt; The orientation or positional relationship of the terms "upper", "lower", "inner", "outer", "bottom" and the like as used in the specification is based on the orientation or positional relationship shown in the drawings, only for convenience of description. The invention and the simplification of the invention are not to be construed as limiting or limiting the invention. Moreover, the terms "first", "second", "third", and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
除非另有定义,本说明书所使用的所有的技术和科学术语与属于本发明的技术领域的技术人员通常理解的含义相同。本说明书中在本发明的说明书中所使用的术语只是为了描述具体的实施例的目的,不是用于限制本发明。本说明书所使用的术语“和/或”包括一个或多个相关的所列项目的任意的和所有的组合。Unless otherwise defined, all technical and scientific terms used in the specification are the same meaning The terminology used in the description of the present invention is for the purpose of describing particular embodiments and is not intended to limit the invention. The term "and/or" used in this specification includes any and all combinations of one or more of the associated listed items.
此外,下面所描述的本发明不同实施例中所涉及的技术特征只要彼此之间未构成冲突就可以相互结合。Further, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as they do not constitute a conflict with each other.
本申请实施例适用于由显示终端通过无线传输方式进行远距离控制的摄像设备上,例如,适用于由遥控器控制的具备拍摄功能的无人飞行器上。The embodiment of the present application is applicable to an image capturing device that performs remote control by a display terminal by wireless transmission, for example, for an unmanned aerial vehicle with a shooting function controlled by a remote controller.
如图1所示,为本发明实施例提供的一种典型的应用环境。该应用环境可以包括:作为摄像设备的无人飞行器10和作为显示终端的遥控器20,其中,无人飞行器10具有拍摄功能,具体地,在本发明实施例中,无人飞行器10上搭 载有用于实现拍摄功能的相机100;遥控器20上安装有用于实现其显示功能的显示装置200。无人飞行器10与遥控器20之间建立有无线通信连接,无人飞行器10与遥控器20可以通过无线通信进行数据传输,遥控器20向无人飞行器10传输遥控器控制信号,以对无人飞行器10的飞行、拍摄等进行远距离控制。As shown in FIG. 1 , it is a typical application environment provided by an embodiment of the present invention. The application environment may include an unmanned aerial vehicle 10 as an imaging apparatus and a remote controller 20 as a display terminal, wherein the unmanned aerial vehicle 10 has a photographing function, and specifically, in the embodiment of the present invention, the unmanned aerial vehicle 10 is provided with useful A camera 100 that realizes a photographing function; a display device 200 for realizing a display function thereof is mounted on the remote controller 20. A wireless communication connection is established between the UAV 10 and the remote controller 20. The UAV 10 and the remote controller 20 can transmit data by wireless communication, and the remote controller 20 transmits a remote control signal to the UAV 10 to The flight, shooting, etc. of the aircraft 10 are remotely controlled.
具体地,在本发明实施例中,无人飞行器10和遥控器20具有用于进行彼此间的数据传输的模块,例如,射频模块(RF模块)。相机100采集的图像等信号通过无人飞行器10的射频模块实时传输给遥控器20的射频模块,再通过遥控器20上的显示装置200向用户显示。另一方面,当用户通过显示装置200输入拍摄请求时,遥控器20基于该拍摄请求生成拍照指令,由遥控器20的射频模块发送给无人飞行器10的射频模块,无人飞行器10的射频模块接收到该拍照指令后,发送给相机100的处理器,由相机100完成相应的拍摄任务,包括在缓存中查找图像和控制查找到的图像的保存。Specifically, in the embodiment of the present invention, the UAV 10 and the remote controller 20 have modules for performing data transmission between each other, for example, a radio frequency module (RF module). The signals and the like collected by the camera 100 are transmitted to the RF module of the remote controller 20 in real time through the RF module of the UAV 10, and then displayed to the user through the display device 200 on the remote controller 20. On the other hand, when the user inputs a photographing request through the display device 200, the remote controller 20 generates a photographing instruction based on the photographing request, and the radio frequency module of the remote controller 20 transmits the radio frequency module to the unmanned aerial vehicle 10, and the radio frequency module of the unmanned aerial vehicle 10 After receiving the photographing instruction, the processor is sent to the camera 100, and the camera 100 completes the corresponding photographing task, including searching for an image in the cache and controlling the saving of the found image.
在图1所示的应用环境中,遥控器20上安装的显示装置200为遥控器20自带的显示屏,在一些实现方式中,显示装置200为液晶显示屏(LCD)。可以理解的是,在其他应用环境中,显示装置200不仅可以是内置在遥控器20上的显示屏,也可以是外接到遥控器上的带有显示功能的移动终端,例如智能手机、平板电脑等。In the application environment shown in FIG. 1, the display device 200 mounted on the remote controller 20 is a display screen provided by the remote controller 20. In some implementations, the display device 200 is a liquid crystal display (LCD). It can be understood that, in other application environments, the display device 200 can be not only a display screen built in the remote controller 20, but also a mobile terminal with a display function externally connected to the remote controller, such as a smart phone or a tablet computer. Wait.
在本发明实施例中,摄像设备为具有拍摄功能的无人飞行器10,其拍摄功能通过搭载在无人飞行器10上的相机100来实现,位于显示终端的用户可以通过无人飞行器10获取由相机100采集的图像。在其他实施例中,摄像设备不限于为具有拍摄功能的无人飞行器10,还可以是具有存储功能和/或处理功能等的相机或者摄像机等,或者是具有拍摄功能的固定装置例如摄像头等。用户可以直接从相机、摄像机或具有拍摄功能的固定装置获取其采集的图像。In the embodiment of the present invention, the image capturing apparatus is an unmanned aerial vehicle 10 having a photographing function, and the photographing function is realized by the camera 100 mounted on the unmanned aerial vehicle 10, and the user located at the display terminal can acquire the camera by the unmanned aerial vehicle 10. 100 captured images. In other embodiments, the image pickup apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function or the like, or a fixing device having a photographing function such as a camera or the like. Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
在本发明实施例中,显示终端为具有显示装置200的遥控器20。在其他实施例中,显示终端还可以是能够显示画面的智能手机、平板电脑、PC机、笔记本电脑等,用户通过在该显示终端上查看摄像设备采集的图像,并远程操控摄像设备,从而实现远程拍摄。例如,当摄像设备为无人飞行器,显示终端为手机时,用户可以在手机上运行由该无人飞行器的厂商提供的App来操纵无人飞 行器,从而实现对无人飞行器10的飞行、拍摄等的远距离控制。In the embodiment of the present invention, the display terminal is the remote controller 20 having the display device 200. In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like capable of displaying a screen, and the user can view the image captured by the camera device on the display terminal and remotely control the camera device, thereby realizing Remote shooting. For example, when the camera device is an unmanned aerial vehicle and the display terminal is a mobile phone, the user can run an app provided by the manufacturer of the unmanned aerial vehicle to operate the unmanned aerial vehicle on the mobile phone, thereby realizing flight, shooting, etc. of the unmanned aerial vehicle 10. Long distance control.
由于无人飞行器10的图像信号传输给遥控器20需要一定时间,因此用户在遥控器20上的显示装置200上观察到的预览的画面并非实时显示的采集的图像,而是存在有一定的延时。本发明实施例提供的拍摄方法解决了现有的通过无线控制信号进行远距离控制的拍摄方法中,由于显示延时而导致用户通过摄像设备实际拍摄的照片与当前在显示终端上显示的预览的画面不一致的问题。以下将在具体实施例中进行说明。Since the image signal of the UAV 10 is transmitted to the remote controller 20 for a certain period of time, the previewed image observed by the user on the display device 200 on the remote controller 20 is not the captured image displayed in real time, but has a certain delay. Time. The photographing method provided by the embodiment of the present invention solves the existing photographing method for remotely controlling by the wireless control signal, and the photograph actually taken by the user through the photographing device and the preview currently displayed on the display terminal due to the display delay The problem of inconsistent pictures. The following description will be made in the specific examples.
如图2所示,为本发明实施例提供的拍摄方法中,由摄像设备所采集的图像的数据在时间轴上对应位置进行处理的示意图。具体地,处理过程主要包括:摄像设备采集图像;摄像设备对采集到的图像进行编码,并将时间信息记录在编码后的图像的数据中;摄像设备将编码后的图像发送给显示终端;显示终端显示编码后的图像;显示终端基于用户的拍照请求生成包含时间信息的拍照指令,并将该拍照指令发送给摄像设备;摄像设备根据时间信息查找该时间信息指示的时间所采集的图像。最后,摄像设备再控制所查找到的图像的存储(未在图2中示出)。As shown in FIG. 2, in the photographing method provided by the embodiment of the present invention, the data of the image collected by the image capturing device is processed in a corresponding position on the time axis. Specifically, the processing process mainly includes: the imaging device collects an image; the imaging device encodes the collected image, and records the time information in the data of the encoded image; the imaging device sends the encoded image to the display terminal; The terminal displays the encoded image; the display terminal generates a photographing instruction including the time information based on the photographing request of the user, and sends the photographing instruction to the photographing device; and the photographing device searches for the image collected by the time indicated by the time information according to the time information. Finally, the imaging device then controls the storage of the found image (not shown in Figure 2).
在一个典型应用中,图2中的摄像设备例如为图1所示的无人飞行器10,图2中的显示终端例如为图1所示的遥控器20,以下以此为例描述本发明实施例提供的拍摄方法的全过程。而在后文中,还将进一步从作为摄像设备一侧的无人飞行器10和作为显示终端一侧的遥控器20,分别描述本发明实施例提供的拍摄方法的流程。In a typical application, the image pickup apparatus in FIG. 2 is, for example, the unmanned aerial vehicle 10 shown in FIG. 1 , and the display terminal in FIG. 2 is, for example, the remote controller 20 shown in FIG. 1 . The whole process of the shooting method provided by the example. In the following, the flow of the photographing method provided by the embodiment of the present invention will be further described from the unmanned aerial vehicle 10 on the side of the image pickup apparatus and the remote controller 20 on the side of the display terminal.
如图2所示,横坐标表示时间轴,纵坐标示出了在时间轴上的各个时间点上,图像的数据等的传输情况。在图2中以t时刻为无人飞行器10通过其相机100采集图像的起始时刻、每间隔1个单位时间进行一次图像采集为例,对本发明实施例进行说明。As shown in Fig. 2, the abscissa represents the time axis, and the ordinate shows the transmission of data of the image, etc. at various points in time on the time axis. In FIG. 2, an embodiment of the present invention will be described by taking an example in which the unmanned aerial vehicle 10 performs image acquisition at intervals of one unit time by the camera 100 at the time t.
具体地,无人飞行器10通过相机100的摄像头从时间轴上的t时刻开始,在t、t+1、t+2、t+3、t+4和t+5时刻分别针对拍摄场景采集了图像a 0、b 0、c 0、d 0、e 0和f 0,并分别记录采集图像a 0、b 0、c 0、d 0、e 0和f 0时的时间信息F(t)、F(t+1)、F(t+2)、F(t+3)、F(t+4)和F(t+5)。无人飞行器10对采集到的图像a 0、b 0、c 0、d 0、 e 0和f 0进行编码,并将图像a 0、b 0、c 0、d 0、e 0和f 0被采集时的时间信息F(t)、F(t+1)、F(t+2)、F(t+3)、F(t+4)和F(t+5)记录在编码后的图像的数据a、b、c、d、e和f中,由无人飞行器10传输给遥控器20,以便在遥控器20上显示编码后的图像。 Specifically, the UAV 10 is collected from the time of the time axis by the camera of the camera 100, and is collected for the shooting scene at times t, t+1, t+2, t+3, t+4, and t+5, respectively. Images a 0 , b 0 , c 0 , d 0 , e 0 , and f 0 , and record time information F(t) when acquiring images a 0 , b 0 , c 0 , d 0 , e 0 , and f 0 , respectively F(t+1), F(t+2), F(t+3), F(t+4), and F(t+5). The unmanned aerial vehicle 10 encodes the acquired images a 0 , b 0 , c 0 , d 0 , e 0 and f 0 , and images a 0 , b 0 , c 0 , d 0 , e 0 and f 0 are The time information F(t), F(t+1), F(t+2), F(t+3), F(t+4) and F(t+5) at the time of acquisition are recorded in the encoded image. The data a, b, c, d, e, and f are transmitted from the unmanned aerial vehicle 10 to the remote controller 20 to display the encoded image on the remote controller 20.
应理解的是,无人飞行器通过相机100采集的图像具体由无人飞行器10的信号发送模块进行传输,遥控器20上具有相应的信号接收模块,遥控器20首先接收到无人飞行器10发送的图像的数据,再在显示装置200上进行显示;当用户在显示装置200上输入拍照请求时,由遥控器20基于该拍照请求生成拍照指令,并将该拍照指令通过遥控器20的信号发送模块进行发送,无人飞行器10上具有相应的信号接收模块,无人飞行器10接收到遥控器20发送的拍照指令后,将该拍照指令传输给相机100,由相机100执行相应的操作。应理解的是,无人飞行器10上的信号发送模块和信号接收模块可以为同一通信模块,遥控器20的信号发送模块和信号接收模块也可以为同一通信模块。It should be understood that the image acquired by the UAV through the camera 100 is specifically transmitted by the signal transmitting module of the UAV 10, and the remote controller 20 has a corresponding signal receiving module, and the remote controller 20 first receives the unmanned aerial vehicle 10 to transmit. The data of the image is displayed on the display device 200. When the user inputs the photographing request on the display device 200, the remote controller 20 generates a photographing instruction based on the photographing request, and passes the photographing command through the signal transmitting module of the remote controller 20. The camera 100 performs a corresponding signal receiving module. After receiving the camera command sent by the remote controller 20, the unmanned aerial vehicle 10 transmits the camera command to the camera 100, and the camera 100 performs a corresponding operation. It should be understood that the signal transmitting module and the signal receiving module on the UAV 10 may be the same communication module, and the signal transmitting module and the signal receiving module of the remote controller 20 may also be the same communication module.
由于图像的传输需要时间,因此,图像到达遥控器20的时间会滞后,存在时间差ΔT,在本实施例中,以ΔT=5为例,由无人飞行器10处理后的每个图像的数据传输至遥控器20需要5个单位时间,即,从无人飞行器10传输到遥控器20上并在遥控器20的显示装置200上进行显示的图像存在5个单位时间的延时,用户在当前时刻在显示装置200上观察到的预览画面实际上是相机100在5个单位时间前采集的图像。在某一时刻,用户输入拍照请求,在本实施例中,以用户在t+8时刻输入拍照指令为例,此时,虽然时间轴上对应的时间为t+8,但显示装置200上显示的是时间信息F(t+3)指示的时间所采集的图像d 0。也就是说,用户实际上观察到并且想要进行拍照的是图像d 0在显示装置200上所显示的那个画面。当用户在t+8时刻输入拍照请求后,遥控器20基于该拍照请求生成包含有该t+8时刻在显示装置200上显示的图像d 0的时间信息F(t+3)的拍照指令,将该拍照指令发送给无人飞行器10,无人飞行器10接收到遥控器20发送的包含有时间信息F(t+3)的拍照指令,根据该时间信息F(t+3),在缓存中查找时间信息F(t+3)所指示的时间通过相机100所采集的图像,即,图像d 0,由上可知,该图像d 0与用户实际上观察到并且想要进行拍照的画面相一致。 Since the transmission of the image takes time, the time when the image arrives at the remote controller 20 may be delayed, and there is a time difference ΔT. In the present embodiment, the data transmission of each image processed by the unmanned aerial vehicle 10 is taken as an example of ΔT=5. It takes 5 unit time to the remote controller 20, that is, an image transmitted from the unmanned aerial vehicle 10 to the remote controller 20 and displayed on the display device 200 of the remote controller 20 has a delay of 5 unit time, and the user is at the current time. The preview screen observed on the display device 200 is actually an image captured by the camera 100 before 5 unit time. At a certain moment, the user inputs a photographing request. In this embodiment, the user inputs the photographing command at time t+8 as an example. At this time, although the time corresponding to the time axis is t+8, the display device 200 displays It is the image d 0 acquired at the time indicated by the time information F(t+3). That is to say, what the user actually observes and wants to take a picture is the picture on which the image d 0 is displayed on the display device 200. Once the user has photographed request t + 8 time, the remote controller 20 based on the photographing request generator contains the t + 8 time displayed on the display device 200 of the image d 0 time information F (t + 3) photographing instruction, The photographing instruction is sent to the unmanned aerial vehicle 10, and the unmanned aerial vehicle 10 receives the photographing instruction including the time information F(t+3) sent by the remote controller 20, according to the time information F(t+3), in the cache. The time indicated by the time information F(t+3) is obtained by the image captured by the camera 100, that is, the image d 0 , which is known from the above, and the image d 0 is consistent with the picture actually observed by the user and intended to be photographed. .
最后,存储查找到的图像d 0。具体地,无人飞行器10查找到相应的图像后,对该图像进行存储,以供用户随时查看、下载。 Finally, the found image d 0 is stored. Specifically, after the unmanned aerial vehicle 10 finds the corresponding image, the image is stored for the user to view and download at any time.
本发明实施例提供的拍摄方法,利用拍照指令中包含的时间信息,在无人飞行器10的缓存中查找到无人飞行器10通过相机100在所述时间信息指示的时间所采集的图像,可以准确查找到用户实际想要拍摄的那个预览画面对应的图像,并对该图像进行存储,从而解决了由于显示延时而导致用户实际拍摄的照片与当前显示的画面不一致的问题。The photographing method provided by the embodiment of the present invention can find the image collected by the unmanned aerial vehicle 10 through the camera 100 at the time indicated by the time information in the cache of the unmanned aerial vehicle 10 by using the time information contained in the photographing instruction. The image corresponding to the preview screen that the user actually wants to capture is found, and the image is stored, thereby solving the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay.
图3是本发明一示例性实施例提供的一种拍摄方法的流程图。该方法可以应用于显示终端,所述显示终端与摄像设备通信,以显示由摄像设备采集的图像。显示终端例如为图1中所示的遥控器20,摄像设备例如为图1中所示的无人飞行器10。如图3所示,该方法可以包括:FIG. 3 is a flowchart of a photographing method according to an exemplary embodiment of the present invention. The method can be applied to a display terminal that communicates with an imaging device to display an image captured by the imaging device. The display terminal is, for example, the remote controller 20 shown in Fig. 1, and the image pickup apparatus is, for example, the unmanned aerial vehicle 10 shown in Fig. 1. As shown in FIG. 3, the method may include:
在步骤S210中,接收用户输入的拍照请求。In step S210, a photo request input by the user is received.
该拍照请求可以用于表示用户意图对当前在作为显示终端的遥控器20的显示装置200上所显示的预览画面进行拍照。例如,当无人飞行器10把通过相机100采集的图像发送到遥控器20上,在遥控器20的显示装置200上显示时,在遥控器20的一端观看预览画面的用户如果对其中某个或某些时刻或时段的画面感兴趣,可以通过遥控器20上的交互界面进行针对该预览画面的拍照请求操作,以指示无人飞行器10对该画面进行拍照。在一些实现方式中,用户通过交互界面向遥控器20输入拍照请求,交互界面位于遥控器20的显示装置200上,该交互界面可以是显示装置200上所显示的app界面,该app界面中包含了用于完成拍照的虚拟的提示按键。在另一些实现方式中,用户还可以通过遥控器20上的实体按键来向遥控器10输入拍照请求,该实体按键可以是位于遥控器20的机身上特定位置的实体按钮。The photographing request can be used to indicate that the user intends to take a picture of the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal. For example, when the UAV 10 transmits an image captured by the camera 100 to the remote controller 20 and displays it on the display device 200 of the remote controller 20, the user who views the preview screen at one end of the remote controller 20 is one of them or The picture of some time or time period is of interest, and the picture request operation for the preview picture may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to take a picture of the picture. In some implementations, the user inputs a photographing request to the remote controller 20 through the interactive interface. The interactive interface is located on the display device 200 of the remote controller 20. The interactive interface may be an app interface displayed on the display device 200, and the app interface includes A virtual reminder button for completing the photo. In other implementations, the user may also input a photo request to the remote control 10 via a physical button on the remote control 20, which may be a physical button located at a particular location on the body of the remote control 20.
在步骤S220中,根据所述拍照请求,生成包含时间信息的拍照指令。In step S220, a photographing instruction including time information is generated according to the photographing request.
所述拍照指令用于向所述摄像设备请求与所述时间信息对应的图像。在一些实施例中,所述时间信息包括时间戳或者一个时间段。在其中一种实现方式中,所述时间戳可以为用户向作为显示终端的遥控器20输入拍照请求时,当前在遥控器20的显示装置200上显示的图像被采集时的时间戳。遥控器20在接 收用户输入的拍照请求之前,该时间戳已经被记录在用于在显示装置200上显示的编码后的图像的数据中,随着编码后的图像的数据一起从无人飞行器10的一端发送给遥控器20的一端,以便用户基于该时间戳请求与该时间戳对应的图像。The photographing instruction is configured to request an image corresponding to the time information from the image capturing device. In some embodiments, the time information includes a timestamp or a time period. In one of the implementations, the time stamp may be a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. The remote controller 20 has been recorded in the data of the encoded image for display on the display device 200 before receiving the photographing request input by the user, along with the data of the encoded image from the unmanned aerial vehicle 10 One end is sent to one end of the remote controller 20 so that the user requests an image corresponding to the time stamp based on the time stamp.
具体地,由无人飞行器10通过相机100采集到的图片、视频等的图像未经编码处理,无法在作为显示终端的遥控器20上直接显示/播放,因此需要经过编码处理成编码后的图像才能在遥控器20上进行实时显示/播放,在无人飞行器10对采集到的图像进行编码处理时,会将所记录下的采集每一图像时的时间戳分别包含在每个编码后的图像的数据中,从而,每个编码后的图像的数据中都记录了该图像被采集时的时间戳。例如,在一个实施例中,如果时间戳为10:31,那么,与该时间戳对应的图像可以包括无人飞行器10在10:31这一时刻所采集的图像,在对该图像进行编码时,该时间戳10:31被记录在编码后的图像的数据中,随编码后的图像一起发送给遥控器20,由遥控器20的显示装置200显示该编码后的图像。Specifically, the image of the picture, video, or the like collected by the UAV 10 through the camera 100 is not encoded, and cannot be directly displayed/played on the remote controller 20 as the display terminal, and therefore needs to be encoded into the encoded image. Real-time display/playback can be performed on the remote controller 20, and when the unmanned aerial vehicle 10 performs encoding processing on the acquired image, the recorded time stamps for collecting each image are respectively included in each encoded image. In the data, thus, the time stamp of the image is collected in the data of each encoded image. For example, in one embodiment, if the timestamp is 10:31, then the image corresponding to the timestamp may include an image acquired by the UAV 10 at 10:31, when encoding the image. The time stamp 10:31 is recorded in the data of the encoded image, and is transmitted to the remote controller 20 along with the encoded image, and the encoded image is displayed by the display device 200 of the remote controller 20.
由于作为显示终端的遥控器20所生成的拍照指令中包含有时间信息,在将该拍照指令发送给无人飞行器10时,就可以利用该拍照指令中包含的时间信息,向无人飞行器10请求与所述时间信息对应的图像,由无人飞行器10在缓存中查找无人飞行器10通过其相机100在该时间信息指示的时间所采集的图像,到查找到该图像后,无人飞行器10控制该图像的存储,以便用户随时查看、下载。Since the photographing instruction generated by the remote controller 20 as the display terminal includes time information, when the photographing instruction is transmitted to the unmanned aerial vehicle 10, the time information included in the photographing command can be used to request the unmanned aerial vehicle 10 An image corresponding to the time information is searched by the unmanned aerial vehicle 10 in the cache for an image acquired by the unmanned aerial vehicle 10 through the time indicated by the camera 100 at the time information, and after the image is found, the unmanned aerial vehicle 10 controls The image is stored so that the user can view and download it at any time.
在步骤S230中,向所述摄像设备发送所述拍照指令,以供所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并存储查找到的图像。In step S230, the photographing instruction is sent to the image capturing device, so that the image capturing device searches the cache for an image captured by the image capturing device at the time indicated by the time information according to the time information, and Store the found image.
具体地,在本实施例中,所述时间信息为用户向作为显示终端的遥控器20输入拍照请求时,当前在遥控器20的显示装置200上显示的图像被采集时的时间戳。由于该时间戳由编码后的图像的数据携带,一起发送给遥控器20,因此,遥控器20在基于用户输入的拍照请求生成拍照指令时,首先获取当前在遥控器20上显示的图像的数据中所携带的时间戳的信息,再将该时间戳作为所述时间信息,包括在生成的所述拍照指令中。Specifically, in the present embodiment, the time information is a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. Since the time stamp is carried by the data of the encoded image and sent to the remote controller 20 together, the remote controller 20 first acquires the data of the image currently displayed on the remote controller 20 when generating the photographing instruction based on the photographing request input by the user. The time stamp information carried in the time stamp is used as the time information, and is included in the generated photographing instruction.
遥控器20向无人飞行器10发送拍照指令后,无人飞行器10解析出该拍照指令中所包含的时间戳的信息,并从缓存中查找出无人飞行器10在所述时间戳指示的时间所采集的图像。由于该时间戳反映出用户在输入拍照指令那一刻具体想要拍摄的是显示装置200上所显示的哪一画面对应的图像,因此,只要根据用户所想拍照的图像的时间戳,就能从事先缓存在无人飞行器10的内存中的众多图像中查找到该时间戳对应的那一图像。After the remote controller 20 sends a photographing instruction to the unmanned aerial vehicle 10, the unmanned aerial vehicle 10 parses out the information of the time stamp contained in the photographing instruction, and finds from the cache the time when the unmanned aerial vehicle 10 is indicated by the time stamp. The captured image. Since the time stamp reflects the image corresponding to the screen displayed on the display device 200 when the user specifically wants to take a picture at the moment of inputting the photographing instruction, the time stamp can be engaged according to the time stamp of the image that the user wants to take. The image corresponding to the timestamp is first found in a plurality of images cached in the memory of the unmanned aerial vehicle 10.
因此,在无人飞行器10的相机100采集图像时,还需对所采集的图像及其采集时的时间戳进行缓存。Therefore, when the camera 100 of the UAV 10 captures an image, it is also necessary to cache the acquired image and the time stamp at the time of acquisition.
如图4所示,示出了在本发明一实施例提供的拍摄方法中,摄像设备采集图像、记录采集图像时的时间戳,并在缓存中对所采集的图像及其被采集时的时间戳进行保存的步骤。具体包括:As shown in FIG. 4, in the photographing method provided by an embodiment of the present invention, a time stamp when an image capturing apparatus collects an image, records an acquired image, and collects an image in a buffer and a time when the image is collected. Stamp the steps to save. Specifically include:
步骤S110,所述摄像设备采集图像;Step S110, the imaging device collects an image;
步骤S120,记录采集图像时的时间戳;Step S120, recording a time stamp when the image is collected;
步骤S130,在所述缓存中保存所述摄像设备采集到的图像以及所述采集到的图像被采集时的时间戳。Step S130, saving an image collected by the imaging device and a time stamp when the collected image is collected in the cache.
具体地,无人飞行器10缓存采集到的图像,以及记录采集图像时的时间戳并对该时间戳进行缓存,是为了在之后从遥控器20接收到拍照指令后,基于图像的数据中包含的时间戳查找到相应的图像。应理解的是,无人飞行器10的缓存空间是有限的,随着时间的推移,无人飞行器10不断采集并缓存图像以及每个所采集的图像被采集时的时间戳,在无人飞行器10的缓存空间被所采集的图像和时间戳的数据完全利用后,每次再采集新的图像及其时间戳时的数据时,已经缓存在缓存空间中的旧的图像及其时间戳的数据将按照采集时间的先后依次清除,也就是说,每当有新的一个图像和/或时间戳的数据即将缓存到无人飞行器10中时,无人飞行器10的缓存空间中在时间先后上最早被缓存的那个图像和/或时间戳的数据将被清除,随着无人飞行器10不断缓存新的图像和/或时间戳的数据,旧的图像和/或时间戳的数据相应地按时间先后顺序一一清除。Specifically, the UAV 10 buffers the acquired image, and records the time stamp when the image is acquired and buffers the time stamp for the purpose of the image-based data included after receiving the photographing instruction from the remote controller 20 The timestamp finds the corresponding image. It should be understood that the cache space of the UAV 10 is limited, and over time, the UAV 10 continuously acquires and caches images and time stamps when each captured image is acquired, in the UAV 10 After the cache space is fully utilized by the acquired image and timestamp data, each time the new image and its timestamp data are collected, the old image that has been cached in the cache space and its timestamp data will be The data is sequentially cleared in the order of the acquisition time, that is, whenever a new image and/or time stamp data is about to be cached in the UAV 10, the cache space of the UAV 10 is the earliest in the time sequence. The cached image and/or timestamp data will be erased, and as the UAV 10 continually caches new image and/or timestamp data, the old image and/or timestamp data is chronologically ordered accordingly. Clear one by one.
应理解的是,时间戳可以放在所采集的图像的数据里面,与所采集的图像的数据一起保存在缓存中;时间戳也可以单独地被保存在缓存。当对时间戳单 独地保存在缓存中,需要一并保存每个时间戳与所采集的图像的对应关系。在本发明一些实施例中,缓存为摄像设备上用于数据交换的缓冲区(称作Cache),通常使用的是RAM(断电即掉的非永久储存),例如,缓存可以是摄像设备上的内存条。在本实施例中,该缓存可以是无人飞行器10上的内存条,该内存条可以设置在无人飞行器10的任意部件上。It should be understood that the timestamp may be placed in the data of the acquired image and stored in the cache along with the data of the acquired image; the timestamp may also be stored separately in the cache. When the timestamp is separately stored in the cache, it is necessary to save the correspondence between each timestamp and the acquired image. In some embodiments of the present invention, the cache is a buffer (referred to as a Cache) for data exchange on the image capturing device, and usually uses RAM (non-permanent storage that is powered off), for example, the cache may be on the camera device. Memory stick. In the present embodiment, the cache may be a memory module on the UAV 10 that may be disposed on any component of the UAV 10.
最后,无人飞行器10控制查找到的图像的存储,以便之后用户可以随时查看、保存和/或下载。在一些实现方式中,无人飞行器10将查找到的图像永久地存储在无人飞行器10,例如,存储在无人飞行器10的存储卡上;或者,无人飞行器10将查找到的图像发送给遥控器20,由遥控器20存储所述查找到的图像,例如,存储在遥控器20的存储卡上;或者,无人飞行器10将查找到的图像发送给其他第三方设备,由该第三方设备对查找到的图像进行存储。在另一些实现方式中,无人飞行器10还可以通过万维网(World Wide Web)上的云存储服务,将查找到的图像上传至网盘。对于将查找到的图像存储在无人飞行器10的存储卡上的情形,用户既可以从无人飞行器10上取下存储卡,用计算机、笔记本、硬盘等外部设备读取并保存存储卡上的图像,也可以不从无人飞行器10上取下存储卡,而是用例如手机等外部设备与无人飞行器10进行无线连接,将存储在无人飞行器10上的图像直接下载到外部设备上。Finally, the UAV 10 controls the storage of the found images so that the user can view, save, and/or download at any time. In some implementations, the UAV 10 permanently stores the found image on the UAV 10, for example, on a memory card of the UAV 10; or, the UAV 10 sends the found image to The remote controller 20 stores the searched image by the remote controller 20, for example, on a memory card of the remote controller 20; or the unmanned aerial vehicle 10 transmits the found image to other third party devices by the third party The device stores the found image. In other implementations, the UAV 10 can also upload the found images to the web disk via a cloud storage service on the World Wide Web. For the case where the searched image is stored on the memory card of the unmanned aerial vehicle 10, the user can remove the memory card from the unmanned aerial vehicle 10 and read and save the memory card with an external device such as a computer, a notebook, or a hard disk. The image may not be removed from the unmanned aerial vehicle 10, but may be wirelessly connected to the unmanned aerial vehicle 10 by an external device such as a mobile phone, and the image stored on the unmanned aerial vehicle 10 may be directly downloaded to the external device.
根据用户对相机100的不同设置,可以将所述查找到的图像保存为raw格式的图片,作为最终输出的照片;或者将所述查找到的图像进行压缩编码,生成压缩编码后的图像,并保存所述压缩编码后的图像,作为最终输出的照片。例如,若果用户将相机100的图片输出格式设定为raw格式,则将该查找到的图像直接保存为raw格式的图片,作为最终输出的照片,提供给用户;如果用户将相机100的图片输出格式设定压缩编码后的图像格式,例如JPG、JPEG、TIFF、TIF等常见的格式,则根据用户的设定,首先对该查找到的图像进行压缩编码,生成与用户所设定的相机100的图像输出格式一致的压缩编码后的图像,再保存该压缩编码后的图像,作为最终输出的照片,提供给用户。According to different settings of the camera 100 by the user, the searched image may be saved as a picture in a raw format as a final output photo; or the searched image may be compression-encoded to generate a compression-encoded image, and The compression-encoded image is saved as a final output photo. For example, if the user sets the picture output format of the camera 100 to the raw format, the searched image is directly saved as a picture in the raw format, and is provided as a final output photo to the user; if the user takes a picture of the camera 100 The output format is set to a compression-encoded image format, such as a common format such as JPG, JPEG, TIFF, TIF, etc., according to the user's setting, first compressing and encoding the searched image to generate a camera set by the user. The image output format of 100 is compressed and encoded, and the compression-encoded image is saved as a final output photo, which is provided to the user.
本发明实施例提供的拍摄方法,由于显示终端生成的拍照指令中包含有时间信息,能够用于向摄像设备请求与该时间信息对应的图像,因此,在摄像设 备接收到该拍照指令后,能够根据该时间信息,在缓存中查找到该摄像设备在所述时间信息指示的时间所采集的图像,从而准确查找到用户实际想要拍摄的那个预览画面对应的图像,并对该图像进行存储,从而解决了由于显示终端的显示延时而导致用户实际拍摄的照片与当前显示的画面不一致的问题。The photographing method provided by the embodiment of the present invention can be used to request an image corresponding to the time information from the image capturing device because the photographing instruction generated by the display terminal includes the time information, and therefore, after the photographing device receives the photographing instruction, According to the time information, the image captured by the imaging device at the time indicated by the time information is found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is stored. Thereby, the problem that the photo actually taken by the user is inconsistent with the currently displayed picture due to the display delay of the display terminal is solved.
图5是本发明另一示例性实施例提供的一种拍摄方法的流程图。该方法可以应用于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像。其中,摄像设备例如为图1中所示的具有拍摄功能的无人飞行器,该无人飞行器10的拍摄功能由其搭载的相机100来实现;显示终端例如为图1中所示的具有显示功能的遥控器20,其显示功能通过遥控器20上的显示装置200来实现。如图5所示,该方法可以包括步骤S310~S330:FIG. 5 is a flowchart of a photographing method according to another exemplary embodiment of the present invention. The method can be applied to an imaging apparatus that communicates with a display terminal to display an image captured by the imaging apparatus on the display terminal. The image capturing apparatus is, for example, an unmanned aerial vehicle having a photographing function as shown in FIG. 1, and the photographing function of the unmanned aerial vehicle 10 is realized by the camera 100 mounted thereon; the display terminal has a display function as shown in FIG. The remote controller 20 has its display function implemented by the display device 200 on the remote controller 20. As shown in FIG. 5, the method may include steps S310-S330:
在步骤S310中,从显示终端接收拍照指令,所述拍照指令中包含有时间信息。In step S310, a photographing instruction is received from the display terminal, and the photographing instruction includes time information.
作为显示终端的遥控器20接收到用户输入的拍照请求后,根据该拍照请求生成包含有时间信息的拍照指令,并向作为摄像设备的无人飞行器10发送该拍照指令,无人飞行器10从作为显示终端的遥控器20接收该包含有时间信息的拍照指令。具体地,在本发明实施例中,遥控器20将拍照指令通过遥控器20上的射频模块传输给无人飞行器10,由无人飞行器10的射频模块进行接收,无人飞行器10的射频模块接收到该拍照指令后,由处理器完成相应的拍摄任务,包括在缓存中查找图像和控制查找到的图像的保存。After receiving the photographing request input by the user, the remote controller 20 as the display terminal generates a photographing instruction including time information according to the photographing request, and transmits the photographing instruction to the unmanned aerial vehicle 10 as the photographing device, and the unmanned aerial vehicle 10 acts as The remote controller 20 of the display terminal receives the photographing instruction including the time information. Specifically, in the embodiment of the present invention, the remote controller 20 transmits the photographing instruction to the unmanned aerial vehicle 10 through the radio frequency module on the remote controller 20, and is received by the radio frequency module of the unmanned aerial vehicle 10, and the radio frequency module of the unmanned aerial vehicle 10 receives the radio frequency module. After the photographing instruction, the corresponding shooting task is completed by the processor, including searching for an image in the cache and controlling the saving of the found image.
该拍照请求可以用于表示用户意图对当前在作为显示终端的遥控器20的显示装置200上所显示的预览画面进行拍照。例如,当无人飞行器10通过相机100采集的图像发送到遥控器20上,在遥控器20的显示装置200上显示时,在遥控器20的一端观看预览画面的用户如果对其中某个或某些时刻或时段的画面感兴趣,可以通过遥控器20上的交互界面进行针对该预览画面的拍照请求操作,以指示无人飞行器10对该画面进行拍照。之后,遥控器20可以接收到该拍照请求。在一些实现方式中,交互界面位于遥控器20的显示装置200上,该交互界面可以是显示装置200上所显示的app界面,该app界面中包含了用于完成拍照的虚拟的提示按键。在另一些实现方式中,用户还可以通过遥控器20上的 实体按键来完成针对当前显示装置200所显示的画面的拍照请求,该实体按键可以是位于遥控器20的机身上特定位置的按钮。The photographing request can be used to indicate that the user intends to take a picture of the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal. For example, when the image collected by the UAV 10 through the camera 100 is transmitted to the remote controller 20 and displayed on the display device 200 of the remote controller 20, the user who views the preview screen at one end of the remote controller 20 is one or some of them. The pictures of the moments or time periods are of interest, and the photographing request operation for the preview screen may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to take a picture of the picture. Thereafter, the remote controller 20 can receive the photographing request. In some implementations, the interactive interface is located on the display device 200 of the remote controller 20. The interactive interface may be an app interface displayed on the display device 200, and the app interface includes a virtual prompt button for completing the photographing. In other implementations, the user may also complete a photo request for a screen displayed by the current display device 200 by a physical button on the remote controller 20, which may be a button located at a specific position on the body of the remote controller 20. .
在一个实施例中,所述时间信息包括时间戳或者一个时间段。在其中一种实现方式中,所述时间戳可以为用户向作为显示终端的遥控器20输入拍照请求时,当前在遥控器20的显示装置200上显示的图像被采集时的时间戳。遥控器20在接收用户输入的拍照请求之前,该时间戳已经被记录在用于在显示装置200上显示的编码后的图像的数据中,随着编码后的图像的数据一起从无人飞行器10的一端发送给遥控器20的一端,以便用户基于该时间戳请求与该时间戳对应的图像。In one embodiment, the time information includes a timestamp or a time period. In one of the implementations, the time stamp may be a time stamp when the image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. The remote controller 20 has been recorded in the data of the encoded image for display on the display device 200 before receiving the photographing request input by the user, along with the data of the encoded image from the unmanned aerial vehicle 10 One end is sent to one end of the remote controller 20 so that the user requests an image corresponding to the time stamp based on the time stamp.
具体地,在步骤S310之前,还包括作为摄像设备的无人飞行器10采集图像、记录采集图像时的时间戳,并在缓存中对所采集的图像及其被采集时的时间戳进行保存等的步骤S110~S130;摄像设备对采集到的图像进行编码,将能够在作为显示终端的遥控器20上显示的编码后的图像的数据发送给遥控器等的步骤S140~S160;以及作为显示终端的遥控器20接收用户的拍照请求,并根据该拍照请求生成包含时间信息的拍照指令、并向无人飞行器10发送该拍照指令等的步骤S210~S230。其中,步骤S110~S130以及步骤S210~S230已在上一实施例中结合图4和图3进行了说明,在此便不再详述。以下具体说明步骤S140~S160:Specifically, before step S310, the unmanned aerial vehicle 10 as an imaging device further collects an image, records a time stamp when the image is collected, and saves the collected image and the time stamp when it is collected in the cache. Steps S110 to S130; the imaging device encodes the acquired image, and transmits data of the encoded image that can be displayed on the remote controller 20 as the display terminal to the remote controller or the like, steps S140 to S160; and as the display terminal The remote controller 20 receives the photographing request of the user, and generates steps S210 to S230 including the photographing instruction of the time information and transmitting the photographing instruction to the unmanned aerial vehicle 10 according to the photographing request. Steps S110 to S130 and steps S210 to S230 have been described in connection with FIG. 4 and FIG. 3 in the previous embodiment, and will not be described in detail herein. Steps S140 to S160 are specifically described below:
参见图6,在步骤S140中,对采集到的图像进行编码;以及在步骤S150中,将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中。在本实施例中,如上所述,遥控器20生成的拍照指令中所包含的时间信息为用户向作为显示终端的遥控器20输入拍照请求时,当前在遥控器20的显示装置200上显示的图像被采集时的时间戳。在相机100采集每一图像时,会记录下采集每一所述图像时的时间戳(上述步骤S120)。由于相机100采集到的图片、视频等的图像的数据未经编码处理,无法在作为显示终端的遥控器20上直接显示/播放,因此需要经过编码处理成编码后的图像才能在作为显示终端的遥控器20上显示/播放。在相机100对数据进行编码处理时,会将所记录下的采集每一图像时的时间戳分别包含在每个编码后的图像的数据中,从而,每个编码后的图像的数据中都记录了其被采集时的时间戳。这些时间戳由编码后的图像的数据 携带,一起发送给遥控器20。Referring to FIG. 6, in step S140, the acquired image is encoded; and in step S150, the time stamp when the collected image is acquired is recorded in the data of the encoded image. In the present embodiment, as described above, the time information included in the photographing instruction generated by the remote controller 20 is currently displayed on the display device 200 of the remote controller 20 when the user inputs a photographing request to the remote controller 20 as the display terminal. The timestamp when the image was acquired. When the camera 100 acquires each image, a time stamp when each of the images is acquired is recorded (step S120 described above). Since the data of the image, video, and the like collected by the camera 100 is not encoded, it cannot be directly displayed/played on the remote controller 20 as the display terminal, and therefore it is necessary to perform encoding processing into the encoded image to be used as the display terminal. Displayed/played on the remote controller 20. When the camera 100 encodes the data, the recorded time stamps for collecting each image are respectively included in the data of each of the encoded images, so that the data of each of the encoded images is recorded. The timestamp when it was acquired. These time stamps are carried by the data of the encoded image and sent to the remote controller 20 together.
在步骤S160中,将所述编码后的图像发送给所述显示终端,以在所述显示终端上显示所述编码后的图像。因此,作为显示终端的遥控器20所接收到的每一编码后的图像的数据中,均包含有该图像被采集时的时间戳,所述时间戳作为每个编码后的图像的数据中所记载的时间信息,由作为显示终端的遥控器20用来根据用户输入的拍照请求,生成包含有时间信息的拍照指令。In step S160, the encoded image is transmitted to the display terminal to display the encoded image on the display terminal. Therefore, the data of each encoded image received by the remote controller 20 as the display terminal includes a time stamp when the image is acquired, and the time stamp is used as data in each encoded image. The recorded time information is used by the remote controller 20 as a display terminal to generate a photographing instruction including time information based on a photographing request input by the user.
因此,由于作为显示终端的遥控器20所生成的拍照指令中包含有时间信息,在将该拍照指令发送给无人飞行器10,就可以向无人飞行器10请求与所述时间信息对应的图像。Therefore, since the photographing command generated by the remote controller 20 as the display terminal includes time information, when the photographing command is transmitted to the unmanned aerial vehicle 10, the image corresponding to the time information can be requested from the unmanned aerial vehicle 10.
再次回到图5,无人飞行器10从遥控器20接收到包含时间信息的拍照指令后,在步骤S320中,无人飞行器10根据所述时间信息,在缓存中查找所述无人飞行器10在所述时间信息指示的时间所采集的图像,在无人飞行器10到查找到该图像后,在步骤S330中,无人飞行器10控制该图像的存储,以便用户随时查看、下载。Returning to FIG. 5 again, after the unmanned aerial vehicle 10 receives the photographing instruction including the time information from the remote controller 20, in step S320, the unmanned aerial vehicle 10 searches the cache for the unmanned aerial vehicle 10 according to the time information. The image acquired at the time indicated by the time information, after the UAV 10 finds the image, in step S330, the UAV 10 controls the storage of the image so that the user can view and download it at any time.
具体地,在本实施例中,所述时间信息为用户向作为显示终端的遥控器20输入拍照请求时,当前在遥控器20的显示装置200上显示的编码后的图像被采集时的时间戳。由于该时间戳由编码后的图像的数据携带,一起由遥控器20发送给无人飞行器10,在从遥控器20接收到所述拍照指令后,无人飞行器10解析出该拍照指令中所包含的时间戳的信息,并从缓存中查找出无人飞行器10在所述时间戳指示的时间所采集的图像。由于该时间戳反映出用户在输入拍照指令那一刻具体想要拍摄的是显示装置200上所显示的那一图像,因此,只要根据用户所想拍照的图像的时间戳,就能从事先缓存在无人飞行器10的内存中的众多图像中查找到该时间戳对应的那一图像。如上一实施例中所描述的,在无人飞行器10通过相机100采集图像时,还需对所采集的图像及其采集时的时间戳进行缓存,由于该过程与结合图4描述的实施例中的步骤S110~S130相同,再此不再赘述。Specifically, in the embodiment, the time information is a time stamp when the encoded image currently displayed on the display device 200 of the remote controller 20 is acquired when the user inputs a photographing request to the remote controller 20 as the display terminal. . Since the time stamp is carried by the data of the encoded image, and sent to the unmanned aerial vehicle 10 by the remote controller 20, after receiving the photographing instruction from the remote controller 20, the unmanned aerial vehicle 10 parses out the image capturing command. The timestamp information is retrieved from the cache for images captured by the UAV 10 at the time indicated by the timestamp. Since the time stamp reflects that the user specifically wants to capture the image displayed on the display device 200 at the moment of inputting the photographing instruction, the time stamp can be cached in advance according to the time stamp of the image that the user wants to take. The image corresponding to the time stamp is found in a plurality of images in the memory of the unmanned aerial vehicle 10. As described in the above embodiment, when the UAV 10 acquires an image through the camera 100, it also needs to buffer the acquired image and its time stamp when it is acquired, as this process is in the embodiment described in connection with FIG. Steps S110 to S130 are the same, and will not be described again.
最后,在步骤S330中,无人飞行器10控制对查找到的图像的存储,以便之后用户可以随时查看、保存和/或下载。Finally, in step S330, the UAV 10 controls the storage of the found images so that the user can view, save, and/or download at any time.
在一些实现方式中,无人飞行器10将查找到的图像永久地存储在无人飞行器10,例如,存储在无人飞行器10的存储卡上;或者,无人飞行器10将查找到的图像发送给遥控器20,由遥控器20存储所述查找到的图像,例如,存储在遥控器20的存储卡上;或者,无人飞行器10将查找到的图像发送给其他第三方设备,由该第三方设备对查找到的图像进行存储。在另一些实现方式中,无人飞行器10还可以通过万维网(World Wide Web)上的云存储服务,将查找到的图像上传至网盘。对于将查找到的图像存储在无人飞行器10的存储卡上的情形,用户既可以从无人飞行器10上取下存储卡,用计算机、笔记本、硬盘等外部设备读取并保存存储卡上的图像,也可以不从无人飞行器10上取下存储卡,而是用例如手机等外部设备与无人飞行器10进行无线连接,将存储在无人飞行器10上的图像直接下载到外部设备上。In some implementations, the UAV 10 permanently stores the found image on the UAV 10, for example, on a memory card of the UAV 10; or, the UAV 10 sends the found image to The remote controller 20 stores the searched image by the remote controller 20, for example, on a memory card of the remote controller 20; or the unmanned aerial vehicle 10 transmits the found image to other third party devices by the third party The device stores the found image. In other implementations, the UAV 10 can also upload the found images to the web disk via a cloud storage service on the World Wide Web. For the case where the searched image is stored on the memory card of the unmanned aerial vehicle 10, the user can remove the memory card from the unmanned aerial vehicle 10 and read and save the memory card with an external device such as a computer, a notebook, or a hard disk. The image may not be removed from the unmanned aerial vehicle 10, but may be wirelessly connected to the unmanned aerial vehicle 10 by an external device such as a mobile phone, and the image stored on the unmanned aerial vehicle 10 may be directly downloaded to the external device.
具体地,根据用户对相机100的不同设置,可以将所述查找到的图像保存为raw格式的图片,作为最终输出的照片;或者将所述查找到的图像进行压缩编码,生成压缩编码后的图像,并保存所述压缩编码后的图像,作为最终输出的照片。例如,若果用户将相机100的图片输出格式设定为raw格式,则将该查找到的图像直接保存为raw格式的图片,作为最终输出的照片,提供给用户;如果用户将相机100的图片输出格式设定压缩编码后的图像格式,例如JPG、JPEG、TIFF、TIF等常见的格式,则根据用户的设定,首先对该查找到的图像进行压缩编码,生成与用户所设定的相机100的图像输出格式一致的压缩编码后的图像,再保存该压缩编码后的图像,作为最终输出的照片,提供给用户。Specifically, according to different settings of the camera 100 by the user, the searched image may be saved as a picture in a raw format as a final output photo; or the searched image may be compression-encoded to generate a compression-encoded image. The image is saved and the compression-encoded image is saved as a final output photo. For example, if the user sets the picture output format of the camera 100 to the raw format, the searched image is directly saved as a picture in the raw format, and is provided as a final output photo to the user; if the user takes a picture of the camera 100 The output format is set to a compression-encoded image format, such as a common format such as JPG, JPEG, TIFF, TIF, etc., according to the user's setting, first compressing and encoding the searched image to generate a camera set by the user. The image output format of 100 is compressed and encoded, and the compression-encoded image is saved as a final output photo, which is provided to the user.
如图7所示,本发明实施例还提供一种拍摄方法,应用于包含摄像设备和显示终端的拍摄系统,所述摄像设备与所述显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像。所述摄像设备例如为图1所示的具有拍摄功能的无人飞行器10,其拍摄功能通过搭载在无人飞行器10上的相机100来实现;所述显示终端例如为图1所示的具有显示功能的遥控器20,其显示功能通过遥控器20上的显示装置200来实现。位于遥控器20一端的用户可以通过无人飞行器10获取由无人飞行器10采集的图像。其他一些实施例中,摄像设备不限于为具有拍摄功能的无人飞行器10,还可以是具有存储功能和/或处理功能 等的相机或者摄像机等,或者是具有拍摄功能的固定装置,例如摄像头等。用户可以直接从相机、摄像机或具有拍摄功能的固定装置获取其采集的图像。在其他一些实施例中,显示终端可以是具有例如显示屏之类的显示装置的智能手机、平板电脑、PC机、笔记本电脑等。As shown in FIG. 7 , an embodiment of the present invention further provides a photographing method, which is applied to a photographing system including an image pickup apparatus and a display terminal, wherein the image pickup apparatus communicates with the display terminal to display on the display terminal The image captured by the camera device. The image pickup apparatus is, for example, an unmanned aerial vehicle 10 having a photographing function as shown in FIG. 1, and the photographing function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; for example, the display terminal has a display as shown in FIG. The function remote controller 20 whose display function is realized by the display device 200 on the remote controller 20. A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In some other embodiments, the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities. In some other embodiments, the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen.
具体地,所述方法包括以下步骤:Specifically, the method includes the following steps:
在步骤S210中,显示终端接收用户输入的拍照请求;In step S210, the display terminal receives a photo request input by the user;
在步骤S220中,所述显示终端根据所述拍照请求,生成包含时间信息的拍照指令;In step S220, the display terminal generates a photographing instruction including time information according to the photographing request;
在步骤S230中,所述显示终端向摄像设备发送所述拍照指令;In step S230, the display terminal sends the photographing instruction to the image capturing device;
在步骤S310中,从所述显示终端接收拍照指令,所述拍照指令中包含有时间信息;In step S310, a photographing instruction is received from the display terminal, and the photographing instruction includes time information;
在步骤S320中,所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及In step S320, the imaging device searches the cache for an image acquired by the imaging device at the time indicated by the time information according to the time information;
在步骤S330中,所述摄像设备控制对查找到的图像的存储。In step S330, the image pickup apparatus controls storage of the searched image.
该实施例涉及以上用于显示终端和用于摄像设备的一个或多个方法中的部分或全部步骤,因而,对其具体步骤在此处不再详细描述。This embodiment relates to some or all of the above steps for the display terminal and one or more methods for the image pickup apparatus, and thus, the specific steps thereof will not be described in detail herein.
本发明实施例提供的拍摄方法,由于摄像设备从显示终端接收的拍照指令中包含有时间信息,能够用于由摄像设备请求与该时间信息对应的图像,因此,在摄像设备接收到该拍照指令后,能够根据该时间信息,在缓存中查找到该摄像设备在所述时间信息指示的时间所采集的图像,从而准确查找到用户实际想要拍摄的那个预览画面对应的图像,并对该图像进行存储,从而解决了由于显示终端的显示延时而导致用户实际拍摄的照片与当前显示的画面不一致的问题。The photographing method provided by the embodiment of the present invention can be used to request an image corresponding to the time information by the image capturing device, because the photographing instruction received by the image capturing device from the display terminal can be used to receive the photographing instruction. After the time information is obtained, the image captured by the imaging device at the time indicated by the time information can be found in the cache, so that the image corresponding to the preview image that the user actually wants to capture is accurately found, and the image is The storage is performed to solve the problem that the photo actually taken by the user is inconsistent with the currently displayed screen due to the display delay of the display terminal.
图8是根据本发明一示例性实施例提供的显示终端与摄像设备之间的信令交互图,该图示出了根据本发明一实施例提供的拍摄方法。显示终端例如为图1所示的具有显示功能的遥控器20,摄像设备例如为图1所示的具有拍摄功能的无人飞行器10。在其他实施例中,摄像设备不限于为具有拍摄功能的无人飞行器10,还可以是具有存储功能和/或处理功能等的相机或者摄像机等,或者是具有拍摄功能的固定装置,例如摄像头等。用户可以直接从相机、摄像机或具有 拍摄功能的固定装置获取其采集的图像。在其他实施例中,显示终端还可以是能够显示画面的智能手机、平板电脑、PC机、笔记本电脑等,用户通过在该显示终端上查看摄像设备采集的图像,并远程操控摄像设备,从而实现远程拍摄。例如,当摄像设备为无人飞行器,显示终端为手机时,用户可以在手机上运行由该无人飞行器的厂商提供的App来操纵无人飞行器,从而实现对无人飞行器10的飞行、拍摄等的远距离控制。FIG. 8 is a signaling interaction diagram between a display terminal and an imaging apparatus according to an exemplary embodiment of the present invention, and illustrates a photographing method according to an embodiment of the present invention. The display terminal is, for example, a remote controller 20 having a display function as shown in FIG. 1, and the image pickup apparatus is, for example, the unmanned aerial vehicle 10 having a photographing function shown in FIG. 1. In other embodiments, the imaging apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities. In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like capable of displaying a screen, and the user can view the image captured by the camera device on the display terminal and remotely control the camera device, thereby realizing Remote shooting. For example, when the camera device is an unmanned aerial vehicle and the display terminal is a mobile phone, the user can run an app provided by the manufacturer of the unmanned aerial vehicle to operate the unmanned aerial vehicle on the mobile phone, thereby realizing flight, shooting, etc. of the unmanned aerial vehicle 10. Long distance control.
图8涉及以上用于显示终端和用于摄像设备的一个或多个方法中的部分或全部步骤,因而,在此处不再详细描述。Figure 8 relates to some or all of the above steps for displaying a terminal and one or more methods for an imaging device, and thus, will not be described in detail herein.
图9是根据本发明一示例性实施例提供的一种拍摄装置的框图。该装置可应用于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像。其中,所述显示终端例如为图1所示的具有显示功能的遥控器20,其显示功能通过遥控器20上的显示装置200来实现;所述摄像设备例如为图1所示的具有拍摄功能的无人飞行器10,其拍摄功能通过搭载在无人飞行器10上的相机100来实现。在其他一些实施例中,显示终端可以是具有例如显示屏之类的显示装置的智能手机、平板电脑、PC机、笔记本电脑等。参照图9,该装置可以包括第一接收模块410,用于接收用户输入的拍照请求;拍照指令生成模块420,用于根据所述拍照请求,生成包含时间信息的拍照指令。所述拍照指令用于向所述摄像设备请求与所述时间信息对应的图像。第一发送模块430,用于向所述摄像设备发送所述拍照指令,以供所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并存储查找到的图像FIG. 9 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention. The apparatus is applicable to a display terminal that communicates with an imaging apparatus to display an image acquired by the imaging apparatus. The display terminal is, for example, a remote controller 20 having a display function as shown in FIG. 1 , and its display function is implemented by the display device 200 on the remote controller 20; for example, the imaging device has the photographing function as shown in FIG. 1 . The unmanned aerial vehicle 10 has a photographing function realized by a camera 100 mounted on the unmanned aerial vehicle 10. In some other embodiments, the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen. Referring to FIG. 9, the apparatus may include a first receiving module 410, configured to receive a photographing request input by a user, and a photographing instruction generating module 420, configured to generate a photographing instruction including time information according to the photographing request. The photographing instruction is configured to request an image corresponding to the time information from the image capturing device. The first sending module 430 is configured to send the photographing instruction to the image capturing device, so that the image capturing device searches the cache for the time taken by the camera device at the time indicated by the time information according to the time information. Images and store the found images
如图10所示,为根据本发明另一示例性实施例提供的一种拍摄装置的框图。该装置可应用于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像。该装置除了包括图9所示的实施例中所包括的第一接收模块410、拍照指令生成模块420和第一发送模块430,还包括第二接收模块440和显示模块450。其中,第一接收模块410、拍照指令生成模块420和第一发送模块430与结合图9所描述的实施例中的相同,不再赘述。As shown in FIG. 10, it is a block diagram of a photographing apparatus according to another exemplary embodiment of the present invention. The apparatus is applicable to a display terminal that communicates with an imaging apparatus to display an image acquired by the imaging apparatus. The device includes a first receiving module 410, a photographing instruction generating module 420 and a first transmitting module 430, which are included in the embodiment shown in FIG. 9, and a second receiving module 440 and a display module 450. The first receiving module 410, the photographing instruction generating module 420, and the first sending module 430 are the same as those in the embodiment described in conjunction with FIG. 9, and are not described again.
在图10所示的实施例中,第二接收模块440用于从所述摄像设备接收编码 后的图像,显示模块450用于显示从所述摄像设备接收的编码后的图像,其中,所述编码后的图像中记录有所述图像被采集时的时间戳。在一些实施例中,所述显示模块例如可以为图1所示的遥控器20的显示装置200,该显示装置200可以包括液晶显示器(LCD)和/或触摸面板(TP)。在另一些实施例中,显示模块可以是智能手机、平板电脑、PC机、笔记本电脑等的显示屏和/或触摸面板。In the embodiment shown in FIG. 10, the second receiving module 440 is configured to receive an encoded image from the imaging device, and the display module 450 is configured to display the encoded image received from the imaging device, wherein the A time stamp when the image is acquired is recorded in the encoded image. In some embodiments, the display module can be, for example, the display device 200 of the remote controller 20 shown in FIG. 1, and the display device 200 can include a liquid crystal display (LCD) and/or a touch panel (TP). In other embodiments, the display module can be a display screen and/or a touch panel of a smartphone, tablet, PC, laptop, or the like.
图11是根据本发明一示例性实施例提供的一种拍摄装置的框图。该装置可应用于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像。其中,所述摄像设备例如为图1所示的具有拍摄功能的无人飞行器10,该无人飞行器10的拍摄功能由其搭载的相机100来实现;所述显示终端例如为图1所示的遥控器20。位于遥控器20一端的用户可以通过无人飞行器10获取由无人飞行器10采集的图像。在其他一些实施例中,摄像设备不限于为具有拍摄功能的无人飞行器10,还可以是具有存储功能和/或处理功能等的相机或者摄像机等,或者是具有拍摄功能的固定装置,例如摄像头等。用户可以直接从相机、摄像机或具有拍摄功能的固定装置获取其采集的图像。FIG. 11 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention. The apparatus is applicable to an imaging apparatus that communicates with a display terminal to display an image acquired by the imaging apparatus on the display terminal. The imaging device is, for example, the unmanned aerial vehicle 10 having the photographing function shown in FIG. 1 , and the photographing function of the unmanned aerial vehicle 10 is implemented by the camera 100 mounted thereon; the display terminal is, for example, the one shown in FIG. 1 . Remote control 20. A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In some other embodiments, the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, etc., or a fixing device having a photographing function, such as a camera. Wait. Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities.
参照图11,该拍摄装置包括:第三接收模块510,用于从显示终端接收拍照指令,所述拍照指令中包含有时间信息;图像查找模块520,用于根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;存储控制模块530,用于控制对查找到的图像的存储。其中,所述显示终端例如为图1所示的遥控器20。在另一些实施例中,所述显示终端还可以为智能手机、平板电脑、PC机、笔记本电脑等。Referring to FIG. 11 , the photographing apparatus includes: a third receiving module 510, configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information; and an image searching module 520, configured to be in the cache according to the time information. The image captured by the imaging device at the time indicated by the time information is searched; the storage control module 530 is configured to control storage of the searched image. The display terminal is, for example, the remote controller 20 shown in FIG. 1 . In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like.
如图12所示,为根据本发明另一实施例提供的一种拍摄装置的框图。该装置可应用于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像。该拍摄装置除了包括图11所示的实施例中所包括的第三接收模块510、图像查找模块520和存储控制模块530,还包括:图像采集模块610、时间戳记录模块620、缓存模块630、编码模块640以及第二发送模块650。其中,第三接收模块510、图像查找模块520和存储控制模块530与结合图11所描述的实施例中的相同,不再赘述。FIG. 12 is a block diagram of a photographing apparatus according to another embodiment of the present invention. The apparatus is applicable to an imaging apparatus that communicates with a display terminal to display an image acquired by the imaging apparatus on the display terminal. The camera device includes an image receiving module 610, a time stamp recording module 620, a cache module 630, and a third receiving module 510, an image searching module 520, and a storage control module 530, which are included in the embodiment shown in FIG. Encoding module 640 and second transmitting module 650. The third receiving module 510, the image searching module 520, and the storage control module 530 are the same as those in the embodiment described in connection with FIG. 11, and details are not described herein.
在图12所示的实施例中,图像采集模块610用于采集图像;时间戳记录模 块620用于记录采集图像时的时间戳;缓存模块630用于在所述缓存中保存采集到的图像以及所述采集到的图像被采集时的时间戳;编码模块640用于对采集到的图像进行编码,并将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;第二发送模块650用于将所述编码后的图像发送给所述显示终端,以在所述显示终端显示所述编码后的图像。具体地,所述第二发送模块650与显示终端的第二接收模块440(图10)通信,由所述第二接收模块440接收编码后的图像,并由显示终端的显示模块450进行显示。In the embodiment shown in FIG. 12, the image acquisition module 610 is configured to acquire an image; the timestamp recording module 620 is configured to record a timestamp when the image is collected; the cache module 630 is configured to save the collected image in the cache and a timestamp when the collected image is collected; the encoding module 640 is configured to encode the collected image, and record the timestamp when the collected image is collected in the data of the encoded image; The second sending module 650 is configured to send the encoded image to the display terminal to display the encoded image on the display terminal. Specifically, the second sending module 650 is in communication with the second receiving module 440 (FIG. 10) of the display terminal, and the encoded image is received by the second receiving module 440 and displayed by the display module 450 of the display terminal.
本发明实施例还提供一种拍摄系统,包括摄像设备和显示终端,所述摄像设备与所述显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像。所述摄像设备例如为图1所示的具有拍摄功能的无人飞行器10,其拍摄功能通过搭载在无人飞行器10上的相机100来实现;所述显示终端例如为图1所示的具有显示功能的遥控器20,其显示功能通过遥控器20上的显示装置200来实现。位于遥控器20一端的用户可以通过无人飞行器10获取由无人飞行器10采集的图像。其他一些实施例中,摄像设备不限于为具有拍摄功能的无人飞行器10,还可以是具有存储功能和/或处理功能等的相机或者摄像机等,或者是具有拍摄功能的固定装置,例如摄像头等。用户可以直接从相机、摄像机或具有拍摄功能的固定装置获取其采集的图像。在其他一些实施例中,显示终端可以是具有例如显示屏之类的显示装置的智能手机、平板电脑、PC机、笔记本电脑等。An embodiment of the present invention further provides a photographing system including an image capturing device and a display terminal, wherein the image capturing device communicates with the display terminal to display an image collected by the image capturing device on the display terminal. The image pickup apparatus is, for example, an unmanned aerial vehicle 10 having a photographing function as shown in FIG. 1, and the photographing function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; for example, the display terminal has a display as shown in FIG. The function remote controller 20 whose display function is realized by the display device 200 on the remote controller 20. A user located at one end of the remote controller 20 can acquire an image acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In some other embodiments, the image capturing apparatus is not limited to the unmanned aerial vehicle 10 having a photographing function, but may be a camera or a video camera having a storage function and/or a processing function, or the like, or a fixing device having a photographing function, such as a camera. . Users can get their acquired images directly from the camera, camera or fixture with shooting capabilities. In some other embodiments, the display terminal may be a smartphone, tablet, PC, notebook, or the like having a display device such as a display screen.
具体地,所述显示终端用于:接收用户输入的拍照请求;根据所述拍照请求,生成包含时间信息的拍照指令;向所述摄像设备发送所述拍照指令。所述摄像设备用于:接收所述拍照指令;根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及控制对查找到的图像的存储。Specifically, the display terminal is configured to: receive a photographing request input by a user; generate a photographing instruction including time information according to the photographing request; and send the photographing instruction to the photographing device. The image capturing device is configured to: receive the photographing instruction; search for an image captured by the camera device at a time indicated by the time information in a cache according to the time information; and control storage of the searched image.
关于上述各实施例中的装置,其中各个模块执行操作的具体方式已经在有关该方法的实施例中进行了详细描述,此处将不做详细阐述说明。With regard to the apparatus in the above embodiments, the specific manner in which the respective modules perform the operations has been described in detail in the embodiment relating to the method, and will not be explained in detail herein.
图13是根据本发明一实施例提供的一种拍摄装置2000的框图。例如,拍摄装置2000可以是智能手机、平板电脑、PC机、笔记本电脑、消息收发设备、 游戏控制台等具有显示功能的终端。FIG. 13 is a block diagram of a photographing apparatus 2000 according to an embodiment of the invention. For example, the photographing device 2000 may be a terminal having a display function such as a smartphone, a tablet, a PC, a notebook computer, a messaging device, a game console, or the like.
参照图13,拍摄装置2000可以包括以下一个或多个组件:处理组件2001、存储器2002、多媒体组件2003、输入/输出(I/O)接口2004以及通信组件2005。Referring to FIG. 13, the photographing apparatus 2000 may include one or more of the following components: a processing component 2001, a memory 2002, a multimedia component 2003, an input/output (I/O) interface 2004, and a communication component 2005.
处理组件2001控制拍摄装置2000的整体操作,例如与显示、数据通信、拍摄操作、对例如无人飞行器之类的移动终端的飞行进行控制等相关联的操作。处理组件2001可以包括一个或多个处理器2010来执行指令,以完成上述各实施例的显示终端一侧的方法的全部或部分步骤。The processing component 2001 controls the overall operation of the photographing device 2000, such as operations associated with display, data communication, photographing operations, control of flight of a mobile terminal such as an unmanned aerial vehicle, and the like. Processing component 2001 may include one or more processors 2010 to execute instructions to perform all or part of the steps of the method on the display terminal side of the various embodiments described above.
存储器2002配置为存储支持在拍摄装置2000上的操作的各种类型的数据,例如用于在拍摄装置2000上操作的任何应用程序或方法的指令、联系人数据、消息、图片、视频、文件等。存储器2002可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(R0M),磁存储器,快闪存储器,磁盘或光盘。The memory 2002 is configured to store various types of data supporting operations on the photographing device 2000, such as instructions for any application or method operating on the photographing device 2000, contact data, messages, pictures, videos, files, etc. . The memory 2002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Disk or Optical Disk.
多媒体组件2003包括在所述拍摄装置2000和用户之间提供一个输出接口的显示装置,例如,图1中所示的显示装置200。在一些实施例中,该显示装置可以包括液晶显示器(LCD)和/或触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。The multimedia component 2003 includes a display device that provides an output interface between the camera device 2000 and a user, such as the display device 200 shown in FIG. In some embodiments, the display device can include a liquid crystal display (LCD) and/or a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user.
输入/输出(I/O)接口2004为处理组件2001和外围接口模块之间提供接口,上述外围接口模块可以是键盘、按钮、虚拟按键等,例如智能手机上的Home按钮、音量按钮、锁屏按钮。An input/output (I/O) interface 2004 provides an interface between the processing component 2001 and a peripheral interface module, which may be a keyboard, a button, a virtual button, etc., such as a Home button, a volume button, a lock screen on a smartphone. Button.
通信组件2005配置为用于为拍摄装置2000和其他设备之间进行有线或无线方式的通信。拍摄装置2000可以接入基于通信标准的无线网络,如WiFi、3G或4G网络。在一些实施例中,所示通信组件2005还包括用于短程通信的近场通信(NFC)模块,例如,该NFC模块可基于射频识别(RF ID)技术、红外通信(I rDA)技术、超宽带(UWB)技术、蓝牙(BT)技术等其他技术来实现。The communication component 2005 is configured for wired or wireless communication between the camera 2000 and other devices. The photographing device 2000 can access a wireless network based on a communication standard such as a WiFi, 3G or 4G network. In some embodiments, the illustrated communication component 2005 also includes a near field communication (NFC) module for short range communication, for example, the NFC module can be based on radio frequency identification (RF ID) technology, infrared communication (I rDA) technology, super Broadband (UWB) technology, Bluetooth (BT) technology and other technologies to achieve.
在本发明实施例中,拍摄装置2000可以由一个或多个专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSro)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现, 以执行上述显示终端一侧的方法。In the embodiment of the present invention, the photographing apparatus 2000 may be composed of one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing equipment (DSro), programmable logic devices (PLDs), and field programmable. A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component is implemented to perform the method on the display terminal side described above.
本发明实施例还提供了一种非易失性计算机可读存储介质,例如存储器2002,所述非易失性计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令由拍摄装置2000的处理器2010执行,以完成上述显示终端一侧的任意方法实施例中的拍摄方法,例如,执行以上描述的图1-图3、图7和图8的方法中的部分或全部步骤,以实现图9、图10中的模块的功能。所述非易失性计算机可读存储介质可以是R0M、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。The embodiment of the present invention further provides a non-transitory computer readable storage medium, such as a memory 2002, which stores computer-executable instructions stored by the photographing device 2000. The processor 2010 is executed to complete the photographing method in any of the above method embodiments on the display terminal side, for example, to perform some or all of the steps of the methods described above in FIGS. 1-3, 7, and 8. The functions of the modules in Figures 9 and 10 are implemented. The non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
图14是根据本发明一实施例提供的一种拍摄装置3000的框图。例如,拍摄装置3000可以是具有存储功能和/或处理功能等的智能摄像机或者智能摄像头等,还可以是由无人飞行器、手持云台等移动终端搭载的相机等。FIG. 14 is a block diagram of a photographing apparatus 3000 according to an embodiment of the invention. For example, the imaging device 3000 may be a smart camera or a smart camera having a storage function and/or a processing function, or the like, or may be a camera mounted on a mobile terminal such as an unmanned aerial vehicle or a handheld cloud platform.
参照图14,拍摄装置3000可以包括以下一个或多个组件:处理组件3001、存储器3002、多媒体组件3003、输入/输出(I/O)接口3004以及通信组件3005。Referring to FIG. 14, the photographing apparatus 3000 may include one or more of the following components: a processing component 3001, a memory 3002, a multimedia component 3003, an input/output (I/O) interface 3004, and a communication component 3005.
处理组件3001控制拍摄装置3000的整体操作,例如与显示、数据通信、拍照、录制视频等相关联的操作。处理组件3001可以包括一个或多个处理器3010来执行指令,以完成上述各实施例的摄像设备一侧的方法的全部或部分步骤。The processing component 3001 controls the overall operation of the photographing device 3000, such as operations associated with display, data communication, photographing, recording video, and the like. The processing component 3001 can include one or more processors 3010 to execute instructions to perform all or part of the steps of the method of the camera device side of the various embodiments described above.
存储器3002配置为存储支持在拍摄装置3000上的操作的各种类型的数据,例如用于在拍摄装置3000上操作的任何应用程序或方法的指令、图片、视频、文件等。存储器3002可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(R0M),磁存储器,快闪存储器,磁盘或光盘。The memory 3002 is configured to store various types of data supporting operations on the photographing device 3000, such as instructions, pictures, videos, files, and the like for any application or method operating on the photographing device 3000. The memory 3002 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM), erasable. Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Disk or Optical Disk.
多媒体组件3003包括在所述拍摄装置3000和用户之间提供一个输出接口的显示装置。在一些实施例中,该显示装置可以包括液晶显示器(LCD)和/或触摸面板(TP)。如果屏幕包括触摸面板,屏幕可以被实现为触摸屏,以接收来自用户的输入信号。例如,当拍摄装置3000为相机时,该显示装置可以是相机上提供预览和查看画面的功能的显示屏和/或触摸面板。The multimedia component 3003 includes a display device that provides an output interface between the camera device 3000 and a user. In some embodiments, the display device can include a liquid crystal display (LCD) and/or a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. For example, when the photographing device 3000 is a camera, the display device may be a display screen and/or a touch panel on the camera that provides a function of previewing and viewing a picture.
输入/输出(I/O)接口3004为处理组件4001和外围接口模块之间提供接 口,上述外围接口模块可以是键盘、按钮、虚拟按键等,例如相机上的菜单按钮、快门按钮、音量按钮和模式拨盘等。An input/output (I/O) interface 3004 provides an interface between the processing component 4001 and a peripheral interface module, which may be a keyboard, a button, a virtual button, etc., such as a menu button, a shutter button, a volume button, and the like on the camera. Mode dials, etc.
通信组件3005配置为用于为拍摄装置3000和其他设备之间进行有线或无线方式的通信。拍摄装置3000可以接入基于通信标准的无线网络,如WiFi、3G或4G网络。在一些实施例中,所示通信组件3005还包括用于短程通信的近场通信(NFC)模块,例如,该NFC模块可基于射频识别(RF ID)技术、红外通信(I rDA)技术、超宽带(UWB)技术、蓝牙(BT)技术等其他技术来实现。例如,当拍摄装置3000为图1中所示的由无人飞行器10搭载的相机100时,该NFC模块可以为安装在无人飞行器10的机壳内腔中的射频模块。The communication component 3005 is configured to communicate in a wired or wireless manner between the camera device 3000 and other devices. The photographing device 3000 can access a wireless network based on a communication standard such as a WiFi, 3G or 4G network. In some embodiments, the illustrated communication component 3005 also includes a near field communication (NFC) module for short range communication, for example, the NFC module can be based on radio frequency identification (RF ID) technology, infrared communication (I rDA) technology, super Broadband (UWB) technology, Bluetooth (BT) technology and other technologies to achieve. For example, when the photographing device 3000 is the camera 100 carried by the unmanned aerial vehicle 10 shown in FIG. 1, the NFC module may be a radio frequency module installed in the inner cavity of the unmanned aerial vehicle 10.
在本发明实施例中,拍摄装置3000可以由一个或多个专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSro)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现,以执行上述摄像设备一侧的方法。In the embodiment of the present invention, the photographing device 3000 may be composed of one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSro), programmable logic devices (PLDs), and field programmable. A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component is implemented to perform the method on the side of the imaging device described above.
本发明实施例还提供了一种非易失性计算机可读存储介质,例如存储器3002,所述非易失性计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令由拍摄装置3000的处理器3010执行,以完成上述摄像设备一侧的任意方法实施例中的拍摄方法,例如,执行以上描述的图1和图2、图4-图8的方法步骤,以实现图11和图12中的模块的功能。所述非易失性计算机可读存储介质可以是R0M、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。The embodiment of the present invention further provides a non-transitory computer readable storage medium, such as a memory 3002, which stores computer-executable instructions stored by the photographing device 3000. The processor 3010 is executed to complete the photographing method in any of the above-described image pickup apparatus embodiments, for example, to perform the method steps of FIG. 1 and FIG. 2, FIG. 4 to FIG. 8 described above to implement FIG. 11 and FIG. The function of the module in 12. The non-transitory computer readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are included in the spirit and scope of the present invention, should be included in the present invention. Within the scope of protection.
最后还应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;在本发明的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上所述的本发明的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替 换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and are not limited thereto; in the idea of the present invention, the technical features in the above embodiments or different embodiments may also be combined. The steps may be carried out in any order, and there are many other variations of the various aspects of the invention as described above, which are not provided in the details for the sake of brevity; although the invention has been described in detail with reference to the foregoing embodiments, It should be understood by those skilled in the art that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and such modifications or substitutions do not detract from the essence of the corresponding technical solutions. The scope of the technical solutions of the embodiments.

Claims (45)

  1. 一种拍摄方法,其特征在于,所述方法包括:A photographing method, characterized in that the method comprises:
    显示终端接收用户输入的拍照请求;The display terminal receives a photo request input by the user;
    所述显示终端根据所述拍照请求,生成包含时间信息的拍照指令;The display terminal generates a photographing instruction including time information according to the photographing request;
    所述显示终端向摄像设备发送所述拍照指令;The display terminal sends the photographing instruction to the image capturing device;
    所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及The image capturing device searches, in the cache, an image collected by the image capturing device at a time indicated by the time information according to the time information;
    存储查找到的图像。Store the found image.
  2. 根据权利要求1所述的拍摄方法,其特征在于,所述时间信息包括时间戳。The photographing method according to claim 1, wherein the time information comprises a time stamp.
  3. 根据权利要求2所述的拍摄方法,其特征在于,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing method according to claim 2, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  4. 根据权利要求2或3所述的拍摄方法,其特征在于,所述方法还包括:The photographing method according to claim 2 or 3, wherein the method further comprises:
    所述摄像设备采集图像;The imaging device collects an image;
    记录采集图像时的时间戳;Record the timestamp when the image was acquired;
    在所述缓存中保存所述摄像设备采集到的图像以及所述采集到的图像被采集时的时间戳。The image acquired by the imaging device and the time stamp when the collected image is acquired are saved in the cache.
  5. 根据权利要求4所述的拍摄方法,其特征在于,所述方法还包括:The photographing method according to claim 4, wherein the method further comprises:
    所述摄像设备对采集到的图像进行编码;The imaging device encodes the acquired image;
    将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;Recording a time stamp when the collected image is collected in data of the encoded image;
    将所述编码后的图像发送给所述显示终端;Transmitting the encoded image to the display terminal;
    所述显示终端显示所述编码后的图像。The display terminal displays the encoded image.
  6. 根据权利要求1至5任一项所述的拍摄方法,其特征在于,所述存储查找到的图像,包括:The photographing method according to any one of claims 1 to 5, wherein the storing the searched image comprises:
    所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
    所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
    所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
  7. 根据权利要求1所述的拍摄方法,其特征在于,所述时间信息包括一个时间段。The photographing method according to claim 1, wherein the time information includes a period of time.
  8. 根据权利要求1至7任一项所述的拍摄方法,其特征在于,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。The photographing method according to any one of claims 1 to 7, characterized in that the image pickup apparatus comprises a camera, an unmanned aerial vehicle having a photographing function, or a fixing device having a photographing function.
  9. 一种拍摄方法,应用于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像,其特征在于,所述拍摄方法包括:A photographing method is applied to a display terminal, and the display terminal communicates with an image capturing device to display an image captured by the image capturing device, wherein the photographing method comprises:
    接收用户输入的拍照请求;Receiving a photo request input by a user;
    根据所述拍照请求,生成包含时间信息的拍照指令;Generating a photographing instruction including time information according to the photographing request;
    向所述摄像设备发送所述拍照指令,以供所述摄像设备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并存储查找到的图像。Sending the photographing instruction to the image capturing device, so that the image capturing device searches for an image captured by the image capturing device at the time indicated by the time information in the cache according to the time information, and stores the image that is found. .
  10. 根据权利要求9所述的拍摄方法,其特征在于,所述时间信息包括时间戳。The photographing method according to claim 9, wherein the time information comprises a time stamp.
  11. 根据权利要求10所述的拍摄方法,其特征在于,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing method according to claim 10, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  12. 根据权利要求11所述的拍摄方法,其特征在于,所述时间戳由所述摄像设备在采集图像时进行记录,并由所述摄像设备保存在所述缓存中。The photographing method according to claim 11, wherein the time stamp is recorded by the image capturing apparatus when acquiring an image, and is saved in the cache by the image capturing apparatus.
  13. 根据权利要求12所述的拍摄方法,其特征在于,所述方法还包括:The photographing method according to claim 12, wherein the method further comprises:
    从所述摄像设备接收编码后的图像;以及Receiving an encoded image from the imaging device;
    并对所述编码后的图像进行显示;And displaying the encoded image;
    其中,所述编码后的图像由所述摄像设备对采集到的图像进行编码而获得,所述编码后的图像的数据中记录有所述采集到的图像被采集时的时间戳。The encoded image is obtained by encoding, by the imaging device, the acquired image, and the data of the encoded image records a time stamp when the collected image is collected.
  14. 根据权利要求9至13任一项所述的拍摄方法,其特征在于,所述摄像设备存储查找到的图像,包括:The photographing method according to any one of claims 9 to 13, wherein the image capturing device stores the searched image, comprising:
    所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
    所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
    所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
  15. 根据权利要求9所述的拍摄方法,其特征在于,所述时间信息包括一个时间段。The photographing method according to claim 9, wherein the time information includes a period of time.
  16. 一种拍摄方法,应用于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像,其特征在于,所述拍摄方法包括:A photographing method is applied to an image capturing apparatus, wherein the image capturing apparatus communicates with a display terminal to display an image captured by the image capturing apparatus on the display terminal, wherein the photographing method comprises:
    从所述显示终端接收拍照指令,所述拍照指令中包含有时间信息;Receiving a photographing instruction from the display terminal, where the photographing instruction includes time information;
    根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及Obtaining, in the cache, an image collected by the imaging device at a time indicated by the time information according to the time information;
    控制对查找到的图像的存储。Controls the storage of the found images.
  17. 根据权利要求16所述的拍摄方法,其特征在于,所述时间信息包括时间戳。The photographing method according to claim 16, wherein the time information comprises a time stamp.
  18. 根据权利要求17所述的拍摄方法,其特征在于,所述时间戳为用户向所述显示终端输入拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing method according to claim 17, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when a user inputs a photographing request to the display terminal.
  19. 根据权利要求17或18所述的拍摄方法,其特征在于,所述方法还包括:The photographing method according to claim 17 or 18, wherein the method further comprises:
    采集图像;Collecting images;
    记录采集图像时的时间戳;Record the timestamp when the image was acquired;
    在所述缓存中保存采集到的图像以及所述采集到的图像被采集时的时间戳。The acquired image is saved in the cache and the time stamp when the collected image is acquired.
  20. 根据权利要求19所述的拍摄方法,其特征在于,所述方法还包括:The photographing method according to claim 19, wherein the method further comprises:
    对采集到的图像进行编码;Encoding the acquired image;
    将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;以及Recording a time stamp when the collected image is acquired in data of the encoded image;
    将所述编码后的图像发送给所述显示终端,以在所述显示终端显示所述编码后的图像。And transmitting the encoded image to the display terminal to display the encoded image on the display terminal.
  21. 根据权利要求16至20任一项所述的拍摄方法,其特征在于,所述摄像设备控制对查找到的图像的存储,包括:The photographing method according to any one of claims 16 to 20, wherein the image capturing device controls storage of the searched image, comprising:
    所述摄像设备将所述查找到的图像永久地存储在所述摄像设备上;或者,The imaging device permanently stores the found image on the imaging device; or
    所述摄像设备将所述查找到的图像发送给所述显示终端,所述显示终端存储所述查找到的图像;或者,The image capturing device transmits the searched image to the display terminal, and the display terminal stores the searched image; or
    所述摄像设备将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The camera device transmits the found image to other devices to store the found image on the other device.
  22. 根据权利要求16所述的拍摄方法,其特征在于,所述时间信息包括一个时间段。The photographing method according to claim 16, wherein the time information includes a period of time.
  23. 根据权利要求16至22任一项所述的拍摄方法,其特征在于,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。The photographing method according to any one of claims 16 to 22, wherein the image pickup apparatus comprises a camera, an unmanned aerial vehicle having a photographing function, or a fixing device having a photographing function.
  24. 一种拍摄系统,其特征在于,包括摄像设备和显示终端,所述摄像设备与所述显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像;其中,A photographing system, comprising: an image capturing device and a display terminal, wherein the image capturing device communicates with the display terminal to display an image captured by the image capturing device on the display terminal; wherein
    所述显示终端用于:The display terminal is used to:
    接收用户输入的拍照请求;Receiving a photo request input by a user;
    根据所述拍照请求,生成包含时间信息的拍照指令;Generating a photographing instruction including time information according to the photographing request;
    向所述摄像设备发送所述拍照指令;Sending the photographing instruction to the imaging device;
    所述摄像设备用于:The camera device is used to:
    接收所述拍照指令;Receiving the photographing instruction;
    根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及Obtaining, in the cache, an image collected by the imaging device at a time indicated by the time information according to the time information;
    控制对查找到的图像的存储。Controls the storage of the found images.
  25. 根据权利要求24所述的拍摄系统,其特征在于,所述时间信息包括时间戳。The photographing system according to claim 24, wherein the time information comprises a time stamp.
  26. 根据权利要求25所述的拍摄系统,其特征在于,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing system according to claim 25, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  27. 根据权利要求25或26所述的拍摄系统,其特征在于,所述摄像设备 还用于:The photographing system according to claim 25 or 26, wherein the image pickup apparatus is further configured to:
    采集图像;Collecting images;
    记录采集图像时的时间戳;Record the timestamp when the image was acquired;
    在所述缓存中保存所述摄像设备采集到的图像以及所述采集到的图像被采集时的时间戳。The image acquired by the imaging device and the time stamp when the collected image is acquired are saved in the cache.
  28. 根据权利要求27所述的拍摄系统,其特征在于:The photographing system according to claim 27, wherein:
    所述摄像设备还用于:The camera device is further configured to:
    对采集到的图像进行编码;Encoding the acquired image;
    将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;Recording a time stamp when the collected image is collected in data of the encoded image;
    将所述编码后的图像发送给所述显示终端;Transmitting the encoded image to the display terminal;
    所述显示终端还用于:The display terminal is further configured to:
    接收所述编码后的图像;Receiving the encoded image;
    显示所述编码后的图像。The encoded image is displayed.
  29. 根据权利要求24所述的拍摄系统,其特征在于,所述时间信息包括一个时间段。The photographing system according to claim 24, wherein said time information comprises a period of time.
  30. 根据权利要求24至29任一项所述的拍摄系统,其特征在于,所述摄像设备包括相机,具有拍摄功能的无人飞行器,或者具有拍摄功能的固定装置。The photographing system according to any one of claims 24 to 29, characterized in that the image pickup apparatus comprises a camera, an unmanned aerial vehicle having a photographing function, or a fixing device having a photographing function.
  31. 一种拍摄装置,所述装置配置于显示终端,所述显示终端与摄像设备通信,以显示由所述摄像设备采集的图像,其特征在于,所述拍摄装置包括:A photographing device, the device is configured to be in a display terminal, and the display terminal is in communication with the image capturing device to display an image captured by the image capturing device, wherein the photographing device comprises:
    第一接收模块,用于接收用户输入的拍照请求;a first receiving module, configured to receive a photo request input by a user;
    拍照指令生成模块,用于根据所述拍照请求,生成包含时间信息的拍照指令;a photographing instruction generating module, configured to generate a photographing instruction including time information according to the photographing request;
    第一发送模块,用于向所述摄像设备发送所述拍照指令,以供所述摄像设 备根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所拍摄的图像,并控制对查找到的图像的存储。a first sending module, configured to send the photographing instruction to the image capturing device, where the image capturing device searches the cache for an image captured by the image capturing device at a time indicated by the time information according to the time information. And control the storage of the found image.
  32. 根据权利要求31所述的拍摄装置,其特征在于,所述时间信息包括时间戳。The photographing apparatus according to claim 31, wherein the time information comprises a time stamp.
  33. 根据权利要求32所述的拍摄装置,其特征在于,所述时间戳为用户向所述显示终端输入所述拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing apparatus according to claim 32, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when the user inputs the photographing request to the display terminal.
  34. 根据权利要求33所述的拍摄装置,其特征在于,所述时间戳由所述摄像设备在采集图像时进行记录,并由所述摄像设备保存在所述缓存中。The photographing apparatus according to claim 33, wherein said time stamp is recorded by said image pickup apparatus when an image is captured, and is held in said cache by said image pickup apparatus.
  35. 根据权利要求34所述的拍摄装置,其特征在于,还包括:The photographing apparatus according to claim 34, further comprising:
    第二接收模块,用于从所述摄像设备接收编码后的图像;以及a second receiving module, configured to receive the encoded image from the imaging device;
    显示模块,用于对所述编码后的图像进行显示;a display module, configured to display the encoded image;
    其中,所述编码后的图像由所述摄像设备对采集到的图像进行编码而获得,所述编码后的图像的数据中记录有所述采集到的图像被采集时的时间戳。The encoded image is obtained by encoding, by the imaging device, the acquired image, and the data of the encoded image records a time stamp when the collected image is collected.
  36. 根据权利要求31所述的拍摄装置,其特征在于,所述时间信息包括一个时间段。The photographing apparatus according to claim 31, wherein said time information comprises a period of time.
  37. 一种拍摄装置,所述装置配置于摄像设备,所述摄像设备与显示终端通信,以在所述显示终端上显示由所述摄像设备采集的图像,其特征在于,所述拍摄装置包括:A photographing apparatus, the apparatus is configured to be in an image capturing apparatus, and the image capturing apparatus is configured to communicate with the display terminal to display an image captured by the image capturing apparatus on the display terminal, wherein the photographing apparatus comprises:
    第三接收模块,用于从所述显示终端接收拍照指令,所述拍照指令中包含有时间信息;a third receiving module, configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information;
    图像查找模块,用于根据所述时间信息,在缓存中查找所述摄像设备在所述时间信息指示的时间所采集的图像;以及An image search module, configured to search, in the cache, an image collected by the camera device at a time indicated by the time information according to the time information;
    存储控制模块,用于控制对查找到的图像的存储。A storage control module for controlling storage of the found image.
  38. 根据权利要求37所述的拍摄装置,其特征在于,所述时间信息包括时间戳。The photographing apparatus according to claim 37, wherein said time information comprises a time stamp.
  39. 根据权利要求38所述的拍摄装置,其特征在于,其中,所述时间戳为用户向所述显示终端输入拍照请求时,当前在所述显示终端上显示的图像被采集时的时间戳。The photographing apparatus according to claim 38, wherein the time stamp is a time stamp when an image currently displayed on the display terminal is acquired when a user inputs a photographing request to the display terminal.
  40. 根据权利要求38或39所述的拍摄装置,其特征在于,所述拍摄装置还包括:The photographing apparatus according to claim 38 or claim 39, wherein the photographing apparatus further comprises:
    图像采集模块,用于采集图像;An image acquisition module for collecting images;
    时间戳记录模块,用于记录采集图像时的时间戳;a timestamp recording module for recording a timestamp when the image is acquired;
    缓存模块,在所述缓存中保存采集到的图像以及所述采集到的图像被采集时的时间戳。a cache module that saves the acquired image in the cache and a time stamp when the collected image is acquired.
  41. 根据权利要求40所述的拍摄装置,其特征在于,所述拍摄装置还包括:The photographing apparatus according to claim 40, wherein the photographing apparatus further comprises:
    编码模块,用于对采集到的图像进行编码,并将所述采集到的图像被采集时的时间戳记录在编码后的图像的数据中;以及An encoding module, configured to encode the collected image, and record a timestamp when the collected image is collected in the data of the encoded image;
    第二发送模块,用于将所述编码后的图像发送给所述显示终端,以在所述显示终端显示所述编码后的图像。And a second sending module, configured to send the encoded image to the display terminal to display the encoded image on the display terminal.
  42. 根据权利要求37至41任一项所述的拍摄装置,其特征在于,所述存储控制模块具体用于:The photographing apparatus according to any one of claims 37 to 41, wherein the storage control module is specifically configured to:
    将所述查找到的图像永久地存储在所述摄像设备上;或者,Permanently storing the found image on the imaging device; or
    将所述查找到的图像发送给所述显示终端以便在所述显示终端上存储所述 查找到的图像;或者,Sending the searched image to the display terminal to store the found image on the display terminal; or
    将所述查找到的图像发送给其他设备以便在所述其他设备上存储所述查找到的图像。The found image is sent to other devices to store the found image on the other device.
  43. 根据权利要求37所述的拍摄装置,其特征在于,所述时间信息包括一个时间段。The photographing apparatus according to claim 37, wherein said time information comprises a period of time.
  44. 一种显示终端,其特征在于,所述显示终端包括处理器和与所述处理器通信连接的存储器;A display terminal, comprising: a processor and a memory communicatively coupled to the processor;
    其中,所述存储器存储有可被所述处理器执行的指令程序,所述指令程序被所述处理器执行,以使所述处理器能够执行如权利要求9-15任一项所述的拍摄方法。Wherein the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the shooting as claimed in any one of claims 9-15 method.
  45. 一种摄像设备,其特征在于,所述摄像设备包括处理器和与所述处理器通信连接的存储器;An image pickup apparatus, comprising: a processor and a memory communicably connected to the processor;
    其中,所述存储器存储有可被所述处理器执行的指令程序,所述指令程序被所述处理器执行,以使所述处理器能够执行如权利要求16-23任一项所述的拍摄方法。Wherein the memory stores an instruction program executable by the processor, the instruction program being executed by the processor to enable the processor to perform the shooting as claimed in any one of claims 16-23 method.
PCT/CN2018/104013 2018-03-09 2018-09-04 Photographing method, photographing apparatus and photographing system WO2019169840A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810195280.4 2018-03-09
CN201810195280.4A CN108322656B (en) 2018-03-09 2018-03-09 Shooting method, shooting device and shooting system

Publications (1)

Publication Number Publication Date
WO2019169840A1 true WO2019169840A1 (en) 2019-09-12

Family

ID=62901432

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/104013 WO2019169840A1 (en) 2018-03-09 2018-09-04 Photographing method, photographing apparatus and photographing system

Country Status (2)

Country Link
CN (1) CN108322656B (en)
WO (1) WO2019169840A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677590A (en) * 2019-10-11 2020-01-10 桂林智神信息技术股份有限公司 Photography control system
CN110764955A (en) * 2019-10-30 2020-02-07 深圳创维-Rgb电子有限公司 Image resource backup system, method, device and storage medium
CN113824902A (en) * 2021-09-30 2021-12-21 杭州海康汽车软件有限公司 Method, device, system, equipment and medium for determining time delay of infrared camera system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108322656B (en) * 2018-03-09 2022-02-15 深圳市道通智能航空技术股份有限公司 Shooting method, shooting device and shooting system
WO2020227997A1 (en) * 2019-05-15 2020-11-19 深圳市大疆创新科技有限公司 Photography apparatus, unmanned aerial vehicle, control terminal and photography method
CN110177215A (en) * 2019-06-28 2019-08-27 Oppo广东移动通信有限公司 Image processing method, image processor, filming apparatus and electronic equipment
CN115802147B (en) * 2021-09-07 2024-06-28 荣耀终端有限公司 Method for capturing images in video and electronic equipment
CN114866700A (en) * 2022-05-30 2022-08-05 展讯通信(上海)有限公司 Photographing method, system, medium, chip and terminal equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110017863A1 (en) * 2007-10-29 2011-01-27 Honeywell International Inc. Guided delivery of small munitions from an unmanned aerial vehicle
CN105120011A (en) * 2015-09-22 2015-12-02 杨珊珊 Aerial photographed data download system and method
CN106060469A (en) * 2016-06-23 2016-10-26 杨珊珊 Image processing system based on photographing of unmanned aerial vehicle and image processing method thereof
CN106598081A (en) * 2016-10-27 2017-04-26 纳恩博(北京)科技有限公司 Image acquisition method and electronic devices
CN107370993A (en) * 2017-08-14 2017-11-21 哈尔滨市舍科技有限公司 A kind of virtual shooting system and method based on two-dimentional code watermark
CN107580234A (en) * 2017-09-01 2018-01-12 歌尔科技有限公司 Photographic method, display end, shooting head end and system in wireless live broadcast
CN108322656A (en) * 2018-03-09 2018-07-24 深圳市道通智能航空技术有限公司 A kind of image pickup method, filming apparatus and camera system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051840A (en) * 2012-12-31 2013-04-17 广东欧珀移动通信有限公司 Method and system of preview shooting
CN107580214A (en) * 2017-07-31 2018-01-12 彩虹无人机科技有限公司 A kind of UAV Video transmission delay measurement method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110017863A1 (en) * 2007-10-29 2011-01-27 Honeywell International Inc. Guided delivery of small munitions from an unmanned aerial vehicle
CN105120011A (en) * 2015-09-22 2015-12-02 杨珊珊 Aerial photographed data download system and method
CN106060469A (en) * 2016-06-23 2016-10-26 杨珊珊 Image processing system based on photographing of unmanned aerial vehicle and image processing method thereof
CN106598081A (en) * 2016-10-27 2017-04-26 纳恩博(北京)科技有限公司 Image acquisition method and electronic devices
CN107370993A (en) * 2017-08-14 2017-11-21 哈尔滨市舍科技有限公司 A kind of virtual shooting system and method based on two-dimentional code watermark
CN107580234A (en) * 2017-09-01 2018-01-12 歌尔科技有限公司 Photographic method, display end, shooting head end and system in wireless live broadcast
CN108322656A (en) * 2018-03-09 2018-07-24 深圳市道通智能航空技术有限公司 A kind of image pickup method, filming apparatus and camera system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110677590A (en) * 2019-10-11 2020-01-10 桂林智神信息技术股份有限公司 Photography control system
CN110764955A (en) * 2019-10-30 2020-02-07 深圳创维-Rgb电子有限公司 Image resource backup system, method, device and storage medium
CN113824902A (en) * 2021-09-30 2021-12-21 杭州海康汽车软件有限公司 Method, device, system, equipment and medium for determining time delay of infrared camera system

Also Published As

Publication number Publication date
CN108322656A (en) 2018-07-24
CN108322656B (en) 2022-02-15

Similar Documents

Publication Publication Date Title
WO2019169840A1 (en) Photographing method, photographing apparatus and photographing system
US10523839B2 (en) Context and content based automated image and media sharing
WO2017000399A1 (en) Video content retrieval method and device
KR100640808B1 (en) Mobile communication terminal with dual-display of photograph and its method
CN105516755B (en) A kind of video previewing method and device
US9742995B2 (en) Receiver-controlled panoramic view video share
US8823816B2 (en) Imaging apparatus including a search condition setting unit for setting a search condition of image data and a non-transistory storage medium storing a program for setting a search condition of image data
US9380214B2 (en) Image photographing apparatus and method thereof
CN111713102B9 (en) Shooting control method and terminal
US20180352156A1 (en) High-Quality Audio/Visual Conferencing
CN104092749A (en) Method and device for synchronizing photos
WO2016045323A1 (en) Method and device for controlling presentation of video picture
JP2014175723A (en) Imaged picture display device, imaging system, imaged picture display method, and program
WO2018082164A1 (en) Video editing method and device, and video taking method and device
CN110870293B (en) Video shooting processing method and device and video shooting processing system
WO2017156990A1 (en) Photographing method and device for mobile terminal
US20090195662A1 (en) Electronic camera and image transfer method adopted in electronic camera
KR101986681B1 (en) Apparatus for processing images and method thereof
JP3906976B2 (en) Imaging transmission apparatus and imaging transmission system
US20110026897A1 (en) Video Recording Devices and Video Recording Methods
CN115967856A (en) Information processing method, device, equipment and storage medium
KR101673020B1 (en) Method and apparatus for requesting of data, method and apparatus for obtaining of data
CN114125300A (en) Photographing method, photographing apparatus, electronic device, and readable storage medium
JP2017059914A (en) Imaging device, data management method and program
KR20050089603A (en) Method for providing animate preview image for moving picture in the mobile communication terminal

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18908605

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18908605

Country of ref document: EP

Kind code of ref document: A1