CN108322656B

CN108322656B - Shooting method, shooting device and shooting system

Info

Publication number: CN108322656B
Application number: CN201810195280.4A
Authority: CN
Inventors: 邹圣仕
Original assignee: Shenzhen Autel Intelligent Aviation Technology Co Ltd
Current assignee: Shenzhen Autel Intelligent Aviation Technology Co Ltd
Priority date: 2018-03-09
Filing date: 2018-03-09
Publication date: 2022-02-15
Anticipated expiration: 2038-03-09
Also published as: WO2019169840A1; CN108322656A

Abstract

The invention relates to a shooting method, a shooting device and a shooting system. The shooting method comprises the following steps: the display terminal receives a photographing request input by a user; the display terminal generates a photographing instruction containing time information according to the photographing request; the display terminal sends the photographing instruction to the camera equipment; the camera shooting equipment searches images collected by the camera shooting equipment at the time indicated by the time information in a cache according to the time information; and storing the searched image. According to the shooting method provided by the embodiment of the invention, the time information contained in the shooting instruction is utilized, the image acquired by the shooting equipment at the time indicated by the time information is searched in the cache of the shooting equipment, the image corresponding to the preview picture which the user actually wants to shoot can be accurately searched, and the image is stored, so that the problem that the picture actually shot by the user is inconsistent with the currently displayed picture due to display delay is solved.

Description

Shooting method, shooting device and shooting system

[ technical field ] A method for producing a semiconductor device

The present invention relates to the field of camera technologies, and in particular, to a shooting method, a shooting device, and a shooting system.

[ background of the invention ]

At present, more and more photographing devices, such as cameras, camcorders, etc., are provided with a communication module that can be accessed to a network in order to communicate with a display terminal. A user positioned at one side of the display terminal can establish communication connection with the shooting device through a wireless network and remotely check images shot by the shooting device on the display terminal at any time; some other shooting devices, such as cameras mounted on mobile terminal devices such as unmanned aerial vehicles, transmit images to users operating the unmanned aerial vehicles on the ground through communication modules built in the unmanned aerial vehicles, so that the users can watch and remotely control shooting operations such as recording videos and taking photos on display terminals, and the display terminals can be remote controllers with display devices or remote controllers with ports for connecting external display devices such as tablets, mobile phones and the like.

In the shooting method for performing remote control through the wireless control signal, a user watches images which are acquired by a camera in real time and transmitted to the display terminal through the display terminal, the images are usually previewed images and cannot be stored in a storage medium of the camera, when the user is interested in a certain image and wants to take a picture, the user clicks a shooting key on the display terminal to transmit a shooting instruction to the camera terminal, and the camera terminal executes the shooting instruction to acquire the image and store the image. However, since there is a certain delay in image transmission from the camera side to the display terminal, typically several hundred milliseconds, the picture viewed by the user on the display terminal is not a picture for displaying the shot scene in real time. For example, in the case where the delay time is five hundred milliseconds, the picture viewed by the user at the present time is actually an image of a shooting scene captured by the camera five hundred milliseconds ago. If the user presses the photographing key to capture the picture viewed from the display terminal at the moment, the camera cannot capture the picture which is actually captured by the camera and appears in the shooting scene after the user presses the key. Therefore, the picture actually taken by the user does not coincide with the currently displayed picture due to the display delay. When an image with a fast moving speed is shot, the picture difference caused by the time delay becomes obvious, so that a user cannot shoot a desired picture.

[ summary of the invention ]

The embodiment of the invention provides a shooting method and a mobile terminal, and aims to solve the problem that in the existing shooting method for performing remote control through a wireless control signal, the picture actually shot by a user is inconsistent with the currently displayed picture due to display delay.

In order to solve the above technical problem, an embodiment of the present invention provides a shooting method, where the method includes:

the display terminal receives a photographing request input by a user;

the display terminal generates a photographing instruction containing time information according to the photographing request;

the display terminal sends the photographing instruction to the camera equipment;

the camera shooting equipment searches images collected by the camera shooting equipment at the time indicated by the time information in a cache according to the time information; and

and storing the searched image.

In some embodiments, the time information comprises a timestamp.

In some embodiments, the timestamp is a timestamp of when the image currently displayed on the display terminal is captured when the user inputs the photographing request to the display terminal.

In some embodiments, the method further comprises:

the camera equipment acquires an image;

recording a time stamp when the image is acquired;

and storing the images acquired by the camera equipment and the time stamps of the acquired images in the cache.

In some embodiments, the method further comprises:

the camera equipment encodes the acquired image;

recording the time stamp of the acquired image when the acquired image is acquired in the data of the encoded image;

sending the coded image to the display terminal;

and the display terminal displays the coded image.

In some embodiments, the storing the located image comprises:

the camera shooting device permanently stores the searched image on the camera shooting device; alternatively, the first and second electrodes may be,

the camera shooting equipment sends the searched image to the display terminal, and the display terminal stores the searched image; alternatively, the first and second electrodes may be,

the camera device sends the searched image to other devices so as to store the searched image on the other devices.

In some embodiments, the time information includes a time period.

In some embodiments, the imaging device includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.

In order to solve the above technical problem, an embodiment of the present invention further provides a shooting method applied to a display terminal, where the display terminal communicates with an image capturing apparatus to display an image captured by the image capturing apparatus, and the shooting method includes:

receiving a photographing request input by a user;

generating a photographing instruction containing time information according to the photographing request;

and sending the photographing instruction to the photographing equipment so that the photographing equipment searches the images photographed by the photographing equipment at the time indicated by the time information in a cache according to the time information and stores the searched images.

In some embodiments, the time information comprises a timestamp.

In some embodiments, the timestamp is recorded by the camera device when the image is captured and saved in the cache by the camera device.

In some embodiments, the method further comprises:

receiving an encoded image from the image pickup apparatus; and

and displaying the encoded image;

the coded image is obtained by coding a collected image by the camera equipment, and a time stamp of the collected image when the collected image is collected is recorded in the data of the coded image.

In some embodiments, the image capturing apparatus storing the searched image includes:

In some embodiments, the time information includes a time period.

In order to solve the above technical problem, an embodiment of the present invention further provides a shooting method applied to an image capturing apparatus, where the image capturing apparatus communicates with a display terminal to display an image captured by the image capturing apparatus on the display terminal, and the shooting method includes:

receiving a photographing instruction from the display terminal, wherein the photographing instruction comprises time information;

according to the time information, searching images acquired by the camera equipment at the time indicated by the time information in a cache; and

controlling the storage of the searched image.

In some embodiments, the time information comprises a timestamp.

In some embodiments, the method further comprises:

collecting an image;

recording a time stamp when the image is acquired;

saving in the cache the captured image and a timestamp of when the captured image was captured.

In some embodiments, the method further comprises:

encoding the acquired image;

recording the time stamp of the acquired image when the acquired image is acquired in the data of the encoded image; and

and sending the coded image to the display terminal so as to display the coded image on the display terminal.

In some embodiments, the controlling the storing of the searched image by the image capturing apparatus includes:

In some embodiments, the time information includes a time period.

In order to solve the above technical problem, an embodiment of the present invention further provides a shooting system, including a camera device and a display terminal, where the camera device communicates with the display terminal to display an image acquired by the camera device on the display terminal; wherein the content of the first and second substances,

the display terminal is used for:

receiving a photographing request input by a user;

sending the photographing instruction to the photographing equipment;

the image pickup apparatus is configured to:

receiving the photographing instruction;

controlling the storage of the searched image.

In order to solve the above technical problem, an embodiment of the present invention further provides a shooting apparatus, where the shooting apparatus is configured on a display terminal, and the display terminal communicates with an image capturing device to display an image captured by the image capturing device, and the shooting apparatus includes:

the first receiving module is used for receiving a photographing request input by a user;

the photographing instruction generating module is used for generating a photographing instruction containing time information according to the photographing request;

and the first sending module is used for sending the photographing instruction to the photographing equipment so that the photographing equipment searches images photographed by the photographing equipment at the time indicated by the time information in a cache according to the time information and controls the storage of the searched images.

In order to solve the above technical problem, an embodiment of the present invention further provides a shooting apparatus, where the shooting apparatus is configured to a camera device, and the camera device communicates with a display terminal to display an image captured by the camera device on the display terminal, and the shooting apparatus includes:

the third receiving module is used for receiving a photographing instruction from the display terminal, wherein the photographing instruction comprises time information;

the image searching module is used for searching the image acquired by the camera equipment at the time indicated by the time information in a cache according to the time information; and

and the storage control module is used for controlling the storage of the searched image.

In order to solve the above technical problem, an embodiment of the present invention further provides a display terminal, where the apparatus includes a processor and a memory communicatively connected to the processor;

wherein the memory stores a program of instructions executable by the processor to enable the processor to perform the photographing method according to any one of claims 9 to 16.

In order to solve the above technical problem, an embodiment of the present invention further provides an image capturing apparatus, where the apparatus includes a processor and a memory communicatively connected to the processor;

wherein the memory stores a program of instructions executable by the processor to enable the processor to perform the photographing method according to any one of claims 17 to 24.

In the technical scheme of the embodiment of the invention, the photographing instruction generated by the display terminal contains the time information and can be used for requesting the camera equipment for the image corresponding to the time information, so that after the camera equipment receives the photographing instruction, the image acquired by the camera equipment at the time indicated by the time information can be searched in the cache according to the time information, the image corresponding to the preview picture which the user actually wants to photograph is accurately searched, and the image is stored, thereby solving the problem that the picture actually photographed by the user is inconsistent with the currently displayed picture due to the display delay of the display terminal.

[ description of the drawings ]

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.

FIG. 1 is a schematic diagram of an application environment of an embodiment of the present invention;

fig. 2 is a schematic diagram illustrating that data of an image acquired by an image capturing device is processed at a corresponding position on a time axis in a shooting method according to an embodiment of the present invention;

fig. 3 is a flowchart of a shooting method applied to a display terminal according to an embodiment of the present invention;

fig. 4 shows a step of acquiring an image, recording a timestamp of the acquired image, and saving the acquired image and the timestamp of the acquired image in a cache in the shooting method according to an embodiment of the present invention;

fig. 5 is a flowchart of a shooting method applied to an image capturing apparatus according to an embodiment of the present invention;

fig. 6 illustrates steps of encoding and the like of a captured image by an image capturing apparatus in a shooting method applied to the image capturing apparatus according to an embodiment of the present invention;

fig. 7 is a flowchart of a shooting method applied to a shooting system including an image capturing apparatus and a display terminal according to an embodiment of the present invention;

fig. 8 is a signaling interaction diagram between a display terminal and an image capturing apparatus according to an embodiment of the present invention, which illustrates a shooting method according to an embodiment of the present invention;

fig. 9 is a block diagram of a photographing apparatus applied to a display terminal according to an embodiment of the present invention;

fig. 10 is a block diagram of a photographing apparatus applied to a display terminal according to another embodiment of the present invention;

fig. 11 is a block diagram of a shooting device applied to an image pickup apparatus according to an embodiment of the present invention;

fig. 12 is a block diagram of a photographing device applied to an image pickup apparatus according to another embodiment of the present invention;

fig. 13 is a block diagram of a camera according to an embodiment of the invention;

fig. 14 is a block diagram of a camera according to an embodiment of the invention.

[ detailed description ] embodiments

In order to facilitate an understanding of the invention, the invention is described in more detail below with reference to the accompanying drawings and specific examples. It will be understood that when an element is referred to as being "secured to" another element, it can be directly on the other element or intervening elements may also be present. When an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may be present. As used in this specification, the terms "upper," "lower," "inner," "outer," "bottom," and the like are used in the orientation or positional relationship indicated in the drawings for convenience in describing the invention and simplicity in description, and do not indicate or imply that the referenced device or element must have a particular orientation, be constructed and operated in a particular orientation, and are not to be considered limiting of the invention. Furthermore, the terms "first," "second," "third," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

Furthermore, the technical features mentioned in the different embodiments of the invention described below can be combined with each other as long as they do not conflict with each other.

The embodiment of the application is suitable for the camera equipment which is remotely controlled by the display terminal in a wireless transmission mode, for example, the camera equipment is suitable for an unmanned aerial vehicle which is controlled by a remote controller and has a shooting function.

Fig. 1 illustrates a typical application environment provided by an embodiment of the present invention. The application environment may include: an unmanned aerial vehicle 10 as an image pickup apparatus and a remote controller 20 as a display terminal, wherein the unmanned aerial vehicle 10 has a shooting function, and specifically, in the embodiment of the present invention, the unmanned aerial vehicle 10 is mounted with a camera 100 for realizing the shooting function; the remote controller 20 is mounted with a display device 200 for realizing its display function. The unmanned aerial vehicle 10 and the remote controller 20 are connected in a wireless communication mode, the unmanned aerial vehicle 10 and the remote controller 20 can perform data transmission through wireless communication, and the remote controller 20 transmits a remote controller control signal to the unmanned aerial vehicle 10 to remotely control flying, shooting and the like of the unmanned aerial vehicle 10.

Specifically, in the present embodiment, the unmanned aerial vehicle 10 and the remote controller 20 have a module for data transmission therebetween, for example, a radio frequency module (RF module). Signals such as images acquired by the camera 100 are transmitted to the rf module of the remote controller 20 in real time through the rf module of the unmanned aerial vehicle 10, and then displayed to the user through the display device 200 on the remote controller 20. On the other hand, when the user inputs a shooting request through the display device 200, the remote controller 20 generates a shooting instruction based on the shooting request, the shooting instruction is sent to the radio frequency module of the unmanned aerial vehicle 10 by the radio frequency module of the remote controller 20, the shooting instruction is received by the radio frequency module of the unmanned aerial vehicle 10 and then sent to the processor of the camera 100, and the camera 100 completes a corresponding shooting task including searching for an image in a cache and controlling storage of the searched image.

In the application environment shown in fig. 1, the display device 200 installed on the remote controller 20 is a display screen of the remote controller 20, and in some implementations, the display device 200 is a Liquid Crystal Display (LCD). It is understood that in other application environments, the display device 200 may be not only a display screen built in the remote controller 20, but also a mobile terminal with a display function externally connected to the remote controller, such as a smart phone, a tablet computer, and the like.

In the embodiment of the present invention, the image capturing apparatus is an unmanned aerial vehicle 10 having a shooting function, the shooting function of which is realized by a camera 100 mounted on the unmanned aerial vehicle 10, and a user at a display terminal can acquire an image captured by the camera 100 through the unmanned aerial vehicle 10. In other embodiments, the imaging apparatus is not limited to the unmanned aerial vehicle 10 having a shooting function, but may be a camera or a video camera or the like having a storage function and/or a processing function or the like, or a fixture having a shooting function such as a camera or the like. The user can directly acquire images acquired by the user from a camera, a video camera or a fixed device with a shooting function.

In the embodiment of the present invention, the display terminal is a remote controller 20 having a display device 200. In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, etc. capable of displaying images, and the user views the images acquired by the camera device on the display terminal and remotely controls the camera device, thereby realizing remote shooting. For example, when the image pickup apparatus is an unmanned aerial vehicle and the display terminal is a mobile phone, the user may operate an App provided by a manufacturer of the unmanned aerial vehicle on the mobile phone to operate the unmanned aerial vehicle, thereby implementing remote control of flight, shooting, and the like of the unmanned aerial vehicle 10.

Since it takes a certain time for the image signal of the unmanned aerial vehicle 10 to be transmitted to the remote controller 20, the preview picture viewed by the user on the display device 200 on the remote controller 20 is not the captured image displayed in real time but has a certain delay. The shooting method provided by the embodiment of the invention solves the problem that in the existing shooting method for performing remote control through a wireless control signal, the picture actually shot by a user through the shooting equipment is inconsistent with the preview picture currently displayed on the display terminal due to display delay. The following description will be given in specific examples.

As shown in fig. 2, a schematic diagram of processing data of an image captured by an image capturing apparatus at a corresponding position on a time axis in a shooting method according to an embodiment of the present invention is provided. Specifically, the processing procedure mainly includes: the image pickup equipment collects images; the camera equipment encodes the acquired image and records time information in the data of the encoded image; the camera equipment sends the coded image to a display terminal; the display terminal displays the coded image; the display terminal generates a photographing instruction containing time information based on a photographing request of a user and sends the photographing instruction to the camera equipment; and the camera equipment searches the image acquired at the time indicated by the time information according to the time information. Finally, the camera device again controls the storage of the found images (not shown in fig. 2).

In a typical application, the image capturing apparatus in fig. 2 is, for example, the unmanned aerial vehicle 10 shown in fig. 1, and the display terminal in fig. 2 is, for example, the remote controller 20 shown in fig. 1, and the following describes, by way of example, the overall process of the image capturing method provided by the embodiment of the present invention. Hereinafter, the flow of the photographing method provided by the embodiment of the present invention will be further described separately from the unmanned aerial vehicle 10 as the image pickup apparatus side and the remote controller 20 as the display terminal side.

As shown in fig. 2, the abscissa indicates a time axis, and the ordinate indicates transmission of data of an image and the like at respective time points on the time axis. In fig. 2, the embodiment of the present invention is described by taking time t as an example of the starting time of the image acquisition by the unmanned aerial vehicle 10 through the camera 100, and performing image acquisition every 1 unit time.

Specifically, the unmanned aerial vehicle 10 acquires the image a for the shooting scene at times t, t +1, t +2, t +3, t +4, and t +5, respectively, starting from time t on the time axis through the camera of the camera 100₀、b₀、c₀、d₀、e₀And f₀And recording the collected images a respectively₀、b₀、c₀、d₀、e₀And f₀Time information F (t), F (t +1), F (t +2), F (t +3), F (t +4), and F (t + 5). The unmanned aerial vehicle 10 pairs the acquired image a₀、b₀、c₀、d₀、e₀And f₀Encoding is performed and the image a is₀、b₀、c₀、d₀、e₀And f₀The time information F (t), F (t +1), F (t +2), F (t +3), F (t +4), and F (t +5) at the time of acquisition is recorded in the data a, b, c, d, e, and F of the encoded image, and transmitted to the remote controller 20 by the unmanned aerial vehicle 10 so that the encoded image is displayed on the remote controller 20.

It should be understood that the image acquired by the unmanned aerial vehicle through the camera 100 is specifically transmitted by a signal sending module of the unmanned aerial vehicle 10, the remote controller 20 is provided with a corresponding signal receiving module, the remote controller 20 firstly receives data of the image sent by the unmanned aerial vehicle 10, and then displays the data on the display device 200; when a user inputs a photographing request on the display device 200, the remote controller 20 generates a photographing instruction based on the photographing request, and sends the photographing instruction through the signal sending module of the remote controller 20, the unmanned aerial vehicle 10 is provided with a corresponding signal receiving module, after receiving the photographing instruction sent by the remote controller 20, the unmanned aerial vehicle 10 transmits the photographing instruction to the camera 100, and the camera 100 executes corresponding operation. It should be understood that the signal transmitting module and the signal receiving module on the unmanned aerial vehicle 10 may be the same communication module, and the signal transmitting module and the signal receiving module of the remote controller 20 may also be the same communication module.

Since the transmission of the image requires time, the time for the image to reach the remote controller 20 is delayed, and there is a time difference Δ T, in this embodiment, taking Δ T as 5 as an example, it takes 5 units of time for the data of each image processed by the unmanned aerial vehicle 10 to be transmitted to the remote controller 20, that is, there is a time delay of 5 units of time for the image transmitted from the unmanned aerial vehicle 10 to the remote controller 20 and displayed on the display device 200 of the remote controller 20, and the preview screen viewed by the user on the display device 200 at the current time is actually an image captured by the camera 100 5 units of time ago. At a certain time, the user inputs a photographing request, and in this embodiment, the user inputs a photographing instruction at time t +8 as an example, at this time, although the corresponding time on the time axis is t +8, the image d captured at the time indicated by the time information F (t +3) is displayed on the display device 200₀. That is, what the user actually observes and wants to take a picture is the image d₀The picture displayed on the display device 200. When the user inputs a photographing request at time t +8, the remote controller 20 generates an image d including the image displayed on the display device 200 at time t +8 based on the photographing request₀The photographing instruction of the time information F (t +3) is sent to the unmanned aerial vehicle 10, the unmanned aerial vehicle 10 receives the photographing instruction containing the time information F (t +3) sent by the remote controller 20, and according to the time information F (t +3), the image acquired by the camera 100 at the time indicated by the time information F (t +3), that is, the image d is searched in the cache₀From the above, the image d₀In line with the picture that the user actually observes and wants to take a picture.

Finally, the searched image d is stored₀. Specifically, after finding the corresponding image, the unmanned aerial vehicle 10 stores the image for the user to view and download at any time.

According to the shooting method provided by the embodiment of the invention, the time information contained in the shooting instruction is utilized, the image acquired by the unmanned aerial vehicle 10 at the time indicated by the time information through the camera 100 is searched in the cache of the unmanned aerial vehicle 10, the image corresponding to the preview picture which the user actually wants to shoot can be accurately searched, and the image is stored, so that the problem that the picture actually shot by the user is inconsistent with the currently displayed picture due to display delay is solved.

Fig. 3 is a flowchart of a photographing method according to an exemplary embodiment of the present invention. The method may be applied to a display terminal which communicates with a camera device to display an image captured by the camera device. The display terminal is, for example, a remote controller 20 shown in fig. 1, and the image pickup apparatus is, for example, an unmanned aerial vehicle 10 shown in fig. 1. As shown in fig. 3, the method may include:

in step S210, a photographing request input by a user is received.

The photographing request may be used to indicate that the user intends to photograph the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal. For example, when the unmanned aerial vehicle 10 transmits an image captured by the camera 100 to the remote controller 20 and displays the image on the display device 200 of the remote controller 20, if a user viewing a preview screen at one end of the remote controller 20 is interested in a screen at a certain time or a certain period of time, a photographing request operation for the preview screen may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to photograph the screen. In some implementations, the user inputs the photographing request to the remote controller 20 through an interactive interface, which is located on the display device 200 of the remote controller 20, and the interactive interface may be an app interface displayed on the display device 200, and the app interface includes a virtual prompt key for completing the photographing. In other implementations, the user may also input the photographing request to the remote control 10 through a physical key on the remote control 20, which may be a physical button located at a specific position on the body of the remote control 20.

In step S220, a photographing instruction including time information is generated according to the photographing request.

The photographing instruction is used for requesting the image corresponding to the time information from the camera shooting equipment. In some embodiments, the time information comprises a timestamp or a time period. In one implementation, the time stamp may be a time stamp when an image currently displayed on the display apparatus 200 of the remote controller 20 is captured when a user inputs a photographing request to the remote controller 20 as a display terminal. The remote controller 20, before receiving the photographing request input by the user, has recorded the time stamp in the data for the encoded image displayed on the display device 200, is transmitted from one end of the unmanned aerial vehicle 10 to one end of the remote controller 20 along with the data for the encoded image, so that the user requests the image corresponding to the time stamp based on the time stamp.

Specifically, images of pictures, videos, and the like acquired by the unmanned aerial vehicle 10 through the camera 100 are not encoded and cannot be directly displayed/played on the remote controller 20 serving as the display terminal, and therefore, the images need to be encoded and processed into encoded images to be displayed/played on the remote controller 20 in real time. For example, in one embodiment, if the time stamp is 10:31, the image corresponding to the time stamp may include an image captured by the unmanned aerial vehicle 10 at the time of 10:31, and when the image is encoded, the time stamp 10:31 is recorded in data of the encoded image, and transmitted to the remote controller 20 along with the encoded image, and the encoded image is displayed by the display device 200 of the remote controller 20.

Because the photographing instruction generated by the remote controller 20 serving as the display terminal includes the time information, when the photographing instruction is sent to the unmanned aerial vehicle 10, the time information included in the photographing instruction can be utilized to request the unmanned aerial vehicle 10 for an image corresponding to the time information, the unmanned aerial vehicle 10 searches for an image acquired by the unmanned aerial vehicle 10 at the time indicated by the time information through the camera 100 in the cache, and after the image is found, the unmanned aerial vehicle 10 controls the storage of the image, so that the user can view and download the image at any time.

In step S230, the photographing instruction is sent to the image pickup apparatus, so that the image pickup apparatus searches, according to the time information, an image photographed by the image pickup apparatus at the time indicated by the time information in a cache, and stores the searched image.

Specifically, in the present embodiment, the time information is a time stamp of when the image currently displayed on the display device 200 of the remote controller 20 was captured when the user inputs a photographing request to the remote controller 20 as the display terminal. Since the time stamp is carried by the data of the encoded image and is transmitted to the remote controller 20, when the remote controller 20 generates a photographing instruction based on the photographing request input by the user, the remote controller 20 first acquires information of the time stamp carried in the data of the image currently displayed on the remote controller 20, and then includes the time stamp as the time information in the generated photographing instruction.

After the remote controller 20 sends a photographing instruction to the unmanned aerial vehicle 10, the unmanned aerial vehicle 10 parses information of a timestamp included in the photographing instruction, and searches an image acquired by the unmanned aerial vehicle 10 at a time indicated by the timestamp from a cache. Since the time stamp reflects which image displayed on the display device 200 the user specifically wants to take at the moment of inputting the photographing instruction, the image corresponding to the time stamp can be found from the plurality of images previously buffered in the memory of the unmanned aerial vehicle 10 only according to the time stamp of the image the user wants to take.

Therefore, when the camera 100 of the unmanned aerial vehicle 10 captures an image, the captured image and the time stamp at the time of capture thereof also need to be buffered.

As shown in fig. 4, a step of acquiring an image, recording a timestamp of the acquired image, and saving the acquired image and the timestamp of the acquired image in a cache in the shooting method according to an embodiment of the present invention is shown. The method specifically comprises the following steps:

step S110, the camera device collects images;

step S120, recording a time stamp when the image is acquired;

step S130, storing the image captured by the image capturing device and the timestamp of the captured image in the cache.

Specifically, the unmanned aerial vehicle 10 caches the captured images, records a time stamp of the captured images, and caches the time stamp, so as to find out a corresponding image based on the time stamp included in the data of the image after receiving a photographing instruction from the remote controller 20. It should be understood that the buffer space of the unmanned aerial vehicle 10 is limited, the unmanned aerial vehicle 10 continuously acquires and buffers the images and the time stamp of each acquired image as time passes, after the buffer space of the unmanned aerial vehicle 10 is fully utilized by the acquired images and the time stamp data, the data of the old images and the time stamps thereof which are already buffered in the buffer space are sequentially cleared according to the acquisition time each time the data of the new images and the time stamps thereof are acquired again, that is, each time a new image and/or time stamp data is to be buffered in the unmanned aerial vehicle 10, the data of the image and/or time stamp which is most buffered in the buffer space of the unmanned aerial vehicle 10 in time is cleared, the data of the new image and/or time stamp is continuously buffered as the unmanned aerial vehicle 10, the old images and/or time stamped data are correspondingly removed one by one in chronological order.

It should be understood that the timestamp may be placed within the data of the acquired image, stored in a cache with the data of the acquired image; the time stamp may also be kept separately in the cache. When the time stamps are separately stored in the cache, it is necessary to store the correspondence between each time stamp and the acquired image together. In some embodiments of the present invention, the Cache is a buffer area (referred to as Cache) for data exchange on the image capture device, and is generally a RAM (non-permanent storage that is powered off), for example, the Cache may be a memory bank on the image capture device. In this embodiment, the cache may be a memory bank on the UAV 10, and the memory bank may be disposed on any component of the UAV 10.

Finally, the UAV 10 controls the storage of the retrieved images so that they may be viewed, saved, and/or downloaded by the user at any time thereafter. In some implementations, the unmanned aerial vehicle 10 permanently stores the located image on the unmanned aerial vehicle 10, for example, on a memory card of the unmanned aerial vehicle 10; alternatively, the unmanned aerial vehicle 10 transmits the searched image to the remote controller 20, and the searched image is stored by the remote controller 20, for example, on a memory card of the remote controller 20; alternatively, the unmanned aerial vehicle 10 transmits the searched image to other third-party equipment, and the third-party equipment stores the searched image. In other implementations, the unmanned aerial vehicle 10 may also upload the found images to a network disk through a cloud storage service on the World Wide Web (Web). For the case where the found image is stored in the memory card of the unmanned aerial vehicle 10, the user may take off the memory card from the unmanned aerial vehicle 10, and read and store the image on the memory card by using an external device such as a computer, a notebook, or a hard disk, or may not take off the memory card from the unmanned aerial vehicle 10, but wirelessly connect the external device such as a mobile phone to the unmanned aerial vehicle 10, and directly download the image stored in the unmanned aerial vehicle 10 to the external device.

According to different settings of the user on the camera 100, the searched image can be stored as a raw format picture as a finally output photo; or carrying out compression coding on the searched image to generate a compression-coded image, and storing the compression-coded image as a finally output photo. For example, if the user sets the picture output format of the camera 100 to raw format, the searched image is directly saved as a picture in raw format, and is provided to the user as a finally output picture; if the user sets the image output format of the camera 100 to the compressed and encoded image format, for example, the common formats such as JPG, JPEG, TIFF, and TIF, according to the setting of the user, the searched image is compressed and encoded first, so as to generate a compressed and encoded image that is consistent with the image output format of the camera 100 set by the user, and then the compressed and encoded image is stored and provided to the user as a finally output photo.

According to the shooting method provided by the embodiment of the invention, the shooting instruction generated by the display terminal contains the time information and can be used for requesting the camera equipment for the image corresponding to the time information, so that after the camera equipment receives the shooting instruction, the image acquired by the camera equipment at the time indicated by the time information can be searched in the cache according to the time information, the image corresponding to the preview picture which the user actually wants to shoot is accurately searched, and the image is stored, so that the problem that the picture actually shot by the user is inconsistent with the currently displayed picture due to the display delay of the display terminal is solved.

Fig. 5 is a flowchart of a photographing method according to another exemplary embodiment of the present invention. The method may be applied to a camera device which communicates with a display terminal to display an image captured by the camera device on the display terminal. The imaging device is, for example, an unmanned aerial vehicle with a shooting function shown in fig. 1, and the shooting function of the unmanned aerial vehicle 10 is realized by a camera 100 mounted on the unmanned aerial vehicle; the display terminal is, for example, a remote controller 20 having a display function shown in fig. 1, and the display function is realized by a display device 200 on the remote controller 20. As shown in fig. 5, the method may include steps S310 to S330:

in step S310, a photographing instruction is received from the display terminal, and the photographing instruction includes time information.

After receiving a photographing request input by a user, the remote controller 20 serving as a display terminal generates a photographing instruction including time information according to the photographing request, and sends the photographing instruction to the unmanned aerial vehicle 10 serving as an image pickup device, and the unmanned aerial vehicle 10 receives the photographing instruction including the time information from the remote controller 20 serving as the display terminal. Specifically, in the embodiment of the present invention, the remote controller 20 transmits the photographing instruction to the unmanned aerial vehicle 10 through the radio frequency module on the remote controller 20, and the photographing instruction is received by the radio frequency module of the unmanned aerial vehicle 10, and after the radio frequency module of the unmanned aerial vehicle 10 receives the photographing instruction, the processor completes a corresponding photographing task, including searching an image in the cache and controlling storage of the searched image.

The photographing request may be used to indicate that the user intends to photograph the preview screen currently displayed on the display device 200 of the remote controller 20 as the display terminal. For example, when the image captured by the unmanned aerial vehicle 10 through the camera 100 is transmitted to the remote controller 20 and displayed on the display device 200 of the remote controller 20, if a user viewing a preview screen at one end of the remote controller 20 is interested in a screen at a certain time or a certain period of time, a photographing request operation for the preview screen may be performed through the interactive interface on the remote controller 20 to instruct the unmanned aerial vehicle 10 to photograph the screen. Thereafter, the remote controller 20 may receive the photographing request. In some implementations, an interactive interface is located on the display device 200 of the remote controller 20, and the interactive interface may be an app interface displayed on the display device 200, and the app interface includes a virtual prompt key for completing the photographing. In other implementations, the user may also complete the photographing request for the picture currently displayed by the display apparatus 200 through a physical key on the remote controller 20, which may be a button located at a specific position on the body of the remote controller 20.

In one embodiment, the time information includes a timestamp or a time period. In one implementation, the time stamp may be a time stamp when an image currently displayed on the display apparatus 200 of the remote controller 20 is captured when a user inputs a photographing request to the remote controller 20 as a display terminal. The remote controller 20, before receiving the photographing request input by the user, has recorded the time stamp in the data for the encoded image displayed on the display device 200, is transmitted from one end of the unmanned aerial vehicle 10 to one end of the remote controller 20 along with the data for the encoded image, so that the user requests the image corresponding to the time stamp based on the time stamp.

Specifically, before step S310, steps S110 to S130 are further included in which the unmanned aerial vehicle 10 serving as an imaging device captures an image, records a time stamp at the time of capturing the image, and saves the captured image and the time stamp at the time of capturing the image in a cache; steps S140 to S160 in which the image pickup apparatus encodes the acquired image, and transmits data of the encoded image that can be displayed on the remote controller 20 as a display terminal to the remote controller or the like; and steps S210 to S230 in which the remote controller 20 as a display terminal receives a photographing request from a user, generates a photographing instruction including time information according to the photographing request, and transmits the photographing instruction to the unmanned aerial vehicle 10. The steps S110 to S130 and the steps S210 to S230 have already been described in the previous embodiment with reference to fig. 4 and fig. 3, and will not be described in detail here. The following specifically describes steps S140 to S160:

referring to fig. 6, in step S140, the acquired image is encoded; and in step S150, recording the time stamp of the captured image as captured in the data of the encoded image. In the present embodiment, as described above, the time information included in the photographing instruction generated by the remote controller 20 is a time stamp of when the image currently displayed on the display device 200 of the remote controller 20 was captured when the user inputs the photographing request to the remote controller 20 as the display terminal. As each image is captured by the camera 100, a timestamp of the time at which each of the images was captured is recorded (step S120 above). Since data of images such as pictures and videos captured by the camera 100 is not encoded and cannot be directly displayed/played on the remote controller 20 serving as a display terminal, the data needs to be encoded and encoded into an encoded image to be displayed/played on the remote controller 20 serving as the display terminal. When the camera 100 encodes the data, the recorded time stamp at the time of capturing each image is included in the data of each encoded image, and thus the time stamp at the time of capturing is recorded in the data of each encoded image. These time stamps are carried by the data of the encoded image and are transmitted together to the remote controller 20.

In step S160, the encoded image is transmitted to the display terminal, so that the encoded image is displayed on the display terminal. Therefore, the data of each encoded image received by the remote controller 20 as the display terminal includes a timestamp of the image captured, the timestamp being time information recorded in the data of each encoded image, and the remote controller 20 as the display terminal is used to generate a photographing instruction including the time information according to a photographing request input by a user.

Therefore, since the photographing instruction generated by the remote controller 20 as the display terminal includes the time information, the image corresponding to the time information can be requested from the unmanned aerial vehicle 10 when the photographing instruction is transmitted to the unmanned aerial vehicle 10.

Returning to fig. 5 again, after the unmanned aerial vehicle 10 receives the photographing instruction including the time information from the remote controller 20, in step 320, the unmanned aerial vehicle 10 searches the image acquired by the unmanned aerial vehicle 10 at the time indicated by the time information in the cache according to the time information, and after the unmanned aerial vehicle 10 finds the image, in step S330, the unmanned aerial vehicle 10 controls the storage of the image so that the user can view and download the image at any time.

Specifically, in the present embodiment, the time information is a time stamp of when the encoded image currently displayed on the display device 200 of the remote controller 20 was captured when the user inputs a photographing request to the remote controller 20 as a display terminal. Since the time stamp is carried by the data of the encoded image and is sent to the unmanned aerial vehicle 10 by the remote controller 20, after the photographing instruction is received from the remote controller 20, the unmanned aerial vehicle 10 analyzes the information of the time stamp included in the photographing instruction, and searches the image acquired by the unmanned aerial vehicle 10 at the time indicated by the time stamp from the cache. Since the time stamp reflects which image displayed on the display device 200 the user specifically wants to take at the moment of inputting the photographing instruction, the image corresponding to the time stamp can be found from the plurality of images that are cached in the memory of the unmanned aerial vehicle 10, as long as the time stamp of the image the user wants to take is based on. As described in the above embodiment, when the unmanned aerial vehicle 10 acquires an image through the camera 100, the acquired image and the timestamp thereof during acquisition need to be cached, and since the process is the same as steps S110 to S130 in the embodiment described with reference to fig. 4, the description is omitted.

Finally, in step S330, the unmanned aerial vehicle 10 controls the storage of the found images so that the user can view, save, and/or download them at any time later.

In some implementations, the unmanned aerial vehicle 10 permanently stores the located image on the unmanned aerial vehicle 10, for example, on a memory card of the unmanned aerial vehicle 10; alternatively, the unmanned aerial vehicle 10 transmits the searched image to the remote controller 20, and the searched image is stored by the remote controller 20, for example, on a memory card of the remote controller 20; alternatively, the unmanned aerial vehicle 10 transmits the searched image to other third-party equipment, and the third-party equipment stores the searched image. In other implementations, the unmanned aerial vehicle 10 may also upload the found images to a network disk through a cloud storage service on the World Wide Web (Web). For the case where the found image is stored in the memory card of the unmanned aerial vehicle 10, the user may take off the memory card from the unmanned aerial vehicle 10, and read and store the image on the memory card by using an external device such as a computer, a notebook, or a hard disk, or may not take off the memory card from the unmanned aerial vehicle 10, but wirelessly connect the external device such as a mobile phone to the unmanned aerial vehicle 10, and directly download the image stored in the unmanned aerial vehicle 10 to the external device.

Specifically, according to different settings of the user on the camera 100, the searched image may be saved as a raw format picture as a finally output picture; or carrying out compression coding on the searched image to generate a compression-coded image, and storing the compression-coded image as a finally output photo. For example, if the user sets the picture output format of the camera 100 to raw format, the searched image is directly saved as a picture in raw format, and is provided to the user as a finally output picture; if the user sets the image output format of the camera 100 to the compressed and encoded image format, for example, the common formats such as JPG, JPEG, TIFF, and TIF, according to the setting of the user, the searched image is compressed and encoded first, so as to generate a compressed and encoded image that is consistent with the image output format of the camera 100 set by the user, and then the compressed and encoded image is stored and provided to the user as a finally output photo.

As shown in fig. 7, an embodiment of the present invention further provides a shooting method, which is applied to a shooting system including an image capturing apparatus and a display terminal, where the image capturing apparatus communicates with the display terminal to display an image captured by the image capturing apparatus on the display terminal. The imaging apparatus is, for example, an unmanned aerial vehicle 10 having a shooting function shown in fig. 1, and the shooting function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; the display terminal is, for example, a remote controller 20 having a display function shown in fig. 1, and the display function is realized by a display device 200 on the remote controller 20. A user at one end of the remote controller 20 may acquire images acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In other embodiments, the imaging device is not limited to the unmanned aerial vehicle 10 having a shooting function, but may be a camera or a video camera or the like having a storage function and/or a processing function, or a fixed device having a shooting function, such as a camera or the like. The user can directly acquire images acquired by the user from a camera, a video camera or a fixed device with a shooting function. In other embodiments, the display terminal may be a smartphone, tablet, PC, laptop, etc. having a display device, such as a display screen.

Specifically, the method comprises the following steps:

in step S210, the display terminal receives a photographing request input by a user;

in step S220, the display terminal generates a photographing instruction including time information according to the photographing request;

in step S230, the display terminal sends the photographing instruction to the image capturing apparatus;

in step S310, receiving a photographing instruction from the display terminal, where the photographing instruction includes time information;

in step S320, the image capturing apparatus searches, according to the time information, for an image acquired by the image capturing apparatus at the time indicated by the time information in a cache; and

in step S330, the image capturing apparatus controls storage of the searched image.

This embodiment relates to some or all of the steps in one or more of the above methods for a display terminal and for an image pickup apparatus, and thus, the specific steps thereof will not be described in detail herein.

According to the shooting method provided by the embodiment of the invention, the shooting instruction received by the camera equipment from the display terminal contains the time information, and can be used for requesting the image corresponding to the time information by the camera equipment, so that after the camera equipment receives the shooting instruction, the image acquired by the camera equipment at the time indicated by the time information can be searched in the cache according to the time information, and therefore, the image corresponding to the preview picture which the user actually wants to shoot can be accurately searched, and the image can be stored, and the problem that the picture actually shot by the user is inconsistent with the currently displayed picture due to the display delay of the display terminal is solved.

Fig. 8 is a signaling interaction diagram between a display terminal and an image pickup apparatus provided according to an exemplary embodiment of the present invention, which illustrates a photographing method provided according to an embodiment of the present invention. The display terminal is, for example, a remote controller 20 having a display function shown in fig. 1, and the image pickup apparatus is, for example, an unmanned aerial vehicle 10 having a photographing function shown in fig. 1. In other embodiments, the imaging apparatus is not limited to the unmanned aerial vehicle 10 having a shooting function, but may be a camera or a video camera or the like having a storage function and/or a processing function or the like, or a fixture having a shooting function, such as a camera or the like. The user can directly acquire images acquired by the user from a camera, a video camera or a fixed device with a shooting function. In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, etc. capable of displaying images, and the user views the images acquired by the camera device on the display terminal and remotely controls the camera device, thereby realizing remote shooting. For example, when the image pickup apparatus is an unmanned aerial vehicle and the display terminal is a mobile phone, the user may operate an App provided by a manufacturer of the unmanned aerial vehicle on the mobile phone to operate the unmanned aerial vehicle, thereby implementing remote control of flight, shooting, and the like of the unmanned aerial vehicle 10.

Fig. 8 relates to some or all of the steps in one or more of the above methods for a display terminal and for an image pickup apparatus, and thus, will not be described in detail herein.

Fig. 9 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention. The device can be applied to a display terminal which communicates with a camera device to display an image captured by the camera device. The display terminal is, for example, a remote controller 20 with a display function shown in fig. 1, and the display function is realized by a display device 200 on the remote controller 20; the imaging apparatus is, for example, an unmanned aerial vehicle 10 having a shooting function shown in fig. 1, and the shooting function is realized by a camera 100 mounted on the unmanned aerial vehicle 10. In other embodiments, the display terminal may be a smartphone, tablet, PC, laptop, etc. having a display device, such as a display screen. Referring to fig. 9, the apparatus may include a first receiving module 410 for receiving a photographing request input by a user; and a photographing instruction generating module 420, configured to generate a photographing instruction including time information according to the photographing request. The photographing instruction is used for requesting the image corresponding to the time information from the camera shooting equipment. A first sending module 430, configured to send the photographing instruction to the image capturing apparatus, so that the image capturing apparatus searches, according to the time information, an image captured by the image capturing apparatus at the time indicated by the time information in a cache, and stores the searched image

As shown in fig. 10, a block diagram of a photographing apparatus according to another exemplary embodiment of the present invention is provided. The device can be applied to a display terminal which communicates with a camera device to display an image captured by the camera device. The apparatus includes a second receiving module 440 and a display module 450 in addition to the first receiving module 410, the photographing instruction generating module 420 and the first transmitting module 430 included in the embodiment shown in fig. 9. The first receiving module 410, the photographing instruction generating module 420 and the first sending module 430 are the same as those in the embodiment described with reference to fig. 9, and are not described again.

In the embodiment shown in fig. 10, the second receiving module 440 is configured to receive an encoded image from the image capturing apparatus, and the display module 450 is configured to display the encoded image received from the image capturing apparatus, where a timestamp of when the image was captured is recorded in the encoded image. In some embodiments, the display module may be, for example, the display device 200 of the remote controller 20 shown in fig. 1, and the display device 200 may include a Liquid Crystal Display (LCD) and/or a Touch Panel (TP). In other embodiments, the display module may be a display screen and/or a touch panel of a smartphone, tablet, PC, notebook, etc.

Fig. 11 is a block diagram of a photographing apparatus according to an exemplary embodiment of the present invention. The device can be applied to a camera device which communicates with a display terminal to display an image acquired by the camera device on the display terminal. The imaging device is, for example, an unmanned aerial vehicle 10 with a shooting function shown in fig. 1, and the shooting function of the unmanned aerial vehicle 10 is realized by a camera 100 mounted on the unmanned aerial vehicle; the display terminal is, for example, a remote controller 20 shown in fig. 1. A user at one end of the remote controller 20 may acquire images acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In other embodiments, the imaging apparatus is not limited to the unmanned aerial vehicle 10 having a shooting function, but may be a camera or a video camera or the like having a storage function and/or a processing function or the like, or a fixed device having a shooting function, such as a camera or the like. The user can directly acquire images acquired by the user from a camera, a video camera or a fixed device with a shooting function.

Referring to fig. 11, the photographing apparatus includes: a third receiving module 510, configured to receive a photographing instruction from the display terminal, where the photographing instruction includes time information; the image searching module 520 is configured to search, according to the time information, an image acquired by the image pickup apparatus at the time indicated by the time information in a cache; and a storage control module 530 for controlling storage of the searched image. The display terminal is, for example, a remote controller 20 shown in fig. 1. In other embodiments, the display terminal may also be a smart phone, a tablet computer, a PC, a notebook computer, or the like.

Fig. 12 is a block diagram of a camera according to another embodiment of the present invention. The device can be applied to a camera device which communicates with a display terminal to display an image acquired by the camera device on the display terminal. The photographing apparatus includes, in addition to the third receiving module 510, the image searching module 520, and the storage control module 530 included in the embodiment shown in fig. 11, further: an image acquisition module 610, a time stamp recording module 620, a buffer module 630, an encoding module 640, and a second transmission module 650. The third receiving module 510, the image searching module 520, and the storage control module 530 are the same as those in the embodiment described with reference to fig. 11, and are not described again.

In the embodiment shown in FIG. 12, image acquisition module 610 is used to acquire images; the timestamp recording module 620 is configured to record a timestamp when the image is acquired; the buffer module 630 is configured to store the captured image and a timestamp of the captured image when the captured image is captured in the buffer; the encoding module 640 is configured to encode the acquired image and record a timestamp of the acquired image when the acquired image is acquired in data of the encoded image; the second sending module 650 is configured to send the encoded image to the display terminal, so as to display the encoded image on the display terminal. Specifically, the second sending module 650 communicates with the second receiving module 440 (fig. 10) of the display terminal, and the encoded image is received by the second receiving module 440 and displayed by the display module 450 of the display terminal.

The embodiment of the invention also provides a shooting system which comprises the camera equipment and the display terminal, wherein the camera equipment is communicated with the display terminal so as to display the image acquired by the camera equipment on the display terminal. The imaging apparatus is, for example, an unmanned aerial vehicle 10 having a shooting function shown in fig. 1, and the shooting function is realized by a camera 100 mounted on the unmanned aerial vehicle 10; the display terminal is, for example, a remote controller 20 having a display function shown in fig. 1, and the display function is realized by a display device 200 on the remote controller 20. A user at one end of the remote controller 20 may acquire images acquired by the unmanned aerial vehicle 10 through the unmanned aerial vehicle 10. In other embodiments, the imaging device is not limited to the unmanned aerial vehicle 10 having a shooting function, but may be a camera or a video camera or the like having a storage function and/or a processing function, or a fixed device having a shooting function, such as a camera or the like. The user can directly acquire images acquired by the user from a camera, a video camera or a fixed device with a shooting function. In other embodiments, the display terminal may be a smartphone, tablet, PC, laptop, etc. having a display device, such as a display screen.

Specifically, the display terminal is configured to: receiving a photographing request input by a user; generating a photographing instruction containing time information according to the photographing request; and sending the photographing instruction to the photographing equipment. The image pickup apparatus is configured to: receiving the photographing instruction; according to the time information, searching images acquired by the camera equipment at the time indicated by the time information in a cache; and controlling the storage of the searched image.

With regard to the apparatuses in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Fig. 13 is a block diagram of a camera 2000 according to an embodiment of the present invention. For example, the camera 2000 may be a terminal having a display function, such as a smart phone, a tablet computer, a PC, a notebook computer, a messaging device, and a game console.

Referring to FIG. 13, the camera 2000 may include one or more components of a processing component 2001, a memory 2002, a multimedia component 2003, an input/output (I/O) interface 2004, and a communication component 2005.

The processing component 2001 controls the overall operation of the photographing device 2000, such as operations associated with display, data communication, photographing operations, control of flight of a mobile terminal such as an unmanned aerial vehicle, and the like. The processing component 2001 may include one or more processors 2010 to execute instructions to perform all or part of the steps of the method on the display terminal side of the embodiments described above.

Memory 2002 is configured to store various types of data that support operations on camera 2000, such as instructions for any application or method operating on camera 2000, contact data, messages, pictures, videos, files, and so forth. The memory 2002 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (R0M), magnetic memory, flash memory, magnetic or optical disks.

The multimedia component 2003 includes a display device, such as the display device 200 shown in FIG. 1, that provides an output interface between the camera 2000 and a user. In some embodiments, the display device may include a Liquid Crystal Display (LCD) and/or a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user.

Input/output (I/O) interface 2004 provides an interface between processing component 2001 and peripheral interface modules, which may be keyboards, buttons, virtual keys, etc., such as Home buttons, volume buttons, and lock screen buttons on a smartphone.

The communication component 2005 is configured to provide wired or wireless communication between the camera 2000 and other devices. The camera 2000 may access a wireless network based on a communication standard, such as a WiFi, 3G, or 4G network. In some embodiments, the illustrated communication component 2005 also includes a Near Field Communication (NFC) module for short range communication, which may be implemented based on Radio Frequency Identification (RFID) technology, infrared communication (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, among other technologies, for example.

In an embodiment of the present invention, the photographing apparatus 2000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), digital signal processing devices (dsros), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components to perform the above-described method at the display terminal side.

Embodiments of the present invention also provide a non-volatile computer-readable storage medium, such as the memory 2002, which stores computer-executable instructions that are executed by the processor 2010 of the photographing apparatus 2000 to perform the photographing method in any of the method embodiments on the display terminal side described above, for example, to perform some or all of the steps in the methods of fig. 1 to 3, 7 and 8 described above to implement the functions of the modules in fig. 9 and 10. The non-volatile computer readable storage medium may be R0M, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Fig. 14 is a block diagram of a photographing apparatus 3000 according to an embodiment of the present invention. For example, the imaging device 3000 may be a smart camera or a smart camera having a storage function and/or a processing function, or may be a camera mounted on a mobile terminal such as an unmanned aerial vehicle or a handheld pan/tilt head.

Referring to fig. 14, the photographing apparatus 3000 may include one or more components of a processing component 3001, a memory 3002, a multimedia component 3003, an input/output (I/O) interface 3004, and a communication component 3005.

The processing component 3001 controls overall operations of the photographing apparatus 3000, such as operations associated with displaying, data communication, photographing, recording video, and the like. The processing component 3001 may include one or more processors 3010 to execute instructions to complete all or part of the steps of the method on the image pickup apparatus side of the above embodiments.

Memory 3002 is configured to store various types of data that support operations on camera 3000, such as instructions for any application or method operating on camera 3000, pictures, videos, files, and so forth. The memory 3002 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (R0M), magnetic memory, flash memory, magnetic or optical disks.

The multimedia component 3003 includes a display device that provides an output interface between the camera 3000 and a user. In some embodiments, the display device may include a Liquid Crystal Display (LCD) and/or a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. For example, when the photographing device 3000 is a camera, the display device may be a display screen and/or a touch panel on the camera that provides functions of previewing and viewing a picture.

Input/output (I/O) interface 3004 provides an interface between processing component 4001 and peripheral interface modules, which may be keyboards, buttons, virtual keys, etc., such as menu buttons, shutter buttons, volume buttons, mode dials, etc. on the camera.

The communication component 3005 is configured for wired or wireless communication between the camera 3000 and other devices. The camera 3000 may access a wireless network based on a communication standard, such as a WiFi, 3G, or 4G network. In some embodiments, the illustrated communication component 3005 also includes a Near Field Communication (NFC) module for short range communication, which may be implemented based on, for example, Radio Frequency Identification (RFID) technology, infrared communication (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies. For example, when the camera 3000 is the camera 100 carried by the unmanned aerial vehicle 10 shown in fig. 1, the NFC module may be a radio frequency module installed in an inner cavity of a housing of the unmanned aerial vehicle 10.

In the embodiment of the present invention, the photographing apparatus 3000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), digital signal processing devices (dsros), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components to perform the above-described method of the photographing apparatus side.

Embodiments of the present invention also provide a non-volatile computer-readable storage medium, such as the memory 3002, which stores computer-executable instructions that are executed by the processor 3010 of the photographing apparatus 3000 to perform the photographing method in any method embodiment of the above-described photographing device side, for example, to execute the method steps of fig. 1 and 2, and fig. 4 to 8 described above to implement the functions of the modules in fig. 11 and 12. The non-volatile computer readable storage medium may be R0M, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Finally, it should also be mentioned that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; within the idea of the invention, also technical features in the above embodiments or in different embodiments may be combined, steps may be implemented in any order, and there are many other variations of the different aspects of the invention as described above, which are not provided in detail for the sake of brevity; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A photographing method, characterized in that the method comprises:

the display terminal displays an image containing time information representing the time when the image is acquired;

the display terminal generates a photographing instruction containing the time information according to a photographing request input by a user;

and storing the searched image.

2. The photographing method according to claim 1, wherein the time information includes a time stamp.

3. The photographing method according to claim 2, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal is captured when the user inputs the photographing request to the display terminal.

4. The photographing method according to claim 2 or 3, wherein the method further comprises:

the camera equipment acquires an image;

recording a time stamp when the image is acquired;

5. The photographing method according to claim 4, wherein the method further comprises:

the camera equipment encodes the acquired image;

sending the coded image to the display terminal;

and the display terminal displays the coded image.

6. The photographing method according to claim 1, wherein the storing the searched image comprises:

7. The photographing method according to claim 1, wherein the time information includes a time period.

8. The photographing method according to claim 1, wherein the photographing apparatus includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.

9. A photographing method applied to a display terminal which communicates with an image pickup apparatus to display an image captured by the image pickup apparatus, the photographing method comprising:

displaying an image including time information representing a time when the image was acquired;

generating a photographing instruction containing time information according to a photographing request input by a user;

10. The photographing method according to claim 9, wherein the time information includes a time stamp.

11. The photographing method according to claim 10, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal is captured when the user inputs the photographing request to the display terminal.

12. The photographing method according to claim 11, wherein the time stamp is recorded by the photographing apparatus at the time of capturing an image and is held in the buffer by the photographing apparatus.

13. The photographing method according to claim 12, wherein the method further comprises:

receiving an encoded image from the image pickup apparatus; and

and displaying the encoded image;

14. The photographing method according to any one of claims 9 to 13, wherein the image pickup apparatus stores the searched image, including:

15. The photographing method according to claim 9, wherein the time information includes a time period.

16. The photographing method according to claim 9, wherein the photographing apparatus includes a camera, an unmanned aerial vehicle having a photographing function, or a fixing device having a photographing function.

17. A photographing method applied to a photographing apparatus which communicates with a display terminal to display an image captured by the photographing apparatus on the display terminal, the photographing method comprising:

adding time information when the image is acquired to the acquired image;

receiving a photographing instruction from the display terminal, wherein the photographing instruction comprises the time information;

controlling the storage of the searched image.

18. The photographing method according to claim 17, wherein the time information includes a time stamp.

19. The photographing method according to claim 18, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal is captured when a photographing request is input to the display terminal by a user.

20. The photographing method according to claim 18 or 19, wherein the method further comprises:

collecting an image;

recording a time stamp when the image is acquired;

21. The photographing method according to claim 20, wherein the method further comprises:

encoding the acquired image;

22. The shooting method according to claim 17, wherein the image pickup apparatus controls storage of the searched image, including:

23. The photographing method according to claim 17, wherein the time information includes a time period.

24. The photographing method according to claim 17, wherein the photographing apparatus includes a camera, an unmanned aerial vehicle having a photographing function, or a fixture having a photographing function.

25. A shooting system is characterized by comprising a camera device and a display terminal, wherein the camera device is communicated with the display terminal to display an image collected by the camera device on the display terminal; wherein the content of the first and second substances,

the display terminal is used for:

sending the photographing instruction to the photographing equipment;

the image pickup apparatus is configured to:

adding the time information of the acquired image to the acquired image;

receiving the photographing instruction;

controlling the storage of the searched image.

26. The camera system of claim 25, wherein the time information comprises a time stamp.

27. The photographing system of claim 26, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal is captured when the user inputs the photographing request to the display terminal.

28. The photographic system of claim 26 or 27, wherein the imaging device is further configured to:

collecting an image;

recording a time stamp when the image is acquired;

29. The camera system of claim 28, wherein:

the image pickup apparatus is further configured to:

encoding the acquired image;

sending the coded image to the display terminal;

the display terminal is further configured to:

receiving the encoded image;

and displaying the coded image.

30. The camera system according to claim 25, wherein the camera apparatus controls storage of the searched image, comprising:

31. The camera system of claim 25, wherein the time information comprises a time period.

32. The camera system according to claim 25, wherein the camera device comprises a camera, an unmanned aerial vehicle having a camera function, or a fixture having a camera function.

33. A camera apparatus, the apparatus being configured for a display terminal that communicates with a camera device to display an image captured by the camera device, the camera apparatus comprising:

a first receiving module for displaying an image containing time information representing when the image was acquired;

the photographing instruction generating module is used for generating a photographing instruction containing the time information according to a photographing request input by a user;

34. The camera of claim 33, wherein the time information comprises a time stamp.

35. The camera according to claim 34, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal was captured when the user inputs the photographing request to the display terminal.

36. The camera of claim 35, wherein the timestamp is recorded by the camera device at the time the image was captured and saved in the cache by the camera device.

37. The camera of claim 36, further comprising:

a second receiving module, configured to receive the encoded image from the image capturing apparatus; and

the display module is used for displaying the coded image;

38. The photographing apparatus according to any one of claims 33 to 37, wherein the image capturing device controls storage of the searched image, including:

39. The camera of claim 33, wherein the time information comprises a time period.

40. The camera of claim 33, wherein the camera device comprises a camera, an unmanned aerial vehicle with camera functionality, or a fixture with camera functionality.

41. A photographing apparatus configured to a photographing device that communicates with a display terminal to display an image captured by the photographing device on the display terminal, the photographing apparatus comprising:

the third receiving module is used for adding the time information when the image is acquired into the acquired image; receiving a photographing instruction from the display terminal, wherein the photographing instruction comprises the time information;

42. The camera of claim 41, wherein said time information comprises a time stamp.

43. The camera according to claim 42, wherein the time stamp is a time stamp of when an image currently displayed on the display terminal was captured when a user inputs a photographing request to the display terminal.

44. The camera of claim 42 or 43, further comprising:

the image acquisition module is used for acquiring images;

the time stamp recording module is used for recording a time stamp when the image is acquired;

and the buffer module is used for storing the acquired images and the time stamps of the acquired images when the acquired images are acquired in the buffer.

45. The camera of claim 44, further comprising:

the encoding module is used for encoding the acquired image and recording the time stamp of the acquired image when the acquired image is acquired in the data of the encoded image; and

and the second sending module is used for sending the coded image to the display terminal so as to display the coded image on the display terminal.

46. The camera of claim 41, wherein the storage control module is specifically configured to:

permanently storing the searched image on the camera device; alternatively, the first and second electrodes may be,

sending the searched image to the display terminal so as to store the searched image on the display terminal; alternatively, the first and second electrodes may be,

and sending the searched image to other equipment so as to store the searched image on the other equipment.

47. The camera of claim 41, wherein said time information comprises a time period.

48. The camera of claim 41, wherein the camera device comprises a camera, an unmanned aerial vehicle with camera functionality, or a fixture with camera functionality.

49. A display terminal, comprising a processor and a memory communicatively coupled to the processor;

wherein the memory stores a computer program executable by the processor, the computer program being executable by the processor to enable the processor to perform the photographing method according to any one of claims 9 to 16.

50. An image pickup apparatus characterized by comprising a processor and a memory communicatively connected to the processor;

wherein the memory stores a computer program executable by the processor, the computer program being executable by the processor to enable the processor to perform the photographing method according to any one of claims 17 to 24.